| Articolo sottoposto a Peer Review

Gestures and multilevel discourse in spontaneous speech corpora: the case of reported speech

 ARTICOLO SCIENTIFICO

  • Data ricezione: 15/11/2023
  • Data accettazione: 30/11/2023
  • Data pubblicazione: 04/01/2024

Abstract

L'obiettivo di questo lavoro è stato quello di analizzare le unità di discorso riportato e le unità gestuali che vengono prodotte insieme ad esse. Studi basati su corpora e fondati sulla Language into Act Theory, il quadro teorico adottato in questa ricerca, hanno dimostrato che le zone di confine delle unità gestuali tendono a coincidere con i confini prosodici del discorso. Per quanto riguarda il discorso riportato, Good 2015 osserva che quando lo inseriamo nel flusso del discorso spontaneo, utilizziamo risorse che mostrano il suo carattere metaillocutivo, come la variazione prosodica, i cambiamenti nella postura del corpo e anche i gesti messi in scena. Pertanto, è prevedibile che si notino differenze nel profilo prosodico e gestuale tra il discorso non riportato e quello riportato, e viceversa. In questa ricerca, questi aspetti sono stati analizzati sulla base di un corpus di parlato spontaneo, C-ORAL-BGEST, etichettato informazionalmente secondo la Language into Act Theory e gestualmente secondo le linee guida di McNeill 1992, Kendon 2004 e Bressem, Ladewig e Müller 2013. I risultati sembrano mostrare che il cambiamento di livello discorsivo, cioè il passaggio dal livello dell'enunciato al livello del discorso riportato, è evidente non solo dal punto di vista prosodico, ma anche gestuale.

 

The aim of this work was to analyze reported speech units and the gestural units that are produced alongside them. Studies based on corpora and grounded in Language into Act Theory, the theoretical framework adopted in this research, have shown that the boundary zones of gestural units tend to coincide with the prosodic boundaries of speech. Regarding reported speech, Good 2015 observes that when we insert them into the flow of spontaneous speech, we use resources that show their meta-illocutionary character, such as prosodic variation, changes in body posture and also enacted gestures. Thus, it is to be expected that differences in the prosodic and gestural profile will be noticed between unreported to reported speech, and vice versa. In this research, these aspects were analyzed based on a corpus of spontaneous speech, C-ORAL-BGEST, informationally labeled according to the Language into Act Theory, and gesturally labeled according to the guidelines of McNeill 1992, Kendon 2004 and Bressem, Ladewig and Müller 2013. The results seem to show that the change in discursive level, i.e. the transition from the level of the utterance to the level of reported speech, is noticeable not only prosodically, but also gesturally.


Parole chiave
Keywords

1. Introduction

This work deals with the analysis of spontaneous speech to study the reported speech units and the gestural units that are produced in parallel to them. For this purpose, gestures are understood as deliberate actions that the interlocutor perceives as aiming to expression – and not to some purely practical goal (Kendon 2004).

Furthermore, in this perspective, besides being synchronously manifested with speech and expression-oriented, gestures are idiosyncratic, since they are produced instantly by the speaker as they express themselves (McNeill & Duncan 2000). In other words, although a few gestures are conventional in certain cultures, gestures produced parallel to speech do not have a pre-established or conventionalized pattern among speakers.

Given their expressive scope, the gestures we perform when engaging in trivial interaction can be conceived as integral parts of an utterance. They unfold consistently with what is expressed in speech, i.e., the spoken component of that same utterance (Kendon, 2004). Thus, speech and gesture, indeed, correlate in such an intrinsic way that they can be treated as parts of a single semiotic sphere (McNeill 1992).

Regarding the relation between gestures and prosody – an aspect of speech that is of particular interest to this research –, there is a tendency for gestural and prosodic units to be synchronized, as already noted by Kendon (1972) in his primordial analyses (see also McNeill 1992, 2005; Kita et al. 1998). Subsequent corpus-based studies grounded in the Language into Act Theory (Cresti 2000; Moneglia & Raso 2014; Cavalcante 2020) have shown, among other things, that boundaries of gestural units end where prosodic boundaries are completed (Cantalini 2018; Cantalini & Moneglia 2020; Barros 2021).  The present research was also based on the Language into Act Theory framework. Therefore, section 2 will briefly discuss its main theoretical guidelines to contextualize our analyses.

               

2. The language into Act Theory

This study was grounded on the theoretical framework of the Language into Act Theory, henceforth L-AcT (Cresti 2000; Moneglia & Raso 2014; Cavalcante 2020), a pragmatic corpus-driven theory aimed at studying the informational structure of spontaneous speech. Within this framework, the units of reference for linguistic analysis are the minimum units that can be pragmatically and prosodically interpreted in the flow of speech (Izre'el et al, 2020). Such units are identified through prosodic and pragmatic parameters: they contain at least one illocution and are considered terminated units since a terminal prosodic boundary can be perceived after them.

These units of reference can be constituted by one or more prosodic and informational patterns. According to the L-AcT, informational functions are conveyed by prosodic units. A prosodic/informational pattern, in turn, is made up of a nuclear unit that carries the illocutionary force, the comment unit (COM). A pattern can also host other non-illocutionary units, which can be of two types: textual units, which compose the semantic text of the pattern, and dialogic units, which are intended to regulate dialogic interaction. These can be classified based on three criteria: function, position, and prosodic form (f0 curve, duration, intensity, and alignment with the syllabic structure) (t’ Hart; Collier; Cohen 1990; Firenzuoli 2003). The prosodic units are internally separated by non-terminal prosodic boundaries.

Based on the concept of prosodic/informational pattern, the units of reference can be of two types: utterances or stanzas. Utterances can be defined as the terminated units made up of just one prosodic/informational pattern; stanzas are terminated units made up of more than one juxtaposed pattern linked by a boundary with a continuity signal.

In our study, the locutive introducer (INT) is of interest among the non-illocutionary units that make up a prosodic/informational pattern. This unit is important because INT signals that what comes next is on a different level, not directly related to the current conversation (Maia Rocha & Raso 2011).

 

3. Discoursive level

While analyzing spontaneous speech, three different discursive levels are observed: the level of the utterance, the level of the parentheticals, and the meta-illocutionary level (see example 3.4 and figure 3.1). In the speech flow, when the speaker moves from one level to another, they mark this transition prosodically in order to indicate that adjacent prosodic units belong to different hierarchical levels.

The level of the utterance is where most of the interactional flow between speakers takes place. It is grounded in the here and now of the interaction. The parenthetical level, in turn, conveys any comments made by the speaker about what they say at the level of the utterance in order to make its interpretation clearer. These comments can be metanarrative – when the speaker adds information considered crucial to understanding what has been said (see example 3.1); modal – when the speaker shows their commitment to what has been said (see example 3.2); or metalinguistic in a lexical sense – when the speaker reformulates something they said (see example 3.3) (Barros 2021; Santos 2020; Tucci 2010).

The examples below were all extracted from the C-ORAL-BRASIL I (Raso & Mello 2012) corpus, and the parentheticals are labeled PAR.


(3.1)



Metanarrative parenthetical: bfamdl03[1041]:


*LUZ: aqui o’ / eu topei cum caminhão aqui / o dia que eu vim sozinha /=PAR= ele / fazendo a curva / subindo / me espremeu ali / quase que eu caí na vala //




*LUZ: here look / I bumped into a truck here / the day I came alone /=PAR= he / making the turn / going up / squeezed me there / I almost fell into the ditch //

(3.2)



Modal parenthetical: bfamdl01[44]:


*FLA: só que é de micro-ondas / eu acho //=PAR=


*FLA: but it's from a microwave / I think //=PAR=

(3.3)



Metalinguistic (lexical) parenthetical: bfammn06[37]:


*JOR:  e nós távamos entrando com outro tipo de aparelho de televisor no mercado / que era uma coqueluche /=PAR= era uma novidade /=PAR= e os próprios vendedores das loja nũ / tinham experiência pra mostrar aquilo pro consumidor brasileiro //



*JOR: and we were entering the market with another type of television set / which was a coqueluche /=PAR= was a novelty /=PAR= and the salesmen themselves didn't / have the experience to show it to the Brazilian consumer //

Prosodically, the parenthetical level often exhibits a change in f0, usually a fall, compared to adjacent units belonging to the utterance level. It also shows a reduction in intensity and may exhibit a higher articulation rate relative to its surroundings. There is often a pause before and/or after the parenthetical (see Figure 3.1).

From another perspective, the meta-illocutionary level indicates that the here and now of the situation is pragmatically suspended. The most common metaillocutions are emblematic exemplification, instruction, and, above all, reported speech, which will be discussed in section 3.1. Example (3.4) illustrates the instruction.

(3.4)



Instruction (bfamcv03)


*CEL: ah / faz assim /=INT= mata o &no [/2] o oito nosso direto //


*CEL: ah / do like this /=INT= kill the &ni [/2] our eight directly //

Example (3.5), extracted from the C-ORAL-BGEST corpus (Mello et al. in preparation), illustrates a situation where all three levels can be observed. This excerpt’s units were tagged using the informational labels adopted by L-AcT – COM, COB and CMM stand for the illocutionary units; TOP stands for topic, i.e., the domain of identification for the interpretation of the illocution; and PAR stands for parenthetical2.

To indicate that a certain unit is reported, « _r » (r for reported) is added to the label assigned to that unit. Therefore, if there is, for instance, a reported illocutionary unit, its label will be COM_r, COB_r, or CMM_r.

In the example below, meta-illocutionary level is indicated in bold, and the parenthetical level is evidenced in italic.

*CAR: aí do nada /=TOP=eu tava [/2] eu voltei a fazer terapia /=PAR= aí / eu tava [/1] tinha terminado de fazer minha sessão /=TOP= eu catei o celular /=COB= e ele /=INT= tamo nessa de não se falar de novo //=COM_r=


*CAR: then out of the blue /=TOP= I was [/2] I was back in therapy /=PAR= then / I was [/1] I’ve just finished the session /=TOP= I picked up my cell phone /=COB= and he /=INT=we're not talking again //=COM_r=


                 Figure 3.1 – Intensity and f0 contour for example (3.5)


On the other hand, since speech and gesture can be treated as parts of a single semiotic sphere, we wanted to verify whether the differences between the three discursive levels are marked not only prosodically but also gesturally. In fact, Barros 2021 noted that the shift from the utterance level to the parenthetical level is marked through strategies of gestural pattern contrast. This paper aimed to analyze the shift to the meta-illocutionary level, focusing on the case of the reported speech.

 

3.1 - The reported speech

Reported speech can be defined as a direct discourse the speaker inserts into the flow of his  own speech. In reported speech, there is a change in deictic parameters; that is, the here and now is suspended to insert something that was said at another time, either by the speaker or by someone else.

However, when reporting a past discourse, the speaker not only repeats (or tries to repeat) what has been said but may also incorporate other strategies that allow the hearer to notice the suspension of the here and now of the current situation. Indeed, Good (2015) argues that reported speech is actually just one facet of a whole reported action.

According to Good 2015, some features that may follow the reported speech are shifts in body posture, gaze, prosodic variation, and enacted gestures. Regarding prosodic variation, reported speech tends to exhibit higher values for intensity and f0 when compared to unreported speech.

Zuckerman 2021 draws attention to the fact that the reported speech is not an exact and faithful enactment of the reported event. Hence, if we analyze them from a gestural perspective, and not only from a semantic or prosodic viewpoint, we can access valuable information about the action itself that is reported but mainly about how the speaker chooses to do so.

In the scope of this paper, we intended to investigate, based on spontaneous speech corpus data, the hypothesis that the shift from the unreported speech to the reported speech, and vice versa, is also marked gesturally.


4. Gestures

Just like speech, gestures can be subdivided into units, the so-called gesture units (GUnits). A GUnit is completed when the speaker removes their hands from a default position, defined as the rest position, performs a series of gestures, and then returns their hands to the rest position. Therefore, GUnits can be defined as «the set of gestures performed between two resting positions.»

The GUnits themselves can be subdivided into gesture phrases (GPhrases). GPhraes are defined by the presence of one gestural nucleus, called stroke (see fig. 4.1). The stroke is one of the gesture phases (GPhases) that constitute a GPhrase and is the only mandatory one. Just as the illocution is the nucleus of a prosodic and informational pattern, the stroke is the nucleus of a GPhrase. Other GPhases can be combined with the stroke to form the GPhrase, and they can be classified in four different ways, depending on the function they perform (fig. 4.1): preparation; retraction; hold, and rest (Ladewig & Brassem 2013).

Figure 4.1 – gesture phases (Ladewig & Brassem 2013, p. 1075)


Studies conducted on spontaneous Italian speech (Cantalini 2018; Cantalini & Moneglia 2020) have shown synchrony between prosodic and gesture units and the tendency of the two nuclei to align with each other (i.e., illocutionary focus and stroke). Furthermore, the authors claimed that GPhrases tend to remain within the same unit of reference (see section 2) and never cross the terminal prosodic boundaries. Barros 2021, while investigating parentheticals in Brazilian Portuguese, also observed that the stroke tends to synchronize with prosodic prominences. Mayberry & Jacques 2000, focusing on stuttering, concluded that interruptions in speech flow had repercussions on gestural patterns, which were interrupted or altered and only were resumed when speech was also resumed fluently.

The concept of gestural pattern considered here encompasses the gestural parameters introduced by Bressem, Ladewig, & Müller 2013, namely those related to movement type, direction, and quality; handshape, orientation, and position (for further details, see Bressem 2013). A change in at least one of these parameters constitutes a change in gestural pattern.


5. The C-ORAL-BGEST

C-ORAL-BGEST (Mello et al, in preparation) is a multimodal corpus of spontaneous speech that is part of the C-ORAL-BRASIL project. By the time this paper was written, the corpus consisted of eleven multimodal texts in Brazilian Portuguese and included video and audio recordings. Altogether, the recordings were 24 minutes and 28 seconds long.

The 11 texts analyzed are informationally tagged according to Language into Act Theory and gesturally labeled according to the guidelines of McNeill 1992, Kendon 2004, and Bressem, Ladewig & Müller 2013. The perceptually-based prosodic segmentation follows the pragmatic-prosodic parameters used in other reference corpora, such as C-ORAL-BRASIL I (Raso & Mello 2012) and C-ORAL-ROM (Cresti & Moneglia 2005) based on the perception of non-terminal boundaries (marked by a single slash, «/») and terminal boundaries (marked by a double slash, «//»). Text, image, and sound were aligned in ELAN software (Sloetjes & Wittenburg 2008), through which qualitative analyses were also done.


6. Results and discussions

By analyzing the 11 texts that make up the C-ORAL-BGEST corpus, eight reported speech constructions were detected. In total, 103 reported prosodic units were found, structured in 35 shifts from utterance level to the reported speech level (and vice versa). According to our observations, 30 of the 35 shifts occurred alongside changes in the gestural pattern.

Regarding the situations in which significant changes in the gestural pattern were not identified, two of them occurred with a speaker who did not gesture profusely throughout the interaction. In the specific passages in which the reported speeches took place, this speaker did not gesture either at the level of the utterance or at the level of the reported speech. In the other cases, the speakers either did not gesticulate in the excerpts of reported speech or only made «incidental movements» (Kendon 2004), i.e., movements that were not aimed at expression, such as scratching the eyes.

Among the changes in the observed gestural pattern, some were concerned with using the body space. In these cases, the speaker used, for instance, his left body space to perform the gestures belonging to the utterance level but used his right body space to gesticulate during the reported speech. In other situations, there were changes in the gestures’ amplitude – from more closed hands to more opened hands when switching levels, for example. There were also instances when speakers changed their head orientation or body position only during the reported speech. Moreover, we identified situations where the speaker stopped gesturing during reported units and resumed gestures when the utterance level was restored.

These results seem to show a relation between the shift between discourse levels and the gestural patterns performed concurrently    .

 

6.1 Examples    

In this section, we will present several examples that have formed the foundation of our analysis regarding reported speech. In all examples(6.1.1, 6.1.2, 6.1.3, 6.1.4), the meta-illocutionarylevelcorresponds to reported speech, and has been highlighted in bold. It is important to recall that labelsassigned tothis level areappendedwith« _r », where « r » stands for reported.


Example (6.1.1) below was extracted from the multimodal text bgest_004. *PEU is the speaker.


(6.1.1)



*PEU: aí minha mãe me ligou /=COB= e falou olha /=COB_r= &he &s [/1] &he / a gente nũ [/3] cê não tem mais dependência do seu pai agora /=COB_r= você [/1] no plano de saúde /=COB_r= que / o trabalho dele oferece /=PAR_r= aí / a gente vai ter que procurar outro plano de saúde //=COM_r=


*PEU: then my mother called me /=COB= and said look /=COB_r= &he &s [/1] &he / we don’t [/3] you're no longer dependent on your father now /=COB_r= you [/1] in the health insurance/=COB_r= that / his work offers /=COB_r= then / we'll have to look for another healthinsurance plan//=COM_r=


 Figure 6.1.1 – left: unreported speech | right: reported speech


The figure on the left, taken from the initial, unreported part of example (6.1.1) («aí minha mãe me ligou» | «then my mother called me»), shows that, while at the utterance level, *PEU's gestures were mainly characterized by larger movements. At this point, the speaker kept his arms rather open. During the reported speech, as we can see in the picture on the right, *PEU kept his hands closer together while gesturing. Back at the level of the utterance, the speaker did not gesture immediately: his hands remained at rest position for approximately 5 seconds, and *PEU resumed the gestures in another reported speech unit later.

Example (6.1.2) was extracted from the multimodal text bgest_005. The reported parts are marked in bold, and *ZUC is the speaker.

(6.1.2)



*ZUC: aí eu comecei a fazer &a [/1] cálculo estrutural /=COB= e o cálculo estrutural já depende da geometria /=COB= depende de tudo //=COM=


*ZUC: aí vem o cara lá do anteprojeto e fala /=INT= não /=COB_r= vamo ter que aumentar /=COB_r= trinta centímetros da asa //=COM_r=


*ZUC: aí / eu vou ficar /=INT= seu filha da puta //=COM_r=


*ZUC: eu já calculei essa droga [/1] desgraça entendeu /=COB_r= eu nũ vou fazer isso de novo //=COM_r=


*ZUC: aí / esse é o problema da coisa entendeu //=COM=




*ZUC: then I started to do the [/1] structural calculation /=COB= and the structural calculation already depends on the geometry /=COB= depends on everything //=COM=


*ZUC: then the guy from the preliminary project says /=INT= no /=COB_r= we're going to have to increase /=COB_rthirty centimeters of the wing //=COM_r=



*ZUC: then / I'll be like /=INT= you son of a bitch //=COM_r= 


*ZUC: I already calculated that shit [/1] damn ityou know /=COB_r= I'm not going to do it again //=COM_r=


*ZUC: then / that's the problem you see //=COM=


Figure 6.1.2 – left: unreported speech | right: reported speech


In the image on the left, which corresponds to the moment before the reported speech (precisely «aí vem o cara lá do anteprojeto e fala» | «then the guy from the preliminary project says»), *ZUC is leaning on the back of the chair. During the reported speech, however, the speaker moves away from the back of the chair. When resuming the utterance level, *ZUC leans back again on his chair.

Besides, *ZUC also modifies the axis of his gestures when switching levels. Before and after the reported speech, *ZUC's gestures are made along a horizontal line «parallel» to his body, as shown in the picture on the left. During the reported speech, however, the gestures are performed along a horizontal line «perpendicular» to his body (sagittal axis).

Example (6.1.3) was extracted from the multimodal text bgest_006. The reported parts are marked in bold, and *ELI is the speaker.

(6.1.3)



*ELI: né / e / eu comecei a dar aula pro Gustavo /=TOP= nessa escola de inglês +=COB=


*ELI: não não //=COM=


*ELI:  esse Gustavo /=TOP= &he / esse meu [/1]= meu aluno //=COM=


*ELI: e aí ele falou assim /=INT= ah /=COB_r= &he / tipo cê dá aula por fora /=COB_r= eu falei dou /=COM_r= e tal //


*ELI:  ele falou assim /=INT= ah eu gostaria de ter aula [/5] gostei de ter aula com você /=COB_r= e tudo / gostaria de ter aula com você /=COB_r= cê [/1] cê pode me dar aula na Status //=COM_r=


*ELI: aí eu falei /=INT= posso //=COM_r=


*ELI: tipo é super tranquilo /=COB= era mais perto inclusive do que a escola //=COM=




*ELI: right / and / I started teaching Gustavo /=TOP= at this English school +=COB=


*ELI: no no //=COM=


*ELI:  this Gustavo /=TOP= &he / this my [/1] my student //=COM=


*ELI:  and then he said /=INT= ah /=COB_r= &he / like do you teach outside of the school /=COB_r= I said yes /=COB_r= and so on //=COM=


*ELI:  he said /=INT= ah I'd like to take class [/5] I enjoyed taking classes with you /=COB_r= and so on / I'd like to take classes with you /=COB_r= you [/1] can you teach me at Status //=COM_r=


*ELI:  so I said /=INT= yes //=COM_r=


*ELI: i t's like super ok /=COB= it was even closer than the school //=COM=



Figure 6.1.3 – left: unreported speech | right: reported speech

 

To perform the gestures she made before the reported speech (picture on the left), *ELI uses the central space of her body and her right hand or both of her hands. During the reported speech (picture on the right), she uses her left hand, or both of her hands, in her left space. When resuming the utterance level, she goes back to gesture in the central space of her body.

Example (6.1.4) was extracted from the multimodal text bgest_007. The reported parts are marked in bold, and *CAR is the speaker.

(6.1.4)



*CAR: eu tava fazendo exercício /=CMM= e’ tava do meu lado /=CMM= só que eu não me aguentei /=CMM= eu tive que falar alguma coisa /=CMM= aí eu perguntei como que ele tava //=COM=


*CAR: aí / eu [/1] ele respondeu que e' tava bem /=COB= aí ele [/2] aí eu /=INT= cê sumiu né //=COM_r


*CAR: hhh tipo / bem [/1] bem chata //=COM=


*CAR: aí ele /=INT= quem que foi o último a mandar mensagem //=COM_r=


*CAR: como se isso importasse /=CMM= né //=CMM=




*CAR: I was doing my exercise /=CMM= he was next to me /=CMM= but I couldn't help myself /=CMM= I had to say something /=CMM= then I asked him how he was //=COM=


*CAR: then / I [/1] he said he was fine /=COB= the he [/2] then I /=INT= you disappeared //=COM_r


*CAR: like / very [/1] very annoying //=COM=


*CAR: then he /=INT= who was the last to text //=COM_r


*CAR: as if that mattered /=CMM= right //=CMM=



Figure 6.1.4 – left: unreported speech | right: reported speech

 

For most of the time in this recording, *CAR held a glass; in the excerpt shown in example (6.1.4), she alternated between reported and unreported speech. During all unreported speech units, she held the glass with only one hand and used her other hand to perform several gestures (image on the left). Alternately, during the reported speech units, she kept both her hands on the glass. So, *CAR’s gestural change is consistently linked to the alternation between reported and non-reported speech.

Hence, in example (6.1.4), *CAR gestured only at the level of the utterance – when telling the situation that preceded the reported speech and also in the comments she made about the speech she reported (for instance, «hh tipo / bem [/1] bem chata //» | «like / very [/1] very annoying //»).      


7. Conclusion


In this work, the reported prosodic/informational units were analyzed under the theoretical framework of the Language into Act Theory. The gestures were analyzed based on the studies carried out mostly by McNeill 1992, Kendon 2004, and Bressem, Ladewig & Müller 2013.

According to Good 2015, reported speech can be conceived as an integral part of a whole reported action, which involves various semiotic processes, including prosodic and gestural ones. Thus, we expected to find evidence that the insertion of reported speech into the flow of spontaneous speech was accompanied by marks of its actional nature, both in gestural and prosodic terms.

The results obtained seem to indicate that the differences between the levels of reported and unreported speech tend to be marked not only prosodically but also gesturally. The main changes in gestural patterns that marked the shift from one level to another concerned the use of the body space, the gestures’ amplitude, changes in head orientation or body position, or the alternation between the presence and absence of gesture.

Extending this analysis to the idea of discourse levels, we may assume that the distinction between the utterance level and the meta-illocutionary level is not only prosodic but also gestural. Since Barros 2021 has already pointed out the gestural distinction between the parenthetical level and the utterance level, we can conclude that the gestural pattern is a distinguishing element between utterance, parenthetical and meta-illocutionary levels. For future studies, it would be interesting and relevant to analyze the gestures produced in other types of metaillocution, such as emblematic exemplification and instruction.

Note
  • 1

    In examples taken from C-ORAL-BRASIL corpora, the file name carries some important information, say:

    Language (b for Brazilian Portuguese); context (fam for family/private; pub for public); interactional type (mn for monologue; dl for dialogue; cv for conversation). The following two digits identify the number of the text file, and the digits in square brackets indicate the utterance number. The asterisk (*) indicates a new shift and the three capital letters (e.g. LUZ) indicates the speaker.

    Terminal prosodic breaks are marked with a double slash (//), and non-terminal prosodic breaks are marked with a single slash (/). Labels between equal signs (e.g. =PAR=) indicate the informational unit.

    bfamdl03[104], for instance, indicates a passage in Brazilian Portuguese, family context, dialogic interactional type. It is the third of its kind in C-ORAL-BRASIL I and the passage refers to utterance 104.

  • 2

    For further information about the informational structure of spontaneous speech, see Cresti 2000, Moneglia & Raso 2014 and Cavalcante 2020.

Bibliografia
  • Barros 2021 = Camila Barros, A relação entre unidades gestuais e quebras prosódicas: o caso da unidade informacional Parentético, Master's dissertation, Faculdade de Letras, Universidade Federal de Minas Gerais, Belo Horizonte.

  • Boersma & Weenink 2022 = Paul Boersma, David Weenink, Praat: doing phonetics by computer [Computer program], version 6.2.15, retrieved 14 August 2022 from http://www.praat.org/.

  • Bressem 2013 = Jana Bressem, A linguistic perspective on the notation of form features in gestures, in Handbücher zur Sprach- und Kommunikationswissenschaft / Handbooks of Linguistics and Communication Science (HSK) 38/1, organized by Cornelia Müller, Alan Cienki, Ellen Fricke, Silva Ladewig, David McNeill, Jana Bressem, Berlin, Boston, DE GRUYTER,
    https://www.degruyter.com/doi/10.1515/9783110261318.1079.

  • Cantalini 2018 = Giorgina Cantalini, La gestualità co-verbale nel parlato spontaneo e nel recitato, Tesi di Dottorato, Università degli studi Roma Tre, Roma Tre, 2018. 281 f.

  • Cantalini & Moneglia 2020 = Giorgina Cantalini, Massimo Moneglia, The annotation of gesture and gesture / prosody synchronization in multimodal speech corpora, in J. of Speech Sci. [Internet], https://econtents.bc.unicamp.br/inpec/index.php/joss/article/view/14956.

  • Cavalcante 2020 = Frederico Cavalcante, The information unit of topic: a crosslinguistic, statistical study based on spontaneous speech corpora, Thesis, Faculdade de Letras, Universidade Federal de Minas Gerais, Belo Horizonte.

  • Cresti 2000 = Emanuela Cresti, Corpus dell’italiano parlato, Firenze, Accademia della Crusca.

  • Cresti 2011 = Emanuela Cresti, The definition of focus in Language into Act Theory (LAcT), in Pragmatics and Prosody: Illocution Modality, Attitude, Information Patterning and Speech Annotation, edited by Heliana Mello, Alessandro Panunzi, Tommaso Raso, Firenze, Firenze University Press.

  • Cresti 2018 = Emanuela Cresti, The illocution-prosody relationship and the Information Pattern in spontaneous speech according to the Language into Act Theory (L-AcT), Linguistik online, v. 88, pp. 33-62.

  • Cresti & Moneglia 2005 = Emanuela Cresti, Massimo Moneglia (Org.), C-ORAL-ROM: integrated reference corpora for spoken Romance languages, Amsterdam, Philadelphia, PA, J. Benjamins, 2005. (Studies in corpus).

  • ELAN 2022 = ELAN (Version 6.4) MacOS (2022), Nijmegen, Max Planck Institute for Psycholinguistics, The Language Archive, Retrieved from https://archive.mpi.nl/tla/elan.

  • Firenzuoli 2003 = Valentina Firenzuoli, Forme Intonative di Valore Illocutivo dell’Italiano Parlato: Analisi Sperimentale di un Corpus di Parlato Spontaneo, Tesi di Dottorato, Università degli Studi di Firenze, Firenze.

  • Good 2015 = Jeffrey Good, Reported and enacted actions: Moving beyond reported speech and related concepts, in Discourse Studies, Sage Journals.

  • t’ Hart; Collier; Cohen 1990 = Johan't Hart, Rene Collier and Antonie Cohen, A perceptual study on intonation: an experimental approach to speech melody, Cambridge, Cambridge University Press.

  • Izre'el et al. 2020 = Shlomo Izre'el, Heliana Mello, Alessandro Panunzi and Tommaso Raso (eds), In  Search  of  Basic  Units  of  Spoken  Language, Amsterdam, Benjamins.

  • Kendon 2004 = Adam Kendon, Gesture: Visible Action as Utterance, Cambridge, Cambridge University Press.

  • Kita et al. 1998 = Sotaro Kita, Ingeborg van Gijn, Harry van der Hulst, Movement phases in signs and co-speech gestures, and their transcription by human coders, in I. Wachsmuth & M. Fröhlich (Eds.), Gesture and Sign Language in Human-Computer Interaction, Berlin, Springer, pp. 23–35.

  • Bressem, Ladewig & Müller 2013 = Jana Bressem, Silva Ladewig, Cornelia Müller, Linguistic Annotation System for Gestures (LASG), in Cornelia Müller, Alan Cienki, Ellen Fricke, Silva H. Ladewig, David McNeill, Sedinha Teßendorf (Eds), Body – Language – Communication, An International Handbook on Multimodality in Human Interaction, Handbooks of Linguistics and Communication Science, De Gruyter Mouton, pp. 1098-125.

  • Ladewig & Bressem 2013 = Silva Ladewig, Jana Bressem, A linguistic perspective on the notation of gesture phases, in Cornelia Müller, Alan Cienki, Ellen Fricke, Silva H. Ladewig, David McNeill, Jana Bressem (Org.), Handbücher zur Sprach- und Kommunikationswissenschaft / Handbooks of Linguistics and Communication Science (HSK) 38/1, Berlin, Boston, De Gruyter,
    https://www.degruyter.com/doi/10.1515/9783110261318.1060.

  • Maia Rocha & Raso 2011 = Bruna Maia Rocha, Tommaso Raso, A unidade informacional de Introdutor Locutivo no Português Brasileiro: uma análise baseada em corpus, In Domínios de Linguagem, pp. 327–43.

  • Mayberry & Jaques 2000 = Rachel Mayberry, Joselynne Jaques, Gesture production during stuttered speech: insights into the nature of gesture–speech integration, in David McNeill (Ed), Language and Gesture, Cambridge, Cambridge University Press.

  • McNeill & Duncan 2000 = David McNeill, Susan Duncan, Growth points in thinking-for-speaking, in David McNeill (Ed), Language and Gesture, Cambridge, Cambridge University Press.

  • McNeill 1992 = David McNeill, Hand and Mind: What Gestures Reveal About Thought, [S.l.], University of Chicago Press.

  • McNeill 2005 = David McNeill, Gesture and thought, Chicago, University of Chicago Press.

  • Mello et al. in preparation = Heliana Mello et al., in preparation, C-ORAL-BGEST.

  • Moneglia & Raso 2014 = Massimo Moneglia, Tommaso Raso, Notes on Language into Act Theory (L-AcT), in Tommaso Raso, Heliana Mello (Org.), Spoken Corpora and Language Studies, Amsterdam/Philadelphia, John Benjamins Publishing Company, pp. 468–95.

  • R CORE TEAM 2022 = R CORE TEAM 2022 R, A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, available in https://www.R-project.org.

  • Raso & Mittmann 2012 = Tommaso Raso, Maryualê Mittmann, As principais medidas da fala, in Tommaso Raso, Heliana Mello (Org.), C-ORAL-BRASIL I: Corpus de referência do Português Brasileiro falado informal, Belo Horizonte, UFMG, pp. 177–221.

  • Raso 2012 = Tommaso Raso, O C-ORAL-BRASIL e a Teoria da Língua em Ato, in Tommaso Raso, Heliana Mello (Org.), C-ORAL-BRASIL I: Corpus de referência do Português Brasileiro falado informal, Belo Horizonte, UFMG, pp. 91–123.

  • Raso & Mello 2012 = Tommaso Raso, Heliana Mello, C-ORAL-BRASIL I: corpus de referência de português brasileiro falado informal.

  • Santos 2020 = Saulo Mendes Santos, Parentético e outras unidades informacionais curtas: uma distinção através da análise das diferentes realizações prosódicas do lexema ASSIM, Master's dissertation, Faculdade de Letras, Universidade Federal de Minas Gerais, Belo Horizonte.

  • Sloetjes & Wittenburg 2008 = H. Sloetjes, P. Wittenburg, Annotation by category - ELAN and ISO DCR, in Proceedings of the 6th International Conference on Language Resources and Evaluation (LREC).

  • Tucci 2010 = Ida Tucci, Obiter dictum. La funzione informativa delle unità parentetiche, in M. Pettorino, A.Giannini, F. Dovetto (a cura di), La Comunicazione parlata 3,  Napoli, Università l’Orientale Press, pp. 635–54.

  • Zuckerman 2021 = Charles Zuckerman, Figure Composition, in Signs and Society, The University of Chicago Press Journals, Chicago, v. 9, n. 10, fall, pp. 263–99,
    https://www.journals.uchicago.edu/toc/sas/2021/9/3.

Vedi tutto
Informazioni
Cita come: Marianna Bicalho de Albuquerque, Gestures and multilevel discourse in spontaneous speech corpora: the case of reported speech in DILEF. Rivista digitale del Dipartimento di Lettere e Filosofia - 3 (2023), pp. 243-260. 10.35948/DILEF/2024.4346