The Temporal Structure of Multimodal Communication: Theory, Methods and Applications

Description

The general focus of this book is on multimodal communication, which captures the temporal patterns of behavior in various dialogue settings. After an overview of current theoretical models of verbal and nonverbal communication cues, it presents studies on a range of related topics: paraverbal behavior patterns in the classroom setting; a proposed optimal methodology for conversational analysis; a study of time and mood at work; an experiment on the dynamics of multimodal interaction from the observer’s perspective; formal cues of uncertainty in conversation; how machines can know we understand them; and detecting topic changes using neural network techniques. A joint work bringing together psychologists, communication scientists, information scientists and linguists, the book will be of interest to those working on a wide range of applications from industry to home, and from health to security, with the main goals of revealing, embedding and implementing a rich spectrum of information on human behavior. Front Matter ....Pages i-xiv Front Matter ....Pages 1-1 Linguistic and Contextual Clues of Intentions and Perspectives in Human Communication (Enikő Németh T.)....Pages 3-21 Front Matter ....Pages 23-23 The Teacher’s Body Communicates. Detection of Paraverbal Behaviour Patterns (Marta Castañer, Oleguer Camerino)....Pages 25-43 Is It Possible to Perform “Liquefying” Actions in Conversational Analysis? The Detection of Structures in Indirect Observations (M. Teresa Anguera)....Pages 45-67 Research Methods for Studying Daily Life: Experience Sampling and a Multilevel Approach to Study Time and Mood at Work (Mariona Portell, Robin M. Hogarth, Anna Cuxart)....Pages 69-94 The Observer Experiment: A View of the Dynamics of Multimodal Interaction (Ghazaleh Esfandiari-Baiat, Laszlo Hunyadi, Anna Esposito)....Pages 95-109 Front Matter ....Pages 111-111 Uncertainty in Conversation: Its Formal Cues Across Modalities and Time (Laszlo Hunyadi)....Pages 113-135 Watching People Talk; How Machines Can Know We Understand Them—A Study of Engagement in a Conversational Corpus (Nick Campbell)....Pages 137-146 Applying Neural Network Techniques for Topic Change Detection in the HuComTech Corpus (György Kovács, István Szekrényes)....Pages 147-162