Multisensory Perception: From Laboratory to Clinic

Description

Multisensory Perception: From Laboratory to Clinic surveys the current state of knowledge on multisensory processes, synthesizing information from diverse streams of research and defining hypotheses and questions to direct future work. Reflecting the nature of the field, the book is interdisciplinary, comprising the findings and views of writers with diverse backgrounds and varied methods, including psychophysical, neuroanatomical, neurophysiological and neuroimaging approaches. Sections cover basic principles, specific interactions between the senses, the topic of crossmodal correspondences between particular sensory attributes, the related topic of synesthesia, and the clinic. MULTISENSORY PERCEPTION: From Laboratory to Clinic Copyright Contributors Preface References 1. Bouba-Kiki: cross-domain resonance and the origins of synesthesia, metaphor, and words in the human mind Introduction Synesthesia Physiology of synesthesia Creativity Paradoxes of synesthesia Bouba-Kiki Bouba-Kiki and word origins Bouba‐Kiki and memory consolidation Bouba-Kiki and conceptual metaphors Intersensory metaphors Directionality of metaphors Inferior parietal lobule and Bouba-Kiki Other sequelae of IPL damage Predictions about dyslexia Metaphor blindness Taxonomy of intersensory effects Esthetic Blending Sex and violence The mirror neuron system Sensory mirror neuron system Out-of-body experience Gestures, imitation, synkinesia, and the MNS Autism Number lines Calendar lines Neural basis of mental calendars Conclusion References Further reading 2. Philosophical insights Starting point: the problem of individuating the senses A taxonomy of sensory interactions Multisensory blends Binding and unisensory perception Are all experiences multimodal? References 3. Neural development of multisensory integration Overview The products of multisensory integration Multisensory integration in individual SC neurons The native state of multisensory integration is competitive Developing multisensory integration and the principles that govern it How experience leads to the development of SC multisensory integration capabilities Incorporating multisensory experience into the circuit Multisensory experience and influences from cortex: two interrelated developmental events Multisensory plasticity in adulthood Clinical implications Using the principles of multisensory integration to ameliorate hemianopia Postrehabilitation visual capabilities Acknowledgments References 4. The development of multisensory processes for perceiving the environment and the self Infant perception of the audiovisual attributes specifying inanimate and animate objects Development of audiovisual processing in infancy Effects of early experience on audiovisual processing Early experience and audiovisual processing: multisensory perceptual narrowing Development of selective attention to multisensory inputs Multisensory processes for perceiving the body, self, and the environment at hand in infancy and childhood Visual–haptic object perception in infancy Multisensory body perception in infancy and childhood Summary References 5. Computational models of multisensory integration Introduction Combining information from a single sensory channel with prior knowledge Forced fusion: integrating sensory signals that come from a common source Causal inference: accounting for observer's uncertainty about the world's causal structure Conclusions Acknowledgments References 6. Multisensory contributions to object recognition and memory across the life span Introduction Multisensory contributions to object recognition Multisensory learning as the norm rather than an exception From multisensory learning to unisensory object memory When is multisensory memory better than memory based on unisensory experiences? What do multisensory benefits for memory depend on and how/why do they vary across individuals? What are the cognitive and brain mechanisms governing multisensory benefits in memory? Brain correlates of implicit multisensory benefits in memory Multisensory representations of objects in the brain Broader implications: multisensory processes scaffold cognition across the life span Theoretical implications of the interplay between multisensory processes and memory functions Outlook: the importance of multisensory processes in public health Conclusion Acknowledgments References 7. Visuo-haptic object perception Introduction Haptic and visuo-haptic object recognition Behavioral studies The neural basis of visuo-haptic object processing Segregated ventral “what” and dorsal “where” pathways Multisensory processing of object shape Object categorization Behavioral studies Neural correlates of visuo-haptic object categorization View-dependence Behavioral studies View-(in)dependent cortical regions Individual differences in visuo-haptic representations Neural differences between object and spatial imagers A model of visuo-haptic multisensory object representation Conclusion Acknowledgments References 8. Multisensory processes in body ownership Introduction Perceptual rules of body ownership Temporal rule Spatial rule(s) Tactile congruence rule Humanoid shape rule Multisensory congruency matters, not the particular modality Multisensory integration of body signals in the cortex: nonhuman primates Multisensory integration of body signals in the cortex: human neuroimaging Neuroimaging studies of limb ownership Full-body ownership Self-identification, mirrors, and the third-person visual perspective Summary Acknowledgments References 9. Visual–vestibular interactions Visual–vestibular interaction in directional heading The visual signal as a source of heading perception The vestibular signal as a source of heading perception Visual–vestibular interaction in heading perception and its neural correlates Visual–vestibular interaction in tilt perception The visual signal for tilt perception The vestibular signal for tilt perception Visual–vestibular interaction and its neural correlates How is multisensory convergence affected in neurological conditions? Impaired tilt perception in vestibular and proprioceptive loss Impaired spatial orientation in stroke Future perspective—translating the concepts of visuo–vestibular integration in clinical neuroscience Summary References Further reading 10. Multisensory flavor perception: A cognitive neuroscience perspective Introduction Food and the brain Multisensory flavor perception: gustatory and olfactory inputs Oral–somatosensory contributions to multisensory flavor perception Visual contributions to multisensory flavor perception Auditory contributions to multisensory flavor perception Conclusions References 11. Audiovisual crossmodal correspondences: behavioral consequences and neural underpinnings Introduction Kinds of audiovisual crossmodal correspondence and their effects on behavior Assessing the impact of crossmodal correspondences on other aspects of cognition Do crossmodal correspondences occur early or late in human information processing? Elevation as a fundamental organizational dimension for many crossmodal correspondences On the relative versus absolute nature of crossmodal correspondences Sound symbolism and crossmodal correspondences Crossmodal correspondences and synesthesia Conclusions References 12. How do crossmodal correspondences and multisensory processes relate to synesthesia? Introduction Crossmodal correspondences Phenomenological similarities between synesthesia and crossmodal correspondences: grapheme-color, sound-color, and number-f ... Phenomenological similarities between synesthesia and crossmodal correspondences: sequence-space synesthesias and synesthet ... Phenomenological similarities between synesthesia and crossmodal correspondences: less well-studied varieties of synesthesia How do these models account for other cognitive and perceptual differences present in synesthetes? Relationships between crossmodal correspondences and synesthesia still requiring clarification Conclusions References 13. Synesthesia: the current state of the field Definition and diagnosis The neural basis of synesthesia Neurodevelopmental accounts of synesthesia Evidence of functional and structural brain differences in adults What is the nature of the connectivity (e.g., functional vs. structural)? Where in the adult brain are the inducer and concurrent connected together? Are there atypical features of the synesthete's brain more widely? Where do synesthetic associations come from? The cognitive profile of synesthesia Perception Imagery Memory Art, personality, and creativity Cognitive weaknesses Future directions References 14. How synesthesia may lead to enhanced memory Introduction Synesthesia and long-term memory Beyond long-term memory Testing earlier stages of memory in synesthesia Load manipulations The dual coding model The recoding model of memory Conclusions References 15. Task-selectivity in the sensory deprived brain and sensory substitution approaches for clinical practice: evidence from bli ... Introduction Sensory substitution devices Crossmodal plasticity in cases of sensory deprivation Task-selective sensory-independent organization in the deprived higher-order “visual” cortices Does task-selective and sensory-independent organization extend to higher-order auditory regions as well? Does TSSI organization extend to deprived primary sensory cortices as well? Task-switching versus TSSI organization in higher-order “visual” cortices Beyond the notion of strictly sensory-specific critical periods Specific multisensory training as a tool to maximize sensory restoration outcomes SSD training as a tool to maximize visual recovery after partial visual loss General conclusions References 16. Crossmodal neuroplasticity in deafness: evidence from animal models and clinical populations Introduction Crossmodal neuroplasticity in animal models of deafness Changes in auditory cortex as a consequence of deafness: structure and neural function Crossmodal reorganization in auditory cortex following deafness: behavior and psychophysics What is the anatomical basis for crossmodal reorganization following deafness? Crossmodal neuroplasticity in clinical populations with deafness and hearing loss Congenital auditory deprivation and neuroplasticity Compensatory crossmodal plasticity in pediatric deafness Clinical implications of compensatory crossmodal plasticity in pediatric hearing loss Using crossmodal reorganization to direct individualized intervention and habilitation for children with hearing loss Crossmodal reorganization as an indicator of efficacy of cochlear implantation Age-related hearing loss and neuroplasticity Compensatory crossmodal plasticity in adult-onset deafness Compensatory crossmodal plasticity in early-stage, mild-moderate, age-related hearing loss Clinical implications of crossmodal plasticity in age-related hearing loss Using crossmodal reorganization to direct individualized rehabilitation for age-related hearing loss Conclusions Acknowledgments References Further reading 17. Neurodevelopmental and neuropsychiatric disorders affecting multisensory processes Introduction Autism spectrum disorder Audiovisual integration in autism spectrum disorder Differences in integration of simple audiovisual stimuli Differences in integration of audiovisual speech signals Disrupted audiovisual temporal processing Developmental considerations Summary of audiovisual integration in autism spectrum disorder Integration of extrapersonal and peripersonal sensory input in ASD Visual–somatic integration in autism spectrum disorder Bottom-up influences on visual–somatic integration Top-down influences on visual-somatic integration Stimulus considerations Summary of extrapersonal-peripersonal multisensory processing in ASD Multisensory integration in animal models of autism spectrum disorder Schizophrenia Low-level multisensory integration Complex stimulus multisensory integration Multisensory integration relevant for self-perception Multisensory integration in animal models of schizophrenia Basic and clinical neuroscience links for multisensory integration Conclusions References 18. Disorders of body representation Introduction Neurological disorders of body representation Unilateral disorder of body representation Personal neglect Feeling of amputation, hemi-depersonalization Somatoparaphrenia Phantom limbs and supernumerary phantom limbs Macro- and microsomatognosia Global body representation disorder Autoscopic hallucinations Heautoscopy Out-of-body experience Feeling of presence Body representation disturbance in chronic pain Complex regional pain syndrome Phantom limb pain Spinal cord injury Body representation disturbance in psychiatric disorders Anorexia Schizophrenia Gender dysphoria References 19. Hemianopia, spatial neglect, and their multisensory rehabilitation Introduction Multisensory rehabilitation for central visual field defects Visual field defects: clinical features and anatomy Multisensory perception in hemianopia Multisensory rehabilitation of VFDs Overview of standard rehabilitation approaches Multisensory compensatory training Unilateral spatial neglect Clinical presentation Unisensory and multisensory perception in USN VISUAL deficits Auditory deficits Tactile deficits Perceptual sensory awareness The neural bases of the neglect syndrome Multisensory perception and its potential for neglect rehabilitation Perspectives for multisensory rehabilitation research References 20. Mirror therapy Introduction Neural mechanisms of mirror visual feedback Effects of mirror therapy on pain syndromes Effects of mirror therapy on hemiparesis after stroke Effects of mirror therapy on other symptoms after stroke Effects of mirror therapy on pain after stroke Effects of mirror therapy on other conditions How should mirror therapy be performed? Conclusion References Index A B C D E F G H I J L M N O P R S T U V W