Formal models and quantitative measures of multisensory integration: a selective overview

Abstract

Multisensory integration (MI) is defined as the neural process by which unisensory signals are combined to form a new product that is significantly different from the responses evoked by the modality-specific component stimuli. In recent years, MI research has seen exponential growth in the number of empirical and theoretical studies. This paper presents a selective overview of formal modeling approaches to MI. Emphasis is on models and measures for behavioral paradigms like, e.g., localization, judgment of temporal order or simultaneity, and reaction times, but some concepts for the modeling of single cell spike rates are treated as well. We identify a number of essential concepts underlying most model classes, like Bayesian causal inference, probability summation, coactivation, and time window of integration. Quantitative indexes for measuring and comparing the strength of MI across different paradigms are also discussed. Whereas progress over the last years is remarkable, we point out some strengths and weaknesses of the modeling approaches and discuss some obstacles towards a unified theory of MI.

This article is protected by copyright. All rights reserved.

http://ift.tt/2Cku8yU