The Multimodal interaction group (MMI), part of the Computer vision and multimedia laboratory (CVML), is interested in the use of various modalities for human-computer interaction and affective computing. The currently studied modalities are visual (eye-gaze tracking), auditory (3D sonification), haptic, physiological (EEG's, peripheral physiological signals). The three main research and development topics, concerning interaction using physiological signals and eInclusion, are:
- brain-computer interaction (BCI) based on EEG's, and brain sources reconstruction (forward and inverse problem);
- affective computing and emotions assessment;
- electronic aids for visually handicapped people and for the elderly
Our specialized equipment includes acquisition systems for EEG's (Biosemi, GTec, Emotiv), peripheral physiological signals (EMG, blood and breathing rates, EDR, skin temperature), eye gaze trackers (Tobii), stereo and 3D+ cameras, etc.
Group website: http://cvml.unige.ch
C. Mühl, B. Allison, A. Nijholt, G. Chanel, A survey of affective brain computer interfaces: principles, state-of-the-art, and challenges, Brain-Computer Interfaces, Published online May 14 2014. DOI: 10.1080/2326263X.2014.912881.
J. Gomez, G. Bologna, T. Pun, See ColOr: An extended sensory substitution device for the visually impaired, J. of Assistive Technologies, Vol. 8, No. 2, 2014, 77-94. DOI: 10.1108/JAT-08-2013-0025
M. Soleymani, M. Larson, T. Pun, A. Hanjalic,Corpus development for affective video indexing, IEEE Trans. on Multimedia, 16, 4, June 2014.
M. Soleymani, M. Pantic, T. Pun, Multi-modal emotion recognition in response to videos, IEEE Trans. on Affective Computing, Vol. 3, No. 2, April-June 2012, 211-223. Digital Object Identifier: 10.1109/T-AFFC.2011.37.
M. Soleymani, J. Lichtenauer, T. Pun, M. Pantic, A multi-modal database for affect recognition and implicit tagging, IEEE Trans. on Affective Computing, Special Issue on Naturalistic Affect Resources for System Building and Evaluation, B. Schuller, L. Devillers, R. Cowie, E. Douglas-Cowie, A. Batliner, Guest Editors, Vol. 3, No. 1, Jan. - March 2012, 42-55.
Faculté des Sciences
Email: Thierry (dot) Pun (at) unige (dot) ch
Tel 022 379 02 23