 ICMI06 Paper: "Cross-modal Coordination of Expressive Strength between Voice and Gesture for Personified Media" by Tomoko Yonezawa et al. |
|
Banff, 2-4, Nov., 2006
Cross-modal Coordination of Expressive Strength between Voice and Gesture for Personified Media
The aim of this paper is to clarify the relationship between the expressive strengths of gestures and voice for embodied and personified interfaces. We conduct perceptual tests using a puppet interface, while controlling singing-voice expressions, to empirically determine the naturalness and strength of various combinations of gesture and voice. The results show that (1) the strength of cross-modal perception is affected more by gestural expression than by the expressions of a singing voice, and (2) the appropriateness of cross-modal perception is affected by expressive combinations between singing voice and gestures in personified expressions. As a promising solution, we propose balancing a singing voice and gestural expressions by expanding and correcting the width and shape of the curve of expressive strength in the singing voice.
|