Japanese
IPSJ JOURNAL Abstract Vol.43 No.08 - 042


Tactile Sensor-doll Interaction with Context-aware Music Expressions

Tomoko Yonezawa *1 *4 , Brian Clarkson *2 , Kenji Mase *3

*1 ATR Media Integration & Communications Research Laboratories
*2 MIT Media Laboratory
*3 ATR Media Information Science Laboratories
*4 NTT Cyber Space Laboratories

We present a sensor-doll capable of music expression as a sympathetic communication device. The doll has a computer and various sensors to recognize its own situation and the activities of the user. It also has the internal ``mind'' states to reflect different situated contexts.The user's multimodal interaction with the passive doll is translated into musical expressions that depend on the state of mind of the doll. Finally we evaluate the effect ofmusic expression to the human communication using the tactile doll.