ATR MI&C Dept.2

Multimedia Sound Creation Proj

Tomoko Yonezawa
Internship Student
Sep. 1, 1999 - Mar. 31, 2000
  • Tangible Sound: brief description
    •
      Tangible Sound is a musical instrument with a novel user interface that uses fluid water. Fluids and sounds change shape over time and thus cannot be grasped. We believe that fluid water is a suitable interface for performing flowing music and so created a live, hands-on installation using water flow as an input medium to control the intuitively appealing feeling of "Musical Tension." We have developped a method of sensing the volume of the water flow corresponding to the enjoyment of the music. For judging a user's actions, we use the changes in the upper flow from the faucet and in the lower flows toward the drains as well as the difference between the two kinds of values.

    • More Info.

      • P laying the
      T angible S ound
      S ource
      D rain


      S ystem of the T angible S ound

  • Iamascope+: A Method for Generating Music from Video Input
    •
      " Iamascope " is an interactive mutlimedia instrument. Using images captured by a camera, it generates kaleidoscopic images, which are projected on the wall. The performer stands in front of the camera and his movements generate music and images. Extending a first prototype, we investigated a novel method for transforming images into musical elements. We also redesigned the musical components of the system, considering hierarchical structures for generating melody, chord and keys.

    • More Info. of Iamascope ground system.



      • P erformance of the I amascope S ystem

  • Com-Music: brief description
    •
      We present a sensor-doll capable of music expression as a sympathetic communication device. The doll is equipped with a computer and various sensors such as a camera, mi-crophone, accelerometer, and touch-sensitive sensors to recognize its own situation and the activities of the user. The doll has its own internal "mind" states reflecting differ-ent situated contexts. The user's multi-modal interaction with the passive doll is translated into musical expressions that depend on the state of mind of the doll.

      Keywords: Context-aware doll, multi-modal interaction, music expression

      S napshot of the C om-Music S ystem