EToOto (Painting with Sound)

EToOto (Painting with Sound)

This project aims to present unexplored techniques that fuse together painting with sound. Corresponding with Xbox 360 Kinect Senser to calibrate a Canvas with Multi Touch technology by Depth Sensing, EToOto triggers a sound when a brush touches with a canvas and manipulates the sound with the movement of drawing. It then cooperates with a color sensor module to convert an intensity from a color of paint into a value of frequency within a musical scale. The hue assigns the scale of sound, and the value determines the octaves. White is set as White Noise, and Black is sample sounds. The Pure Data Patch composes the sounds in delay loops and effects, and also controls a character of the sound. As painting gets layers of brush strokes on canvas, the sounds equally echo in time sequence.