September, 2014

divider
timbreID-3D

The timbre space example for timbreID has finally gone 3D using the LEAP controller. Each finger on a hand is a browsing cursor, allowing polyphony and gesture-oriented synthesis according to various dimensions of timbre. See a video browsing speech grains. [here].


divider
aural-maze

The Aural Maze challenges visitors to navigate a space using only their ears. A path is determined ahead of time, and walking along it from start to finish plays a piece of music from beginning to end. If you stray to the left or right of the defined path, the audio fades out to let you know that you're off course. Ideally, it is installed in a pitch black room where your ears are your only guide. In the following videos of an early demo, the path is drawn on the floor, and visitors were able to walk along it to "play" Erik Satie's Gymnopedie No. 1. The speed of playback is controlled by walking pace, and walking backwards along the path causes reverse playback. If you stand still, so does the music. Position tracking was achieved using an overhead infrared camera that follows the inrared-emitting helmet worn by visitors. A much more subtle active IR marker is being used for the premiere installation in December 2014. See demo videos of the first test run [here] and [here].


divider
1982-moe

1982 – MYTHS OF ESCAPE is a dance theatre work being created by dancer [Mirenka Cechova], computer musician/software designer William Brent and ‘cellist NJ Snider. The piece relies on custom technology to create relationships between physical movement, acoustic/computer-generated sound, and real-time video manipulation. In parallel with the traditional dialog between dancer and musician, Myths of Escape introduces an additional dialog between the musician and a phantom (recorded) representation of the dancer. Various aspects of the cellist's playing, such as pitch, loudness, and liveliness control video of the dancer in real-time. This requires that the cellist learn to "play" the video just as much as the music, in an environment where new relationships between movement and sound are constantly introduced and destabilized. See a video that demonstrates the basic elements of the cello-video mapping software [here].