This is an early experiment using the reacTIVision libs with MIDI. I wanted to be able to play notes & trigger loops using fiducial markers and try and make an intuitive connection between the image and the sound. There is no visual feedback like with the Reactable - I kinda like it organic. It removes the computer and keyboard interface completely.
How it works: Video camera (Sony PD170) shooting progressive mode hooked up to a capture card (nVidia), reacTIVision does the image recognition and then I'm MIDI'ed out to a Roland MC505 and Korg KP3 (as a sampler).
Current Flaws: If you accidentally cover over a loop / beat it sometimes retriggs... often out of time (you see this at 3:47). Likewise triggering anything on tempo is tricky - especially when trying to time LFO's to a beat. There is a slight latency between the camera seeing the image, the A/D and reactivision processing the fiducial, but it is quite usable once you get used to it. Also, it is very easy to "clash" fiducials by overlap. My new version mounts these on blocks of foam and the new table will also be much bigger than a sheet of photocopier paper!!
Thanks for watching :-)
(ps. back to the chiptune!)
36 Comments