I love this interactive instant data visualization of particles moving to music. Mind-blowing real-time music visualizer using the depth data from the Kinect sensor. Interactive particles are reacting to the beat of the music. This is an oscilloscope-like 3D effect with Kinect data and some interactive particle physics reacting "live" to sound input.
It uses OpenFrameworks, with the following addons:
ofxKinect (gets the Kinect point cloud data)
MSAPhysics - controls the particle physics, and enables physics interaction with the kinect data (though most of the kicks here miss the particles, they are interactive and will bounce off the scenery/me)
You take the sound feed from the mic sound object, get the sound spectrum and apply it to the kinect data to produce the lines.
I love how this has the potential to be huge. It could be used in concerts for an interactive effect targeting both the crowd and the performers. It would also be cool to see this in music videos or even advertisements. Perhaps it could somehow be integrated into an interactive advertisement e.g. advert to promote and inform people of a new club or music festival.
The camera is turning by the sensor reading depth in 3d, the rotation is done once the points are loaded into the computer. It's purely a virtual/software camera pan.
