RealSense for TouchDesinger
TouchDesigner is a visual development platform that equips artists and designers with the tools they need to create stunning realtime projects and rich user experiences. It is used for creating interactive media systems, architectural projections, live music visuals, and other such projects. The RealSense camera was implemented into TouchDesigner to allow user's with the hardware to use it's features within TouchDesigner. These include face and hand tracking, gesture recognition, and depth sensing, among others.
Company
Derivative
Project
Application API
Work
Development
A demo of an interactive dance piece currently being created. The RealSense camera captures the dancers gestures and movements and then, through TouchDesigner, renders them out as animations or uses them to interact with other objects, all in real time.
The RealSense camera tracks the depth of the user on screen and creates a cloud of points in 3D space (x, y, and z coordinates). This 3D geometry can then be manipulated in TouchDesigner for use in a variety of projects.
The colour camera on the RealSense is used to capture live video of the user, which is then colour shifted and projected onto an animated geometry within TouchDesigner.
The depth camera on the RealSense is used to track the user's hand position, which in TouchDesigner, is used to interact with other objects. In this case a noise generator with a displace effect creates a unique image similair to a particle system.
