mixed reality streaming system - Demo
COVID-19 has effected everyone differently. I have been personally put on long term furlough. With the many problems COVID-19 has created this is a time where innovative solutions can be pursued to solve the unique challenges posed by COVID-19.
With this in mind I have developed a mixed reality streaming system - pairing a studio setting and live performers with interactive digital technology to create a seamless tangible virtual experience.
Below is a breakdown of what this technology can achieve, all developed by a solo creative!
Components of Concept
DJ Performer Zen
Some highlights of the system are:
- Real time green screening into virtual worlds with multiple configurations (dance, portrait, DJ)
- Audio reactive graphics and geo that can be customized for each performer.
- Twitch chat integration into virtual world ( 4:52 ex in demo video) (subscriber only feature $)
- Limited run purchasable merch that appears in the virtual world. Fans can own a piece of the experience.
World Building
Lunar Excavation
moodboard
A world was envisioned to sync with the future forward electronic music. Imagining a futuristic world where mining a lunar like planet for a precious crystal to power our hungry galactic empire. Upon arrival an ancient societies technological artifacts are discovered and become activated by our presence.
3d modeling
A variety of 3d models were created to build out the lunar excavation world.
This started with a geometric exploration bringing together modular complex geometry inspired loosely by tribal architecture. This was then being simplified throughout the process to create celestial craft and installations.
Animations
Once the forms were created they were given movement synced with the music. These were triggered and turned off at various changes in music's progression to create a 3d responsive environment. Additionally a variety of 2d procedural animations responded to the rms power of the song and were layered on top as a graphical component.
Merch
Creating physical artifacts of the experience was something else that was experimented with. Take the virtual environment and allow for viewers to purchase physical reproductions. Prints and t shirt designs could be used as texture assets in the virtual world going forward to create seamless blend between the physical and virtual.
This was only the start of an exciting new process that can be a solution to live entertainment during COVID-19. I look forward to continuing this workflow and pushing this idea farther.
thank you for your time.
