🎶 Realtime Album Art

Realtime, Audio-reactive Behavior Framework.
Celebrating Kerrin Connolly’s Album: ALMOST

🎶 ✈️ 💽

USE SOUND 🔊⤴

A framework for making real-time, audio-reactive behaviors & visuals. Made entirely in Unity. A creative collaboration between @RaySoyama, @ColinVAudio, & me.

Created in 2020 to celebrate the launch of Kerrin Connelly’s first album: ALMOST.
Audio sampled from the track: PLANESONG.

This visualizer’s design was based on Kerrin’s original album-art ✨

Technical Notes:

This project was used to prototype a Realtime Framework for scripting "dynamic, audio-reactive behaviors".
The idea was to create multiple, small "listener" scripts that pickup on tags/tracks in an audio-sample, and then react in a predefined way based on what they "hear" & when.

Example:
The colored lights in the clouds were “listening” for sections of the track tagged “Refrain” (where Kerrin sings "…over and over…”), and had the behavior: “On every 2nd downbeat, Illuminate then fade-out the next point light in the array”.

At the core of this exploration was the idea that we could plug in any audio track (with our markup) and have the visuals react in a controlled, but surprising & dynamic way. And that this could be built further to enable things vistas & landscapes that react in a visual & diagetic way to ambient audio of a level.

We haven't touched the project in ages, but it remains a solid proof of concept that I know I’ll revisit eventually. For now, it's a fun little music video thing 😅