Live Concert Interactive Visuals
Type
Interactive System
Role
Software Engineer
Technical Artist
Date
Aug 2021 - Jan 2023
Client
好樂團 GoodBand
Credits
This project transformed live music into immersive visuals. Using LiCAP optical pickup and real-time rendering, every guitar strum generated dynamic graphics on stage, making each show unique to the performer and the audience.
For the first song, we designed a set of generative algorithms to capture the emotional shifts in the music. Each guitar strum controlled rain, light flows, and particle bursts, so the visuals mirrored the intensity of the performance in real time.
Soft picking produced a gentle rain, while stronger pressure brightened the scene to reflect the guitarist’s mood. In the chorus, particles exploded across the screen, symbolizing hope vanishing in an instant.
For the second song, we shifted to a playful, hand-drawn illustration style. Six cats appeared across different scenes—pushing yarn balls, balancing on electric lines, or jolting with every strum—making the visuals whimsical and lighthearted.
Illustrations by Aery Orange (橘子)
Photograph by 周柏辰
WORKFLOW & Experiments
Signal Processing
Processed MIDI signals from LiCAP in TouchDesigner, filtering noise and extracting interactive events such as Note On/Off, Aftertouch, and Pitch Bend.
Real-Time Visuals
Transmitted the processed MIDI via OSC to Unity, generating real-time visualizations with VFX Graph on HDRP.
