{"id":3535,"date":"2024-11-11T18:57:59","date_gmt":"2024-11-11T17:57:59","guid":{"rendered":"https:\/\/fki.htw-berlin.de\/creative-media\/?post_type=fw-portfolio&p=3535"},"modified":"2024-11-12T00:47:51","modified_gmt":"2024-11-11T23:47:51","slug":"interactive-stage-design","status":"publish","type":"fw-portfolio","link":"https:\/\/fki.htw-berlin.de\/creative-media\/project\/interactive-stage-design\/","title":{"rendered":"Interactive Stage Design"},"content":{"rendered":"\n

Bachelorprojekt <\/em>WiSe22<\/p>\n\n\n\n

Interactive Stage Design<\/h1>\n\n\n\n

Goal<\/h2>\n\n\n\n

The goal of this project is to create an interactive stage show in which the audience can actively participate to create a deeper connection to the overall concert experience. For this purpose, the audience will submit various drawings for the individual songs in the run-up to the concert. These will then be transformed into an animation showed on the stage design together with the live input of the band.<\/p>\n\n\n\n

\n
\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n<\/div>\n\n\n\n
\n\n\n\n

More than just a particle system<\/h3>\n\n\n\n

The project basically consists of 4 components: A web app that allows the audience to submit drawings to the concert songs, a backend that manages the data and makes the different services publicly available, an audio analysis program to evaluate live music input data and finally the Unity application that visualizes the live music data and the audience drawings.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n
\n\n\n\n

Unity<\/h3>\n\n\n\n

The main part for our project is the visualization app which we build via Unity. It communicates with the music analyzer Tool to visualize the live music and with the Web app to get the collected user input. Our visualization is realized with the Unity Particle System and with the VFX Graph. Inside the running Unity App you can start and stop the visualization of the user input, switch between songs, stop or change colors for the live input visualization and dissolve the particles for small breaks.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n
\n\n\n\n

Liveinput<\/h3>\n\n\n\n

In order for the visualization to be visibly related to the music, we still needed a way to analyze music in real time in order to use it to influence parameters in the Unity application. The choice of framework here fell relatively quickly on JUCE, since it is possible to realize both standalone applications and plug-ins with it and we had not made this decision at the beginning. In the end, we decided to use a plug-in, because this way we didn\u2019t have to implement the routing of the audio channels ourselves. For the analysis we decided to implement relatively simple analyzers, but to provide 6 channels in order to be able to create complex but obvious connection between music and visualization. Another challenge was the assignment of the analysis values to the parameters of the Unity application. We ultimately solved this using a matrix mixer per analysis channel. This approach allowed for maximum flexibility, even if it was somewhat at the expense of usability, since there were ultimately a lot of coefficients that could\u00a0have\u00a0been\u00a0set.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n
\n\n\n\n

WebApp<\/h3>\n\n\n\n

The WebApp gives visitors a variety of functions and information. The visitor should be given the opportunity to get an overview of past and upcoming events. Furthermore, each event should have a title, start and duration as well as a track list with the songs played at the event.<\/p>\n\n\n\n

In the run-up to an event, the audience can submit their own small drawings via a website for the individual songs that will be played at the event. These drawings are then played as an animation during the concert, so that all spectators can clearly recognize their input:<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n
\n\n\n\n

Team<\/h2>\n\n\n\n