{"id":3555,"date":"2024-11-11T19:22:38","date_gmt":"2024-11-11T18:22:38","guid":{"rendered":"https:\/\/fki.htw-berlin.de\/creative-media\/?post_type=fw-portfolio&p=3555"},"modified":"2024-11-12T00:47:26","modified_gmt":"2024-11-11T23:47:26","slug":"vamx-virtual-audio-manipulation-experience","status":"publish","type":"fw-portfolio","link":"https:\/\/fki.htw-berlin.de\/creative-media\/project\/vamx-virtual-audio-manipulation-experience\/","title":{"rendered":"VamX-Virtual Audio Manipulation Experience"},"content":{"rendered":"\n

Masterprojekt SoSe23<\/em><\/p>\n\n\n\n

VamX-Virtual Audio Manipulation Experience<\/h1>\n\n\n\n

Acoustics are stimulating. They influence us in many different ways, create stress or comfort. Our stress level impacts our actions. But stress does not necessarily have to be negative. Depending on the task, stress can even be beneficial for the desired outcome. With VamX (Virtual Audio Manipulation Experience) we have developed a framework that supports the manipulation of sound in virtual environments and therefore also the manipulation of the stress level.<\/p>\n\n\n\n

Goal<\/h3>\n\n\n\n

Our goal was to create a tool that helps Unity developers design applications that consider sound and its effect on the user. Either the desired sounds can be included in VamX or passed to the framework via FMOD.<\/p>\n\n\n\n

Features<\/h2>\n\n\n\n

VamX<\/h3>\n\n\n\n

Vamx is a editor tool that allows multiple sounds instances to be grouped and controlled by a single component. The\u00a0Editor<\/strong>\u00a0component allows the user to import a sound file and manipulate various sound properties using different evaluation methods, such as custom graphs for complex sound manipulation. The various sound properties and their evaluation settings can be saved as presets and reused in other sound files. The\u00a0Editor<\/strong>\u00a0allows importing regular audio files via the\u00a0Unity-Editor<\/strong> or FMOD-Events using the\u00a0FMOD-Editor<\/strong>, that will automatically expose all custom automation\/parameter sliders.<\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n

Each individual sound property expects a normalized float input value, that can be controlled by the user or by a script. Input values of ALL sound properties of a Editor<\/strong> component, can also be controlled and processed by a Editor Level<\/strong>.<\/p>\n\n\n\n

The Manager<\/strong> component is a overview of all available editor instances in the scene. The editors can be directly manipulated from the Manager<\/strong> component. In addition to that, the Manager Level<\/strong> can control ALL editor instances and their respective audio properties, overriding the Editor Level<\/strong>. This value, similar to the Editor Level<\/strong>, can be controlled by the user individually or by a external script.<\/p>\n\n\n\n

Heart Rate Sensor<\/h3>\n\n\n\n

In our demonstrations, we utilize the\u00a0Manager Level<\/strong>\u00a0by using a Bluetooth heart rate monitor device to measure stress levels through heart-rate variability (HRV). This value is then mapped to a normalized float value to control our entire sound system.<\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n
\n\n\n\n

Games<\/h2>\n\n\n\n

There were three different interactive scenarios within VR to test and evaluate the effect of the framework, each with an unique approach to that task.<\/p>\n\n\n\n

Tower of Hanoi<\/h3>\n\n\n\n

A low-stress task, which can be completed at its own pace.<\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n
\n\n\n\n

Ball Maze<\/h3>\n\n\n\n

A stress level variable task in which you have to react on the virtual physics<\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n
\n\n\n\n

Piano Tiles<\/h3>\n\n\n\n

Steadily increasing stress level due to this accelerating rhythm game. Can sound manipulation help us break the personal limit?<\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n
\n\n\n\n

Team<\/h2>\n\n\n\n