Bachelorprojekt SoSe22

Spellweaver- Words of Power

Goal


If you’ve ever used a VR Headset, you might’ve run into the tedious task of inputting text. This experience is quite similar to navigating a keyboard with the remote of your smart-TV. A viable alternative offered by more and more web services is speech-to-text input. And that was our calling.

We then asked ourselves which STT (speech-to-text) options are there, and how do we implement them into Unity? After all, what better way is there to introduce a feature than by gamifying it. And so we set the following goals:

The game should make it easy for the user to test the performance of each API while seeing exactly what went wrong. It should also make it relatively easy for other developer to implement new API’s from other providers.


Once started, you have to choose one of the implemented STT-API’s.
After that, you’ll join the wondrous world of Spellweaver – Words of Power. There you’ll find a wand and a book full of all kinds of Spells.
Above both the book and the stand with the wand you’ll find two boards. One will show you the performance of your cast, while the other gives you two play options: sandbox or challenge. Both will spawn different kind of enemy types, but only one will give you a time limit and a final score.

Features

The following is a brief overview of the individual features of our game. They were developed with the goal to playfully try out speech-to-text input in VR and to test its performance. Despite the focus on STT, it was important to us to create a solid and meaningful gaming experience.

Core Elements

  • three selectable Speech-to-Text API’s
  • spell book with different spells that can be turned over
  • wand in different designs to cast the selected spell
  • word error rate analysis board where you can see the transcribed text and what mistakes you made

…other game features

  • start challenge option: starts a timer and makes opponents appear regularly. When the timer runs out, you’ll be able to see your final score
  • spawn buttons where you can spawn enemies yourself
  • two types of enemies with different health points
  • three different types of spells, with an intensity is based on the WER
  • magical and gloomy game environment and game sounds
  • info buttons for the gameplay, licences and data processing

Team

  • Esther Gülpen Garray
  • Felix Anders
  • Adrian Joos
  • Jana Meißner
  • Luca Hobiger

Betreuung

Tamara Voigt, Jonas Ehrhardt

Links

https://showtime.f4.htw-berlin.de/ss23/bachelor/b5-spellweaver

Skip to content