Innovation > Innovation
FAHRENHEIT DDB, Lima / PILSEN CALLAO / 2022
Awards:
Overview
Credits
Why is this work relevant for Innovation?
E-nterpreters is a development that changes the way in which deaf people communicate in online games completely. By integrating them into a socialization space they were missing due to not being able to hear. Before E-nterpreters, deaf gamers missed commands, instructions and even simple conversations that are part of the essence of online gaming. Now, you can open Discord and start observing what other players are saying in real time.
Background
There are over 100 million deaf gamers in the world that are currenty missing the complete interactive gaming experience for not being able to hear; often opting to play alone. Many solutions have come up in other mediums and platforms, but none for communication between online game users; and as a result, this group of gamers are excluded from simple online conversations between friends.
That’s why this development combines artificial intelligence with sign language and integrates them in a bot inside Discord, the world’s largest communication platform for gamers, which now, when listening to each player’s voice, converts them into text commands and translates them to a visual response. Not so long ago, there were no available developments that could reduce the gap between gamers that are able to hear and deaf gamers in online games.
Describe the idea
E-nterpreters is an AI bot that translates sign language conversations that occur in Discord, the world’s largest online gamer interaction platform, in real time. Partnered with Cyrcis’ technological labs, we summoned deaf gamers in order to learn gamer sign language so we could consolidate it into a universal language; creating specific translations for actions that didn’t have one yet.
Powered by Google’s artificial intelligence, bots listen to the conversations and translate them through avatars. An algorithm recognizes each player’s voice and translates it in the order they’re speaking. The goal is to transform the way deaf people communicate in the gaming world, by connecting them with gamers that are able to hear.
An innovation that took 10 months of development and was certified by Discord as an official bot within the platform.
What were the key dates in the development process?
Please include a timeline of the details and dates. (e.g. 3 November 2017 - First patent agreed)
Jun 12 – Oct 15, 2020: Research of technology
Oct 20 – Nov 5, 2020: Research of the community
Oct 20 – Nov 19, 2020: Concept Art
Nov 12, 2020: Motion Capture
Nov 20 – Dic 12 2020: Unity, and Discord
Feb 20, 2020: E-nterpreters Final Test
March 22, 2020: Launch Day
Describe the innovation / technology
E-nterpreters is a bot that translates users’ conversations within Discord to sign language in real time. To achieve this, we integrated Google’s “speech to text” to our algorithm in order to convert texts into visual responses in any online game supported by this platform.
Currently, this development is available only for PC within Discord. E-nterpreters is as an open source in development that’s looking forward to continuing with the inclusion of more signs and the learning of more translations in real time.
Describe the expectations / outcome
Currently, E-nterpreters is a bot verified by Discord, which allows us to start learning new languages in the medium term. For this, we plan to focus on the languages with the largest number of users (English, Japanese, Chinese, Korean), thus, accelerating the learning process.
The programming is open so that any developer in the world can improve the AI and integrate more signs within the library of gestures in our programming.
More Entries from Applied Innovation in Innovation
24 items
More Entries from FAHRENHEIT DDB
24 items