Cannes Lions
FAHRENHEIT DDB, Lima / AB INBEV / 2023
Awards:
Overview
Entries
Credits
Background
Online video games are currently the largest social community in the world, unfortunately it has not been developed for deaf people, because they need to listen and reply to be part of it.
In 2022 we created E-nterpreters, a bot that managed to enable deaf gamers through sign language in Discord, to understand online conversations in real time, allowing the inclusion of these gamers in online games.
However, hearing impairment generates speech disability, due to the fact that deaf people do not have sound reference. This creates an additional barrier to communication.
Idea
E-nterpreters Season 2 is a continuation of E-nterpreters (2022), an innovation that made a bot translate Discord conversations into sign language in real time.
To close the communication circle, this year we decided to evolve our AI so that, through an algorithm, it be able to read the movement of lips and gestures and translate them into a voice message, in real time and at the speed of the game.
With just a simple webcam, anyone, anywhere, will be able to express themselves freely and be part of the game.
This makes E-nterpreters an inclusion platform where we first gave them the opportunity to understand the conversations and now to be understood by everyone and make more friends.
Strategy
Since last year, we worked hand in hand with the deaf gamer community, so after rigorous research, we discovered that deaf people have problems developing speech, specifically regarding sound emission, because they do not have sound reference.
However; if they have the ability to gesticulate and move their lips when trying to speak, this opened a window of possibilities. Through the capture of gestures and lip movements we could predict the words they meant to use, giving deaf gamers the opportunity to reply with a voice for the first time, and thus engage them in the online experience in an equal manner.
Execution
Evolving our artificial intelligence, this year we made E-nterpreters a platform for inclusion in the world of online video games, providing the tools and opportunities for deaf gamers to equally take part in the game.
Our priority has always been to bring technology anywhere at any time, this is why with just a simple webcam, anyone, anywhere, may use the E-nterpreters platform and communicate freely, both to understand the conversations and to take part in them.
Although the platform is created for Discord and in Spanish (with which we can reach more than 284.1 million Spanish-speaking gamers), the platform may be applied to other languages; e.g., from English to Chinese, and it may also be replicated in other communication platforms such as Zoom, Meet or Youtube.
Outcome
• 22,000 active users of the platform.
• We accomplished to include those 22,000 users in the universe of 284.1 million Spanish-speaking gamers.
• We created technology scalable from a simple webcam.
Similar Campaigns
12 items