We created a technology for Samsung VR that, through augmented reality, places subtitles in the field of vision of people with hearing disabilities. This way, they can watch the play in real time, like someone who goes to the movies or watches TV. They just had to put on a Gear VR (which they receive before the play starts), turn the app on and watch the play live with subtitles.

We partnered with the city of São Paulo to make this new technology available at a municipal theater. Every deaf person received a Samsung Gear VR to wear during the play so they can read the subtitles.

The technology works like this: the cellphone camera captures the image of the play and transmits it live to the deaf person. Simultaneously, the microphone captures the actors’ voice and turns it into subtitles. This way, the subtitles appear over the live image of the play in the field of vision of the deaf person.

The technology has the potential to completely change the way deaf people watch live plays. Opening the doors of theater to completely new audience, estimated in 9.7 million people in Brazil alone.

The attendance of deaf persons at these plays increased from practically nothing to around 5% of the total audience. Which means that all the seats we had available with this technology were completely sold out.

Due to the success of the project, it is now being expanded for 10 more theaters. Other theater plays already consulted us to use this technology.