Sustainable Development Goals > People

KIKI, VIRTUAL HUMAN INTERPRETER

MEDIA.MONKS, Hilversum / NHK ENTERPRISES & NHK GLOBAL MEDIA SERVICES / 2024

Awards:

Bronze Cannes Lions
CampaignCampaignLayout(opens in a new tab)
Supporting Images
Supporting Images
Supporting Images

Overview

Credits

Overview

Why is this work relevant for Sustainable Development Goals?

Kiki serves as a prime example of an innovative solution that has the power to achieve broader societal objectives by promoting inclusivity and reducing healthcare disparities. It fosters a more inclusive society where the Deaf community can fully integrate and have equitable access to essential services, such as communication, aligning with the goal of creating sustainable communities globally. By bridging the gap for Japan's Deaf community and potentially expanding globally, Kiki contributes to building environments where individuals of all abilities can actively participate and communicate in any language.

Please provide any cultural context that would help the Jury understand any cultural, national or regional nuances applicable to this work.

Surrounded by rising sea levels, Japan has one of the highest earthquake risks globally. In only the last decade, it has experienced over 30 earthquakes, including a record breaking one in 2011— A 9.0 magnitude quake that resulted in the most destructive tsunami in recorded history. Despite having one of the most advanced early-warning systems, designed to provide life-saving information in multiple languages, it was missing one very important one: Japanese Sign Language.

In order to provide fundamental and equal access to Japan's 300,000+ Deaf Community Members, NHK (Japan’s Public Broadcaster) created Kiki. The world’s first, text-to-sign translator for Emergency Alerts. Through a first of its kind text to sign translation engine, Kiki, a lifelike virtual avatar, receives text input and generates full dynamic Japanese Sign Language in real-time.

How does this campaign fit into the overall brand objectives? How is this part of the brand's wider commitment towards the UN’s Sustainable Development Goals?

Kiki's integration into the brand's initiatives resonates deeply with its core values of inclusivity and accessibility. This alignment with the brand's overarching objectives is evident in Kiki's direct impact on reducing inequalities and promoting sustainable communities. Specifically, Kiki addresses Sustainable Development Goal (SDG) 10, which focuses on reducing inequalities, by providing the Deaf community with access to crucial information during emergencies. Moreover, Kiki contributes to SDG 11, which aims to create sustainable cities and communities, by fostering a more inclusive environment where individuals of all abilities can participate fully. By bridging the communication gap for Japan's Deaf community and potentially expanding globally, Kiki exemplifies the brand's commitment to making meaningful contributions towards achieving the United Nations' Sustainable Development Goals.

Background

For members of the Deaf community, providing only closed captioning only during Emergency Alerts is like translating content into an entirely different language as they read. Transcribing spoken words doesn’t capture the same meaning or nuances for those who communicate primarily through Sign Languages.

Sign Languages have their own word order (or syntax). And what word order is appropriate depends on the context. Proper word order depends on what you’re trying to do: explain, remind, confirm, negate, cause to consider, ask a question, etc. This results in multiple variations of interpretation of a single sentence of spoken word.

The fact that the distinction between closed captioning and the importance of actual Sign language isn’t widely understood is why the world needs to include more sign language interpretation and advocacy of linguistic diversity. Emergency alerts are but one part of answering the broader call. It’s time to embrace true accessibility.

Describe the cultural / social / political climate and the significance of the work within this context

Kiki's significance lies in its response to the critical need for accessibility in emergency communication for Japan's Deaf community, especially in a country prone to earthquakes. This work embodies the values of inclusivity and partnership, aligning closely with societal needs and cultural values. By bridging the communication gap during emergencies, Kiki contributes to fostering a more inclusive and equitable society. In a country with a strong emphasis on community and mutual support, Kiki's role in enhancing accessibility highlights its cultural and social significance as a vital tool for promoting inclusivity and partnership.

Describe the creative idea

The creative idea behind Kiki was to develop the world's first text-to-sign translation engine, revolutionizing communication for the Deaf community. Drawing upon advanced technology and collaboration with Sign Language experts, Kiki seamlessly translates plain text into lifelike Japanese Sign Language (JSL) in real-time. The idea was to create a dynamic virtual avatar capable of accurately conveying the nuances of sign language, including facial expressions and emotional cues. This innovative approach ensures rapid and effective communication during emergencies and beyond. By combining cutting-edge technology with linguistic expertise, Kiki represents a breakthrough in accessibility, empowering the Deaf community with vital information and fostering inclusivity on a global scale. The creative idea behind Kiki encapsulates the brand's commitment to leveraging innovation for positive societal impact, driving meaningful change in how we communicate and interact with one another.

Describe the strategy

In crafting our strategy for Kiki, our goal was to create a scalable tool addressing the lack of accessibility for the deaf community during emergency broadcasts in Japan. We collaborated closely with our client and JSL experts, including professors from Tsukuba University of Technology, to ensure complete accuracy of the complexity and nuances in sign language.

Through seamless integration of our first of its kind text-to-sign translation engine and rapid rendering of less than 2 seconds per motion phase, Kiki generates disaster messages within 10 seconds from user text. This breakthrough approach not only aids emergency broadcasts but also benefits the Deaf Community globally. Kiki’s design and API-based approach consider the holistic needs of other government institutions and brands worldwide, making it ideal for future business solutions requiring increased accessibility.

We're in discussions with the government and universities in Europe and beginning the process of capturing audiences for European Sign Language.

Describe the execution

Kiki's execution showcases innovation through her pioneering text-to-sign translation engine, revolutionizing real-time Japanese Sign Language (JSL) interpretation. With a database of over 16,000 individually captured mocaps representing signed words, Kiki achieves unprecedented accuracy and realism, setting a new standard in the field not just in Japan, but globally. The implementation involved a meticulous two-year process, collaborating with Sign Language experts and Tsukuba University of Technology to ensure linguistic authenticity and technical precision. Integration into Japan's emergency broadcast system underscores the project's scalability and immediate impact. Kiki's deployment extends beyond emergencies, enhancing accessibility in various settings such as museums, airports, and aircraft safety videos. This inventive execution not only addresses a crucial gap in emergency communication but also demonstrates adaptability, pushing the boundaries of real-time text-to-sign language translation to exponentially increase opportunities for sign inclusivity for the Deaf community.

Describe the results/impact

1. NHK's integration of Kiki into Japan's emergency broadcast system ensures vital communication for over 300,000 Deaf individuals during crises, solidifying its importance in emergency situations.

2. Since it’s launch, Kiki has provided life-saving data at every emergency broadcast most notably during the January 1, 2024 7.6 magnitude earthquake.

3. Created an official sign language repository in conjunction with the Tsukuba University of Technology. Its initial 16,000 forms the basis for all future sign language capture to be easily expanded.

4. Successfully integrated Kiki as the first-ever virtual ambassador at the 2025 Deaflympics in Tokyo, helping support and demonstrate the need and ease of use of our real-time sign service.

5. We’re already working on future developments. Kiki 2.0 will leverage AI and machine learning to capture more efficiently, and cost-effective

6. We are in talks with several European universities to capture new languages to be used for online courses.

Describe the long-term expectations/outcome for this work

Kiki represents more than just a solution; it embodies a groundbreaking force for lasting change. Beyond its immediate impact in emergencies, Kiki serves as a catalyst for transformative progress, driving inclusivity and empowerment for individuals, organizations, and wider society. Our long-term vision extends beyond borders, aiming to radically simplify sign language content creation globally. Through ongoing innovation and scalability, we envision Kiki becoming a widespread tool, bridging communication gaps and fostering accessibility for all. Our commitment to longevity fuels this endeavor, as we continue to expand Kiki's capabilities across languages and cultures, ensuring unprecedented accessibility on a global scale. As we embark on the next phase of development, our goal is to solidify Kiki's position as a pioneering solution, advancing inclusivity and empowerment for generations to come.

Were the carbon emissions of this piece of work measured? For additional context, what consideration was given to the sustainable development, production and running of the work?

While we didn't explicitly measure carbon emissions, sustainability was a core focus in every aspect of Kiki's production and deployment. Our commitment to sustainable development shines through our efforts to minimize environmental impact whenever possible. For instance, with the development of Kiki 2.0, we're actively exploring AI and machine learning technologies not just for innovation's sake, but to streamline operations and reduce energy consumption. We're continually assessing our production processes to enhance sustainability. Our goal is not only to advance accessibility for the Deaf community but also to champion a greener approach to technology development.

More Entries from Good Health and Well-being in Sustainable Development Goals

24 items

Grand Prix Cannes Lions
RENAULT - CARS TO WORK

Decent Work and Economic Growth

RENAULT - CARS TO WORK

RENAULT, PUBLICIS CONSEIL

(opens in a new tab)

More Entries from MEDIA.MONKS

24 items

Silver Cannes Lions
I'M A CRIMINAL

Script

I'M A CRIMINAL

GIRLS NOT BRIDES, MEDIA.MONKS

(opens in a new tab)