Health and Wellness > Health Awareness & Advocacy

KIKI, VIRTUAL HUMAN INTERPRETER

MONKS, Amsterdam / NHK ENTERPRISES & NHK GLOBAL MEDIA SERVICES / 2024

CampaignCampaignLayout(opens in a new tab)
Supporting Images
1 of 0 items

Overview

Credits

OVERVIEW

Why is this work relevant for Healthcare Product Innovation?

Kiki stands at the forefront of accessibility innovation, driven by the creation of the world's first text-to-sign engine. This groundbreaking technology has brought the conversation of sign inclusivity to healthcare in a way that was never thought possible before. By providing real-time Japanese Sign Language (JSL) interpretation, Kiki demonstrates the transformative power of healthcare product innovation in overcoming unique accessibility challenges and fostering inclusivity within healthcare delivery. NHK's development serves as a beacon for future innovation, proving how technology can be leveraged to bridge communication gaps and enhance the quality of care for everybody.

Please provide any cultural context that would help the Jury understand any cultural, national or regional nuances applicable to this work.

Surrounded by rising sea levels, Japan has one of the highest earthquake risks globally. In only the last decade, it has experienced over 30 earthquakes, including a record breaking one in 2011— A 9.0 magnitude quake that resulted in the most destructive tsunami in recorded history. Despite having one of the most advanced early-warning systems, designed to provide life-saving information in multiple languages, it was missing one very important one: Japanese Sign Language.

In order to provide fundamental and equal access to Japan's 300,000+ Deaf Community Members, NHK Enterprises and NHK Global Media (Japan’s Public Broadcaster) created Kiki. The world’s first, text-to-sign translator for Emergency Alerts. Through a first of its kind text to sign translation engine, Kiki, a lifelike virtual avatar, receives text input and generates full dynamic Japanese Sign Language in real-time.

Background

For members of the Deaf community, providing only closed captioning only during Emergency Alerts is like translating content into an entirely different language as they read. Transcribing spoken words doesn’t capture the same meaning or nuances for those who communicate primarily through Sign Languages.

Sign Languages have their own word order (or syntax). And what word order is appropriate depends on the context. Proper word order depends on what you’re trying to do: explain, remind, confirm, negate, cause to consider, ask a question, etc. This results in multiple variations of interpretation of a single sentence of spoken word.

The fact that the distinction between closed captioning and the importance of actual Sign language isn’t widely understood is why the world needs to include more sign language interpretation and advocacy of linguistic diversity. Emergency alerts are but one part of answering the broader call. It’s time to embrace true accessibility.

Describe the creative idea

The creative idea behind Kiki was to develop the world's first text-to-sign translation engine, revolutionizing communication for the Deaf community. Drawing upon advanced technology and collaboration with Sign Language experts, Kiki seamlessly translates plain text into lifelike Japanese Sign Language (JSL) in real-time. The idea was to create a dynamic virtual avatar capable of accurately conveying the nuances of sign language, including facial expressions and emotional cues. This innovative approach ensures rapid and effective communication during emergencies and beyond. By combining cutting-edge technology with linguistic expertise, Kiki represents a breakthrough in accessibility, empowering the Deaf community with vital information and fostering inclusivity on a global scale. The creative idea behind Kiki encapsulates the brand's commitment to leveraging innovation for positive societal impact, driving meaningful change in how we communicate and interact with one another.

Describe the final product

Kiki is a revolutionary web-based application that seamlessly generates Japanese Sign Language (JSL) videos in real-time. The heart of Kiki's functionality lies in its utilization of motion-captured signed words, meticulously supervised by Tsukuba University of Technology, ensuring unparalleled accuracy and alignment with JSL nuances. This advanced technology enables Kiki to dynamically translate plain text into lifelike JSL, facilitating effective communication for the Deaf community. Beyond emergency situations, Kiki's deployment extends to various settings, including Japan's emergency broadcast system, as well as public spaces like museums and airports. Users interact with Kiki through simple text input, which is swiftly translated into expressive sign language videos, enhancing accessibility and inclusivity on a wide scale.

List the results

1. NHK Enterprises and NHK Global Media's integration of Kiki into Japan's emergency broadcast system ensures vital communication for over 300,000 Deaf individuals during crises, solidifying its importance in emergency situations.

2. Since it’s launch, Kiki has provided life-saving data at every emergency broadcast most notably during the January 1, 2024 7.6 magnitude earthquake.

3. Created an official sign language repository in conjunction with the Tsukuba University of Technology. Its initial 16,000 forms the basis for all future sign language capture to be easily expanded.

4. Successfully integrated Kiki as the first-ever virtual ambassador at the 2025 Deaflympics in Tokyo, helping support and demonstrate the need and ease of use of our real-time sign service.

5. We’re already working on future developments. Kiki 2.0 will leverage AI and machine learning to capture more efficiently, and cost-effective

6. We are in talks with several European universities to capture new languages to be used for online courses.

More Entries from Brand-Led Education & Awareness in Health and Wellness

24 items

Grand Prix Cannes Lions
THE LAST BARF BAG

OTC Oral Medicines

THE LAST BARF BAG

DRAMAMINE, FCB CHICAGO

(opens in a new tab)

More Entries from MONKS

17 items

Silver Cannes Lions
KIKI, VIRTUAL HUMAN INTERPRETER

Real-Time Contextual Content

KIKI, VIRTUAL HUMAN INTERPRETER

NHK ENTERPRISES & NHK GLOBAL MEDIA SERVICES, MONKS

(opens in a new tab)