Now is a time when we are limited in our ability to feel the physical presence of other people or to even go outdoors. YAKUSHIMA TREASURE was looking for a way to deliver its music.

However, they thought it would be difficult to surpass the quality of a live performance by simply distributing video.

We were required to create a completely new shared experience of live performance that was different from the real live experience, and different from the streaming live video experience of the past.

This work allowed audiences to experience an entirely new way of taking in a concert that is different from both regular video captured with a camera and from a scene observed with the human eye.

Rather than recording video of this musical performance about the cycle of rebirth, we captured a world "seen by spirits" in the form of data.

We recorded their live performance in Yakushima using a variety of technologies.

Space: 360° LiDAR Scan

The entire forest was scanned as 3D point cloud data with a LiDAR sensor.

Colors and textures: Photogrammetry

Photogrammetry employing over 1,500 high-resolution photographs enabled expression of colors and texture as though from a painting.

Motion: Volumetric Video

Nine depth cameras were used. They recorded 3D data that captured absolutely all of the movement and expression from a one-time-only performance.

Sound Field: Spatial Audio

360° microphones in a surround sound system using eight speakers recorded the audio.

The live performance, reconstructed from the recorded data, is exported with color/depth/camera information and can be viewed on the website.

In this way, there are no physical constraints on camera angles, and viewers can get so close to the artist that the distance between them disappears, fly around in the forest, and watch the performance from any perspective.

Furthermore, by using WebGL to process the data of color, depth, camera information, and other viewers' perspectives, real-time data can be synthesized into the pre-rendered video space without any sense of discomfort, making it possible to experience the live performance while feeling the presence of other viewers.

On the website, the dynamic camera work of PointCloud, the gothic typography that reminds us of people's historical years, and the fine lines that constantly change shape and waver express the reincarnation of life and the dynamism of life felt from the nature of Yakushima.