What was the day like when Monet painted his “Water Lilies”?

What if we could breathe the same air as the scenery captured in an artwork?

?uration is the project that creates a new way of encountering art through the use of air. We utilized AI technology to analyze landscape paintings and succeeded in estimating the temperature and humidity of the painted sceneries.

We made the liquid crystal display in the shape of picture frame. It shows the landscape painting’s temperature and humidity score similar to the viewer’s world. By linking the viewer’s world and the world inside the painting, we created a new way for viewers to experience the painting’s atmosphere through the frame.

The landscape paintings are drawn on the canvas by the painters seen and thought in their brain who lived in the real world of that period. But in modern times, the art experience is merely that just looking at the pictures in art museums.

We succeeded in creating a new art experience by connecting the atmosphere between viewers and the artist.

In this project, we had to prepare an abundant sample data as we used deep learning to estimate the scenery's temperature. Then, we built a dataset made by geotagged and time stamped picture about 6.7M samples to unite public domained picture dataset(Yahoo Flickr Creative Commons 100M) and geometroligical dataset(Global Historical Climatology Network)

We trained a deep learning model with the dataset and created an AI that can estimate the temperature and humidity of the image. By using the AI, we have succeeded in estimating “the painting’s world’s” temperature and humidity scores. Those scores of the viewers’ environment are acquired in real-time and entered into the AI. The AI then refers to public domain data on paintings which has been made available by art galleries all over the world.

By placing themselves within the world of the painting, viewers can breathe the same air as the painted scenery and experience art in a new, immersive way.

?uration was unveiled at Art Fair Tokyo (the biggest art trade fair in Japan) that was held between March 7 and March 10, 2019.

By recreating the same atmosphere, it bridges the art at the time and the present to demonstrate a new way of discovering art.