Using data and technology we were able to, for the first time ever, create paintings made from music.

With a 3D-printed tech baton fueled with sensors, we tracked the conductor’s movement while she conducted the 12 greatest classical songs and transformed that data into strokes.

Then we made unique paintings from each song’s movement, hand signed by the conductor. We also made souvenirs, like mugs, calendars, notebooks and magnets.

We made and exhibition with the paintings and each one had a Bluetooth headphone playing the exact song on the paintin

OSESP is the most important Latin America orchestra, but its social projects lives off donations. Instead of asking for it, we invited OSESP’s principal conductor and music director: Marin Alsop to make paintings from classical music.

We created something never seen before. Paintings from music, technologically made.

We did more than simply map the conductors movement through a Kinnect. We made a tech baton, with sensors inside it that don’t interfere in the conducting. It was able to capture even the smallest movement.

Then, we developed a software able to read more than 13 thousand code lines per song and translate it into strokes.

The strokes became paintings and souvenirs to be sold to raise money for OSESP.

The baton has a circuit board built inside it’s pear with 9 freedom sensors: 3 for an accelerometer, 3 for a gyroscope and 3 for a magnetometer. Together, they can precisely capture the smallest movement or rotation from the baton. It also has a USB port for charging. The baton is completely wireless so it doesn’t interfere the conductor.

A good conductor conducts with the tip of the baton, and a bad one with their wrist. And Marin Alsop is one of the greatest. So, even though our circuit board is inside the pear, we made the sensors project itself to the tip of the baton.

A microprocessor translated the sensors data and transferred it to a Bluetooth device that send the information to the computer. Then, a software read the data and transformed it into strokes.

Using data and technology we were able to, for the first time ever, create paintings made from music.

With a 3D-printed tech baton fueled with sensors, we tracked the conductor’s movement while she conducted the 12 greatest classical songs and transformed that data into strokes.

The paintings will be sold on an auction in July.

The souvenirs are already being sold at OSESP’s local store.

Several local news featured the idea and the internet loved it.

The opening night was a success: more than 1000 people came and the visitation number at OSESP increased on all the other days.

The total impact was 1.304.000 impressions.

But most importantly, we created a permanent source of income for OSESP using our own product: music.