THOUGHTS ON

‍

‍

Unveiling Meaning Through Music

Imagine being able to hear the story behind the numbers that shape our world. Picture a melody that tells the tale of climate change, a harmony that reveals the struggles of displaced communities, or a rhythm that captures the ebb and flow of life underwater. At KLING KLANG KLONG, we believe that data can become more than just figures on a page—it can transform into a symphony that speaks to the heart and musically interprets the world around us.

‍
How Sonification gives new insights

When we translate data into sound, we aim for an emotional impact that allows us to connect with a topic in a different way. This process, known as sonification, is a powerful tool for introducing a deeper understanding on an emotional level.

Sonification leverages the strengths of the human auditory system, providing a unique and powerful way to perceive, understand, and engage with complex information. This method not only enhances accessibility and emotional engagement but also supports better temporal resolution and attention management, making it a valuable tool for various scientific, medical, and practical applications.
‍

A study published in the "Journal of Experimental Psychology: Applied" (Wiseheart, 2019) found that participants using sonification alongside visual data were able to detect patterns and anomalies in data more effectively than those relying solely on visual representations. This can assist in real-time data monitoring too. By transforming data points into sound parameters, such as pitch, tempo, and intensity, professionals can detect trends or anomalies more quickly, enabling timely decision-making.

At our studio, we approach data sonification with an artistic perspective. When we spoke at TEDxBerlin on Friday, June 21st, we showcased our thinking behind data sonification and how it allows us to present narratives and information in ways that are both stimulating and emotionally resonant with the world we live in.

‍

‍
For Seasons: Transforming Vivaldi's Masterpiece

‍The project "For Seasons" embarked on a profound journey of reinterpreting Vivaldi’s timeless composition, "The Four Seasons," through the lens of climate data spanning three centuries. Working closely with the NDR Orchestra, we explored a range of data categories including temperature variations, CO₂ levels, storm occurrences, and bird population dynamics. Each dataset became a note in our symphonic endeavour and we projected the data into Vivaldi’s Four Seasons.

A poignant example of this creative process lies in the "Spring" segment, where we confronted the stark reality of declining bird populations. By aligning our algorithms with historical bird population data, we made the bold decision to remove 15% of the notes from Vivaldi’s original bird motif. This reduction reflects the drastic decline in bird numbers since Vivaldi’s era, infusing the composition with a sense of loss and environmental urgency.

Beyond avian life, complex variables such as CO₂ levels and temperature fluctuations exerted profound influences on the harmonic structure and temporal flow of the orchestration. Each environmental factor left its indelible mark, shaping the symphony into a living testament to our changing planet.

Today, our algorithmic recomposition stands proudly as part of the United Nations' cultural program, resonating with orchestras worldwide. This initiative not only celebrates artistic innovation but also underscores the emotional power of sonifying data. By translating abstract climate statistics into musical expression, we aim to evoke empathy, provoke contemplation, and foster a deeper connection to the urgent issues facing our global community.

‍

‍
Sonifying the Depths: Fjord and Bælt Underwater Research Lab and Museum

One of our early projects using this approach took place at the underwater research lab and museum in Denmark, Fjord and Bælt. Tasked with creating a musical ambient for a new permanent exhibition in an underwater research station, we sought to use sound as a narrative tool rather than mere background noise.

We gathered data from a nearby weather station and translated these insights into a musical composition filled with narrative depths, dynamic shifts, and harmonious structures. Drawing from underwater recordings, we meticulously shaped textures, tones, and melodies that resonated with the data collected.

Initially tasked with a 10-minute multichannel linear composition, we innovated further by developing an audio engine that generated a 4-hour musical ambient. This extended piece dynamically mirrored the fluctuating weather patterns and their profound impact on the delicate underwater life forms. In this sonic journey, each day is condensed into 40 seconds and each month unfolds over 20 minutes, offering a unique auditory exploration of the year's fluctuations and rhythms.

By blending scientific exploration with artistic expression, we aimed to evoke emotions such as curiosity, wonder and admiration for nature’s complexities, as well as a sense of connection to our underwater ecosystem, while fostering a profound connection between data-driven exploration and sensory engagement.

‍

The Next Frontier

Looking ahead, we are exploring the sonification of semantic content from news outlets and social media to make the emotional impact of public discourse more tangible. We believe that the negative and divisive nature of these information channels is often underestimated.

We are inundated with negativity and the worst aspects of humanity daily. It is within our power to transform this discord into a symphony of hope and love, contributing to a more harmonious world.