LOOK AT 
THE SOUND

Thesis

by Ieva Valule
2014
How does image work as an agent of meaning in a performance of music?

The purpose of this research is to analyze and explore meaningful ways of images depicting sound. This thesis can be used as a theoretical base to create consequential and purposeful audio visualizations in order to benefit to the satisfactory music listening.

In order to find a way to visualize any sounds I am doing a study on intuitive reactions and co-operation of the senses while listening to the music or sounds. I have been researching the neurological phenomenon of synesthesia, in which stimulation of one sense leads to the automatic experience of another sense. Genuinely this phenomenon could take the music listening process beyond its current form. Furthermore, I am analyzing how audiovisual art progressed through out the time. Consequently I express which method I would prefer using in my further artistic practice. In this paper you will also find an interview that reveals the point of view of a music professional about audio visualizations during a performance. 

The anticipated outcome of this research is to explore ways of visualizing music in a graphical way that is based on scientific theories and yet remains to be emotional. Also during this research I search for a context of meaningful audio visualization by summarizing and investigating the practice of other artists that deal with this subject.
"Artistic man can be wholly satisfied only by the unification of all forms of art in the service of the common artistic endeavor. Any fragmentation of his artistic sensibilities limits his freedom, prevents him from becoming fully what he is capable of being… When eye and ear mutually reinforce the impressions each receives, only then artistic man present in all his fullness."

Richard Wagner
INTRODUCTION I
This thesis examines beneficial ways of visualizing sound performance from a graphic designer’s and sonologist’s point of view. Based on my research of historical narrative of audiovisual arts and the phenomenon of chromosthesia – I am trying to find a way in which we can look at the sound during the performance.

I strongly believe that we should cherish an emotional and symbolic connection between the music and visual arts. Even so there is a hypothesis about something more than just an abstract connection between our senses of hearing and seeing.
Based on the available literature this report examines possibilities of - How does image work as an agent of meaning in a performance of music? In the chapter of “Methodology II” you will find a narrative of audiovisual arts. A particular problem area of my research question is to analyze already existing forms of audiovisual arts. Overall there are endless possibilities to visualize sound or music. In this report, you will find examples that are explicitly related to the field of the sonology or graphic design. Each method of the visualizations is concluded with my subjective conclusion and arguments why I would prefer using one or the other method in my further artistic practice.

In the chapter of “Discussion III” you will find an interview with the music professional. I find it important to acknowledge the professional’s point of view in order to accomplish my research with more diverse assumptions.

“Conclusion IX” is summarizing the outcome of my findings - Which means can be chosen in order to create meaningful and yet emotional audio visualizations? Likewise I explain the context of meaningful audio visualization.
Previous experience with visualizing music was a trigger to start this research
Recently I had a fruitful and trilling collaborating with an alumna student from Royal Conservatory The Hague [3] . First Nerea Vera [4] approached me and proposed me to introduce graphic design in one of her percussion concerts by Iannis Xenakis [5]  - Psappha [6]. After the first meeting, she made it clear - that a majority of concerts have a dull atmosphere. She believed that some visuals really could make a change and lighten up the space. We agreed to create visual piece that would represent her music style and characteristics of Iannis Xenakis composition. As a result, I created an animation that was built the way as this piece was composed. Music visualizations were inspired by the dynamic rhythm, mathematical composition structure and muscularity of the piece. (Figure 1)
I did enjoy this “cross field" working method. However I believe that one discipline can learn from the other a lot. It is possible to have surprising results by learning principles from other fields and applying them in the field of graphic design. In fact, I believe that my mission as a graphic designer is to help my clients to stand out and to be seen.

Siamak Anvari approached me with his request and interest in collaboration with me. His request was similar as I described before in the case of Nerea. Siamak is an alumnus of the master program of "Sonology department" of the Royal Conservatory The Hague. Also he faces the same struggle as Nerea. It is hard to attract visitors and fill up the audience since the dull atmosphere of thse events.
[3] The Royal Conservatoire (Dutch: Koninklijk Conservatorium, KC) is a conservatoire in The Hague, providing higher education in music and dance. "Studying at the RC". Koninklijk Conservatorium Den Haag. Retrieved 11 November 2014.
[4] Percussion player and founder of “Music and Movement Den Haag”.
[5] Iannis Xenakis was a Greek-French composer, music theorist, and architect-engineer. http://www.iannis-xenakis.org
[6] Psappha is a musical composition for multi-percussion solo. http://szsolomon.com/notes/xenakis.shtml
Figure 1. Stills from the video visualization for Nerea’s concert.
Video. Duration - 5 min. 30 sec.
METHODOLOGY II
2 Using our senses simultaneously
2.1 Synesthesia is an actual sensation of seeing sound
2.2 Chromesthesia
2.3 Synesthetic experiences in art
2.4 “The man who heard his paint box hiss”
2.5 Visual Rhythms of Piet Mondrian
2.6 The “ticket” to the meaningful image

3 "Instruments"
3.1 “Instruments” for music performance visualizing
3.2 Ocular Harpsichor
3.3 Tireless Inventions
3.4 Lumigraph
3.5 Peculiar Explorations
4 Abstract film and Video
4.1 Early abstract film industry
4.2 Walter Rutman
4.4 Viking Eggeling
4.5 Are abstractions meaningful?

5 VJing
5.1 VJ
5.2 VJ Mary Hallock-Greenewalt
5.3 Art made by machines
5.4 Rather technique then a design approach

6 Stage Design
6.1 Term Stage Design
6.2 United Visual Artists
6.4 Unification
Questions?
Have any questions about my thesis or just want to say hi?
valule.ieva@gmail.com