Audio Perception Tools
/ 1 of 1


Role

Concept
Direction
Design
Production

Client

Personal

Credits

Music: Cliff Martinez

Description

A set of small applications that help enhance the perception of music by providing a personal approach to audio visualization.

_

Scope
While working on music videos I have developed a certain technique to memorize music and its finer details. The technique is based on a set of tools I programmed in Processing to help enhance my personal experience of the music. The first version of the tools allows for visualizing perception of space, marks, phases and tempo. The tools consists of recorders and players. First the user records alongside the audio using the mouse. Then the user plays the recorded input with audio for evaluation and study. This method helps memorize the characteristics of the music thus enhancing the perception.

The tools where used in development of Dark and Searchers.
Not available for distribution.


Space Recorder


Moving the mouse in relation to the center controls the size of the perceived space.


Space Player


The perceived space, represented by a 3d object, passes through the playhead, represented by a circle. The user is able to freely rotate, zoom and control the playback of the recording.


Mark Recorder


Pressing space creates a mark on the timeline representing a perceived significant event in the music.


Mark Player


The playhead passes the perceived marks on the timeline in relation to the music.


Tempo Recorder


Moving the mouse vertically controls the intensity of the perceived tempo.


Tempo Player


The playhead passes the perceived tempo on the timeline in relation to the music.


Phase Recorder


Moving the mouse vertically controls the intensity of the selected phase.


Phase Player


The playhead passes the perceived phases on the timeline in relation to the music. In this case blue represents steeldrums, green represents strings, red represents chimes and black represents bass.


 
Alternative Visualization
While developing the audio perception tools I created a small real-time application with an object animated completely by the combined recordings of space, marks, tempo and phases. Space factors overall size, marks creates random orientation and opacity jumps, tempo controls rotation and phases controls the spread of the cones.


Sound Object