A March 12 event hosted by the Noiseborder Multimedia Performance Lab allowed attendees to compose and perform music through a virtual reality interface.

Point Line Piano is a project of Jarosław Kapuściński, professor of music composition at Stanford University, in collaboration with digital artists Marc Downie and Paul Kaiser of the OpenEndedGroup.

As participants enter the VR realm, their hands stroke lines to create musical notes, which form melodic phrases and rhythms, while the computer devises intricate visual geometries in response. As the work sets in motion, it surrounds the creator with an audiovisual dance.

“With the headset on, you were transported into an infinite blue space,” explains communication student Sean O’Neil. “Using your hands, you were able to create small beats with lines. Each beat would create a cascading effect through the space — exploding into ripples of orange, red, and yellow. Each beat created a different musical experience that would echo throughout the space. Then, you could use your hands to manipulate the preexisting sonic elements: sometimes causing them to slow, and other times causing them to create a different noise entirely.

“You were able to in many ways compose your own music utilizing an intricate series of visuals in front of you — essentially turning shapes and colour into noise.”

Student Allison Ware tried her hand at drawing a musical masterpiece and describes the experience as magical.

“The expansion of colour and sound in this technological world was unlike anything I had ever experienced before,” she says. “The combination of composed notes, light, graphics and design changed my understanding of the term ‘intermedia’ in an inspiringly futuristic way.

“The cumulative VR performance platform created a seemingly multidimensional and immersive way to experience music, visuals, technology, design and engineering all at once.”

Vu Le calls it an “amazing and unforgettable” experience.

“When I put on the headset, it was incredible to witness something so new and unfamiliar, yet exciting and engaging,” Le says. “I was completely immersed in it and honestly didn’t want to stop.”

In addition to his post in music at Stanford University, Dr. Kapuściński is affiliated with its Department of East Asian Languages and Cultures. His research focuses on intermedia composition, performance, and Japanese traditional aesthetics.