iPhones as musical instruments

Building a Mobile Phone Ensemble, believed to be the first such course in the world, is taught by Georg Essl, a computer scientist and musician who has been driving the development of mobile phones as musical instruments.

Several years ago, Essl and his colleagues were the first known to use the microphone as a wind sensor—a tactic that enables popular iPhone apps such as the Ocarina. Ocarina essentially turns the phone into an ancient type of flute.

"The mobile phone is a very nice platform for exploring new forms of musical performance," Essl said. "We're not tethered to the physics of traditional instruments. We can do interesting, weird, unusual things.This kind of technology is in its infancy, but it's a hot and growing area to use iPhones for artistic expression."

To build an instrument on an iPhone, you program the device to play back as sound information it receives from one if its multitude of sensors. The touch-screen, microphone, GPS, compass, wireless sensor and accelerometer can all be transformed so that when you run your finger across the display, blow air into the mic, tilt or shake the phone, for example, different sounds emanate.

The students,who design, build and play instruments on their smartphones, performed their first concert on Dec. 9.