Title :
A computer music system that follows a human conductor
Author :
Morita, Hideyuki ; Hashimoto, Shuji ; Ohteru, Sadamu
Author_Institution :
Dept. of Appl. Phys., Waseda Univ., Tokyo, Japan
fDate :
7/1/1991 12:00:00 AM
Abstract :
An electronic orchestra with a complex performance database and MIDI (Musical Instrument Digital Interface) controllers is presented. This system responds to the gestures of a conductor through a CCD camera and a sensor glove. The processing of musical information is examined, and the system and its operation are described. It consists of a gesticulation system and the MIDI controllers. The human interface is also discussed. The first professional conductor who tried the system could direct it without special skills or knowledge of either MIDI or a computer. Tests revealed feedback effects on the behavior of the users through their auditory sense, which in turn suggested some ways to determine the parameters of tempo prediction and compensation. The system can play in concert with human performers and even as a part of a symphony orchestra.<>
Keywords :
CCD image sensors; computerised pattern recognition; electronic music; user interfaces; CCD camera; MIDI; Musical Instrument Digital Interface; auditory sense; charge coupled device camera; complex performance database; computer music system; electronic orchestra; gesticulation system; human interface; sensor glove; symphony orchestra; tempo prediction; Charge coupled devices; Charge-coupled image sensors; Conductors; Control systems; Databases; Digital control; Humans; Instruments; Music; Sensor systems;
