Title :
Multisensory surgical support system incorporating, tactile, visual and auditory perception modalities
Author :
Constantinou, Christos E. ; Omata, Sadao ; Murayama, Yoshinobu
Author_Institution :
Stanford Univ. Med. Sch., CA, USA
Abstract :
The incorporation of novel broad band sensory modalities, integrating tactile technology, with visual and auditory signals into the evolution of the next generation of surgical robotic is likely to significantly enhance their utility and safety. In this paper considerations are made of a system, where tactile information together with visual and audio feedback are integrated into a multisensory surgical support platform. The tactile sensor system uses a piezoelectric transducer (PZT) system to evaluate the haptic properties of tissues. The spatial position of the sensor is tracked by a video camera, visualizing the location of the marker. Tactile information is additionally converted to an audio signal, to represent tissue properties in terms of a frequency/amplitude modulated signal. Representative data were obtained from biological tissues demonstrating that the technology developed has potential applications in virtual systems or robotic tele-medical care. In view of these technical developments, consideration is made as to whether visual audio and tactile modalities act as independent sources of information.
Keywords :
audio signal processing; data visualisation; haptic interfaces; medical robotics; surgery; tactile sensors; telemedicine; touch (physiological); video signal processing; amplitude modulated signal; audio feedback; auditory perception; auditory signals; biological tissue; broad band sensory; frequency modulated signal; multisensory surgical support platform; multisensory surgical support system; piezoelectric transducer system; robotic telemedical care; surgical robotic; tactile information; tactile perception; tactile sensor system; tactile technology; tissue haptic properties; video camera; virtual system; visual feedback; visual perception; visual signals; Biosensors; Evolution (biology); Feedback; Haptic interfaces; Piezoelectric transducers; Robot sensing systems; Robot vision systems; Safety; Surgery; Tactile sensors;
Conference_Titel :
Computer and Information Technology, 2004. CIT '04. The Fourth International Conference on
Print_ISBN :
0-7695-2216-5
DOI :
10.1109/CIT.2004.1357304