Behavior sampling: a recording mechanism for visually based teleoperation

Proposes a visually based teleoperation with accumulation method and system where the visual and control information sequences are stored and available for syntactically indexed playback. Visually based teleoperation systems heretofore described in the literature unfortunately can only display an instantaneous representation of the control sequence. Past control experience should instead be accumulated and available to facilitate teleoperators. In this paper, the behavior sampling extraction theory and method, the behavior sampling data representation, and portions of the status on demand function-set are introduced. Behavior sampling utilizes semiotic analysis of the teleoperator control behavior to syntactically segment the control motions and the relevant visual objects into a syntactically indexable storage stream. A preliminary system used for manipulating single biological cells under an optical microscope (fitted with a video camera) is described. Repetitive manipulation experiments on Mato fluorescent granular perithelial (FGP) cells show the effectiveness of this enhancement to the visually based control approach