Title :
SEED Framework of Early Language Development: The Dynamic Coupling of Infant–Caregiver Perceiving and Acting Forms a Continuous Loop during Interaction
Author :
Zukow-Goldring, P. ; de Villiers Rader, N.
Author_Institution :
Center for the Study of Women, Univ. of California, Los Angeles, Los Angeles, CA, USA
Abstract :
The research and theory described here evolved from fine-grained descriptions of early word learning based on videotapes of infants and their families in the US and Mexico. This naturalistic approach led to theorizing about the perceptual processes underlying the caregiver´s role in assisting infants´ early word learning. Caregivers educate infants´ attention by synchronizing the saying of a word with a dynamic gesture, a show, in which they display the object/referent to the infant. By making this perceptual information prominent, infants can detect an amodal invariant across gesture and speech. Doing so brackets the word and object within the auditory and visual flow of events and constitutes the basis for perceiving them as belonging together. Stemming from the earlier naturalistic work, we designed eye-tracking experiments to test three hypotheses: 1) infants will attend more to an object when the referring word is said if the speaker uses a dynamic, synchronized show gesture, rather than a static or asynchronous gesture; 2) a show gesture will be most effective in drawing attention away from the mouth to the object when the referring word is spoken; and 3) the use of a show gesture will lead to enhanced word learning. These experiments confirmed our hypotheses, establishing that infants detected referent-word relations best when the speaker used a show gesture. These results support the SEED Framework of early language development which delineates how the situated, culturally embodied, emergent, and distributed character of caregiver-infant interaction nurtures communicative behavior. The ability to communicate germinates and takes root during social interaction, as the dynamically-coupled perceiving-and-acting of infants and caregivers forms a continuous loop, each of them unceasingly affecting the other. These findings have implications for the design of cognitive systems in autonomous robots, especially “tutor spotting” and detecting &#x- 01C;acoustic packages.”
Keywords :
cognition; gesture recognition; interactive video; linguistics; natural language processing; paediatrics; speech; SEED framework; acoustic packages; amodal invariant across gesture; amodal invariant across speech; auditory flow; autonomous robots; caregiver-infant interaction; cognitive system design; communicative behavior; continuous loop; dynamic gesture; dynamic-coupled perceiving-acting; early language development; eye-tracking experiments; fine-grained descriptions; infant-caregiver; perceptual information; social interaction; stemming; synchronized show gesture; tutor spotting; videotapes; visual flow; word learning; Laboratories; Mouth; Speech; Synchronization; Videos; Visualization; Human voice; learning system; natural language processing; psychology; speech processing;
Journal_Title :
Autonomous Mental Development, IEEE Transactions on
DOI :
10.1109/TAMD.2013.2279556