See Me, Teach Me: Facial Expression and Gesture Recognition for Intelligent Tutoring Systems

Author

Sarrafzadeh, Abdolhossein ; Alexander, Samuel ; Dadgostar, Farhad ; Fan, Chao ; Bigdeli, Abbas

Author_Institution

Inst. of Inf. & Math. Sci., Massey Univ., Auckland

fYear

2006

fDate

Nov. 2006

Firstpage

1

Lastpage

5

Abstract

Many software systems would significantly improve performance if they could adapt to the emotional state of the user, for example if intelligent tutoring systems, ATM´s and ticketing machines could recognise when users were confused, frustrated or angry they could provide remedial help so improving the service. This paper presents research leading to the development of Easy with Eve, an affective tutoring systems (ATS) for mathematics. The system detects student emotion, adapts to students and displays emotion via a lifelike agent called Eve. Eve´s is guided by a case-based system which uses data that was generated by an observational study. This paper presents the observational study, the case-based method, and the ATS

Keywords

case-based reasoning; gesture recognition; intelligent tutoring systems; software agents; Easy with Eve; affective tutoring system; case-based method; facial expression; gesture recognition; intelligent tutoring system; software system; Australia; Emotion recognition; Face detection; Face recognition; Image analysis; Intelligent systems; Kernel; Mathematics; Support vector machine classification; Support vector machines; Affective Computing; Affective Tutoring Systems; Emotion Detection; Human Computer Interaction; Lifelike Agents;

fLanguage

English

Publisher

ieee

Conference_Titel

Innovations in Information Technology, 2006

Conference_Location

Dubai

Print_ISBN

1-4244-0674-9

Electronic_ISBN

1-4244-0674-9

Type

conf

DOI

10.1109/INNOVATIONS.2006.301981

Filename

4085496