• DocumentCode
    110297
  • Title

    Hire me: Computational Inference of Hirability in Employment Interviews Based on Nonverbal Behavior

  • Author

    Nguyen, Lam S. ; Frauendorfer, Denise ; Mast, Marianne Schmid ; Gatica-Perez, Daniel

  • Author_Institution
    Idiap Res. Inst., Martigny, Switzerland
  • Volume
    16
  • Issue
    4
  • fYear
    2014
  • fDate
    Jun-14
  • Firstpage
    1018
  • Lastpage
    1031
  • Abstract
    Understanding the basis on which recruiters form hirability impressions for a job applicant is a key issue in organizational psychology and can be addressed as a social computing problem. We approach the problem from a face-to-face, nonverbal perspective where behavioral feature extraction and inference are automated. This paper presents a computational framework for the automatic prediction of hirability. To this end, we collected an audio-visual dataset of real job interviews where candidates were applying for a marketing job. We automatically extracted audio and visual behavioral cues related to both the applicant and the interviewer. We then evaluated several regression methods for the prediction of hirability scores and showed the feasibility of conducting such a task, with ridge regression explaining 36.2% of the variance. Feature groups were analyzed, and two main groups of behavioral cues were predictive of hirability: applicant audio features and interviewer visual cues, showing the predictive validity of cues related not only to the applicant, but also to the interviewer. As a last step, we analyzed the predictive validity of psychometric questionnaires often used in the personnel selection process, and found that these questionnaires were unable to predict hirability, suggesting that hirability impressions were formed based on the interaction during the interview rather than on questionnaire data.
  • Keywords
    behavioural sciences; human resource management; industrial psychology; regression analysis; social sciences computing; behavioral feature extraction; employment interviews; hirability automatic prediction; hirability computational inference; job applicant; marketing job; nonverbal behavior; organizational psychology; regression method; ridge regression; social computing problem; Employment; Feature extraction; Interviews; Psychology; Sensors; Social network services; Visualization; Employment interviews; hirability; nonverbal behavior; social computing;
  • fLanguage
    English
  • Journal_Title
    Multimedia, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1520-9210
  • Type

    jour

  • DOI
    10.1109/TMM.2014.2307169
  • Filename
    6746207