Text size
  • Small
  • Medium
  • Large
  • Standard
  • Blue text on blue
  • High contrast (Yellow text on black)
  • Blue text on beige

    E-Bot: A Facial Recognition Based Human- Robot Emotion Detection System

    HCI 2018

    Proceedings of the 32nd International BCS Human Computer Interaction Conference (HCI 2018)

    Belfast, UK, 4 - 6 July 2018


    Rahul Sridhar, Haiying Wang, Patrick McAllister & Huiru Zheng



    There are many Emotion Detection Systems which can understand emotion but are only present for monitoring purposes. Emotional Robots currently available predict emotion with low accuracy. Thus there is a requirement for Emotion Detection Robot which can predict emotion of user with high accuracy. The robot should converse with the user based on their emotion. It should be a companion for the user. In this paper we present the development of the E-Bot system, which enables human-robot interaction based on emotion detected from facial recognition. A mobile app is developed to control the robot and guide the chat. The Google Cloud Vision API and Pre-trained Facial Expression Algorithm are explored and the prediction accuracy, sensitivity and specificity of these two approaches are summarised in this paper. Results show that the proposed E-Bot system could be applied to provide affective care for people living alone at home.


    PDF filePDF Version of this Paper (424kb)