Data-driven Human-Robot Interaction

Researchers: Pieter Wolfert, Tony Belpaeme, in collaboration with Emmanuel Senft (University of Madison - Wisconsin), Bahar Irfan (University of Plymouth), Severin Lemaignan (Bristol Robotics Lab), Judith Holler (MPI Nijmegen)

While robots are increasingly found interacting with people, building the artificial intelligence for the robots’ social cognition tends to be a challenge. For simple applications, the interaction between the user and the robot can still be hand-coded, but soon programming social behaviour reaches its limits. On the one hand, because the interaction design becomes overly complex, on the other hand, because social interaction is almost impossible to capture in rules. The fickleness of social interaction, This is where data-driven methods come in. Starting from data collected of people interacting with each other, we use machine learning methods to interpret social behaviour and to produce robot behaviour which not only is more humanlike but which can also deal with situations that the robot has never encountered before.


  1. The DREAM dataset : supporting a data-driven study of autism spectrum disorder and robot enhanced therapy
    Billing, Erik, Belpaeme, Tony, Cai, Haibin, Cao, Hoang-Long, Ciocan, Anamaria, Costescu, Cristina, David, Daniel, Homewood, Robert, Garcia, Daniel Hernandez, Esteban, Pablo Gomez, Liu, Honghai, Nair, Vipul, Matu, Silviu, Mazel, Alexandre, Selescu, Mihaela, Senft, Emmanuel, Thill, Serge, Vanderborght, Bram, Vernon, David, and Ziemke, Tom
    PLOS ONE 2020
  2. Teaching robots social autonomy from in situ human guidance
    Senft, Emmanuel, Lemaignan, Séverin, Baxter, Paul E., Bartlett, Madeleine, and Belpaeme, Tony
  3. The PInSoRo dataset : supporting the data- driven study of child-child and child-robot social dynamics
    Lemaignan, Severin, Edmunds, Charlotte E. R., Senft, Emmanuel, and Belpaeme, Tony
    PLOS ONE 2018