From Research to Social Innovation through Robotics and AI : A Quest

 Ph.D. (Robotics and AI)
Socially Intelligent Robots and Societal Applications, Human Robot Interaction, Cognitive Architecture, Learning

[email protected] (official)

[email protected] (personal)
Chief Technology Officier (CTO) &
Chief Science Officer (CSO)
Hanson Robotics

Socially Intelligent Robot's Capabilities

  1. Human Cooperative Social Robot
    Human Cooperative Social Robot
  2. Reasoning about Humans
    Reasoning about Humans
  3. Situation Assessment for HRI
    Situation Assessment for HRI
  4. Learning in Human-Robot Interaction
    Learning in Human-Robot Interaction
  5. Socially-Aware Manipulation
    Socially-Aware Manipulation
  6. Socially-Aware Navigation and Guide
    Socially-Aware Navigation and Guide

Socially Intelligent Robot's Concerns

  1. Benchmarking and Evaluation
    Benchmarking and Evaluation
  2. Ethical Intelligence & Ethical Issues
    Ethical Intelligence & Ethical Issues
Reasoning About Humans
Perspective Taking, Theory of Mind, Effort...
Development of a coherent functional and theoretical framework for reasoning about robots and humans, and their abilities. Using them for planning proactive and cooperative behaiors.

Mightability Analysis: Multi-Agent Multi-Effort Perspective Taking

Example of multi-agent Perspective Taking analysis (left) Real World (Middle) 3D world model generated nad updated online by the robot (right) Robot's estimation of visible places and objects when agents will put a particular level of effort.

Human-Aware Effort Analysis

Reasoning About Actions and Affordances
Manipulability Graph
Encodes effort based action possibilities betwee agents pairs
Taskability Graph
Encodes effort based action possibilities between agents and objects pairs
Affordance Graph
Encodes different effort affordances in the environment
Situation Assessment for Human-Centered Envrironment

Meanwhile please see:

Amit Kumar Pandey et al., Romeo2 Project: Humanoid Robot Assistant and Companion for Everyday Life: I. Situation Assessment for Social Intelligence, International workshop on Artificial Intelligence and Cognition, Torino, Italy (AIC 2014)

Under Construction...
Learning in Human-Robot Interaction
Robot learning task semantics through dialog based human-robot interaction and demonstration.
Nao robot learning complex functional affordances through dialog based human-robot interaction.
Human Cooperative Social Robots
Jump to 4m15s in the Video
PR2 Robot showing cooperative and proactive behaviors.
PR2 Robot generates a collaborative shared plan to cooperatively clean the table and executes it collaboratively with Human. 
Socially-Aware Manipulation
Same Theoretical and Functional Framewprk, different robots, different tasks, different scenarios
Jump to 55s in the Video
PR2 Robot autonomously planning and performing various tasks: Show, Give, Hide, Make-Accessible in different situations.
HRP2 Robot autonomously planning and performing Show Object task.
Socially-Aware Navigation and Robot Guide
  1. SLAM of Big Area, Sonar Only Sensor
    SLAM of Big Area, Sonar Only Sensor
  2. Passing a person from correct side with comfortable distance.
    Passing a person from correct side with comfortable distance.
  3. Social robot avoids a group of people, not passing amid them
    Social robot avoids a group of people, not passing amid them
  4. Socially-aware path planning in a complex environment
    Socially-aware path planning in a complex environment
  5. Socially-aware robot guide
    Socially-aware robot guide
Benchmarking and Evaluation of Socially Intelligent Robots
Under Construction...
Meanwhile please see:

Pandey, A. K., de Silva, L., & Alami, R. (2016, November). A Human-Robot Competition: Towards Evaluating Robots’ Reasoning Abilities for HRI. In International Conference on Social Robotics (pp. 138-147). Springer International Publishing.
Ethical Issues of Socially Intelligent Robots
Learning Ethical Intelligence though social interaction, a Proof of Concept
Keynote Talk on Ethical, Social and Legal issues for social robots