Human-Robot Interaction

A robotic bear as a learning companion

Dec 11, 20153 min read
Assembled prototype of the robotic bear
Undergraduate thesis: Penagos Dordevic, Daniel José. Desarrollo de un asistente de aprendizaje robótico personal. Universidad de los Andes, 2015.

Robots such as Keepon, Pleo or Paro have shown that a body that moves expressively holds a person's attention in a way a screen does not. This project applies that idea to studying: a teddy bear with six joints reads a card, asks a question aloud, waits for the answer on two buttons, and reacts with a gesture of joy or sadness. The prototype was built for about 310,000 Colombian pesos and works. It was not evaluated with children.

Mechanical design

The bear is seated, so the waist serves as a fixed base. Each side has three joints: hip, shoulder and arm.

Degrees of freedom

The six degrees of freedom of the design

The mechanical problem is at the hip. Its motors have to move the whole upper structure, and if the shoulder motors sit at the shoulders, the moment the hip has to overcome is large. A four-bar linkage was synthesized that brings the shoulder motors down to the waist and transmits the rotation upward.

Hip torque

Torque required at the hip, with and without the four-bar linkage

With the linkage, the torque required at the hip drops over the whole range of motion, which made it possible to use small, low-cost servos at all six joints.

Internal structure

Model of the internal structure of one side of the bear

The structure combines 3D-printed parts and laser-cut acrylic. The stuffing was distributed in compartments so it would not interfere with the mechanism, and the plush was sewn with support from the Design Department.

Interaction

A webcam looks for QR codes. Each card carries a code associated with an audio file containing the question and with its correct answer.

Cards

QR-coded cards by subject area

The program, in MATLAB, follows a state machine. It greets, waits, reads the card, plays the question, receives the answer from the true and false buttons through an Arduino, and chooses the reaction. If some time passes with no cards, the bear talks or dances to regain attention.

State machine

State machine of the game

Gestures were defined as positions of the six joints: wait, greet, sad, happy, still and dance.

Greeting gesture

Initial and final position of the greeting gesture

What is missing

The claim that the movements hold the child's attention and stimulate learning is the project's hypothesis, not a result: there were no user tests. The system depends on an external computer running MATLAB, a camera and a speaker, so it is not yet a standalone toy. Questions are true or false and prerecorded.

How it fits in Robiolab

This project is not bioinspired in the mechanical sense, but it addresses a topic the lab took up again years later from another angle: how a robot communicates with a person. Here the answer is body gesture. In recent work it is language, as in the reasoning for a humanoid with language models. The technical contribution that lasts is the use of mechanism synthesis to relocate actuators near the base and reduce loads, the same strategy as the distal actuators of the elbow orthosis.

Social roboticsMechanism synthesisFour-bar linkageEducation