Novel Policy Allows Robots to Perform Interactive Tasks in Sequential Order

Georgia Tech Ph.D. student Niranjan Kumar created the Cascaded Compositional Residual Learning (CCRL) framework, enabling a quadrupedal robot to perform increasingly complex tasks without relearning motions, mirroring human learning, showcased by the robot opening a heavy door using energy transfer, a remarkable achievement in robotics.

The CCRL, however, functions as a “library” that allows the robot to remember everything it has learned while performing the simple tasks. Each newly obtained skill is added to the library and leveraged for more complex skills. A turning motion, for instance, can be learned on top of walking while serving as the basis for navigation skills.

Kumar said CCRL has broken new ground on interactive navigation research. Interactive navigation is one of several navigation solutions that allow robots to navigate in the real world. These solutions include point navigation, which trains a robot to reach a point on a map, and object navigation, which teaches it to reach a selected object.

Interactive navigation requires a robot to reach a goal location while interacting with obstacles on the way, which has proven to be the most difficult for robots to learn.

The key, Kumar said, to get a robot to go from walking to pushing an object is in the joints and the robot discovering the different types of motions it can make with them.

So far, Kumar’s policy has reached 10 skills that a robot can learn and deploy. The number of skills it can learn on one policy depends on the hardware the programmer is using.

“It just takes longer to train as you keep adding more skills because now the policy also has to figure out how to incorporate all these skills in different situations,” he said. “But theoretically, you can keep adding more skills indefinitely as long as you have a powerful enough computer to run the policies.”

Kumar said he sees CCRL being useful for home assistant robots, which are required to be agile and limber to navigate around a cluttered household. He also said it could possibly serve as a guide dog for the visually impaired.

“If you have obstacles in front of someone who is visually impaired, the robot can just clear up the obstacles as the person is walking, open the door for them, and things like that,” he said.