BradHayes.info : Research

Current Research Focus

Developing and analyzing methods of training robotic agents through demonstration and human feedback.
Platforms used: Pleo, Nao, Create

To construct flexible systems that can adapt to the changing needs of daily operations, many researchers have proposed to construct robots that learn basic skills which can be re-used in multiple tasks and under varying conditions. In the machine learning community, hierarchical learning (HL) is designed to support skill abstraction and to provide a level of portability to acquired knowledge that improves performance on future tasks. These systems attempt to abstract the critical aspects of a task from multiple demonstrations such that the learned skill can be applied under varying environmental conditions and across different human co-workers.

While traditional hierarchical learning has been successfully applied to a number of real-world robotic tasks in which the robot acts autonomously and does not interact with humans, this method suffers a critical weakness when applied to collaborative scenarios. Division of responsibilities, role identification, and joint actions are left unaddressed, leaving state-of-the-art hierarchical systems inapplicable in collaborative domains. Social Hierarchical Learning (SHL) aims to address these weaknesses. Where traditional hierarchical learning assumes an isolated, autonomous robot which learns and performs on its own, Social Hierarchical Learning develops a collaborative robot that learns portable skills from human guidance and engages in tasks with human co-workers.

SHL leverages and extends the capabilities of state-of-the-art HL systems to operate under realistic human-robot interaction domains. Currently, HL lacks mechanisms to account for multi-agent coordination with humans in the loop, whereas SHL is designed explicitly for it. HL systems excel when presented tasks in which the agent has full environmental awareness and control. Such systems are not intended to handle elements outside the agent's control interacting within its problem space. At its core, SHL is designed to provide the required flexibility in task decomposition and assignment for successful human-robot collaboration.
My Software

v1.0 (Changelog) (Documentation) - Pleo Control Framework v1.0
This Java framework allows for remote control of one or more Pleo robots. Pleo robots are represented as 'Pleo' objects which expose all of the functionality that one can obtain out of its serial or USB port. By exposing the sensor and motor values, as well as allowing the user to manipulate the motor positions via simple function calls, it is very easy to plug your own artificial intelligence into Pleo. Requires RxTx Framework.

While I am releasing this software free to the public, I only ask that you let me know how you are using it and send me any upgrades you make at [bradley.h.hayes (at) yale (dot) edu].

Opening screen, listing all detected
Pleos and their assigned 'brain' types.
A Pleo running with the 'GUIBrain' brain type.