Aude Billard

During her master's degree at the University of Edinburgh, Billard focused on learning how to build Knowledge-Based Systems, essentially computer programs that are built on fundamental frames, concepts, and logical assertions from the real world but with the ability to perform inferences and derive new knowledge through reasoning systems. Billard’s Master’s thesis, titled “Allo Kazam, do You Follow Me? or Learning to Speak Through Imitation for Social Robots”, focused on the goal of building a system that could develop communication abilities. She developed a system that was capable of learning simple syntactical language and she used two mobile and autonomous robots, acting as teacher and student, to implement the architecture. With an emphasis on simplicity and generalizability, Billard was able to ensure that neither specificities about the environment nor the particular robotic agent were necessary for success of the architecture in practice.

In Billard’s graduate thesis, she described her work implementing imitation learning in autonomous robots through applying her innovative connectionist model designed for robot learning called DRAMA (Dynamical – Recurrent – Associative – Memory – Architecture). To develop DRAMA, Billard used an anti-objectivist framework, distinguishing between cognitive and behavioral skills. This framework ensures that the behavior of one robot takes into account its previous interactions, since behaviors are performed in relation to the social environment with which the robot exists. The framework also takes into account the internal state of the robot, essentially the computations representing the robots own actions. She uses this model in various scenarios in which a human or a robot is the instructor teaching a student robot to build symbolic representations of the world, learn a synthetic proto-language, or perform specific imitative movements.

Billard is an active member of both the local and international research communities she is a part of. Billard is the elected president of the EPFL Teaching Body Assembly, elected president of the EPFL Teachers’ Council, a member of the Swiss Science and technology Council, the Swiss Academy of Engineering Sciences, a Fellow of the computer science department at the University of Hertfordshire, a senior editor of the IEEE Transactions in Robotics, a member of the advisory board of Ecole des Mines & Telecommunication in Paris, and the associate editor of the International Journal of Social Robotics.

In 2018, Billard and her colleagues developed a method to teach robots to modify their tasks based on human physical interactions and interference. By updating the parameters of their dynamical system to account for desired trajectory versus trajectory of the human interference, they were able to test their approach in real world experiments where robots successfully learned how to adjust their movements in relation to human interactions.

In 2016, Billard and her students won multiple awards for their paper 'Coordinated multi-arm motion planning: Reaching for moving objects in the face of uncertainty'. In this work, Billard and her students proposed a virtual object based dynamical systems control law that could generate autonomous and synchronized movements for a multi-arm robotic system. They were able to validate their approach using a dual-arm robotic system and they found that it was able to adapt and coordinate the motion of each arm to catch flying objects at high speeds and with uncertainty in trajectory.

Billard and her team have also implemented hierarchical knowledge systems to allow robots to learn both high-level complex task plans as well as lower level movements after demonstrations. Their work in 2016 showed that by combining a variant of a Hidden Markov Model with an algorithm that outputs transition probabilities, they were able to learn both low-level motor patterns during specific behaviors as well as the probability of a transition to the next behavior in the sequence. Billard and her colleagues further improved robotic learning of task sequences publishing their methods in the Proceedings of Machine Learning Research in 2017. They combined linear parameter varying systems, to enable the learning of task sequences, with hidden Markov Models, to learn complex control policies of each subgoal/subtask, and were able to validate their approach using two different human demonstrations.

In 2015, Billard and her colleagues used electromyographic EMG recordings to decode grasping intentions at early stages of grasping, as these stages are important for early estimation of final hand position and generation of smooth gestures. With 90% accuracy, they were able to decode three typical grasps, which provides a novel and effective approach to coordinating a subjects arm movements with a robotic hand to generate a natural pattern of motion.

Using biologically inspired robotic models, Billard has been able to improve the ability of robots to learn precise and complex motor skills. In 2011, Billard highlighted the power of dynamical systems in controlling fine robot movements and generalizing those movements within different contexts. Billard and her team used golf putting as a task to explore the ability of the robot to learn complex motions and adapt to changes in position, speed, and target location. When they allowed the robot to learn from the failed attempts at putting the golf ball into the hole, just as a human would learn from failure, the robot began to perform better as it gained information regarding the precise speed patterns and orientations from both successful and failed attempts at sinking a put. Shortly after Billard published these astonishing results of the motor learning capabilities of robots, she showed that she could also teach robots to catch objects in flight. The video of their robot catching objects in flight has been viewed millions of times on YouTube and their publication in IEEE was the most frequently downloaded document in the journal.

Her leadership within the IEEE is longstanding as she served as an elected member of the administrative committee of the IEEE Robotics and Automation Society for two terms, from 2006 to 2011, and is currently the chair of the IEEE Robotics and Automation Society Technical Committee on Humanoid Robotics. From 2013 to 2014 she served as the associate editor of the IEEE Transactions in Robotics and she was the industry forum chair for the IEEE Robotics and Automation Society Committee in 2015.

In 2006, Billard began adding social cues to interactions between humanoid robots to improve the ability of humanoids to switch between learning and reproduction phases in an imitation framework. She found that implementing a gesture recognition system and using motion sensors, as well as a Hidden Markov Model to extract the essential components of the social cues, produced more life-like behaviors in a social learning task.

In 2001, Billard proposed a biologically plausible model of human imitation and discussed its applicability in robot teaching. The model was able to learn the principal features of an arm trajectory in a throwing/catching imitation task, was able to generalize across different demonstrations, was able to learn on-line, and its movements were robust to perturbations. Billard continued to explore more biologically inspired connectionist architectures with which to train robots to learn complex arm movements by imitation. She based her artificial neural networks on brain regions such as the visual and motor cortices and incorporated a decision making occurs region as well. This allowed Billard’s model to imitate a teacher just as well as a human subject would imitate in the same task. Billard continues to base her computational approaches on biological systems and began to explore how implementing neuromodulatory mechanisms in neural networks produce tune-able pattern generation as they would in the human brain. Further, Billard and her colleagues began to implement neurobiological concepts such as homeostatic plasticity, Hebbian reinforcement learning, and hormone feedback into their neural networks to again provide adaptability and flexibility like that exists in the human brain.

In 1999, Billard was appointed research associate in the computer science department at the University of Southern California. The following year, she was promoted to research assistant professor, a title she held until 2002. She was then appointed to adjunct professor at USC as well as assistant professor of the School of Engineering at EPFL. While maintaining her adjunct professorship at USC, Billard was continually promoted at EPFL. In 2005, Billard was promoted to associate professor with tenure, and then in 2013 she was promoted to full professor of the School of Engineering at EPFL. Her research and laboratory work have focused on using machine learning to control and design robotic systems meant to interact with humans. Her laboratory at EPFL is called the Learning Algorithms and Systems Laboratory (LASA), which started in 2006, and is widely known for training robots to perform skills with the level of dexterity of a human. The main facets of research her laboratory currently explores are: human-robot interaction, machine learning with applications to robotics, fast adaptive control, dexterous manipulations and grasping, as well as computational neuroscience and cognitive modelling. All of their research works towards developing robotic systems that are able to adapt to fast changes, interact with humans and other robots in a humanistic way, and learn from teachers as well as from previous experiences.

Billard completed her PhD in 1998 and then moved back to Switzerland to pursue her postdoctoral studies at EPFL and The Swiss Artificial Intelligence Lab (IDSIA or Instituto Dalle Molle di Syudi sull’Intelligenza Artificiale) until 1999.

After completing her degrees at EPFL, Billard pursued further education at the University of Edinburgh in the Department of Artificial Intelligence. Billard first completed another Masters of Science in 1996, this time in Knowledge Based Systems, and then continued at the University of Edinburgh completing her PhD in Artificial Intelligence.

Aude G. Billard (born c. August 6, 1971) is a Swiss physicist and pioneer in the fields of machine learning and human-robot interactions. As a full professor at the School of Engineering at Swiss Federal Institute of Technology in Lausanne (EPFL), Billard’s research focuses on applying machine learning to support robot learning through human guidance. Billard’s work on human-robot interactions has been recognized numerous times by the Institute of Electrical and Electronics Engineers (IEEE) and she holds currently holds a leadership position on the executive committee of the IEEE Robotics and Automation Society (RAS) as the vice president of publication activities.

Billard was born in Lausanne, Switzerland, on August 6, 1971. She stayed in Switzerland and pursued a Bachelor of Science in physics at the Swiss Federal Institute of Technology at Lausanne (EPFL). After graduating in 1994, Billard stayed at EPFL for one more year to complete her Master of Science in physics. During her time at EPFL, she specialized in Particle Physics and conducted research at the European Center for Nuclear Research (CERN).