Posted in | News | Industrial Robotics

EES Algorithm Empowers Robots to Learn Autonomously

A team of researchers from MIT has been developing a technique known as "Estimate, Extrapolate, and Situate (EES)." This algorithm enables robots to practice and enhance their skills in new environments with minimal human supervision. By allowing robots to adapt and learn autonomously, EES addresses the challenges associated with preparing robots to perform tasks effectively across diverse settings, a crucial step for their broader deployment in real-world applications.

EES Algorithm Empowers Robots to Learn Autonomously
Study: EES Algorithm Empowers Robots to Learn Autonomously. Image Credit: Oselote /Shutterstock.com

Background

The saying "practice makes perfect" is not just for humans—it also applies to robots, especially when they are in new or changing environments. Even though robots can be highly skilled, they can still struggle with unfamiliar tasks or settings. For instance, a robot that is great at placing items in a warehouse might need extra practice to handle picking items from new or different shelves.

This scenario underscores the importance of autonomous learning for robots. In new environments, robots must independently identify and refine the specific skills required for successful task performance. Self-directed learning is crucial for enabling robots to adapt and perform effectively across a range of settings without continuous human intervention.

Research Overview

In this study, the authors developed an EES to tackle challenges in autonomous robot skill refinement. Their algorithm integrates with a vision system that monitors the robot's environment, enabling it to evaluate the reliability of its actions. This assessment predicts whether enhancing a specific skill would improve task performance. The robot then practices the skill, with the vision system assessing its progress after each attempt. This iterative cycle of prediction, practice, and evaluation allows the robot to independently refine its skills and achieve better task outcomes.

The researchers implemented the EES algorithm on Boston Dynamics' Spot quadruped robot, demonstrating its efficacy in real-world scenarios. Equipped with an arm mounted on its back, Spot was able to perform various manipulation tasks. To assess the algorithm's performance, two key experiments were conducted.

In the first experiment, Spot used a three-dimensional (3D) printed handle to facilitate grasping a brush. The robot was tasked with securely placing a ball and ring on a slanted table. Guided by the EES algorithm, Spot focused on improving its manipulation skills through practice sessions. The robot successfully learned to perform this task within approximately three hours.

In the second experiment, Spot was assigned the task of sweeping toys into a bin. The EES algorithm again directed the robot’s practice, this time concentrating on refining its sweeping abilities. The robot achieved proficiency in this task in about two hours, marking a significant improvement compared to previous frameworks, which typically required over 10 hours per task.

Key Findings

The research highlighted the efficiency and effectiveness of the EES algorithm. It demonstrated that EES enabled Spot to quickly learn and improve manipulation tasks after just a few hours of practice, significantly reducing the time required compared to traditional reinforcement learning methods. This efficiency came from EES's ability to focus on specific skills that needed improvement, allowing the robot to concentrate on its practice efforts.

The authors also observed that EES facilitated autonomous learning, enabling the robot to refine its skills without ongoing human intervention. This autonomy was crucial for deploying robots in real-world environments where continuous human supervision was impractical.

Applications

The presented algorithm offers a range of potential applications across various fields. In healthcare, robots utilizing EES could assist with patient care, deliver medication, or disinfect surfaces. In manufacturing, EES could enable robots to adapt to new production lines, enhance assembly processes, or perform quality control.

At home, robots equipped with EES could manage tasks such as cleaning, cooking, or elderly care. In agriculture, EES could support robots in planting, harvesting, or monitoring crops. In logistics, EES could improve warehouse operations, package sorting, and inventory management. Additionally, in disaster response scenarios, robots using EES could navigate hazardous environments, assist with search and rescue missions, or handle dangerous materials.

Conclusion

In summary, the novel EES algorithm improved robotics by allowing robots to learn and enhance their skills autonomously. This innovation could revolutionize how robots adapt to new tasks and environments, leading to more intelligent robots capable of performing complex tasks with minimal human input.

Moving forward, the researchers acknowledged that further development is needed to address limitations, such as reliance on low-to-the-ground tables and occasional object misidentification. They suggested using simulation environments to speed up learning and improve the algorithm's performance. Additionally, they recommended enhancing the algorithm's ability to reason about practice sequences rather than just planning which skills to refine. Overall, this research shows great potential for the future of robotics, leading to robots that can increasingly learn and adapt to new tasks and environments on their own.

Journal Reference

Shipps, A. Helping robots practice skills independently to adapt to unfamiliar environments | A new algorithm helps robots practice skills like sweeping and placing objects, potentially helping them improve at important tasks in houses, hospitals, and factories. Published on: MIT News Website, 2024. https://news.mit.edu/2024/helping-robots-practice-skills-independently-adapt-unfamiliar-environments-0808

Disclaimer: The views expressed here are those of the author expressed in their private capacity and do not necessarily represent the views of AZoM.com Limited T/A AZoNetwork the owner and operator of this website. This disclaimer forms part of the Terms and conditions of use of this website.

Muhammad Osama

Written by

Muhammad Osama

Muhammad Osama is a full-time data analytics consultant and freelance technical writer based in Delhi, India. He specializes in transforming complex technical concepts into accessible content. He has a Bachelor of Technology in Mechanical Engineering with specialization in AI & Robotics from Galgotias University, India, and he has extensive experience in technical content writing, data science and analytics, and artificial intelligence.

Citations

Please use one of the following formats to cite this article in your essay, paper or report:

  • APA

    Osama, Muhammad. (2024, August 20). EES Algorithm Empowers Robots to Learn Autonomously. AZoRobotics. Retrieved on October 09, 2024 from https://www.azorobotics.com/News.aspx?newsID=15166.

  • MLA

    Osama, Muhammad. "EES Algorithm Empowers Robots to Learn Autonomously". AZoRobotics. 09 October 2024. <https://www.azorobotics.com/News.aspx?newsID=15166>.

  • Chicago

    Osama, Muhammad. "EES Algorithm Empowers Robots to Learn Autonomously". AZoRobotics. https://www.azorobotics.com/News.aspx?newsID=15166. (accessed October 09, 2024).

  • Harvard

    Osama, Muhammad. 2024. EES Algorithm Empowers Robots to Learn Autonomously. AZoRobotics, viewed 09 October 2024, https://www.azorobotics.com/News.aspx?newsID=15166.

Tell Us What You Think

Do you have a review, update or anything you would like to add to this news story?

Leave your feedback
Your comment type
Submit

While we only use edited and approved content for Azthena answers, it may on occasions provide incorrect responses. Please confirm any data provided with the related suppliers or authors. We do not provide medical advice, if you search for medical information you must always consult a medical professional before acting on any information provided.

Your questions, but not your email details will be shared with OpenAI and retained for 30 days in accordance with their privacy principles.

Please do not ask questions that use sensitive or confidential information.

Read the full Terms & Conditions.