ID: 4523

International research project FLAIROP successfully completed

New AI methods improve picking by robots

The FLAIROP (Federated Learning for Robot Picking) research project, which was sponsored by the German Federal Ministry for Economic Affairs and Climate Action, was concluded at Festo in Esslingen-Berkheim. At the event, all project participants – as well as interested public – were on site or presented their results live from Canada.

Over the past two years, Festo has been conducting joint research with the “Karlsruher Institut für Technologie” (KIT) and partners from Canada (University of Waterloo, Darwin AI) to make picking robots more intelligent using distributed AI methods. To do this, the partners investigated how robots can learn from each other without sharing their training data. This approach – called Federated Learning – allows to develop more robust and efficient AI than it would be possible with data from just one robot – without handing out sensitive company data.

"We are proud that we have succeeded in showing that robots can learn from each other without sharing sensitive data and company secrets. This protects our customers' data and we also gain speed because the robots can take over many tasks faster this way. For example, the collaborative robots can help production workers with repetitive, heavy and tiring tasks," says Jan Seyler, Head of Advanced Development Analytics and Control.

"We have developed a universal, simulation-based data set that we can use to train autonomous gripping robots in such a way that they are able to reliably grasp items that they have not seen before," explains Maximilian Gilles from KIT. In the future, the Federated-Learning System will be further developed so that the platform enables different companies to train robot systems together without having to share data among themselves. This can increase the acceptance of such systems in practice.

Federated Learning revolutionizes picking through robotics
Federated Learning is a machine learning technique to create privacy-preserving AI applications. Instead of sending the training data of the robotic arms in the picking cells to a central server to train the model there, the training takes place at many different locations. The locally trained models are then sent to the central machine learning server so that the sensitive training data does not leave the data provider. Nevertheless, Federated Learning enables learning across data silos by aggregating the distributed models and ultimately enabling highly accurate and data-driven prediction of object recognition and grasping point detection.

The robot arms in the picking cells are equipped with cameras to visually detect the items in front of them. Based on the camera image, the robot arms automatically recognize the different items and select a suitable gripping method. Due to the variety of items in a warehouse, this is a complicated task and large amounts of data are needed to achieve reasonable results. Creating such large amounts of data is time consuming. With data collected from picking cells in different organizations, it was possible to improve the grasping point detection of the cells.  

During the project, a total of five autonomous picking stations were set up for training the robots: Two at the KIT Institute for Materials Handling and Logistics Systems (IFL) and three at Festo SE & Co. KG based in Esslingen am Neckar.

Project completion: Now it's time for practice

At the final event, Festo focused on the usability of the results. Jan Seyler: "We are showing which Festo products it can be incorporated into." The research results will now be published and can be freely used by all interested parties in initial pilot projects."

费斯托 (Festo)是一家全球性的独立的家族企业,总部位于德国埃斯林根。自成立以来,Festo在工业自动化技术和技术教育方面制定标准,从而为环境、经济和社会的可持续发展做出贡献。公司为超过35个行业的30万家工厂和过程自动化客户提供气动和电驱动自动化技术解决方案,其中生命科学和实验室自动化业务受到越来越多的关注。Festo产品和服务遍布176个国家。2022年,费斯托在全球61个国家的250多个分支机构拥有约20800名员工,实现销售额38.1亿欧元。每年约7%的销售额用于研发。在这家学习型企业,1.5%的销售额用于基础和进一步培训。Festo 教学培训 (Didactic SE) 是全球领先的技术教育和培训供应商,为全球客户提供工业环境中全面的数字化和常规学习解决方案。

© Festo SE & Co. KG
Research Project FLAIROP
International research project FLAIROP successfully completed - the project partners from left to right: Kai Sandmann (Federal Ministry for the Economy and Climate Protection), Maximilian Brock (DLR), Daniel Brauchle (Advanced Development...