Drewing, Nadine ; Ahmadi, Arjang ; Xiong, Xiaofeng ; Sharbafi, Maziar Ahmad (2024)
Comparison of Empirical and Reinforcement Learning (RL)-Based Control Based on Proximal Policy Optimization (PPO) for Walking Assistance: Does AI Always Win?
In: Biomimetics, 2024, 9 (11)
doi: 10.26083/tuprints-00028848
Article, Secondary publication, Publisher's Version
Text
biomimetics-09-00665-v2.pdf Copyright Information: CC BY 4.0 International - Creative Commons, Attribution. Download (2MB) |
Item Type: | Article |
---|---|
Type of entry: | Secondary publication |
Title: | Comparison of Empirical and Reinforcement Learning (RL)-Based Control Based on Proximal Policy Optimization (PPO) for Walking Assistance: Does AI Always Win? |
Language: | English |
Date: | 10 December 2024 |
Place of Publication: | Darmstadt |
Year of primary publication: | November 2024 |
Place of primary publication: | Basel |
Publisher: | MDPI |
Journal or Publication Title: | Biomimetics |
Volume of the journal: | 9 |
Issue Number: | 11 |
Collation: | 19 Seiten |
DOI: | 10.26083/tuprints-00028848 |
Corresponding Links: | |
Origin: | Secondary publication DeepGreen |
Abstract: | The use of wearable assistive devices is growing in both industrial and medical fields. Combining human expertise and artificial intelligence (AI), e.g., in human-in-the-loop-optimization, is gaining popularity for adapting assistance to individuals. Amidst prevailing assertions that AI could surpass human capabilities in customizing every facet of support for human needs, our study serves as an initial step towards such claims within the context of human walking assistance. We investigated the efficacy of the Biarticular Thigh Exosuit, a device designed to aid human locomotion by mimicking the action of the hamstrings and rectus femoris muscles using Serial Elastic Actuators. Two control strategies were tested: an empirical controller based on human gait knowledge and empirical data and a control optimized using Reinforcement Learning (RL) on a neuromuscular model. The performance results of these controllers were assessed by comparing muscle activation in two assisted and two unassisted walking modes. Results showed that both controllers reduced hamstring muscle activation and improved the preferred walking speed, with the empirical controller also decreasing gastrocnemius muscle activity. However, the RL-based controller increased muscle activity in the vastus and rectus femoris, indicating that RL-based enhancements may not always improve assistance without solid empirical support. |
Uncontrolled Keywords: | wearable assistive device, exosuit, exo control, reinforcement learning, PPO |
Identification Number: | Artikel-ID: 665 |
Status: | Publisher's Version |
URN: | urn:nbn:de:tuda-tuprints-288488 |
Additional Information: | This article belongs to the Special Issue: Biologically Inspired Design and Control of Robots: Second Edition |
Classification DDC: | 500 Science and mathematics > 570 Life sciences, biology 600 Technology, medicine, applied sciences > 620 Engineering and machine engineering 700 Arts and recreation > 796 Sports |
Divisions: | 03 Department of Human Sciences > Institut für Sportwissenschaft > Sportbiomechanik |
Date Deposited: | 10 Dec 2024 13:35 |
Last Modified: | 12 Dec 2024 09:37 |
SWORD Depositor: | Deep Green |
URI: | https://tuprints.ulb.tu-darmstadt.de/id/eprint/28848 |
PPN: | 524525668 |
Export: |
View Item |