TY - JOUR ID - 41122 TI - Optimal Strategy for Sit-to-Stand Movement Using Reinforcement Learning JO - Journal of Rehabilitation Sciences & Research JA - JRSR LA - en SN - 2345-6167 AU - Jamali, Saeed AU - Taghvaei, Sajjad AU - Haghpanah, Seyyed Arash AD - School of Mechanical Engineering, Shiraz University Y1 - 2017 PY - 2017 VL - 4 IS - 3 SP - 70 EP - 75 KW - Sit-to-stand KW - optimal control KW - reinforcement learning KW - human dynamic model DO - 10.30476/jrsr.2017.41122 N2 - Background: Sit-to-stand motion is a frequent and challenging task in daily lifeactivities especially for elderly and disabled people. Central nervous system usesseveral strategies for sit-to-stand movement. Many studies have been conductedto understand the underlying basis of the optimal approach. Reinforcementlearning (RL) is a suitable method for modeling the control strategies that occurin neuro-musculoskeletal system.Methods: In this paper a dynamic model of human sit-to-stand was derived, andkinematic data of a healthy subject has been extracted in this task. An optimalcontrol problem was formulated considering minimum energy and Q-Learningmethod has been utilized to find the optimal joint moments during sit to standmovement.Results: The simulation results have been compared to the experimental data.The lower extremity joint angles have been simulated and tracked the actualhuman angles extracted from the experiments. Also the joints moments showeda satisfactory precision by the proposed approach.Conclusion: An RL-based algorithm was used to model the human sit-to-stand,in which the model explores the state space with a Markov based approach andfinds the best actions (joint moments) at each state (posture). In this approach themodel successfully performs the task while consuming minimum energy. Thiswas achieved by updating the algorithm in every trial using a Q-learning method. UR - https://jrsr.sums.ac.ir/article_41122.html L1 - https://jrsr.sums.ac.ir/article_41122_e7383adf8fe1dd63d1d836301483f310.pdf ER -