volume | PIER Journals

Abstract

Human intention recognition is important for any interaction between the user and the exoskeleton. This study proposes a novel approach, based on a contactless sensory system, using linear Hall effect sensors to recognize human intentions. This contactless sensory system consists of four Hall effect sensors mounted on the exoskeleton, whilst a ring-shaped permanent magnet with diametrical magnetization consisting of two semi-rings is worn on the user's forearm. The model of the magnetic field created by the permanent magnet is also developed. Based on the developed magnetic field model and by interpreting the signals from the Hall effect sensory system received while the user's elbow and forearm move, the intention identification algorithm is derived. A lightweight elbow and forearm assistive exoskeleton is developed. The proposed approach for human intention recognition is used to assist in controlling the exoskeleton, following the wearer's intended motions. By implementing this contactless sensory system, wearers can use the exoskeleton easily and can move their forearm comfortably, while the human intention motion is recognized and used to control the exoskeleton. Moreover, achieved signals are unaffected by skin perspiration and muscle fatigue. As the sensory system is mounted on the exoskeleton, there is only indirect contact between the user's body and the sensors, leading to improved comfort. Finally, the system does not require expert knowledge to place the sensors on the body of the user. This approach can be extended to detect human intentions for the control of exoskeletons with more degrees of freedom.

1. Rahman, M. H., C. O. Luna, M. Saad, and P. Archambault, "EMG based control of a robotic exoskeleton for shoulder and elbow motion assist," Jounal of Automation and Control Engineering, Vol. 3, No. 4, 270-276, 2015.

2. Kiguchi, K. and Y. Hayashi, "An EMG-based control for an upper-limb power-assist exoskeleton robot," IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), Vol. 42, No. 4, 1064-1071, Aug. 2012.

3. Andreasen, D. S., S. K. Alien, and D. A. Backus, "Exoskeleton with EMG based active assistance for rehabilitation," Proceedings of the 9th International Conference on Rehabilitation Robotics, 2005, ICORR 2005, 333-336, 2005.

4. Lenzi, T., S. M. M. De Rossi, N. Vitiello, and M. C. Carrozza, "Intention-based EMG control for powered exoskeletons," IEEE Transactions on Biomedical Engineering, Vol. 59, No. 8, 2180-2190, Aug. 2012.

5. Rahman, M. H., C. O. Luna, M. Saad, and P. Archambault, "Motion control of an exoskeleton robot using electromyogram signals," Proceedings of Advances in Robotics, Mechatronics and Circuits: 18th International Conference on Circuits (Part of CSCC'14), 2014 International Conference on Mechatronics and Robotics, Structural Analysis (MEROSTA 2014), ISBN: 978-1-61804-242-2, 2014.

6. Kiguchi, K., T. Tanaka, and T. Fukuda, "Neuro-fuzzy control of a robotic exoskeleton with EMG signals," IEEE Transactions on Fuzzy Systems, Vol. 12, No. 4, 481-490, Aug. 2004.

7. Tang, Z., K. Zhang, S. Sun, Z. Gao, L. Zhang, and Z. Yang, "An upper-limb power-assist exoskeleton using proportional myoelectric control," Sensors, Vol. 14, 6677-6694, 2014.

8. Irimia, D. C., M. S. Poboroniuc, F. Serea, A. Baciu, and R. Olaru, "Controlling a FESEXOSKELETON rehabilitation system by means of brain-computer interface," Proceedings of International Conference and Exposition on Electrical and Power Engineering (EPE), 352-355, Iasi, 2016.

9. Lalitharatne, T. D., K. Teramoto, Y. Hayashi, K. Tamura, and K. Kiguchi, "EEG-based evaluation for perception-assist in upper-limb power-assist exoskeletons," Proceedings of 2014 World Automation Congress (WAC), 307-312, Waikoloa, HI, 2014.

10. Kilicarslan, A., S. Prasad, R. G. Grossman, and J. L. Contreras-Vidal, "High accuracy decoding of user intentions using EEG to control a lower-body exoskeleton," Proceedings of the 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 5606-5609, Osaka, 2014.

11. Lee, K., D. Liu, L. Perroud, R. Chavarriaga, and J. del R. Millán, "A brain-controlled exoskeleton with cascaded event-related desynchronization classifiers," Robotics and Autonomous Systems, Vol. 90, 15-23, 2017.

12. Li, Z., W. He, C. Yang, S. Qiu, L. Zhang, and C. Y. Su, "Teleoperation control of an exoskeleton robot using brain machine interface and visual compressive sensing," Proceedings of 2016 12th World Congress on Intelligent Control and Automation (WCICA), 1550-1555, Guilin, 2016.

13. Vidaurre, C., C. Klauer, T. Schauer, A. R. Murguialday, and K.-R. Müller, "EEG-based BCI for the linear control of an upper-limb neuroprosthesis," Medical Engineering & Physics, Vol. 38, 1195-1204, 2016.

14. Schultz, A. E. and T. A. Kuiken, "Neural interfaces for control of upper limb prostheses: The state of the art and future possibilities," PM&R, Vol. 3, No. 1, 55-67, 2011.

15. Noda, T., N. Sugimoto, J. Furukawa, M. A. Sato, S. H. Hyon, and J. Morimoto, "Brain-controlled exoskeleton robot for BMI rehabilitation," Proceedings of the 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012), 21-27, Osaka, 2012.

16. Ammar, L. I., B. Y. Kaddouh, M. K. Mohanna, and I. H. Elhajj, "SAS: SMA aiding sleeve," Proceedings of the 2010 IEEE International Conference on Robotics and Biomimetics, 1596-1599, Tianjin, 2010.

17. Ul Islam, M. R. and S. Bai, "Intention detection for dexterous human arm motion with FSR sensor bands," Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, 139-140, Vienna, Austria, 2017.

18. Xiao, Z. G., A. M. Elnady, and C. Menon, "Control an exoskeleton for forearm rotation using FMG," Proceedings of the 5th IEEERAS/EMBS International Conference on Biomedical Robotics and Biomechatronics, 591-596, Sao Paulo, 2014.

19. Cho, E., R. Chen, L.-K. Merhi, Z. Xiao, B. Pousett, and C. Menon, "Force myography to control robotic upper extremity prostheses: A feasibility study," Frontiers in Bioengineering and Biotechnology, Vol. 4, 18, 2016.

20. Huang, J., W. Huo, W. Xu, S. Mohammed, and Y. Amirat, "Control of upper-limb power-assist exoskeleton using a human-robot interface based on motion intention recognition," IEEE Transactions on Automation Science and Engineering, Vol. 12, No. 4, 1257-1270, 2015.

21. Nguyen, V. T., T.-F. Lu, and P. Grimshaw, "Human intention recognition based on contactless sensors to control an elbow and forearm assistive exoskeleton," Proceedings of the 7th International Conference of Asian Society for Precision Engineering and Nanotechnology (ASPEN 2017), ARM-P-06, Seoul, Nov. 2017.

22. Fontana, M., F. Salsedo, and M. Bergamasco, "Novel magnetic sensing approach with improved linearity," Sensors, 2013.

23. Wang, S., J. Jin, T. Li, and G. Liu, "High-accuracy magnetic rotary encoder," System Simulation and Scientific Computing, 74-82, Springer Berlin Heidelberg, Berlin, 2012.

24. Lee, Y. Y., R. H. Wu, and S. T. Xu, "Applications of linear Hall-effect sensors on angular measurement," Proceedings of the 2011 IEEE International Conference on Control Applications (CCA), 479-482, Denver, CO, 2011.

25. Smirnov, Y., T. Kozina, E. Yurasova, and A. Sokolov, "Analog-to-digital converters of the components of a displacement with the use of microelectronic sine-cosine magnetic encoders," Measurement Techniques, Vol. 57, No. 1, 41-46, 2014.

26. Hu, J., J. Zou, F. Xu, Y. Li, and Y. Fu, "An improved PMSM rotor position sensor based on linear hall sensors," IEEE Transactions on Magnetics, Vol. 48, No. 11, 3591-3594, 2012.

27. Ramsden, E., Hall-effect Sensors. Theory and Applications, 2nd Ed., 272 pages, Newness, Elsevier, 2006.

28. Nguyen, V. T. and T.-F. Lu, "Modelling of magnetic field distributions of elliptical cylinder permanent magnets with diametrical magnetization," Journal of Magnetism and Magnetic Materials, Vol. 491, 2019.

29. Nguyen, V. T. and T.-F. Lu, "Analytical expression of the magnetic field created by a permanent magnet with diametrical magnetization," Progress In Electromagnetics Research C, Vol. 87, 163-174, 2018.

30. Nguyen, V. T., "Modelling of magnetic fields of permanent magnets with diametrical magnetization,", MPhil Thesis, 2019.

31. Jezný, J. and M. Čurilla, "Position measurement with Hall effect sensors," American Journal of Mechanical Engineering, Vol. 1, No. 7, 231-235, 2013.

32. Romilly, D. P., C. Anglin, R. G. Gosine, C. Hershler, and S. U. Raschke, "A functional task analysis and motion simulation for the development of a powered upper-limb orthosis," IEEE Transactions on Rehabilitation Engineering, Vol. 2, No. 3, 119-129, 1994.

Dr. Van Tai Nguyen

Dr. Tien-Fu Lu

Dr. Paul Grimshaw

Dr. William Robertson