Hostname: page-component-848d4c4894-m9kch Total loading time: 0 Render date: 2024-06-12T12:44:34.608Z Has data issue: false hasContentIssue false
  • English
  • Français

DESIGNING FOR REHABILITATION MOVEMENT RECOGNITION AND MEASUREMENT IN VIRTUAL REALITY

Published online by Cambridge University Press:  19 June 2023

Ummi Khaira Latif ,
Zhengya Gong ,
Vijayakumar Nanjappan  and
Georgi V. Georgiev
Ummi Khaira Latif*
Affiliation:
Center for Ubiquitous Computing, University of Oulu, Finland
Zhengya Gong
Affiliation:
Center for Ubiquitous Computing, University of Oulu, Finland
Vijayakumar Nanjappan
Affiliation:
Center for Ubiquitous Computing, University of Oulu, Finland
Georgi V. Georgiev
Affiliation:
Center for Ubiquitous Computing, University of Oulu, Finland
*
Latif, Ummi Khaira, University of Oulu, Finland, ummi.latif@oulu.fi

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

Virtual reality (VR)-based rehabilitation has been widely implemented to maintain and increase patient motivation during therapy sessions. Researchers nowadays design VR-based rehabilitation by leveraging off-the-shelf VR devices for easy access and application. However, researchers need to implement additional custom hardware or incorporate a specific algorithm to perform a real-time evaluation of each therapeutic movement. This study aims to design and develop a system with features for recognizing and measuring the upper limb rehabilitation movement in VR using off-the-shelf VR devices such as VR headsets, controllers, and trackers. This system is bundled and distributed as a single toolkit to accommodate other researchers in providing the evaluation feature for their VR-based rehabilitation system. The user experiment was conducted to verify the usability of this proposed design system. The experiment results show that the system can recognize 16 upper limb movements and provide several measurement data that researchers can use in providing the evaluation feature based on their design requirements.

Keywords

Virtual realityInnovationEvaluationRehabilitationToolkit
Type
Article
Information
Proceedings of the Design Society , Volume 3: ICED23 , July 2023 , pp. 1387 - 1396
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NCCreative Common License - ND
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use or in order to create a derivative work.
Copyright
The Author(s), 2023. Published by Cambridge University Press

References

Afyouni, I., Murad, A. and Einea, A. (2020), “Adaptive rehabilitation bots in serious games”, Sensors, Vol. 20 No. 24, http://doi.org/10.3390/s20247037.CrossRefGoogle ScholarPubMed
AlMousa, M., Al-Khalifa, H.S. and AlSobayel, H. (2020), “Move-it: a virtual reality game for upper limb stroke rehabilitation patients”, in: International Conference on Computers Helping People with Special Needs, Springer, pp. 184–195, http://doi.org/10.1007/978-3-030-58796-3_23.CrossRefGoogle Scholar
Callegaro, A., Caten, C., Jung, C., Fogliatto, F., Tonetto, L. et al. (2016), “Design of a module for continuous passive motion to be used in equipment for the rehabilitation of elbow and forearm”, in: Proceedings of the DESIGN 201614th International Design Conference, pp. 801–810.Google Scholar
Colomer, C., Llorens, R., Noe, E. and Alcaniz, M. (2016), “Effect of a mixed reality-based intervention on arm, hand, and finger function on chronic stroke”, Journal of Neuro engineering and Rehabilitation, Vol. 13 No. 1, pp. 1–11.Google ScholarPubMed
Dias, P., Silva, R., Amorim, P., Lains, J., Roque, E., Serodio, I., Pereira, F. and Santos, B.S. (2019), “Using virtual reality to increase motivation in poststroke rehabilitation”, IEEE Computer Graphics and Applications, Vol. 39 No. 1, pp. 64–70, http://doi.org/10.1109/MCG.2018.2875630.CrossRefGoogle ScholarPubMed
Georgiev, D.D., Georgieva, I., Gong, Z., Nanjappan, V. and Georgiev, G.V. (2021), “Virtual reality for neurorehabilitation and cognitive enhancement”, Brain Sciences, Vol. 11 No. 2, http://doi.org/10.3390/brainsci11020221.CrossRefGoogle ScholarPubMed
Georgieva, I. and Georgiev, G.V. (2022), “Narrative self-recreation in virtual reality”, Frontiers in Virtual Reality, Vol. 3, http://doi.org/10.3389/frvir.2022.854333.CrossRefGoogle Scholar
Ghazali, M., Mat Ariffin, N.A. and Omar, R. (2014), “User centered design practices in healthcare: A systematic review”, in: 2014 3rd International Conference on User Science and Engineering (i-USEr), pp. 91–96, http://doi.org/10.1109/IUSER.2014.7002683.CrossRefGoogle Scholar
Gustavsson, M., Kjork, E.K., Erhardsson, M. and Alt Murphy, M. (2021), “Virtual reality gaming in rehabilitation after stroke-user experiences and perceptions”, Disability and Rehabilitation, Vol. 44 No. 22, pp. 6759–6765, http://doi.org/10.1080/09638288.2021.1972351.CrossRefGoogle ScholarPubMed
Huang, Q., Wu, W., Chen, X., Wu, B., Wu, L., Huang, X., Jiang, S. and Huang, L. (2019), “Evaluating the effect and mechanism of upper limb motor function recovery induced by immersive virtual-reality-based rehabilitation for subacute stroke subjects: study protocol for a randomized controlled trial”, Trials, Vol. 20 No. 104, http://doi.org/10.1186/s13063-019-3177-y.CrossRefGoogle ScholarPubMed
Jack, K., McLean, S.M., Moffett, J.K. and Gardiner, E. (2010), “Barriers to treatment adherence in physiotherapy outpatient clinics: A systematic review”, Manual Therapy, Vol. 15 No. 3, pp. 220–228, http://doi.org/10.1016/j.math.2009.12.004.CrossRefGoogle ScholarPubMed
Jung, H.T., Kim, H., Jeong, J., Jeon, B., Ryu, T. and Kim, Y. (2017), “Feasibility of using the rapael smart glove in upper limb physical therapy for patients after stroke: A randomized controlled trial”, in: 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 3856–3859, http://doi.org/10.1109/EMBC.2017.8037698.Google Scholar
Knight, J., Baber, C., Schwirtz, A. and Bristow, H. (2002), “The comfort assessment of wearable computers”, in: Sixth International Symposium on Wearable Computers, pp. 65–72, http://doi.org/10.1109/ISWC.2002.1167220.CrossRefGoogle Scholar
Lee, S.H., Jung, H.Y., Yun, S.J., Oh, B.M. and Seo, H.G. (2020), “Upper extremity rehabilitation using fully immersive virtual reality games with a head mount display: A feasibility study”, PM & R : the Journal of Injury, Function, and Rehabilitation, Vol. 12 No. 3, pp. 257–262, http://doi.org/10.1002/pmrj.12206.CrossRefGoogle ScholarPubMed
Liao, K.L., Huang, M., Wang, Y., Wu, Z., Yang, R., Zhang, J. and Wang, L. (2021), “A virtual reality serious game design for upper limb rehabilitation”, in: 2021 IEEE 9th International Conference on Serious Games and Applications for Health (SeGAH), pp. 1–5, http://doi.org/10.1109/SEGAH52098.2021.9551913.CrossRefGoogle Scholar
Lim, D.Y., Hwang, D.M., Cho, K.H., Moon, C.W. and Ahn, S.Y. (2020), “A fully immersive virtual reality method for upper limb rehabilitation in spinal cord injury”, Annals of Rehabilitation Medicine, Vol. 44 No. 4, pp. 311–319, http://doi.org/10.5535/arm.19181.CrossRefGoogle ScholarPubMed
Mendes, D., Sousa, M., Lorena, R., Ferreira, A. and Jorge, J. (2017), “Using custom transformation axes for mid-air manipulation of 3d virtual objects”, in: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, 27, Association for Computing Machinery, pp. 1–8, http://doi.org/10.1145/3139131.3139157.CrossRefGoogle Scholar
Namdari, S., Yagnik, G., Ebaugh, D.D., Nagda, S., Ramsey, M.L., Williams, G.R. Jr and Mehta, S. (2012), “Defining functional shoulder range of motion for activities of daily living”, Journal of Shoulder and Elbow Surgery, Vol. 21 No. 9, pp. 1177–1183, http://doi.org/10.1016/jjse.2011.07.032.CrossRefGoogle ScholarPubMed
Pereira, M.F., Oliveira, E., Rodrigues, N.F., Bressler, M., Kolbenschlag, J. and Prahm, C. (2021), “Hand rehabilitation with virtual reality: preliminary learning results”, in: 2021 IEEE 9th International Conference on Serious Games and Applications for Health(SeGAH), pp. 1–8, http://doi.org/10.1109/SEGAH52098.2021.9551862.CrossRefGoogle Scholar
Proffitt, R., Sevick, M., Chang, C.Y. and Lange, B. (2015), “User-centered design of a controller-free game for hand rehabilitation”, Games for Health Journal, Vol. 4 No. 4, pp. 259–264, http://doi.org/10.1089/g4h.2014.0122.CrossRefGoogle ScholarPubMed
Rahman, M., Gustafson, S., Irani, P. and Subramanian, S. (2009), “Tilt techniques: Investigating the dexterity of wrist-based input”, in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Association for Computing Machinery, p. 1943–1952, http://doi.org/10.1145/1518701.1518997.CrossRefGoogle Scholar
Shirzad, N., Valdes, B.A., Hung, C.T., Law, M., Hay, J., der Loos, V., Machiel, H., et al. (2015), “Feathers, a bimanual upper limb rehabilitation platform: a case study of user-centred approach in rehabilitation device design”, in: Proceedings of the 20th International Conference on Engineering Design (ICED15), pp. 361–370.Google Scholar
Song, H., Lee, S., Kim, H., Jang, G., Choi, Y. and Yang, D. (2016), “Rapael: Wearable technology and serious game for rehabilitation”, in: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, Association for Computing Machinery, New York, NY, USA, p. 3774–3777, http://doi.org/10.1145/2851581.2890229.CrossRefGoogle Scholar
Soomro, S., Nanjappan, V. and Georgiev, G. (2022), “Designing and integrating electronics for bespoke rehabilitation experiences in virtual reality”, Computer-Aided Design and Applications, pp. 99–110, http://doi.org/10.14733/cadaps.2023.S6.99-110.CrossRefGoogle Scholar
Tuah, N.M., Ahmedy, F., Gani, A. and Yong, L.N. (2021), “A survey on gamification for health rehabilitation care: Applications, opportunities, and open challenges”, Information, Vol. 12 No. 2, https://www.mdpi.com/2078-2489/12/2/91.CrossRefGoogle Scholar
Weber, L.M., Nilsen, D.M., Gillen, G., Yoon, J. and Stein, J. (2019), “Immersive virtual reality mirror therapy for upper limb recovery following stroke: A pilot study”, American Journal of Physical Medicine & Rehabilitation, Vol. 98 No. 9, pp. 783–788, http://doi.org/10.1097/phm.0000000000001190.CrossRefGoogle Scholar
World Health Organization (2019), Rehabilitation in health systems: guide for action, World Health Organization.Google Scholar
Yoshioka, K. (2020), “Development and clinical study of a projection images program to encourage arm movements for rehabilitation”, in: Proceedings of the DESIGN 2020 16th International Design Conference, pp. 2227–2234, http://doi.org/10.1017/dsd.2020.3.CrossRefGoogle Scholar
Zirbel, C., Zhang, X. and Hughes, C. (2018), “The vrehab system: A low-cost mobile virtual reality system for post-stroke upper limb rehabilitation for medically underserved populations”, in: 2018 IEEE Global Humanitarian Technology Conference (GHTC), pp. 1–8, http://doi.org/10.1109/GHTC.2018.8601885.CrossRefGoogle Scholar
Zwerus, E.L., Willigenburg, N.W., Scholtes, V.A., Somford, M.P., Eygendaal, D. and van den Bekerom, M.P. (2019), “Normative values and affecting factors for the elbow range of motion”, Shoulder & Elbow, Vol. 11 No. 3, pp. 215–224, http://doi.org/10.1177/1758573217728711.CrossRefGoogle ScholarPubMed