The Gross Motor Function Estimation of Upper Extremity with Simple Daily Living Activities for the Outcome Measurement: Design, Development, and Automation

Authors

  • Sucheta V. Kolekar Department of Information and Communication Technology, Manipal Academy of Higher Education, Manipal, India-576104
  • Aneesha Acharya K. Department of Instrumentation and Control Engineering, Manipal Academy of Higher Education, Manipal, India-576104
  • Somashekara Bhat Department of Electronics and Communication Engineering, Manipal Academy of Higher Education, Manipal, India-576104
  • Kanthi M. Department of Electronics and Communication Engineering, Manipal Academy of Higher Education, Manipal, India-576104

Keywords:

Daily activities, Hand function test, Instrumented test battery, Inertial sensor, Sensor fusion

Abstract

The main objective of the work is to develop an instrumented hand function test system to assess the gross motor function of the upper limb in human beings. Simple day-to-day activities are selected for the test item generation, and they are: i) displacement of cylindrical object and ii) pouring water into a cup test. The trajectory of hand movement and position values obtained from the Logitech B525 USB camera are fused with the motion data from MPU6050 and further linearized through the Extended Kalman Filter. The activity time is automatically calculated using the developed instrument. Also, the acceleration, orientation, trajectory plots of the object movement, and mean force are captured using the sensor fusion technique. Spearman’s rank correlation coefficient is above 0.9, representing a high correlation between the traditional stopwatch and automated test methods. Manual stopwatch usage is avoided, which reduces the clinician's burden. The method is more useful as patients need not visit the physiotherapy center each time for outcome measurement.

Downloads

Download data is not yet available.

References

Carpinella, D. Cattaneo, and M. Ferrarin, “Quantitative assessment of upper limb motor function in Multiple Sclerosis using an instrumented Action Research Arm Test,” J NeuroEngineering Rehabil, vol. 11, no. 1, p. 67, 2014, doi: 10.1186/1743-0003-11-67.

N. Lander, D. Nahavandi, S. Mohamed, I. Essiet, and L. M. Barnett, “Bringing objectivity to motor skill assessment in children,” Journal of Sports Sciences, vol. 38, no. 13, pp. 1539–1549, Jul. 2020, doi: 10.1080/02640414.2020.1747743.

E. D. Ona Simbana, P. Sanchez-Herrera Baeza, A. Jardon Huete, and C. Balaguer, “Review of Automated Systems for Upper Limbs Functional Assessment in Neurorehabilitation,” IEEE Access, vol. 7, pp. 32352–32367, 2019, doi: 10.1109/ACCESS.2019.2901814.

David, T. Subash, S. K. M. Varadhan, A. Melendez-Calderon, and S. Balasubramanian, “A Framework for Sensor-Based Assessment of Upper-Limb Functioning in Hemiparesis,” Front. Hum. Neurosci., vol. 15, p. 667509, Jul. 2021, doi: 10.3389/fnhum.2021.667509.

Francisco-Martínez, J. A. Padilla-Medina, J. Prado-Olivarez, F. J. Pérez-Pinal, A. I. Barranco-Gutiérrez, and J. J. Martínez-Nolasco, “Kinect v2-Assisted Semi-Automated Method to Assess Upper Limb Motor Performance in Children,” Sensors, vol. 22, no. 6, p. 2258, Mar. 2022, doi: 10.3390/s22062258.

Werner et al., “Using Wearable Inertial Sensors to Estimate Clinical Scores of Upper Limb Movement Quality in Stroke,” Front. Physiol., vol. 13, p. 877563, May 2022, doi: 10.3389/fphys.2022.877563.

S. S. Mahmoud, Z. Cao, J. Fu, X. Gu, and Q. Fang, “Occupational Therapy Assessment for Upper Limb Rehabilitation: A Multisensor-Based Approach,” Front. Digit. Health, vol. 3, p. 784120, Dec. 2021, doi: 10.3389/fdgth.2021.784120.

Schwarz, M. M. C. Bhagubai, G. Wolterink, J. P. O. Held, A. R. Luft, and P. H. Veltink, “Assessment of Upper Limb Movement Impairments after Stroke Using Wearable Inertial Sensing,” Sensors, vol. 20, no. 17, p. 4770, Aug. 2020, doi: 10.3390/s20174770.

K. Kontson, I. Marcus, B. Myklebust, and E. Civillico, “Targeted box and blocks test: Normative data and comparison to standard tests,” PLoS ONE, vol. 12, no. 5, p. e0177965, May 2017, doi: 10.1371/journal.pone.0177965.

K. A. Acharya, S. Bhat, and M. Kanthi, “Accelerometer based quantitative outcome measurement for hand function test,” IJSNET, vol. 31, no. 3, p. 172, 2019, doi: 10.1504/IJSNET.2019.103045.

E. D. Oña, A. Jardón, and C. Balaguer, “The Automated Box and Blocks Test an Autonomous Assessment Method of Gross Manual Dexterity in Stroke Rehabilitation,” in Towards Autonomous Robotic Systems, vol. 10454, Y. Gao, S. Fallah, Y. Jin, and C. Lekakou, Eds., in Lecture Notes in Computer Science, vol. 10454. , Cham: Springer International Publishing, 2017, pp. 101–114. doi: 10.1007/978-3-319-64107-2_9.

J. Paul, R. Amritanand, P. Margabandhu, R. Karuppusami, K. S. David, and V. Krishnan, “Composite Grip Strength as a Marker of Outcome in Patients Surgically Treated for Degenerative Cervical Myelopathy,” Asian Spine J, vol. 15, no. 5, pp. 664–672, Oct. 2021, doi: 10.31616/asj.2020.0253.

S. F. M. Toh, P. C. Gonzalez, and K. N. K. Fong, “Usability of a wearable device for home-based upper limb telerehabilitation in persons with stroke: A mixed-methods study,” DIGITAL HEALTH, vol. 9, p. 205520762311537, Jan. 2023, doi: 10.1177/20552076231153737.

M. Dong, B. Fang, J. Li, F. Sun, and H. Liu, “Wearable sensing devices for upper limbs: A systematic review,” Proc Inst Mech Eng H, vol. 235, no. 1, pp. 117–130, Jan. 2021, doi: 10.1177/0954411920953031.

X. Gao and Y. Yin, “Design on a wearable armband device for assessing the motion function of upper limbs,” Computer Communications, vol. 153, pp. 135–144, Mar. 2020, doi: 10.1016/j.comcom.2020.01.074.

L. Paredes et al., “FabHandWear: An End-to-End Pipeline from Design to Fabrication of Customized Functional Hand Wearables,” Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., vol. 5, no. 2, pp. 1–22, Jun. 2021, doi: 10.1145/3463518.

Angelucci, A. Tettamanti, E. Sarasso, M. Filippi, A. Aliverti, and M. Scarlato, “Validation of a graphic test to quantitatively assess the dominant hand dexterity,” PLoS ONE, vol. 17, no. 8, p. e0271889, Aug. 2022, doi: 10.1371/journal.pone.0271889.

N. Yamamoto, T. Matsumoto, T. Sudo, M. Miyashita, and T. Kondo, “Quantitative measurement of finger usage in stroke hemiplegia using ring-shaped wearable devices,” J NeuroEngineering Rehabil, vol. 20, no. 1, p. 73, Jun. 2023, doi: 10.1186/s12984-023-01199-4.

O. N. Zestas and N. D. Tselikas, “Sollerman Hand Function Sub-Test ‘Write with a Pen’: A Computer-Vision-Based Approach in Rehabilitation Assessment,” Sensors, vol. 23, no. 14, p. 6449, Jul. 2023, doi: 10.3390/s23146449.

M. MassirisFernández, J. Á. Fernández, J. M. Bajo, and C. A. Delrieux, “Ergonomic risk assessment based on computer vision and machine learning,” Computers & Industrial Engineering, vol. 149, p. 106816, Nov. 2020, doi: 10.1016/j.cie.2020.106816.

M. Yahya, J. A. Shah, K. A. Kadir, Z. M. Yusof, S. Khan, and A. Warsi, “Motion capture sensing techniques used in human upper limb motion: a review,” SR, vol. 39, no. 4, pp. 504–511, Jul. 2019, doi: 10.1108/SR-10-2018-0270.

B. Sokal et al., “Network of Movement and Proximity Sensors for Monitoring Upper-Extremity Motor Activity After Stroke: Proof of Principle,” Archives of Physical Medicine and Rehabilitation, vol. 95, no. 3, pp. 499–505, Mar. 2014, doi: 10.1016/j.apmr.2013.09.013.

Atrsaei, H. Salarieh, and A. Alasty, “Human Arm Motion Tracking by Orientation-Based Fusion of Inertial Sensors and Kinect Using Unscented Kalman Filter,” Journal of Biomechanical Engineering, vol. 138, no. 9, p. 091005, Sep. 2016, doi: 10.1115/1.4034170.

R. J. M. Lemmens, Y. J. M. Janssen-Potten, A. A. A. Timmermans, R. J. E. M. Smeets, and H. A. M. Seelen, “Recognizing Complex Upper Extremity Activities Using Body Worn Sensors,” PLoS ONE, vol. 10, no. 3, p. e0118642, Mar. 2015, doi: 10.1371/journal.pone.0118642.

T. Boultache, B. Achour, and M. Laghrouche, “Human activity detection from inertial data using RNN and LSTM network,” IJSNET, vol. 39, no. 3, p. 156, 2022, doi: 10.1504/IJSNET.2022.124568.

M. Alatise and G. Hancke, “Pose Estimation of a Mobile Robot Based on Fusion of IMU Data and Vision Data Using an Extended Kalman Filter,” Sensors, vol. 17, no. 10, p. 2164, Sep. 2017, doi: 10.3390/s17102164.

Downloads

Published

25.12.2023

How to Cite

Kolekar, S. V. ., Acharya K., A. ., Bhat, S. ., & M., K. . (2023). The Gross Motor Function Estimation of Upper Extremity with Simple Daily Living Activities for the Outcome Measurement: Design, Development, and Automation. International Journal of Intelligent Systems and Applications in Engineering, 12(2), 269–277. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/4250

Issue

Vol. 12 No. 2 (2024)

Section

Research Article

License

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.

IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.