Desai, Vaaruni; Fisher, Laben F.; Imran, Zufeshan; Jogadhenu, Sagar R.; Shukla, Prakhar; Ochoa, Benjamin; Richardson, Brian; Duenas, Kevin; Franco, Malerie (2024). Physio AI Companion. In Data Science & Engineering Master of Advanced Study (DSE MAS) Capstone Projects. UC San Diego Library Digital Collections. https://doi.org/10.6075/J0HM58PG

Physical Therapists (PT) and Kinesiologists recommend a series of exercises but often face challenges in continuously monitoring individuals performing exercises to ensure correct postures and prevent injury aggravation. This research attempts to address this issue by building a product designed to automate the detection of the incorrect exercises and provide users with timely feedback. The research effort began with a set of curated exercise videos, a set of biomechanical standards as well as developing a core model to analyze a single exercise - overhead squat. The core model approach consists of three main steps: preprocessing to standardize the videos, creating a 3D body model and calculating incorrectness scores for each repetition and aggregation based on measured joint angles. The work uses state-of-the-art computer vision models and computational algorithms for a customized solution. The results from the core model are used to provide feedback to both practitioners and users through visual overlays on the exercise video and graphical presentation of biomechanical measures captured during the exercise.

• 2024-01-06 to 2024-06-07

• 2024

• Duenas, Kevin
• Franco, Malerie
• Ochoa, Benjamin
• Richardson, Brian

• Desai, Vaaruni
• Fisher, Laben F.
• Imran, Zufeshan
• Jogadhenu, Sagar R.
• Shukla, Prakhar

This project relies on external software packages, modules/libraries, or programs, use of which may carry specific license requirements. Users should comply with any licenses specified within the contents of this project.

• DSE MAS - 2024 Cohort

• Biomechanics
• Capstone projects
• Computer vision
• Data Science & Engineering Master of Advanced Study (DSE MAS)
• Data science application
• Engineering
• Injury recovery
• Multimedia computation
• Physical therapy
• Pose estimation

• data
• text

• English

Creative Commons Attribution-NonCommercial 4.0 International Public License

• Desai, Vaaruni; Fisher, Laben F.; Imran, Zufeshan; Jogadhenu, Sagar R.; Shukla, Prakhar

Under copyright (US)

Use: This work is available from the UC San Diego Library. This digital copy of the work is intended to support research, teaching, and private study.

Constraint(s) on Use: This work is protected by the U.S. Copyright Law (Title 17, U.S.C.). Use of this work beyond that allowed by "fair use" or any license applied to this work requires written permission of the copyright holder(s). Responsibility for obtaining permissions and any use and distribution of this work rests exclusively with the user and not the UC San Diego Library. Inquiries can be made to the UC San Diego Library program having custody of the work.

Research Data Curation Program, UC San Diego, La Jolla, 92093-0175 (https://lib.ucsd.edu/rdcp)

2024-07-10