3D Body Mesh Reconstruction for Remote Acupuncture Guidance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current physical therapy methods, including acupuncture and therapeutic manipulations, require skilled practitioners and physical presence, which can be limiting due to the need for extensive training, physical stamina, and privacy concerns, and lack effective remote guidance solutions.
Innovation Solution
A system that uses a local site with a therapeutic robot and remote expert guidance, where 2D images are processed to generate real-time 3D human body meshes marked with acupuncture points, allowing less skilled personnel or patients to administer treatments with the aid of a remote expert through a mixed reality environment and haptic feedback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If skilled practitioners perform physical therapy manually, then treatment accuracy and effectiveness are improved, but the requirement for extensive training and physical stamina increases
Solution Approach 1:
The patent introduces a remote expert system as an intermediary between the treatment facility and the patient. The remote expert uses 3D body reconstruction and acupuncture point identification technology to guide local practitioners or patients through treatment, transferring expert knowledge remotely without requiring the expert to be physically present or the local practitioner to have extensive training
Solution Approach 2:
The system creates a digital copy of the patient's body through 3D reconstruction from 2D images, marking acupuncture points and key physical points on the virtual model. This digital copy allows remote experts to analyze and guide treatment based on the replicated body structure, eliminating the need for the expert to physically examine the patient
2Reliability
If skilled practitioners perform physical therapy manually, then treatment effectiveness is improved, but physical stamina and age limitations worsen
Solution Approach 1:
The remote expert system acts as an intermediary that separates the knowledge required for effective treatment from the physical execution. Experts can guide multiple patients remotely without physical fatigue, while local practitioners or patients perform the actual treatment based on expert guidance
Solution Approach 2:
The system replaces the need for physically present skilled practitioners with a digital guidance system. The remote expert's knowledge is transmitted through the 3D body reconstruction and point identification system, eliminating the physical stamina requirements of manual practice
3Measurement precision
If physical therapy requires physical presence and contact, then treatment accuracy is improved, but privacy concerns and patient comfort worsen
Solution Approach 1:
The system creates a virtual 3D model of the patient's body from 2D images, allowing remote experts to examine and identify treatment points on the digital copy rather than requiring direct physical contact. This maintains treatment accuracy while preserving patient privacy and comfort
Solution Approach 2:
The system transitions from 2D images to a 3D virtual representation of the patient's body, enabling remote experts to analyze body structure and identify acupuncture points in three-dimensional space without physical presence. This dimensional transformation maintains diagnostic accuracy while eliminating privacy concerns associated with physical examination
4Adaptability or versatility
If remote guidance is implemented, then accessibility and privacy are improved, but real-time accurate identification of acupuncture points becomes more difficult
Solution Approach 1:
The system creates a detailed 3D digital copy of the patient's body with marked acupuncture points and key physical points, allowing remote experts to identify treatment locations accurately on the virtual model. This digital copy preserves the spatial relationships and anatomical features needed for precise point identification
Solution Approach 2:
The system transforms 2D image data into 3D spatial parameters, reconstructing the patient's body geometry and positioning acupuncture points in three-dimensional space. This parameter transformation enables accurate remote identification of treatment locations that would otherwise require physical presence
Data Source
AI summary
System and method for generating acupuncture points on reconstructed 3D human body mesh for physical treatment are disclosed. The computing device obtains a first two-dimensional image of a human subject that captures at least a predefined portion of the human subject; processes the first two-dimensional image of the first human subject using a trained human body recovery model to obtain a plurality of parameters representing a three-dimensional human body mesh with corresponding acupuncture points. The trained human body recovery model includes an iterative three-dimensional regression module that is supervised by a discriminator and that minimizes a combined loss below a preset threshold. The combined loss includes a discriminator error that provides a measure of whether the obtained three-dimensional human body mesh with corresponding acupuncture points correspond to real human shape, pose, and acupuncture points.