3D Motion Recognition Feedback for Exercise Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users exercising without a fitness trainer struggle to determine if their motions are standard and effective for fitness, as existing technologies lack accurate feedback in video-based exercise scenarios.

Innovation Solution

A method and apparatus that acquire three-dimensional recognition coordinates of body key points from user motion images, compare them to standard coordinates, and provide real-time feedback on deviations to correct motion, using pre-trained deep learning models for body and joint point recognition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If video images are used for exercise guidance, then ease of operation is improved, but measurement precision of motion standardness deteriorates

Engineering Contradiction:
Improveease of operationVSAvoidmeasurement precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent transitions from two-dimensional video images to three-dimensional spatial coordinates for motion analysis. By establishing a coordinate system that maps body key points in 3D space, the system achieves accurate measurement of motion standardness while maintaining ease of operation through automatic recognition algorithms.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces an intermediary processing system that includes coordinate calibration, key point recognition, and motion parameter calculation modules. This intermediary layer transforms raw video data into precise motion measurements, resolving the contradiction between simple video-based operation and accurate motion assessment.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If three-dimensional recognition coordinates are used, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvemeasurement precisionVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent divides the complex three-dimensional recognition system into modular functional components: coordinate calibration module, body key point recognition module, and motion parameter calculation module. Each module handles a specific aspect of the processing, making the overall system more manageable and implementable while maintaining high measurement precision.

Inventive Principle:
Principle #1Segmentation

3Productivity

If real-time body recognition is implemented, then productivity is improved, but use of energy increases

Engineering Contradiction:
ImproveproductivityVSAvoiduse of energy
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent performs preliminary actions by pre-calibrating coordinate systems and pre-processing video frames to identify regions of interest before full body recognition. This preliminary processing reduces the computational load during real-time execution, improving productivity while reducing energy consumption during the main recognition phase.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11816847B2Method and apparatus for prompting motion, electronic device and storage medium
Publication Date: 2023.11.14 BEIJING BAIDU NETCOM SCI & TECH CO LTD
  • US11816847B2 patent drawing
  • US11816847B2 patent drawing
  • US11816847B2 patent drawing

AI summary

A method and apparatus for promoting a motion, an electronic device and a storage medium, relating to the field of image recognition technology are provided. An embodiment of the method may include: acquiring a user motion image, and acquiring three-dimensional recognition coordinates of body key points recognized in the user motion image; determining, based on the three-dimensional recognition coordinates, a user motion matching the user motion image; screening, according to a mapping relationship between user motion and body key points, a target body key point among all of the recognized body key points; acquiring three-dimensional standard coordinates of the target body key point corresponding to the user motion; and prompting a motion based on values of differences between the three-dimensional standard coordinates of the target body key point and the three-dimensional recognition coordinates of the target body key point.