Single-Camera Pose Estimation for Real-Time Fitness Motion Counting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing fitness and gaming applications require specialized hardware and multiple cameras for real-time tracking of physical movements, limiting their use to stationary setups and not facilitating exercises or activities like running using general-purpose computing devices.
Innovation Solution
A virtual fitness application using pose estimation and a Convolutional Neural Network (CNN) to count repetitive motions on general-purpose devices, such as smartphones, tablets, and smart TVs, providing gamified experiences through leaderboards, statistics, and real-time feedback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple high-definition cameras and specialized hardware are used for real-time tracking, then measurement precision and reliability are improved, but device complexity and cost increase
Solution Approach 1:
The patent combines multiple camera arrays and processing functions into a unified system that uses a single camera with pose estimation algorithms. Instead of requiring multiple separate cameras positioned at different angles, the system merges the tracking function into one device that captures video and processes pose data through machine learning models, significantly reducing hardware complexity while maintaining tracking precision.
Solution Approach 2:
The patent replaces the mechanical/optical system of multiple physical cameras with a computational approach using pose estimation algorithms and Convolutional Neural Networks. The system substitutes hardware complexity with software intelligence, using machine learning models to extract motion data from standard video feeds, thereby achieving accurate tracking without specialized camera equipment.
2Reliability
If specialized equipment and multiple cameras are deployed, then tracking reliability is improved, but ease of operation and accessibility deteriorate
Solution Approach 1:
The patent makes the system universal by designing it to work with general-purpose computing devices like smartphones, tablets, and standard computers that already have built-in cameras. The pose estimation technology adapts to various devices and environments, allowing users to perform fitness activities at home without specialized equipment. The system processes video from different camera types and adjusts accordingly, greatly improving accessibility.
Solution Approach 2:
The system performs automatic pose detection and motion counting without requiring user setup or calibration. The Convolutional Neural Network automatically identifies body positions and tracks movements in real-time, providing reliable feedback without human intervention. This self-service capability eliminates the need for users to configure complex hardware or understand technical parameters, making the system easy to operate.
3Productivity
If massive processing power in server-grade hardware is used, then productivity and analysis accuracy are improved, but use of energy and computational resources increase
Solution Approach 1:
The patent applies partial processing by focusing computational resources only on detecting relevant body parts and movements needed for fitness tracking. Instead of processing entire video frames at maximum resolution, the pose estimation model identifies key anatomical points and tracks their positions, using computational power selectively where needed. This approach maintains high productivity for motion analysis while reducing overall energy consumption compared to full-frame processing.
Data Source
AI summary
A computer-implemented method for video processing is disclosed. The method includes receiving an input video of one or more persons from a camera; detecting a sequence of human poses in the input video using an artificial intelligence (AI) based technique; selecting a proper pose from among multiple poses in a given frame of the input video, to generate a sequence of proper poses; detecting one or more key points in the sequence of proper poses; computing changes in coordinates of the one or more key points; computing a function of the changes in the coordinates of the one or more key points in the sequence of proper poses; counting a given user movement as a repetitive motion of an activity based on the function; and computing a plurality of statistics about the activity based on the counting. In some embodiments, the activity is running, jogging, walking jumping, performing jumping jacks, squatting, and/or dribbling.


