Motion Analysis Display Synchronizing Sensor Data with Video

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing systems for analyzing motion, such as in sports, struggle to effectively combine and display motion data from sensors with corresponding video images in real-time, leading to incomplete or difficult-to-understand analysis results.

Innovation Solution

An image processing apparatus and system that includes a processor to acquire images, measure motion using sensors, create indices based on sensor data, and display both the image and index together, utilizing Bluetooth Low Energy and Wi-Fi for communication, with features like BOX animation to simulate three-dimensional motion and display sensor information synchronously with video.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If motion data from sensors is combined with video images for analysis, then the comprehensiveness of motion analysis is improved, but the complexity of data synchronization and display is increased

Engineering Contradiction:
Improvecompleteness of motion analysis informationVSAvoidcomplexity of data synchronization system
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent combines video image data and sensor motion data into a unified display interface, merging visual information with quantitative motion metrics. The display unit presents both the taken image and motion analysis results (such as swing phase, speed, acceleration) simultaneously, allowing users to correlate visual observations with numerical data without requiring separate analysis systems.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The control unit acts as an intermediary that receives data from both the imaging device and sensor, processes the data streams, and coordinates their synchronization. It matches sensor data points with corresponding video frames based on timing information, resolving the synchronization complexity by centralizing the coordination function in a dedicated processing component.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If real-time display of sensor data with video images is implemented, then the effectiveness of motion analysis is improved, but the processing time and computational load are increased

Engineering Contradiction:
Improveeffectiveness of motion analysisVSAvoidprocessing time for data synchronization
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary processing of sensor data by pre-calculating motion parameters (such as swing phase identification, speed, acceleration) and organizing them into structured formats before the display phase. This preliminary organization reduces the computational burden during real-time display, allowing faster presentation of analysis results alongside video images.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If detailed motion measurement data is displayed together with images, then the precision of motion analysis is improved, but the ease of understanding the results is reduced

Engineering Contradiction:
Improveprecision of motion measurementVSAvoidease of understanding analysis results
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The display presents different types of information with different levels of detail in appropriate locations. Visual spatial information from images provides contextual understanding, while numerical sensor data provides precise measurement values. The layout allows users to focus on visual patterns for qualitative assessment and reference numerical data for quantitative verification, optimizing both understanding and precision.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10881937B2Image processing apparatus, analysis system, and method for processing images
Publication Date: 2021.01.05 CASIO COMPUTER CO LTD
  • US10881937B2 patent drawing
  • US10881937B2 patent drawing
  • US10881937B2 patent drawing

AI summary

To present a measurement result on the motion of a subject more easily, a processor 3 of an analysis system S includes an image acquisition unit 357, a sensor information acquisition unit 356, an analysis unit 358, and an image creation unit 359. The image acquisition unit 357 acquires a taken image of the subject. The sensor information acquisition unit 356 acquires a measurement result of the motion of the subject measured with a sensor. The analysis unit 358 creates an index indicating the motion of the subject based on the measurement result acquired by the sensor information acquisition unit 356. The image creation unit 359 makes an output unit 319 display an image acquired by the image acquisition unit 357 and an index created by the analysis unit 358 together.