Video Target Position Interpolation for Missing Frames

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image processing techniques for estimating the spin condition of a pitched ball from video fail to interpolate positional information when it is missing in frames, leading to incomplete data sets.

Innovation Solution

An information interpolation device and method that acquires target information, determines a starting frame based on validity indicators, and interpolates positional information for frames without target data using adjacent frames' data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If video processing is used to estimate spin condition without Doppler radar systems, then equipment cost and installation restrictions are reduced, but positional information may be missing in some frames leading to incomplete data

Engineering Contradiction:
Improveequipment cost and installationVSAvoidpositional information completeness
Core Design Contradiction:
Ease of manufactureVSLoss of information

Solution Approach 1:

The patent applies preliminary action by performing interpolation of positional information before spin condition estimation. The system identifies frames with missing positional information and interpolates the data from adjacent frames beforehand, ensuring complete data is available for subsequent spin analysis. This preprocessing step resolves the information loss issue while maintaining the cost advantages of video-based systems.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If frame-by-frame target identification is performed to acquire positional information, then measurement capability is improved, but data gaps occur when targets are not detected in certain frames

Engineering Contradiction:
Improvepositional information accuracyVSAvoiddata continuity
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent uses interpolation as an intermediary process between frame detection and spin analysis. When positional information is missing in certain frames, the system calculates intermediate values based on data from adjacent frames with valid measurements. This intermediary step ensures data continuity and reliability while preserving the precision of actual measurements.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If preprocessing is performed to identify targets in each frame, then spin condition estimation accuracy is improved, but processing time increases when interpolation is needed

Engineering Contradiction:
Improvespin condition estimation accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies partial action by performing interpolation only for frames where positional information is missing, rather than processing all frames uniformly. The system selectively identifies problematic frames and applies interpolation only where needed, minimizing additional processing time while ensuring accuracy for the spin condition estimation.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS12003762B2Information completion apparatus, method and program
Publication Date: 2024.06.04 NIPPON TELEGRAPH & TELEPHONE CORP
  • US12003762B2 patent drawing
  • US12003762B2 patent drawing
  • US12003762B2 patent drawing

AI summary

A technique for interpolating positional information of a target in an image of a frame in which positional information of the target has not been acquired. An information interpolation device includes: a target information acquisition unit 4 acquiring target information that is information related to a target in an image of each frame composing an input video; an indicator determination unit 5 determining, based on the target information, an indicator indicating validity as a starting frame for each frame, the starting frame starting predetermined image processing on a target; a starting frame determination unit 6 determining a starting frame based on the determined indicator; and a target information interpolation unit 7 interpolating, when a frame in which positional information of a target is not included in target information exists among frames within a predetermined number from the determined starting frame, positional information of the target of the frame that does not include the positional information of the target by using positional information of the target included in target information of a frame other than the frame that does not include the positional information of the target.