Video Processing Device Scene-Based Haptic Vector Estimation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing techniques fail to generate force sense information from video content, limiting the ability to provide a real virtual experience by synchronizing video with haptic devices.

Innovation Solution

A video processing device and method that estimates a movement vector from video content by identifying scene classes and selecting appropriate movement information estimation units to calculate movement vectors, which are then used to generate force sense control information for haptic devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single movement information estimation unit is used for all video content, then the device complexity is reduced, but the measurement precision of movement vectors deteriorates for different video types

Engineering Contradiction:

Improvestructure of movement information estimation unitVSAvoidmovement vector estimation accuracy

Core Design Contradiction:

Device complexityVSMeasurement precision

Solution Approach 1:

The patent divides the movement information estimation unit into multiple specialized units (first movement information estimation unit for sports videos, second movement information estimation unit for non-sports videos) that process different video types separately. This segmentation allows each unit to be optimized for its specific video category, improving measurement precision without significantly increasing overall system complexity.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent implements a dynamic selection mechanism where the system automatically chooses which movement information estimation unit to use based on scene class identification. The controller switches between different estimation units depending on the detected video type, making the system adaptable and precise across various video content without requiring a fixed complex structure.

Inventive Principle:

Principle #15Dynamics

2Measurement precision

If multiple movement information estimation units are used for different video content types, then the measurement precision of movement vectors is improved, but the device complexity increases

Engineering Contradiction:

Improvemovement vector estimation accuracyVSAvoidstructure of movement information estimation unit

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces a scene class identification unit as an intermediary that analyzes video content and determines the appropriate movement information estimation unit to use. This intermediary component manages the complexity by providing a systematic way to select between multiple specialized units, reducing the burden on the controller and making the overall system more manageable despite having multiple estimation units.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent applies different estimation algorithms and parameters tailored to specific video types (sports vs. non-sports). Each movement information estimation unit is optimized with local quality characteristics suited to its designated video category, improving precision for each type while keeping the overall device structure organized and manageable through clear functional division.

Inventive Principle:

Principle #3Local quality

3Ease of operation

If generic force sense information is generated without scene-specific processing, then the ease of operation is improved, but the adaptability to different video content deteriorates

Engineering Contradiction:

Improveforce sense information generation processVSAvoidforce sense information adaptability

Core Design Contradiction:

Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent performs scene class identification and selection of the appropriate movement information estimation unit before generating force sense information. This preliminary action ensures that the system is properly configured for the specific video type before processing, maintaining ease of operation through automatic configuration while achieving high adaptability to different video content through scene-specific optimization.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS11907425B2Image processing device, image processing method, and image processing program

Publication Date: 2024.02.20 NIPPON TELEGRAPH & TELEPHONE CORP

AI summary

To implement a video processing device, a video processing method, and a video processing program capable of estimating a movement vector from a video content and providing processing information based on the movement vector to a haptic device or other force sense presentation devices, a video processing device according to the present disclosure includes a scene identification unit to estimate scene class information that is information identifying a scene class for a video content and a plurality of movement information estimation units to estimate a movement vector from the video content. One movement information estimation unit that is selected from the plurality of the movement information estimation units in response to the scene class identified by the scene class information estimates the movement vector.