Image Processing Device Feature Point Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods require significant effort and time to add additional information to moving objects in images, especially when multiple images are involved, making the process complex and time-consuming.

Innovation Solution

An image processing device that automatically generates data based on motion information to change additional information displayed with a feature point, allowing for simple addition of information to moving objects by selecting display scenarios matching the feature point's behavior, including position, size, facial expressions, and movement speed.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If additional information is manually added to moving objects in images, then the additional information can be displayed with the moving object, but the operation becomes complicated and time-consuming

Engineering Contradiction:
Improveease of adding additional informationVSAvoidtime required to set additional image display
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system automatically tracks feature points in images and manages the display of additional information without requiring manual intervention. The feature point tracking unit autonomously follows moving objects across frames, and the display control unit automatically adjusts the position and timing of additional information based on the tracked feature points, enabling the system to serve itself rather than requiring continuous user input.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary setup by allowing users to define display scenarios and associate additional information with specific feature point behaviors in advance. During image processing, the system automatically matches observed feature point behaviors with pre-defined scenarios and executes the corresponding display actions, eliminating the need for real-time manual configuration.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If multiple additional images are set to accompany moving objects, then more comprehensive information can be displayed, but the operation becomes even more complicated

Engineering Contradiction:
Improveability to display multiple additional imagesVSAvoidcomplexity of setting multiple additional images
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The display scenario mechanism serves multiple functions: it can handle a single additional information element or multiple elements simultaneously, adapt to various feature point behaviors (movement, appearance, disappearance), and work with different types of additional information (text, icons, graphics). This universal framework allows the system to manage multiple additional images through a single unified interface rather than requiring separate configuration procedures for each.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system merges the management of multiple additional information elements into a single display scenario configuration. Multiple additional images can be associated with one feature point or distributed across multiple feature points through a unified scenario definition, combining what would otherwise be separate complex operations into one streamlined process.

Inventive Principle:
Principle #5Merging (Combining)

3Productivity

If additional information is added to moving objects, then the images become more interesting and informative, but significant effort and time are required

Engineering Contradiction:
Improveefficiency of adding additional informationVSAvoideffort required to add additional information
Core Design Contradiction:
ProductivityVSEase of manufacture

Solution Approach 1:

The system replaces manual mechanical operations (dragging, positioning, timing adjustments of additional information) with automated computational processes. The feature point tracking unit uses image processing algorithms to automatically locate and follow moving objects, while the display control unit uses logical rules to determine optimal display positions and timing, substituting manual effort with automated mechanical and computational systems.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system continuously monitors the position and behavior of feature points in real-time and uses this feedback to dynamically adjust the display of additional information. The display control unit receives ongoing information about feature point locations and movements, and automatically modifies the positioning and presentation of additional images accordingly, creating a closed-loop system that adapts to changing conditions without manual intervention.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP2287809B1Image processing device, image processing method, and computer program
Publication Date: 2018.12.26 SONY GROUP CORP
  • EP2287809B1 patent drawingFigure 1
  • EP2287809B1 patent drawingFigure 2
  • EP2287809B1 patent drawingFigure 3A

AI summary

Provided is an image processing device. A feature point detection unit detects a feature point from moving image data. An association processing unit associates the feature point with additional information, the feature point being selected based on feature point selection information for selecting one or at least two feature points that display the additional information displayed to be accompanied with the feature point. A motion analysis unit analyzes a changing behavior of the feature point through reproduction of moving image data. A data generating unit generates data indicating change content to change display of the additional information associated with the feature point based on motion information indicating the behavior of the feature point analyzed by the motion analysis unit and a display scenario indicating a change pattern to change the additional information added to the feature point according to the behavior of the feature point.