Dual-Interval Template Tracking for Camera Position Estimation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing automatic tracking cameras face difficulties in accurately tracking targets with varying features due to changes in posture, brightness, and other factors, as they typically rely on either short-term or long-term templates without considering the historical reliability of target features.

Innovation Solution

A photographing apparatus and method that utilize both long-term and short-term templates of a target, created from past images, to estimate the target's position in real-time, with the long-term template updated at a longer interval and the short-term template updated at a shorter interval, allowing for more accurate tracking and photography.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a single template is used for tracking, then the system is simple to operate, but the tracking accuracy deteriorates when target features vary

Engineering Contradiction:
Improvetemplate management simplicityVSAvoidtarget position estimation accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent segments the template into two distinct types: short-term template and long-term template. The short-term template is updated frequently to capture recent target appearance, while the long-term template is updated rarely to maintain historical appearance characteristics. This segmentation allows the system to handle both recent changes and historical consistency of target features simultaneously.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces dynamic template updating mechanisms with different update intervals. The short-term template uses frequent updates to adapt to recent changes in target appearance, while the long-term template uses infrequent updates to preserve stable historical features. This dynamic approach allows the system to adapt to changing conditions while maintaining stability.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If the template is updated frequently, then the tracking adapts to recent changes, but the historical reliability of the template deteriorates

Engineering Contradiction:
Improvetracking adaptability to recent changesVSAvoidtemplate historical reliability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent divides the template updating function into two separate templates with different update strategies. The short-term template is updated frequently to capture recent changes in target appearance, while the long-term template is updated rarely to maintain historical appearance characteristics. This segmentation resolves the contradiction by having each template serve its specific purpose.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent merges both short-term and long-term templates into the position estimation process. The position estimation unit combines information from both templates to determine target position, allowing the system to benefit from both recent adaptability and historical reliability simultaneously.

Inventive Principle:
Principle #5Merging (Combining)

3Reliability

If the template is updated rarely, then the historical reliability is maintained, but the adaptability to recent changes deteriorates

Engineering Contradiction:
Improvetemplate historical reliabilityVSAvoidtracking adaptability to recent changes
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent segments the template into short-term and long-term versions with different update frequencies. The long-term template is updated rarely to maintain historical reliability, while the short-term template is updated frequently to capture recent changes. This segmentation allows both requirements to be satisfied simultaneously.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent combines both templates in the position estimation process, where the short-term template provides adaptability to recent changes and the long-term template provides historical reliability. The merging of both templates resolves the contradiction between these two requirements.

Inventive Principle:
Principle #5Merging (Combining)

4Measurement precision

If multiple templates are used, then the tracking accuracy improves, but the device complexity increases

Engineering Contradiction:
Improvetarget position estimation accuracyVSAvoidtemplate management complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the template management into two clear categories with distinct update rules and usage scenarios. This segmentation simplifies the overall complexity by providing clear guidelines for when to use each template, rather than requiring complex decisions about multiple templates.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements a feedback mechanism where the position estimation unit uses both templates to estimate target position, and this estimation feedback informs the template updating process. The feedback loop helps optimize the use of both templates and maintains tracking accuracy while managing complexity.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10132913B2Photographing apparatus, photographing method, template creation apparatus, template creation method, and program
Publication Date: 2018.11.20 SONY GROUP CORP
  • US10132913B2 patent drawing
  • US10132913B2 patent drawing
  • US10132913B2 patent drawing

AI summary

A photographing apparatus includes a position estimation unit and a photographing control unit. The position estimation unit is configured to use a long-term template of a target to be tracked and a short-term template of the target to be tracked, which are created from a past taken image, to estimate a position of the target to be tracked in a current taken image. The long-term template is a template updated at a longer interval, and the short-term template is a template updated at a shorter interval. The photographing control unit is configured to control photographing on the basis of the position estimated by the position estimation unit.