3D Shape Model Tracking for Object Orientation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional techniques for tracking moving objects are unable to simultaneously determine the position and direction of an object, such as a person's orientation or the orientation of their face, which limits their effectiveness in applications like sports tracking.

Innovation Solution

An image processing system that generates a three-dimensional shape model of an object using multiple camera images, specifies the direction of this model, and stores it along with identification information, allowing for the tracking of both position and direction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If conventional tracking techniques are used, then object position can be determined, but object direction cannot be determined

Engineering Contradiction:
Improvedirection informationVSAvoidtracking system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent transitions from two-dimensional image tracking to three-dimensional shape model tracking by introducing depth information through multiple camera viewpoints. This dimensional expansion enables the system to determine both position and direction of objects, resolving the information loss while maintaining manageable system complexity through standardized 3D model generation processes

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If multiple cameras are used to capture images from different directions, then both position and direction can be tracked, but system complexity increases

Engineering Contradiction:
Improvetracking accuracyVSAvoidcamera system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent creates a universal three-dimensional shape model that serves multiple functions: it enables both position determination and direction determination from a single integrated data structure. This multi-functionality allows the system to achieve high measurement precision for both parameters while avoiding the need for separate specialized systems, thereby managing overall system complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Loss of information

If a three-dimensional shape model is generated from multiple images, then direction specification becomes possible, but processing time increases

Engineering Contradiction:
Improvespatial orientation dataVSAvoidmodel generation time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent performs preliminary action by pre-generating standardized three-dimensional shape models from multiple camera images before actual tracking begins. These pre-generated models are then reused for direction specification during tracking operations, reducing the processing time required during active tracking while still providing complete spatial orientation data

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10853952B2Image processing apparatus, image processing method, and non-transitory computer-readable storage medium
Publication Date: 2020.12.01 CANON KK
  • US10853952B2 patent drawing
  • US10853952B2 patent drawing
  • US10853952B2 patent drawing

AI summary

An image processing apparatus, comprising a generation unit configured to generate a three-dimensional shape model of an object present in a field, based on a plurality of captured images obtained by a plurality of cameras that capture the field from different directions, a specification unit configured to specify a direction of the three-dimensional shape model generated by the generation unit, and a storage control unit configured to cause the direction of the three-dimensional shape model specified by the specification unit to be stored in a storage unit together with identification information of the object.