Object Angle Estimation Using Rotating Imaging and Dictionary Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image-based object recognition systems are limited in providing additional information about the angle of an object in an image, as they typically require extensive dictionary data preparation for various angles, which is cumbersome and inefficient.

Innovation Solution

A system comprising an information processing apparatus and method that acquires images of an object from different angles, generates dictionary data based on angle information, and estimates the object's angle using this data, enabling efficient recognition and posture adjustment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If dictionary data is prepared for each angle of the object to increase recognition availability, then object recognition accuracy is improved, but the complexity of data preparation and system configuration increases

Engineering Contradiction:
Improveobject recognition accuracyVSAvoiddictionary data preparation complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system changes the parameter of angle information by capturing images at multiple predetermined angles (0°, 45°, 90°, 135°, etc.) and using these angular parameters to generate dictionary data. This allows the system to achieve accurate recognition at various orientations without manually preparing separate dictionary data for each angle, as the angle parameter automatically structures the recognition process.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system performs preliminary action by automatically capturing images at multiple predetermined angles and generating the necessary dictionary data in advance through automated processes. This eliminates the need for manual dictionary data preparation for each angle, as the system pre-processes all necessary angular variations systematically.

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If multiple images are captured at different angles to provide additional object information, then information completeness is improved, but the time required for image acquisition increases

Engineering Contradiction:
Improveobject information completenessVSAvoidimage acquisition time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The imaging apparatus performs periodic action by capturing images at regularly spaced predetermined angles (e.g., every 45 degrees). This systematic periodic capture ensures complete angular information is obtained while following an efficient, repeatable sequence that minimizes unnecessary delays between shots.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system applies dynamics by rotating the imaging apparatus or the object through predetermined angles to capture images from multiple orientations. This dynamic approach allows the system to efficiently acquire comprehensive angular information by moving through a defined sequence of positions rather than using static multiple-camera setups.

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If the imaging apparatus is rotated to capture images at multiple angles, then angle coverage is improved, but the mechanical complexity of the rotation mechanism increases

Engineering Contradiction:
Improveangle coverageVSAvoidrotation mechanism complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The rotation mechanism serves multiple functions: it positions the imaging apparatus at various predetermined angles for image capture, and simultaneously provides the angular information needed for dictionary data generation and object recognition. This multi-functionality reduces the need for separate mechanisms for positioning and angle measurement.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The control unit acts as an intermediary that coordinates the rotation mechanism's movement to predetermined angles and tracks the angular position. This intermediary control simplifies the overall system by centralizing the coordination of rotation and image capture, reducing the need for complex independent control systems for each component.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11200695B2System, jig, information processing device, information processing method, and program
Publication Date: 2021.12.14 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11200695B2 patent drawing
  • US11200695B2 patent drawing
  • US11200695B2 patent drawing

AI summary

There is provided a system including one or a plurality of information processing apparatuses that individually or cooperatively realize functions including a first image acquisition function of acquiring a first image of an object, an angle information acquisition function of acquiring angle information indicating an angle of the object in the first image, a dictionary data generation function of generating dictionary data based on the first image and the angle information, a second image acquisition function of acquiring a second image of the object different from the first image; and an angle estimation function of estimating an angle of the object in the second image based on the second image and the dictionary data.