Calibration Chart Stabilizes Image Recognition Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The recognition accuracy of real objects in information processing systems is unstable due to variations in object colors caused by image pickup environments, leading to incorrect object identification.

Innovation Solution

An image pickup apparatus that adjusts image pickup and processing conditions based on color information from a calibration chart with multiple luminance regions, ensuring accurate color representation and reducing confusion between similar colors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If color information from picked up images is used for object recognition, then object identification can be performed, but recognition accuracy becomes unstable due to color variations caused by illumination and material differences

Engineering Contradiction:
Improverecognition accuracyVSAvoidstability of recognition
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system performs preliminary color calibration by capturing images of a calibration chart with known color values before actual object recognition. This preliminary action establishes reference data that compensates for illumination and environmental variations, enabling stable and accurate recognition subsequent to calibration.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system changes the parameter set used for recognition from raw color values to calibrated color values that have been adjusted based on the calibration chart. By transforming the color parameters through calibration, the system eliminates the influence of illumination and material variations, achieving both accuracy and stability.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If standard image pickup conditions are used without adjustment, then the system is simple to operate, but color accuracy varies depending on illumination and environment

Engineering Contradiction:
Improvecolor accuracyVSAvoidoperation simplicity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system performs automatic calibration by autonomously capturing images of the calibration chart, computing color correction parameters, and applying adjustments without requiring manual intervention. This self-service approach maintains ease of operation while significantly improving color accuracy through environmental adaptation.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system automatically adjusts image pickup parameters such as exposure time and gain based on the calibration results, transforming the operation from manual parameter setting to automatic optimization. This maintains simplicity for the user while achieving accurate color representation across different lighting conditions.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10869010B2Image pickup apparatus, information processing system, mat, and image generation method
Publication Date: 2020.12.15 SONY INTERACTIVE ENTERTAINMENT LLC
  • US10869010B2 patent drawing
  • US10869010B2 patent drawing
  • US10869010B2 patent drawing

AI summary

A mat for an image pickup apparatus, where the image pickup apparatus operates to recognize a real object, the mat includes: a play field that defines a bottom region of a space in which the real object is placed; and a calibration chart located in the space and having a plurality of color regions in which respective luminances thereof differ from one another, where: the image pickup apparatus: (i) obtains data of a picked up image of the space in which the real object is located; and (ii) evaluates the picked up image and adjusts at least one of an image pickup condition in which the picked up image of the space is taken, and a processing condition in which the data are analyzed to recognize the real object, and at least one of the image pickup condition and the processing condition are adjusted based on color information in the data of the picked up image resulting from the plurality of color regions of the calibration chart.