Sum Picture Generation for Stable Position Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The brightness range of photographed pictures can vary widely due to factors like subject position, color, and lighting conditions, leading to inaccuracies in information acquisition and display representation.

Innovation Solution

An information processing device that acquires and adds pixel values from multiple frames to generate a sum picture, enhancing brightness and stability for accurate position information and image representation, using a combination of cameras and image analysis to integrate depth images and adjust for varying conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If photographed pictures are used to obtain information about a subject, then the information can be acquired, but the brightness range variation causes failure to achieve required accuracy

Engineering Contradiction:
Improveaccuracy of position informationVSAvoidstability of brightness range
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent combines multiple photographed pictures (first photographed picture and second photographed picture) into a sum picture by adding pixel values. This merging process integrates information from multiple frames to produce a result picture with stable and accurate position information, overcoming the brightness range variation problem that affects individual pictures.

Inventive Principle:
Principle #5Merging (Combining)

2Illumination intensity

If photographed pictures are used for display, then image representation is achieved, but brightness range variation prevents full performance of display device

Engineering Contradiction:
Improvebrightness rangeVSAvoidimage representation accuracy
Core Design Contradiction:
Illumination intensityVSManufacturing precision

Solution Approach 1:

The patent merges multiple photographed pictures with different brightness characteristics into a sum picture. This combination enables the system to achieve both wide brightness range and accurate image representation, allowing the display device to operate at full performance by presenting a result picture with stable and appropriate brightness characteristics.

Inventive Principle:
Principle #5Merging (Combining)

3Illumination intensity

If exposure time or light intensity is increased to improve brightness, then illumination intensity improves, but noise increases and accuracy decreases

Engineering Contradiction:
ImprovebrightnessVSAvoidaccuracy of position information
Core Design Contradiction:
Illumination intensityVSMeasurement precision

Solution Approach 1:

Instead of increasing exposure time or light intensity on a single picture, the patent combines multiple pictures taken under different conditions. This merging approach amplifies the effective brightness through accumulation of signal while maintaining accuracy by averaging out noise across multiple frames, eliminating the need to adjust exposure times or light intensity.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11030732B2Information processing device, information processing system, and image processing method for generating a sum picture by adding pixel values of multiple pictures
Publication Date: 2021.06.08 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11030732B2 patent drawing
  • US11030732B2 patent drawing
  • US11030732B2 patent drawing

AI summary

A picture data acquisition unit 52 of an information processing device 10 acquires data of frames of a moving picture from an imaging device 12. A picture data storage unit 54 stores data of at least a predetermined number of past frames. A picture adding unit 56 generates a sum picture obtained by adding pictures of the past frame and a current frame together on a pixel value by pixel value basis. An image analysis unit 58 extracts feature points and acquire position information from each of the sum pictures and the pictures of the current frame, and integrates the acquired pieces of position information. An information processing unit 60 performs information processing using the position information, and an output unit 62 outputs a result of the information processing to a display device 16.