Image Processor Depth-Based Candidate Area Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Processing shot images in environments with numerous objects is inefficient due to high processing loads caused by the need for high temporal and spatial resolution, leading to delayed response to subject motion.

Innovation Solution

An information processor with a candidate area extraction section, detailed information acquisition section, and output information generation section that uses template matching on depth images to efficiently identify and track target objects by extracting candidate areas and adjusting processing detail based on object distance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If template matching is performed on the entire shot image to ensure high detection accuracy, then measurement precision is improved, but processing time increases and productivity decreases

Engineering Contradiction:
Improvetarget detection accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent divides the shot image into multiple regions based on depth information, performing template matching only in candidate regions where targets are likely to exist. This segmentation approach maintains detection accuracy by focusing on relevant areas while significantly reducing the overall processing time compared to analyzing the entire image.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different processing strategies to different regions of the image based on depth data. Candidate regions identified through depth-based filtering receive detailed template matching processing, while other regions are processed more quickly or skipped, creating local quality variations in processing intensity that optimize both accuracy and speed.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If high temporal and spatial resolution is used for target detection, then measurement precision is improved, but processing load increases

Engineering Contradiction:
Improvetarget detection accuracyVSAvoidprocessing load
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent performs preliminary filtering using depth information before conducting detailed template matching. By pre-identifying candidate regions where targets are likely to be located based on depth data, the system reduces the amount of high-resolution processing needed, thereby lowering the overall processing load while maintaining detection accuracy in the relevant areas.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent extracts and processes only the necessary portions of the image data - specifically, candidate regions identified through depth-based filtering. By taking out and processing only these relevant portions rather than the entire high-resolution image, the system maintains measurement precision where needed while significantly reducing the total processing load.

Inventive Principle:
Principle #2Taking out (Extraction)

3Measurement precision

If detailed analysis is performed on the entire shot image, then measurement precision is improved, but response time to subject motion deteriorates

Engineering Contradiction:
Improveimage analysis accuracyVSAvoidresponse time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the image analysis process into two stages: first, rapid identification of candidate regions using depth information, and second, detailed analysis only within those candidate regions. This segmentation enables the system to maintain high measurement precision in the regions that matter while dramatically reducing the time required compared to analyzing the entire image in detail.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by performing detailed analysis only in candidate regions rather than the entire image. This partial processing approach provides sufficient accuracy for the regions containing potential targets while avoiding the time cost of analyzing all image areas, thus improving response time to subject motion.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9460337B2Information processor and information processing method
Publication Date: 2016.10.04 SONY INTERACTIVE ENTERTAINMENT LLC
  • US9460337B2 patent drawing
  • US9460337B2 patent drawing
  • US9460337B2 patent drawing

AI summary

An image storage section 48 stores shot image data with a plurality of resolutions transmitted from an imaging device. Depth images 152 with a plurality of resolutions are generated using stereo images with a plurality of resolution levels from the shot image data (S10). Next, template matching is performed using a reference template image 154 that represents a desired shape and size, thus extracting a candidate area for a target picture having the shape and size for each distance range associated with one of the resolutions (S12). A more detailed analysis is performed on the extracted candidate areas using the shot image stored in the image storage section 48 (S14). In some cases, a further image analysis is performed based on the analysis result using a shot image with a higher resolution level (S16a and S16b).