Image Processing Unit Virtual Object Placement Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies fail to accurately combine virtual objects with captured images based on the state or type of objects shown, leading to inappropriate processing and mismatched virtual object placement, such as excess clothing parts being difficult to erase or accessories not matching the user's attire.

Innovation Solution

An image processing apparatus with an image processing unit that determines virtual objects to be combined with a captured image based on the state or type of objects shown, using detection units to identify features and adjust virtual object placement accordingly, such as erasing excess clothing parts or modifying accessories to match the user's attire.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If virtual objects are combined with captured images using existing technologies, then image processing can be performed, but the virtual object placement and object processing are inaccurate and do not reflect the actual state or type of objects shown in the captured image

Engineering Contradiction:
Improveaccuracy of virtual object placementVSAvoidability to adapt to object state or type
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system performs preliminary detection and recognition of objects, their states, and types in the captured image before combining virtual objects. This preliminary analysis enables accurate determination of virtual object placement and appropriate selection/modification based on the detected object characteristics, resolving the contradiction between precision and adaptability

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses feedback from object detection results to adjust virtual object selection and placement. By continuously analyzing the detected object state and type, and using this information to refine virtual object combination, the system achieves both accurate placement and adaptability to different object characteristics

Inventive Principle:
Principle #23Feedback

2Ease of operation

If clothes that a user already wore come out of the clothes, then the captured image shows the excess part, but it is difficult to automatically erase the part that came out

Engineering Contradiction:
Improveautomatic erasing capabilityVSAvoidaccuracy of erasing excess clothing parts
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The system performs preliminary detection of excess clothing parts that come out of other clothes before the erasing operation. By identifying these parts in advance based on object state analysis, the system can then automatically and accurately erase only the detected excess portions, resolving the contradiction between ease of operation and manufacturing precision

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system extracts and identifies the specific excess clothing parts that need to be removed from the captured image. By separating the detection of excess parts from the general object recognition, the system enables precise targeting of only the portions that need erasing, achieving both automation and accuracy

Inventive Principle:
Principle #2Taking out (Extraction)

3Adaptability or versatility

If accessories are combined with captured images without considering the user's attire, then the processing is simple, but the accessory does not match the user's attire

Engineering Contradiction:
Improveaccessory matching capabilityVSAvoidcomplexity of determining appropriate accessories
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system performs preliminary detection and classification of the user's attire (clothes type, style, color) before selecting accessories. This preliminary analysis of object type and state enables the system to automatically determine appropriate accessories that match the detected attire characteristics, resolving the contradiction between adaptability and device complexity

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses the detected attire information to automatically select and combine appropriate accessories without requiring manual input or complex configuration. By making the system self-sufficient in determining accessory matching based on detected object characteristics, the complexity is managed internally while maintaining high adaptability

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11024251B2Image processing apparatus and image processing method
Publication Date: 2021.06.01 SONY GROUP CORP
  • US11024251B2 patent drawing
  • US11024251B2 patent drawing
  • US11024251B2 patent drawing

AI summary

There is provided an image processing apparatus including an image processing unit which combines a virtual object with a captured image. The image processing unit determines the virtual object based on a state or a type of an object shown in the captured image.