AR Overlay Area Selection Using Luminance Undulation Thresholds

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing Augmented Reality (AR) technologies face issues with impaired visibility of virtual content when displayed over areas with strong texture components, leading to a demand for improved methods to prevent visibility loss and ensure safety by accurately detecting suitable overlay areas.

Innovation Solution

An information processing apparatus and method that detects areas with low undulation changes in luminance and three-dimensional geometry, excluding areas with strong textures or moving objects to enhance visibility and safety by overlaying content on suitable, visually recognizable areas, using imaging units, control units, and sensors to determine optimal display locations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If virtual content is displayed overlaid on real-world images in AR applications, then information provision and user perception are enhanced, but visibility of the virtual content is impaired when texture components are strong in the overlaid display area

Engineering Contradiction:
Improvevisibility of virtual contentVSAvoiddisplay area selection
Core Design Contradiction:
Loss of informationVSAdaptability or versatility

Solution Approach 1:

The patent applies local quality by analyzing different regions of the image individually and selecting display areas based on local texture characteristics. The control unit divides the image into multiple areas and evaluates each area's luminance distribution undulation independently, choosing to display virtual content only in areas where the local texture complexity is below a predetermined threshold. This ensures that each local region is evaluated on its own merits rather than treating the entire image uniformly.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent utilizes parameter changes by measuring the undulation of luminance distribution as a quantitative parameter to characterize texture complexity. The control unit calculates this parameter for each candidate display area and compares it against a predetermined threshold value. By changing from qualitative visual assessment to quantitative parameter-based selection, the system objectively determines suitable display areas and dynamically adjusts content placement based on measured luminance characteristics.

Inventive Principle:
Principle #35Parameter changes

2Area of stationary object

If content is displayed on areas with strong texture components, then more display areas are available, but visibility and safety are compromised

Engineering Contradiction:
Improveavailable display areaVSAvoidvisibility and safety
Core Design Contradiction:
Area of stationary objectVSReliability

Solution Approach 1:

The patent transforms the qualitative concept of 'texture strength' into a quantitative parameter by measuring the undulation of luminance distribution. This allows the system to objectively compare different areas and make reliable decisions about content placement. By establishing a predetermined threshold for this parameter, the system creates a clear criterion for selecting safe display areas, eliminating subjective judgment and improving reliability.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system implements feedback by continuously evaluating the luminance distribution characteristics of candidate display areas and using this information to make informed decisions about where to place virtual content. The control unit measures the undulation parameter, compares it against the threshold, and adjusts content placement accordingly. This closed-loop approach ensures that content is always displayed in areas that meet the visibility and safety criteria.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9563981B2Information processing apparatus, information processing method, and program
Publication Date: 2017.02.07 SONY GROUP CORP
  • US9563981B2 patent drawing
  • US9563981B2 patent drawing
  • US9563981B2 patent drawing

AI summary

An information processing apparatus includes an imaging unit, a control unit, and an output unit. The control unit is configured to detect at least one candidate area for overlaid display of a content, from an image imaged by the imaging unit. The control unit is further configured to detect as an overlaid display area, out of the at least one candidate area, an area where a change in undulation of luminance distribution is equal to or less than a first threshold value. The control unit is further configured to generate the content to be arranged virtually in a visually recognizable manner on the overlaid display area, to be recognized by a user. The output unit is configured to output the generated content overlaid on the overlaid display area.