Virtual Object Display Using Inlier Entity Classification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional techniques for determining a user's physical environment in computer-generated reality systems are inaccurate due to positioning errors and inability to distinguish between types of entities in the physical environment, leading to irrelevant virtual objects being displayed.

Innovation Solution

The system identifies reliable indicators, or 'inlier entities', within the physical environment using image data from cameras, determining their type based on specific properties such as mobility, consistency, and likelihood of erroneous classification to enhance the accuracy of environment identification.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional positioning techniques are used to determine physical environment, then system complexity is reduced, but measurement precision deteriorates due to positioning errors

Engineering Contradiction:
Improveenvironment determination accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the environment determination task into multiple components: capturing image data from the physical environment, identifying entities within the environment, classifying entity types, and determining the physical environment based on entity type frequencies. This segmentation improves measurement precision by breaking down the complex positioning problem into manageable steps that can be executed with higher accuracy at each stage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces an intermediary classification process between direct positioning and environment determination. Instead of relying solely on positioning data, the patent uses entity identification and classification as an intermediate step that mediates the determination of physical environment. This intermediary layer filters out positioning errors by using entity type analysis as a verification mechanism.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If all entities in the physical environment are analyzed to determine environment type, then measurement precision improves, but use of energy increases due to processing requirements

Engineering Contradiction:
Improveenvironment identification accuracyVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system applies local quality by focusing analysis on specific entity types that are most indicative of the physical environment rather than uniformly analyzing all entities. The patent identifies and prioritizes certain entity types (such as furniture, appliances, or structural elements) that provide stronger signals for environment classification, thereby reducing overall processing energy while maintaining or improving identification accuracy.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system performs partial action by analyzing only the necessary portion of entities required for accurate environment determination. Instead of exhaustively processing every detected entity, the patent implements early termination criteria or sampling strategies that achieve sufficient accuracy with reduced processing, thereby lowering power consumption while maintaining measurement precision.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If entity classification based on multiple properties is implemented, then measurement precision improves, but device complexity increases

Engineering Contradiction:
Improveentity classification accuracyVSAvoidclassification system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The classification system is segmented into distinct property evaluation stages, where entities are assessed based on multiple properties (such as mobility, consistency, and likelihood of erroneous classification) in a structured sequence. This segmentation allows the system to build classification accuracy incrementally without overwhelming complexity, as each property contributes a specific dimension to the overall classification decision.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary classification actions by pre-defining entity properties and classification criteria before actual environment determination. The patent establishes a framework where entity properties are identified and weighted in advance, allowing the classification process to execute efficiently with reduced runtime complexity while maintaining high measurement precision through pre-computed classification rules.

Inventive Principle:
Principle #10Preliminary action

4Reliability

If inaccurate environment determination is used, then device complexity is reduced, but reliability of virtual object display deteriorates

Engineering Contradiction:
Improvevirtual object relevanceVSAvoidenvironment analysis complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system implements feedback mechanisms where the determined physical environment type is used to validate and refine the classification of entities. The patent creates a closed-loop system where environment determination results feed back into entity classification, allowing the system to adjust and improve reliability iteratively. This feedback ensures that virtual object display decisions are based on consistently validated environment assessments.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary environment analysis and entity classification before making virtual object display decisions. By establishing a robust classification framework in advance with predefined rules and criteria, the patent ensures that when environment determination is completed, it is sufficiently reliable to guide virtual object selection, thereby improving reliability without requiring complex real-time adjustments.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12462558B2Presenting virtual objects in a physical environment
Publication Date: 2025.11.04 APPLE INC
  • US12462558B2 patent drawing
  • US12462558B2 patent drawing
  • US12462558B2 patent drawing

AI summary

An exemplary process for identifying a type of a physical environment amongst a plurality of types of physical environments is provided. The process includes obtaining, using the one or more cameras, image data corresponding to a physical environment. The process further includes identifying at least one portion of an entity in the physical environment based on the image data; determining, based on the identified at least one portion of the entity, whether the entity is an entity of a first type; determining a type of the physical environment if the entity is an entity of the first type; and presenting one or more virtual objects and a representation of the entity.