Geographical Space Modeling for CGR via Image Classification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for synthesizing a model of a geographical space in computer-generated reality (CGR) experiences are resource-intensive and time-consuming due to the need for computationally expensive correspondence searches between images, especially when many images lack common features.

Innovation Solution

Implementing an image classifier to determine whether sets of images correspond to the same geographical space, thereby selectively performing correspondence searches only on likely matching images, using techniques such as neural networks, regression similarity learning, and feature descriptors to establish correspondences efficiently.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If correspondence searches are performed between all images to synthesize a model of geographical space, then the model accuracy is improved, but the computing resources and time required increase significantly

Engineering Contradiction:
Improvemodel accuracyVSAvoidtime required for correspondence search
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by performing image classification before correspondence search. The system pre-processes images to identify their geographical space correspondence, then uses this classification information to guide subsequent correspondence searches. This preliminary sorting step ensures that only relevant image pairs undergo computationally expensive correspondence analysis, significantly reducing overall processing time while maintaining model accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an image classification result as an intermediary between the raw image set and the correspondence search process. This intermediary layer filters and organizes images based on their geographical space characteristics, creating a structured subset of candidate image pairs. The intermediary classification results act as a guide that directs correspondence searches toward promising matches while avoiding futile comparisons between unrelated images.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If correspondence searches are performed between all images to synthesize a model of geographical space, then the model accuracy is improved, but the computing resources required increase significantly

Engineering Contradiction:
Improvemodel accuracyVSAvoidcomputing resources required
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary image classification to identify geographical space correspondences before initiating correspondence searches. This pre-processing step creates a filtered set of candidate image pairs that are likely to share common features, thereby reducing the total number of computationally expensive correspondence operations required while maintaining model synthesis accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies partial action by performing correspondence searches only on a subset of image pairs identified as potential matches through classification, rather than exhaustively searching all possible pairs. This selective approach performs sufficient (but not excessive) correspondence analysis on relevant images, achieving accurate model synthesis with reduced computational resource consumption.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If image classification is performed to filter images before correspondence search, then the computing resources and time required are reduced, but the system complexity increases

Engineering Contradiction:
Improveefficiency of model synthesisVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the model synthesis process into distinct stages: image classification, correspondence search, and model synthesis. By dividing the overall task into separate functional modules, the system manages complexity through structured organization. Each module handles a specific aspect of the problem, making the overall system more tractable and maintainable despite the added procedural steps.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The image classification component serves multiple functions within the system: it pre-processes images for correspondence search, identifies geographical space relationships, and provides filtering criteria for subsequent processing stages. This multi-functionality justifies the added complexity by delivering multiple benefits from a single computational step.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11488352B1Modeling a geographical space for a computer-generated reality experience
Publication Date: 2022.11.01 APPLE INC
  • US11488352B1 patent drawing
  • US11488352B1 patent drawing
  • US11488352B1 patent drawing

AI summary

Various implementations disclosed herein include devices, systems, and methods for modeling a geographical space for a computer-generated reality (CGR) experience. In some implementations, a method is performed by a device including a non-transitory memory and one or more processors coupled with the non-transitory memory. In some implementations, the method includes obtaining a set of images. In some implementations, the method includes providing the set of images to an image classifier that determines whether the set of images correspond to a geographical space. In some implementations, the method includes establishing correspondences between at least a subset of the set of images in response to the image classifier determining that the subset of images correspond to the geographical space. In some implementations, the method includes synthesizing a model of the geographical space based on the correspondences between the subset of images.