Geographical Space Modeling for CGR via Image Classification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for synthesizing a model of a geographical space in computer-generated reality (CGR) experiences are resource-intensive and time-consuming due to the need for computationally expensive correspondence searches between images, especially when many images lack common features.
Innovation Solution
Implementing an image classifier to determine whether sets of images correspond to the same geographical space, thereby selectively performing correspondence searches only on likely matching images, using techniques such as neural networks, regression similarity learning, and feature descriptors to establish correspondences efficiently.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If correspondence searches are performed between all images to synthesize a model of geographical space, then the model accuracy is improved, but the computing resources and time required increase significantly
Solution Approach 1:
The patent applies preliminary action by performing image classification before correspondence search. The system pre-processes images to identify their geographical space correspondence, then uses this classification information to guide subsequent correspondence searches. This preliminary sorting step ensures that only relevant image pairs undergo computationally expensive correspondence analysis, significantly reducing overall processing time while maintaining model accuracy.
Solution Approach 2:
The patent introduces an image classification result as an intermediary between the raw image set and the correspondence search process. This intermediary layer filters and organizes images based on their geographical space characteristics, creating a structured subset of candidate image pairs. The intermediary classification results act as a guide that directs correspondence searches toward promising matches while avoiding futile comparisons between unrelated images.
2Manufacturing precision
If correspondence searches are performed between all images to synthesize a model of geographical space, then the model accuracy is improved, but the computing resources required increase significantly
Solution Approach 1:
The system performs preliminary image classification to identify geographical space correspondences before initiating correspondence searches. This pre-processing step creates a filtered set of candidate image pairs that are likely to share common features, thereby reducing the total number of computationally expensive correspondence operations required while maintaining model synthesis accuracy.
Solution Approach 2:
The patent applies partial action by performing correspondence searches only on a subset of image pairs identified as potential matches through classification, rather than exhaustively searching all possible pairs. This selective approach performs sufficient (but not excessive) correspondence analysis on relevant images, achieving accurate model synthesis with reduced computational resource consumption.
3Productivity
If image classification is performed to filter images before correspondence search, then the computing resources and time required are reduced, but the system complexity increases
Solution Approach 1:
The patent segments the model synthesis process into distinct stages: image classification, correspondence search, and model synthesis. By dividing the overall task into separate functional modules, the system manages complexity through structured organization. Each module handles a specific aspect of the problem, making the overall system more tractable and maintainable despite the added procedural steps.
Solution Approach 2:
The image classification component serves multiple functions within the system: it pre-processes images for correspondence search, identifies geographical space relationships, and provides filtering criteria for subsequent processing stages. This multi-functionality justifies the added complexity by delivering multiple benefits from a single computational step.
Data Source
AI summary
Various implementations disclosed herein include devices, systems, and methods for modeling a geographical space for a computer-generated reality (CGR) experience. In some implementations, a method is performed by a device including a non-transitory memory and one or more processors coupled with the non-transitory memory. In some implementations, the method includes obtaining a set of images. In some implementations, the method includes providing the set of images to an image classifier that determines whether the set of images correspond to a geographical space. In some implementations, the method includes establishing correspondences between at least a subset of the set of images in response to the image classifier determining that the subset of images correspond to the geographical space. In some implementations, the method includes synthesizing a model of the geographical space based on the correspondences between the subset of images.


