Reality Interface Mapping for External Device Function Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in accurately and efficiently mapping external devices in a physical environment to their representative objects in a computer-generated reality interface, requiring precise recognition and identification of the external devices for function access.
Innovation Solution
The system employs image recognition, three-dimensional object recognition, and location recognition to detect external devices in a physical environment, and displays a representation of the environment along with affordances that, when activated, allow the devices to perform corresponding functions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If image recognition and object recognition techniques are used to map external devices to reality interface objects, then the accuracy of device identification is improved, but the complexity of the system increases
Solution Approach 1:
The patent introduces an intermediary mapping system that connects external devices to reality interface objects through multiple recognition techniques. The system uses image data processing, object recognition algorithms, and location recognition as intermediary layers to bridge the physical device and its virtual representation, thereby improving identification accuracy while managing system complexity through modular architecture
Solution Approach 2:
The reality interface system is designed with multi-functional capabilities to handle various types of external devices simultaneously. The same mapping mechanism works for different device categories (audio devices, display devices, computing devices), making the system universal and reducing the need for device-specific handling logic, thus improving accuracy without proportionally increasing complexity
2Reliability
If multiple recognition techniques are employed to identify external devices, then the reliability of device detection is improved, but the time required for processing increases
Solution Approach 1:
The system performs preliminary actions by pre-processing image data and maintaining ready-state recognition models before actual device mapping is needed. Location recognition and initial object detection are performed in advance, so when an external device needs to be mapped, the system already has processed data and identified candidates, reducing real-time processing time while maintaining high reliability through multiple verification techniques
Data Source
AI summary
In an exemplary process, an electronic device obtains, from an external device, information specifying one or more available functions of the external device, and image data of a physical environment that includes the external device is captured by an image sensor. The electronic device then determines that the image data includes a representation of the external device, and in response, a display concurrently presents a view of the physical environment and a user-activatable virtual object corresponding to a first function of the one or more available functions of the external device, where the user-activatable virtual object is selected from a plurality of candidate user-activatable virtual objects based on the information specifying the one or more available functions of the external device.