Object-Recognized SR Content for Context-Sensitive Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing synthesized reality (SR) systems lack the ability to present context-sensitive content based on recognized objects in a physical setting, often requiring user selection from a library of pre-existing content.
Innovation Solution
The system detects objects within a physical setting and presents SR content associated with those objects, using sensor data and orientation/location relative to the object, enabling dynamic and context-sensitive SR experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the system presents pre-existing SR content from a library, then the content is available for user selection, but the system lacks context-sensitivity and requires manual user selection
Solution Approach 1:
The system automatically detects objects in the physical environment and retrieves associated SR content without requiring user selection. The computing device performs object recognition, identifies relevant content from the library, and presents it automatically, allowing the system to serve itself rather than requiring manual user intervention for content selection
Solution Approach 2:
The system continuously monitors the physical environment through image sensors, recognizes objects in real-time, and dynamically adjusts the presented SR content based on the detected objects. This creates a feedback loop where environmental input automatically triggers appropriate content delivery, making the system context-sensitive without manual input
2Adaptability or versatility
If the system uses object recognition and orientation detection, then context-sensitive content is delivered, but the device complexity increases
Solution Approach 1:
The computing device performs multiple functions using integrated components: image capture, object recognition, orientation determination, content retrieval, and presentation. By consolidating these functions into a single multi-functional device rather than separate specialized components, the system achieves dynamic content adaptation without proportionally increasing overall device complexity
Solution Approach 2:
The system uses an intermediary approach by leveraging existing object recognition technologies and content management systems as mediators between the physical environment and SR content delivery. Rather than building all functionality from scratch, the patent integrates existing technologies to handle the complexity of object detection and content matching
Data Source
Figure 1A
Figure 1B
Figure 2
AI summary
In one implementation, a method includes: obtaining image data from an image sensor; recognizing a portion of an object within the image data; obtaining synthesized reality (SR) content - such as mixed reality, augumented reality, augmented virtuality, or virtual reality content - associated with the portion of the object; and displaying the SR content in association with the portion of the object. In some implementations, the SR content is dependent on the orientation of an electronic device or the user relative to the object. In some implementations, the SR content is generated based on sensor data associated with the object.