HMD Camera Object Detection for Immersive Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users of 3D devices face difficulties in locating and accessing food and beverages while wearing head-mounted displays, as the devices block the view of the surrounding environment, disrupting the immersive experience.
Innovation Solution
Incorporating cameras into head-mounted displays that capture images of the user's environment, allowing for the detection and display of nearby objects like food and drinks within the simulated environment, using labels with geometric shapes and colors for easy recognition, and integrating parental control settings to manage what is shown.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If a head mounted display is worn to view a simulated environment, then the user experiences an immersive 3D environment, but the user cannot locate or access food and beverages in the real world
Solution Approach 1:
The patent introduces an intermediary system consisting of cameras mounted on the headgear and a processing device that mediates between the user and the real environment. The cameras capture images of the surrounding environment, and the processing device identifies objects and presents their locations within the simulated environment, allowing the user to access real-world objects without removing the headgear.
Solution Approach 2:
The patent creates a copy of the real-world environment by capturing images with cameras and presenting visual representations of detected objects within the simulated environment. This copy allows the user to locate and access real objects (food, beverages) through the simulated environment without breaking immersion.
2Ease of manufacture
If the head mounted display blocks the view of the real environment, then the simulated environment remains immersive, but the user loses awareness of surrounding objects
Solution Approach 1:
The camera system and processing device act as intermediaries that capture and process information about the real environment, making it available within the simulated environment without requiring the user to remove the headgear or break immersion.
Solution Approach 2:
The patent adds a new dimension of information presentation by overlaying or integrating visual representations of real-world objects within the simulated environment. This allows the user to perceive both the simulated environment and real-world objects simultaneously in a unified visual space.
3Difficulty of detecting and measuring
If cameras are added to capture the environment, then object detection is enabled, but device complexity increases
Solution Approach 1:
The headgear device is designed with multi-functionality by integrating cameras, processing capabilities, and display functions into a single system. This allows the same device to provide both the simulated environment and real-world object detection without requiring separate independent systems.
Data Source
AI summary
Methods and apparatus for determining location of objects surrounding a user of a 3D rendering and display system and indicating the objects to the user while the user views a simulated environment, e.g., on a headmounted display, are described. A sensor, e.g. camera, captures images or senses the physical environment where the user of the system is located. One or more objects in the physical environment are identified, e.g., by recognizing predetermined symbols on the objects and based on stored information indicating a mapping between different symbols and objects. The location of the objects relative to the user's location in the physical environment is determined. A simulated environment, including content corresponding to a scene and visual representations of the one or more objects, is displayed. In some embodiments visual representation are displayed in the simulated environment at locations determined based on the location of the objects relative to the user.