Head-Mounted Device AR Content Creation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality systems lack the capability for users to create and share virtual content directly from a head-mounted device without relying on external clients, limiting their ability to interactively provide multimedia content associated with physical objects in real-time.
Innovation Solution
A head-mounted device (HMD) system that enables users to create, associate, and share virtual content with physical objects by using visual references, tracking data, and sensors, allowing for the generation and display of multimedia content, such as video and audio, directly on the HMD, and storing or retrieving this content from a server based on object identifiers and conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If users rely on external clients to create and share virtual content, then content creation capability is limited, but device functionality remains simple
Solution Approach 1:
The patent merges the content creation, storage, and sharing functions into the head-mounted device itself. The HMD includes a camera system for capturing visual references, a processor for generating virtual content, and memory for storing content locally, eliminating the need for external clients and enabling self-contained AR content creation capability.
Solution Approach 2:
The head-mounted device is designed to perform multiple functions: capturing visual references through integrated cameras, processing and generating virtual content, storing content locally in memory, transmitting content to servers, and displaying augmented reality content. This multi-functionality replaces the need for separate external client devices.
2Productivity
If virtual content is stored on a server, then content sharing is enabled, but real-time interaction is delayed
Solution Approach 1:
The system performs preliminary actions by storing virtual content both locally in the HMD's memory and on remote servers in advance. When a user needs to share or access content, the locally stored content is immediately available without requiring real-time server communication, thus eliminating delays while maintaining the ability to share content through the server infrastructure.
3Measurement precision
If the HMD captures and processes visual references in real-time, then object recognition accuracy improves, but processing speed decreases
Solution Approach 1:
The HMD implements a two-level processing approach: first, a simplified visual reference capture and initial processing occurs in real-time for immediate object identification; second, more comprehensive and accurate processing occurs when the device is docked with a host computer, which performs detailed analysis and generates enhanced virtual content. This partial real-time processing maintains speed while achieving high accuracy through subsequent detailed processing.
Data Source
AI summary
A system and method for generating a virtual content to a physical object is described. The system accesses a video that was captured by a camera. The video depicts a user performing a physical operation in relation to a physical object. The system determines metadata identifying positions of the camera relative to the physical object during the capturing of the video, identifies feature points of the physical object in the video, and retrieves a virtual object based on the feature points of the physical object. The system generates virtual content based on the video, the metadata, and the virtual object, and stores the object identifier and the virtual content relationally in a data storage that stores multiple sets of virtual content associated with multiple physical objects and their corresponding object identifiers.