Mixed Reality Image Encoding with Virtual-Physical Pixel Indexing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality systems face challenges in seamlessly integrating virtual and physical image data, leading to inefficiencies in data management and rendering, particularly in mixed reality applications where real-time interaction with physical environments is required.
Innovation Solution
A method of encoding virtual image data with physical image data within a formatted image file, where each spatial image element includes data fields for both physical and virtual information, along with indexing data associating identifiers with spatial elements, allowing for differentiated rendering processes for physical and virtual image information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If virtual image data and physical image data are integrated in current augmented reality systems, then mixed reality experience is achieved, but data management and rendering efficiency deteriorate
Solution Approach 1:
The patent segments the image data into distinct virtual and physical components, each with separate data fields. Virtual image data and physical image data are encoded independently within the same formatted file, allowing the rendering system to process and optimize each segment separately, thereby maintaining rendering efficiency while achieving mixed reality integration
Solution Approach 2:
The patent introduces an intermediary encoding format that acts as a mediator between virtual and physical image data. This formatted image file structure with separate data fields serves as an intermediate representation that enables efficient data management and rendering by providing a standardized interface for processing both types of data without direct integration of their processing pipelines
2Adaptability or versatility
If virtual image data and physical image data are integrated in current augmented reality systems, then mixed reality experience is achieved, but data management complexity increases
Solution Approach 1:
The patent creates a universal formatted image file structure that can accommodate both virtual and physical image data through standardized data fields. This multi-functional encoding format enables a single data management system to handle both types of data consistently, reducing complexity by eliminating the need for separate management systems while still achieving integrated mixed reality functionality
Data Source
AI summary
Methods, computer program products, and systems are presented. The method computer program products, and systems can include, for instance: obtaining virtual image data representing a virtual object; and encoding the virtual image data with physical image data to provide a formatted image file, wherein the encoding includes for a plurality of spatial image elements providing one or more data field that specifies physical image information and one or more data field that specifies virtual image information based on the virtual image data so the formatted image file for each of the plurality of spatial image elements provides physical image information and virtual image information, and wherein the encoding includes providing indexing data that associates an identifier for the virtual object to spatial image elements for the virtual object.