Electronic Device Image Display Method Using Pose Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality (AR) and virtual reality (VR) experiences lack a suitable storage format, resulting in poor immersive experiences when users replay recorded scenarios as videos, as they cannot recreate the original interactive environment.
Innovation Solution
An image display method for electronic devices that stores experience data including video, pose data, and digital resources, allowing users to relive the experience by displaying digital signage or 3D models based on collected location and orientation information, enhancing immersion by recreating the original scenario.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If experience data is stored and replayed as a video, then the data can be stored and shared, but the user cannot immerse themselves in the original scenario
Solution Approach 1:
The experience data is segmented into multiple components: video data, pose data (location and orientation), and digital resources. This segmentation allows the system to store and replay each component separately, enabling the reconstruction of the original immersive scenario while maintaining manageable data structures
Solution Approach 2:
During the data collection phase, the system preliminarily captures and stores not only video frames but also associated pose data and digital resources. This preliminary action ensures that all necessary information for immersive replay is captured upfront, eliminating the need for complex real-time processing during playback
2Reliability
If only video data is stored, then storage is simple, but the user experience lacks immersion and interactivity
Solution Approach 1:
The stored experience data serves multiple functions: it provides visual information through video frames, spatial context through pose data, and additional information through digital resources. This multi-functionality allows a single dataset to support immersive replay without requiring separate storage systems for each type of information
Solution Approach 2:
The system creates a comprehensive copy of the original experience scenario by capturing video frames, pose data, and digital resources simultaneously. This copying approach preserves the complete contextual information needed for immersion while maintaining a manageable data structure that can be stored and replayed efficiently
3Reliability
If pose data and digital resources are integrated with video data, then immersive replay is enabled, but the data processing complexity increases
Solution Approach 1:
The experience data is segmented into distinct components (video data, pose data, digital resources) that can be processed and stored separately. This segmentation reduces the immediate processing complexity while enabling accurate scenario recreation during replay by systematically integrating the segmented components
Solution Approach 2:
The system uses an intermediary data structure that links video frames with their corresponding pose data and digital resources through timing and spatial relationships. This intermediary structure facilitates the integration of multiple data types without requiring complex real-time processing, as the relationships are pre-established during data collection
Data Source
AI summary
This application provides example image display methods, media, and electronic devices. One example method includes detecting, by an electronic device that has a camera and a display, an operation of opening experience data by a user, where the experience data is stored in the electronic device and includes video data, and the video data includes multiple frames of images. A first interface is displayed in response to the operation, where the first interface includes a first image. Pose change information is determined within a preset duration, where the pose change information includes location movement information of the electronic device and pose change information of the camera. A second image including digital signage or a 3D virtual object is displayed based on pose data during collection of the first image and based on the pose change information, where the multiple frames of images include the second image.