3D Scene Metadata Linking for Low-Load Content Reproduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for handling metadata that changes with time in a scene description require complex synchronization between metadata and timed media, leading to increased load in the reproduction process of 3D object content.
Innovation Solution
A scene descriptive file is generated with timed metadata identification information stored in an MPEG_media extension and timed metadata access information associated with the camera object, allowing for synchronized acquisition and display of timed metadata.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If all timed metadata is described in the scene description, then complete metadata information is available, but the reproduction process load increases due to complex synchronization requirements
Solution Approach 1:
The patent divides timed metadata into two categories: essential metadata stored in the scene description and additional timed metadata stored in external files. This segmentation allows the system to maintain complete metadata information while reducing the complexity of the reproduction process by only loading essential metadata into memory.
Solution Approach 2:
The patent extracts timed metadata from the scene description and stores it in external files, keeping only the necessary metadata identification information in the scene description. This extraction reduces the memory burden and simplifies the reproduction process while preserving access to complete metadata information.
2Ease of operation
If all timed metadata is stored in the scene description, then metadata is easily accessible, but memory usage increases
Solution Approach 1:
The patent extracts timed metadata from the scene description and stores it in external files, keeping only metadata identification information (such as URIs and timestamps) in the scene description. This significantly reduces memory usage while maintaining ease of access through the stored identification information.
Solution Approach 2:
The patent prepares metadata identification information in advance during the scene description creation phase, including URIs and timestamps. This preliminary action enables quick access to external metadata files during reproduction without loading all metadata into memory simultaneously.
3Reliability
If complicated synchronization work is performed between metadata and timed media, then accurate synchronization is achieved, but the reproduction process load increases
Solution Approach 1:
The patent performs synchronization preparation in advance by storing timestamp information and metadata identification information in the scene description. During reproduction, the system only needs to match timestamps with pre-identified metadata, significantly reducing the computational load while maintaining synchronization accuracy.
Solution Approach 2:
The patent introduces timestamp information as an intermediary between timed metadata and timed media. This intermediary enables automatic synchronization without complex processing by simply matching timestamps, thereby maintaining synchronization accuracy while improving reproduction efficiency.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present disclosure relates to an information processing device and method capable of suppressing an increase in load of a reproduction process. A scene descriptive file describing a scene of 3D object content is generated, in the scene descriptive file, timed metadata identification information indicating that metadata of an associated external file changes in a time direction being stored in an MPEG_media extension, and timede metadata access information associating a camera object with the metadata being stored in the camera object. Furthermore, timed metadata that changes in the time direction is acquired on the basis of the timed metadata identification information and the timed metadata access information stored in the scene descriptive file, and a display image of the 3D object content is generated on the basis of the acquired timed metadata. The present disclosure is applicable to, for example, an information processing device, an information processing method, or the like.