3D Spatial Metadata for VR Temperature and Surface Roughness
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing VR video broadcasting technologies lack the capability to provide high-quality virtual videos that realistically simulate sensory experiences beyond sight and hearing, such as temperature and surface roughness, which are crucial for creating immersive and realistic three-dimensional virtual spaces.
Innovation Solution
A generation apparatus and method that generates three-dimensional spatial data with sensory representation metadata for temperature and surface roughness, and a reproduction apparatus and method that render and represent these sensory elements based on user field of view, using devices like HMDs and tactile presentation systems to enhance the realism of virtual videos.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If VR video broadcasting includes only visual and auditory data, then data transmission load is reduced, but sensory realism and immersion quality deteriorate
Solution Approach 1:
The patent extracts tactile sensory information (temperature and surface roughness) from the complete sensory experience and represents it separately through metadata in three-dimensional spatial data. This allows tactile sensations to be transmitted without including full tactile data streams, reducing overall data load while maintaining sensory realism.
Solution Approach 2:
The patent changes the representation of tactile sensations from direct data transmission to parameter-based metadata description. Temperature and surface roughness are encoded as parameters in sensory representation metadata, allowing efficient transmission while preserving the ability to reproduce tactile experiences.
2Reliability
If three-dimensional spatial data includes sensory representation metadata for temperature and surface roughness, then virtual video quality is improved, but data complexity increases
Solution Approach 1:
The patent uses a universal metadata structure that can represent multiple sensory attributes (temperature, surface roughness) within the existing three-dimensional spatial data framework. This multi-functional approach allows various tactile parameters to be handled through a unified data structure, managing complexity while enhancing video quality.
Solution Approach 2:
The patent introduces sensory representation metadata as an intermediary layer between the three-dimensional spatial data and the tactile reproduction system. This metadata acts as a mediator that carries tactile information without requiring fundamental changes to the core spatial data structure, thus improving quality while limiting complexity increase.
3Reliability
If tactile sensations are reproduced in virtual video, then user immersion is enhanced, but processing and transmission requirements increase
Solution Approach 1:
The patent uses lightweight metadata structures that can be quickly generated, transmitted, and discarded after use. The sensory representation metadata is designed to be computationally inexpensive and suitable for single-use transmission cycles, reducing processing and transmission energy requirements while maintaining immersion enhancement.
Data Source
AI summary
A generation apparatus according to an embodiment of the present technology includes a generation section. The generation section generates three-dimensional spatial data used in rendering processing executed to represent a three-dimensional space and including sensory representation metadata for representing at least one of a temperature or surface roughness with respect to a component of a scene configured by the three-dimensional space. This makes it possible to greatly simplify the representation of the temperature and the surface roughness in the three-dimensional virtual space, thereby reducing a processing load. As a result, it becomes possible to realize a high-quality virtual video.