Depth-Time Mapping in Sensory Substitution for Spatial Perception
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing sensory substitution apparatuses struggle to accurately convey spatial and object shape information due to the overlapping conversion of visual information, making it difficult for users to perceive distance and object details effectively.
Innovation Solution
The apparatus segments visual information based on depth to generate multiple depth images, maps sensory substitution information to a time axis according to depth, and sequentially outputs this information to allow for accurate perception of spatial and object shape.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If all visual information is converted and transmitted at once, then the conversion process is simple and fast, but the sensory substitution information overlaps and users cannot accurately perceive spatial and object shape information
Solution Approach 1:
The patent segments the 3D image into multiple depth images based on depth information, converting visual information from a single holistic conversion to segmented depth-based conversions. This segmentation allows spatial information to be preserved while maintaining conversion efficiency, resolving the contradiction between fast conversion and accurate spatial perception.
2Loss of time
If all visual information is converted and transmitted at once, then the processing time is short, but users cannot accurately perceive distance and object details
Solution Approach 1:
The patent divides the 3D image into multiple depth images segmented by depth information, allowing the system to process and transmit spatial information in organized segments rather than all at once. This maintains processing efficiency while enabling accurate distance perception through the structured depth-based segmentation.
Solution Approach 2:
The patent introduces a depth dimension to the visual information conversion process by segmenting images based on depth layers. This dimensional approach allows the system to preserve spatial and distance information while maintaining processing time efficiency through the organized structure of depth-based segmentation.
3Measurement precision
If visual information is segmented by depth, then spatial information transmission is improved, but the device complexity increases
Solution Approach 1:
The patent applies depth-based segmentation to divide the 3D image into multiple depth images, which simplifies the information structure and makes spatial information more manageable. This segmentation approach, while adding processing steps, organizes complexity in a way that actually reduces the difficulty of transmitting and perceiving spatial information accurately.
Data Source
AI summary
Provided are an apparatus and method for sensory substitution based on depth-time mapping. The apparatus for sensory substitution based on depth-time mapping according to the present invention includes an image segmentation unit configured to generate a plurality of depth images by segmenting three-dimensional (3D) image information based on depth, a sensory substitution unit configured to generate pieces of sensory substitution information by converting at least any one of the plurality of depth images into preset sensory information, a depth-time mapping unit configured to map the sensory substitution information to a time axis based on depth information corresponding to the depth image, and an output unit configured to sequentially output the pieces of sensory substitution information in order mapped to the time axis.