Spatial Communication Display for 3D Telepsychiatry Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video conferencing technologies, particularly in telepsychiatry, fail to capture the richness of in-person interactions, leading to Zoom fatigue and difficulties in establishing a therapeutic alliance due to the limitations of 2D screens and bulky VR headsets.
Innovation Solution
A system employing a lenticular display for 3D volumetric video capture and a secondary panoramic display to enhance spatial awareness and object recognition, combined with a Plenoptic camera array and deep learning super-resolution for high-resolution video streaming, providing a more immersive and authentic communication experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If 2D video screens are used for telepsychiatry communication, then device simplicity is maintained, but the richness of in-person interaction and therapeutic alliance establishment deteriorates
Solution Approach 1:
The patent transitions from 2D video screens to volumetric 3D displays, adding a spatial dimension to telepsychiatry communication. The volumetric display creates three-dimensional representations of patients and therapists, enabling natural head movements and spatial relationships that mimic in-person interactions, thereby preserving interaction richness while maintaining device accessibility.
Solution Approach 2:
The system segments the visual information into multiple depth layers, separating foreground subjects from background environments. This layered approach allows independent optimization of each layer's quality and provides viewers with enhanced depth perception and spatial awareness, improving the authenticity of remote interactions without requiring complex hardware changes.
2Loss of information
If VR headsets are used to enhance spatial awareness, then immersion is improved, but device bulkiness and comfort deteriorate
Solution Approach 1:
Instead of requiring users to wear VR headsets, the patent creates physical volumetric copies of the interaction space using light fields and optical elements. The system captures three-dimensional light information and reconstructs it in visible space, allowing users to view immersive 3D representations on standard displays without wearing bulky equipment.
Solution Approach 2:
The patent replaces the mechanical VR headset system with an optical field-based display system. Instead of directing light through lenses and waveguides into the user's eyes, the system creates actual volumetric light structures that can be viewed from multiple angles, eliminating the need for head-mounted mechanical components.
3Measurement precision
If high-resolution volumetric video is captured and transmitted, then image quality is improved, but network bandwidth requirements and processing complexity increase
Solution Approach 1:
The patent extracts only the essential depth and spatial information from the captured scene, separating it from full-color photorealistic data. By capturing volumetric metadata (depth maps, spatial position, head tracking) alongside standard video, the system transmits minimal additional data while enabling high-quality volumetric reconstruction at the display端, reducing network bandwidth requirements.
Solution Approach 2:
The system performs preliminary processing of volumetric data during capture, pre-computing depth information, spatial relationships, and predictive models of subject movement. This advance preparation reduces the computational burden during real-time transmission and display, allowing high-resolution volumetric rendering without excessive processing complexity during operation.
Data Source
AI summary
A method and apparatus for an imaging system capturing light field image data and audio data that is compressed and transmitted over a heterogenous network to the plurality of users. The video data is decompressed to volumetric frames and this data is rendered in a computer synthesised 3D environment employing a volumetric lenticular hardware display to engage foveal vision and a secondary display to engage peripheral vision. This depth enhanced, real-time communication system, is highly amenable for use in Telepsychiatry applications.