Bi-directional VR System Using 3D Depth Camera for Immersive Conferencing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video conferencing systems face limitations in sharing content between remote locations, requiring separate channels for user images and data, leading to economic burdens and a lack of interactivity, with 3D depth camera-based methods struggling with resolution and privacy issues.
Innovation Solution
A bi-directional VR system using a 3D depth camera to extract user images and voices, processed by a mixing server to create interactive content in a virtual space, allowing all participants to share high-quality multimedia content regardless of standard sharing functions, with a virtual space background that can be controlled by participants.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If separate dual-channel type is used for user image/voice and shared data, then content sharing is enabled, but device complexity and economic burden increase due to additional codec hardware equipment
Solution Approach 1:
The patent merges the user image/voice channel and shared data channel into a single integrated transmission channel. The mixing server combines the user's video feed with shared content (screens, documents, multimedia) into one composite video stream, eliminating the need for separate codec hardware for data sharing while maintaining full functionality.
Solution Approach 2:
The mixing server acts as a universal platform that handles multiple functions: capturing user video, receiving shared content from various sources (screens, documents, multimedia players), synthesizing these elements, and transmitting the combined stream. This single device replaces multiple specialized components needed in the dual-channel approach.
2Adaptability or versatility
If PIP mode is used to display shared content, then content sharing is achieved, but user interaction capability is limited and the interface appears old-fashioned
Solution Approach 1:
The patent transitions from the traditional PIP (Picture-in-Picture) overlay approach to a full-screen immersive virtual reality environment. Instead of placing small content windows over the video feed, the system creates a unified 3D virtual space where users can interact with shared content naturally, expanding the dimensional experience from 2D overlay to immersive 3D space.
Solution Approach 2:
The system enables dynamic interaction with shared content through the virtual reality interface. Users can manipulate documents, navigate multimedia, and control shared screens with natural gestures and movements, transforming static PIP displays into dynamic, interactive experiences that respond to user actions in real-time.
3Area of stationary object
If 3D depth camera fills background according to camera resolution, then background is displayed, but background content quality deteriorates and interactivity is lost
Solution Approach 1:
The mixing server acts as an intermediary that receives high-resolution background content from external sources (documents, images, videos) and composites it with the user's video feed. This allows the background to be displayed at full quality without being constrained by the depth camera's resolution limitations, as the background content comes from its native high-resolution source.
Solution Approach 2:
The system segments the background display into two independent components: the user's video feed captured by the depth camera and the shared background content from external sources. This segmentation allows each component to maintain its optimal quality - the user video at camera resolution and the background content at its native high resolution - while being combined in the final output.
4Ease of operation
If conventional video conferencing is used, then basic communication is enabled, but immersive experience and sense of being there are reduced
Solution Approach 1:
The patent replaces conventional 2D video conferencing interfaces with a virtual reality system that uses depth cameras and spatial audio processing. This substitution transforms flat screen-based communication into an immersive 3D environment where users experience a sense of presence and spatial awareness, enhancing the communicative experience while maintaining ease of use.
Data Source
AI summary
The present disclosure relates to a bi-directional VR (virtual reality) system and, more particularly, to a bi-directional VR system using a user image and a user voice extracted by a 3D depth camera, and media processed by synthesizing an interactive content image and sound.A bi-directional VR system may include two or more terminals; and a mixing server configured to transmit mixed data generated by processing signals transmitted from the terminals to the respective terminals. At least one main terminal of the two or more terminals may include a 3D depth camera; a main body unit provided with a processor and a memory, and loaded with an operation program; at least two sound devices connected to the main body unit to be controlled by the main body unit, and provided with an audio output terminal and a microphone terminal; and at least two display units connected to the main body unit to be controlled by the main body unit.