3D Video Stream Synchronization via Shared Viewing Direction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing videoconferencing technologies face challenges in coordinating the viewing of multiple users when viewing a 3D space, as users may have different points of view, making it difficult for them to see the same region of interest, especially when one user's viewing direction is not synchronized with others.
Innovation Solution
The system communicates information about each user's point of view (POV) to other users' devices, allowing them to update their video streams dynamically and optionally includes graphical elements to indicate which regions are being viewed or of interest by others, enabling synchronized viewing and control over the viewing direction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If each user controls their own point-of-view independently, then user autonomy and viewing flexibility are improved, but coordination difficulty and communication overhead increase
Solution Approach 1:
The system implements feedback by continuously transmitting each user's point-of-view information to other users' devices. This allows users to see what others are viewing and adjust their own views accordingly, creating a closed-loop coordination mechanism that maintains both individual flexibility and group synchronization.
Solution Approach 2:
The system uses an intermediary communication channel that transmits POV information between all users. This mediator facilitates coordination without restricting individual viewing control, allowing users to independently select their views while the intermediary ensures everyone has access to others' viewing directions for synchronization.
2Reliability
If the video stream is updated dynamically based on other users' POV information, then viewing coordination and synchronization are improved, but data transmission volume and processing load increase
Solution Approach 1:
The system extracts only the essential POV information (viewing direction parameters) from the complete video stream and transmits this extracted data between users. This allows dynamic synchronization of viewing perspectives without transmitting redundant video data, significantly reducing data volume while maintaining synchronization reliability.
Solution Approach 2:
The system changes the parameter representation from transmitting complete video frames to transmitting only the critical viewing direction parameters. This parameter transformation enables efficient data transmission that maintains synchronization by updating only the necessary directional information rather than entire video streams.
3Loss of information
If graphical elements are added to indicate regions of interest, then user awareness and coordination are improved, but visual clutter and interface complexity increase
Solution Approach 1:
The system uses color-coded graphical elements (such as colored indicators or highlights) to represent different users' points of view and regions of interest. This visual encoding method efficiently communicates multiple users' viewing information without requiring complex text or detailed graphics, reducing interface complexity while maintaining information completeness.
Data Source
AI summary
Described are techniques for shared viewing of video among remote users, including methods and corresponding systems and apparatuses. A first computer device operated by a first user can receive an input video stream representing a three-dimensional (3D) space. From the input video stream, an output video stream corresponding to the 3D space as seen from a viewing direction specified by the first user is generated. The output video stream includes images that cover a narrower field of view compared to the input video stream. The first computer device can receive information indicating a viewing direction specified by a second user, who is a user of a second computer device. The first computer device can update the output video stream based on the information indicating the viewing direction specified by the second user. The updated output video stream can then be presented on a display of the first user.