Multi-camera Display for Natural Dialogue Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing multi-camera devices, such as mobile communication devices, struggle to optimally present video content captured from front and rear cameras when used to record conversations between two people, as the side-by-side presentation does not effectively convey the dialogue interaction.
Innovation Solution
The system uses a user device with front and rear cameras to capture video content and presents it in a virtual reality or augmented reality environment, where the displays are angled towards each other to create the illusion that the participants are directly interacting, even if they are not oriented towards the cameras.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If front and rear cameras are used to capture video content of two people having a dialogue, then the video content can be captured from both participants, but the side-by-side presentation does not effectively convey the dialogue interaction
Solution Approach 1:
The patent transitions from a 2D side-by-side display to a 3D virtual environment where camera feeds are positioned in spatial coordinates that replicate the physical arrangement of participants. This dimensional change allows viewers to perceive depth and spatial relationships, making the dialogue interaction more natural and intuitive while maintaining easy viewing through the immersive 3D interface.
Solution Approach 2:
The patent introduces a virtual environment as an intermediary layer between the captured video content and the viewer. This virtual space acts as a mediator that reconstructs the physical scene geometry, positioning camera feeds to represent participant locations and orientations. The intermediary virtual environment preserves dialogue interaction information while presenting it in a viewer-friendly format.
2Ease of operation
If displays are positioned to show both participants clearly, then viewing convenience is improved, but the natural interaction appearance is lost
Solution Approach 1:
The patent changes the spatial parameters of display presentation by positioning virtual camera feeds in three-dimensional space according to the actual geometric arrangement of participants. Instead of fixed side-by-side 2D positioning, the system dynamically adjusts display parameters (position, orientation, depth) to match the physical scene, preserving natural interaction appearance while maintaining viewing convenience through the virtual environment.
3Reliability
If participants are not oriented towards the cameras, then natural conversation positioning is maintained, but the video output loses realism
Solution Approach 1:
The patent replaces mechanical camera positioning with virtual positioning in a computational environment. Instead of physically orienting cameras toward participants (which would require complex mechanical adjustment mechanisms), the system uses software-based spatial transformation to achieve the same effect. This substitution maintains video realism while avoiding complex mechanical systems.
Data Source
Figure 1~2a
Figure 2b~3
Figure 4~5
AI summary
This specification relates to a method and apparatus comprising: receiving a first input and a second input from a front camera and a rear camera respectively of a user device, wherein: the first input is a video of a first object having a first orientation with respect to the front camera, the second input is a video of a second object having a second orientation with respect to the rear camera; generating a video output comprising a first part based on the first input and a second part based on the second input; and presenting the video output relative to a viewpoint of a first viewer, such that, at the viewpoint, the first and second parts of the video output are visible at the same time and the first object in the first part of the video output is orientated towards the second object in the second part of the video output.