Mobile Terminal Panoramic Video via Multi-Camera Merging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current mobile terminals cannot provide a panoramic image during video communication, limiting users' ability to show their surroundings during video calls, as they only utilize images from a single camera or switch between front and back camera views.
Innovation Solution
A method and apparatus that utilize multiple cameras on a mobile terminal to capture and combine images, transmitting them to a server which processes and augments the data to create a panoramic image, which is then transmitted back to the other party during video communication.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If only a single camera is used for video communication, then the device complexity is reduced, but the capability to provide panoramic images is lost
Solution Approach 1:
The patent combines images from multiple cameras (front camera capturing user image and back camera capturing surrounding environment) to create a panoramic image. This merging of multiple image sources enables panoramic capability while maintaining reasonable device complexity by utilizing existing camera hardware for a new combined function.
2Adaptability or versatility
If multiple cameras are used to capture both user and surrounding environment, then the panoramic image capability is improved, but the device complexity increases
Solution Approach 1:
The patent makes existing camera hardware serve multiple functions: the front camera captures both user images and surrounding environment images, while the back camera captures additional environmental views. This multi-functionality enables panoramic image creation without requiring dedicated specialized hardware, thus limiting the increase in device complexity.
3Loss of information
If images from multiple cameras are captured and combined, then the comprehensiveness of the view is improved, but the processing complexity and time increase
Solution Approach 1:
The patent performs preliminary actions by capturing images from multiple cameras simultaneously during the video communication session. The captured images are then combined to create panoramic views in real-time, allowing the system to prepare comprehensive environmental information without significant delay to the communication flow.
Data Source
Figure 1A
Figure 1B
Figure 2
AI summary
Provided is a method and apparatus for performing video communication in a mobile terminal, by which during video communication in the mobile terminal, a panoramic image can be created and provided. To this end, a method for performing video communication in a mobile terminal includes transmitting image data captured by at least two cameras during video communication to a server, if receiving image data associated with the captured image data from the server, creating a panoramic image by using the captured image data and the associated image data, and transmitting the created panoramic image to another mobile terminal which is performing the video communication.