Dual-Camera Video Encoding Using Difference Images to Prevent Jitter
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The transmission of large data amounts from multiple camera lenses causes instantaneous network data increases, leading to display picture jitter due to concurrent I frames, affecting user experience.
Innovation Solution
A method involving a remote device with panoramic and close-up camera lenses that encodes panoramic images and calculates difference images based on their correlation, reducing data volume by encoding difference images instead of full close-up images, thereby minimizing network data spikes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If multiple camera lenses compress and transmit image streams simultaneously, then the local device can obtain multiple image streams, but the network bandwidth is exceeded causing picture jitter
Solution Approach 1:
The patent segments the close-up image transmission by using difference images instead of full images. The close-up image is divided into a difference image (containing only changes from the panoramic image) and the panoramic image itself. This segmentation reduces the data amount for close-up images while maintaining quality, allowing multiple camera streams to be transmitted simultaneously without exceeding network bandwidth.
Solution Approach 2:
The patent merges the close-up image transmission with the panoramic image transmission by using the panoramic image as a reference. Instead of transmitting complete close-up images separately, the system combines the close-up information with the panoramic image through difference imaging, reducing redundant data transmission and enabling efficient use of network bandwidth for multiple camera streams.
2Reliability
If I frames are compressed from multiple camera lenses simultaneously, then all image streams are available, but the data amount increases instantly causing picture jitter
Solution Approach 1:
The patent segments the close-up I frame transmission by replacing it with difference images that contain only the essential changes from the corresponding panoramic image. This segmentation maintains the reliability of image stream availability while significantly reducing the instantaneous data amount during I frame transmission, preventing network bandwidth overload.
Solution Approach 2:
The patent changes the parameter of image data representation from complete close-up images to difference images. This parameter change reduces the data amount while maintaining the essential image information, allowing simultaneous I frame transmission from multiple camera lenses without causing instantaneous network data spikes.
3Measurement precision
If close-up images are transmitted as full images, then picture quality is maintained, but data volume is large causing network bandwidth issues
Solution Approach 1:
The patent extracts only the essential information from close-up images by using difference imaging. Instead of transmitting complete close-up images, the system extracts and transmits only the difference between the close-up and panoramic images, along with the panoramic image itself. This extraction maintains picture quality while significantly reducing data volume for close-up content.
Solution Approach 2:
The patent segments the close-up image data into two parts: the panoramic image (containing overall scene information) and the difference image (containing only local changes). This segmentation allows the system to transmit close-up information efficiently by combining these two segments, maintaining quality while reducing overall data volume.
Data Source
AI summary
An encoding and decoding method, an electronic device, a communication system, and a storage medium are provided. The encoding method includes enabling a first camera lens and a second camera lens after an image shooting instruction sent by a second device is received; encoding a first panoramic image to obtain a first compressed image, where the first panoramic image is any image in a first panoramic image stream. Obtaining a first difference image based on the first panoramic image and a first close-up image, where the first close-up image is an image that is in a first close-up image stream and that is collected synchronously with the first panoramic image. Encoding the first difference image to obtain a second compressed image, and sending the first compressed image and the second compressed image to the second device.