Method for enhancing smoothness and clearness of video call under weak signal and narrow network bandwidth

By analyzing and comparing multi-frame images in video calls, differential data are formed, and video communication mode is switched according to the terminal activity status, the problem of smoothness and clarity of video calls under weak signal narrow network bandwidth is solved, and the problem of unreduced video calls is achieved Improve the smoothness and clarity of video calls under picture quality.

CN118890340APending Publication Date: 2024-11-01SHANGHAI SEARCH INFORMATION TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410916327.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-09
Publication Date
2024-11-01

AI Technical Summary

Technical Problem

Under the conditions of weak signals and narrow network bandwidth, the prior art improves fluency and clarity by adjusting the display area of ​​the video screen, resulting in a decrease in the overall display effect of video calls, and it is impossible to improve video calls without sacrificing the details and size of the picture. fluency and clarity.

Method used

By analyzing the basic picture at the beginning of the video call, the local picture and the basic picture are compared and processed to form differential data, reduce the amount of differential data sent, use multi-axis sensors to detect the terminal activity status, and switch video Communication mode to optimize picture transmission to ensure picture fluency and clarity.

Benefits of technology

Without sacrificing frame rate and picture quality, improve the smoothness and clarity of video calls, avoid video picture lag, prevent picture resolution from being reduced, and improve user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118890340A_ABST
    Figure CN118890340A_ABST
Patent Text Reader

Abstract

The invention discloses a method for enhancing smoothness and clearness of a video call under a weak signal narrow network bandwidth, which relates to the technical field of communication and is applied to a first video call terminal and a second video call terminal. Establishing a video communication connection between the first video call terminal and the second video call terminal; and the second video call terminal receives the multiple frames of pictures from the first video call terminal and stores the multiple frames of pictures in the second storage unit. According to the invention, at the beginning of establishment of the video communication, the basic picture is obtained by analyzing the multiple frames of pictures, and the local picture is compared with the basic picture for difference analysis, so that the sending amount of difference data can be reduced, the occupation of network bandwidth is reduced, the fluency and definition of the video call picture can be improved on the basis of not sacrificing the frame rate and the picture quality, and the user experience is improved. The phenomenon that a real-time video picture is stuck under the conditions of weak signals and narrow network bandwidth is avoided, and the situation that the resolution of the picture is reduced in the video call process and the experience is affected is prevented.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and in particular to a method for enhancing the smoothness and clarity of video calls under weak signal and narrow network bandwidth. Background Art

[0002] The use of telecommunications technology and mobile communication technology to convert and transmit signals can achieve point-to-point audio and video communication; Internet audio and video is built on an IP network, introducing the communication method of the SIP server and cooperating with the IP link to realize calls. In addition, by integrating IP and LTE / NR networks, the introduction of the IMS (IP Multimedia Subsystem) communication method is the basic network architecture of the current Internet. In addition to meeting the communication exchange capabilities of different media (i.e. video formats) categories, it is also required to have a high level of security authentication access and control management capabilities. During audio and video calls, in order to ensure the fluency, clarity and synchronization of audio and video, video calls often require higher bandwidth than audio calls.

[0003] However, when the signal strength and network bandwidth cannot meet the requirements of video call picture smoothness and clarity, frame drops will occur during the video call, causing the video to freeze and the audio and picture to be out of sync, affecting the smoothness of the video call and the clarity of the picture. Currently, most of the means to solve the above problem are to obtain the real-time network status during the video playback process, determine whether the real-time network status meets the first predetermined condition, and adjust the display area of ​​the video screen according to the determination result.

[0004] However, although the existing technical solutions can adjust the visual clarity of the video, they sacrifice the details and size of the video image, resulting in a decrease in the overall display effect of the video call. To this end, we propose a method to enhance the smoothness and clarity of video calls under weak signal and narrow network bandwidth. Summary of the invention

[0005] The purpose of the present invention is to provide a method for enhancing the smoothness and clarity of video calls under weak signals and narrow network bandwidth, so as to solve the problem that the prior art proposed in the above background technology sacrifices the details and size of the video picture, resulting in a decrease in the overall display effect of the video call.

[0006] To achieve the above object, the present invention provides the following technical solutions: a method for enhancing the smoothness and clarity of video calls under weak signal and narrow network bandwidth, the method being applied to a first video call terminal and a second video call terminal;

[0007] Establishing a video communication connection between a first video call terminal and a second video call terminal; the first video call terminal includes a first main circuit unit, a first storage unit and a first image display unit; the second video call terminal includes a second main circuit unit, a second storage unit and a second image display unit;

[0008] The second video call terminal receives multiple frames of images from the first video call terminal and stores them in a second storage unit, and the second main circuit board analyzes the common part of the received images and the local images to obtain a frame of images;

[0009] The one frame of picture is a basic picture, and is sent by the second video calling terminal to the first video calling terminal;

[0010] The first video call terminal compares the basic image from the second video call terminal with the local image, and sends the comparison result to the second video call terminal;

[0011] The second video call terminal parses the comparison result from the first video call terminal to obtain a new picture.

[0012] As a further solution of the present invention: the plurality of frames are not less than 100 frames;

[0013] The comparison process includes the first video call terminal comparing the local data with a received frame of basic picture to form difference data, and then sending the difference data to the second video terminal after compression.

[0014] As a further solution of the present invention: the analysis process includes the second video call terminal decoding and analyzing the difference data from the first video call terminal through the second main channel unit, and supplementing the difference data according to the basic picture.

[0015] As a further solution of the present invention: the first video call terminal and the second video call terminal respectively include at least one multi-axis sensor unit and a motion amplitude detection unit, and the multi-axis sensor unit detects whether the first image display unit or the second image display unit is in a stationary state;

[0016] The motion amplitude detection unit calculates the posture feature value through normalization processing, and judges the change amplitude of the picture based on it. It can detect small-amplitude postures, which is conducive to maintaining the smoothness of the picture.

[0017] As a further solution of the present invention: the multi-axis sensor unit is a first three-axis sensing unit and a second three-axis sensing unit, the first three-axis sensing unit is electrically connected to the first main circuit unit, and the second three-axis sensing unit is electrically connected to the second main circuit unit.

[0018] As a further solution of the present invention: the multi-axis sensor unit is a first six-axis sensor unit and a second six-axis sensor unit, the first six-axis sensor unit is electrically connected to the first main circuit unit, and the second six-axis sensor unit is electrically connected to the second main circuit unit.

[0019] As a further solution of the present invention: when the multi-axis sensor unit detects that the first video call terminal is in a stationary state, the basic screen at the beginning of establishing the communication of the first video call terminal is run;

[0020] When the multi-axis sensor unit detects that the second video call terminal is in a stationary state, the basic screen at the beginning of establishing communication with the second video call terminal will be run.

[0021] As a further solution of the present invention: the first image display unit and the second image display unit have a video enhancement mode and a real-time video communication mode respectively;

[0022] Among them, the video enhancement mode is established based on a strong signal.

[0023] As a further solution of the present invention: when the multi-axis sensor unit detects that the first video call terminal is in an active state, the first video call terminal recalculates a frame of basic image and sends the frame of basic image to the second video call terminal.

[0024] As a further solution of the present invention: when the multi-axis sensor unit detects that the second video call terminal is in an active state, the second video call terminal recalculates a frame of basic image and sends the frame of basic image to the first video call terminal.

[0025] A system for enhancing the smoothness and clarity of video calls based on weak signal and narrow network bandwidth, the system being applied to a first video call terminal and a second video call terminal; the first video call terminal comprising a first main circuit unit, a first storage unit and a first image display unit; the second video call terminal comprising a second main circuit unit, a second storage unit and a second image display unit;

[0026] The second video call terminal receives multiple frames of images from the first video call terminal and stores them in a second storage unit, and the second main circuit board analyzes the common part of the received images and the local images to obtain a frame of images;

[0027] The one frame of picture is a basic picture, and is sent by the second video calling terminal to the first video calling terminal;

[0028] As a further solution of the present invention: the system also includes:

[0029] A comparison unit, configured to compare the basic image received by the first video call terminal with the local image and obtain a comparison result;

[0030] A sending unit, used to send the comparison processing result to the other party's call terminal;

[0031] The parsing unit is used to parse the comparison processing result from the other party's call terminal to obtain a new picture;

[0032] The detection unit is a multi-axis sensor unit, which is used to detect the activity state of the call terminal and send the detected state result to the state switching unit;

[0033] As a further solution of the present invention: the activity state includes a static state or a moving state;

[0034] Table 1 below is a mapping table of the active state and state switching of the call terminal:

[0035] Status Results Whether to send a switching signal Whether to switch state Static state no no Movement status yes yes

[0036] As a further solution of the present invention: the system also includes:

[0037] A state switching unit switches the real-time video screen button according to the motion state of the call terminal;

[0038] The real-time video image buttons include an enhanced video button and a real-time video communication button;

[0039] As a further solution of the present invention: when the detection unit detects that the call terminal is in a stationary state, the basic screen completed at the beginning of the call terminal establishment is run on the call terminal in the stationary state;

[0040] When the detection unit detects that the call terminal is in motion, the detection unit sends a switching signal to the state switching unit, and the state switching unit turns off the enhanced video button of the call terminal and turns on the real-time video communication button. During the real-time video communication process, the storage unit stores multiple frames of images in real time;

[0041] As a further solution of the present invention: the plurality of frames are not less than 100 frames;

[0042] As a further solution of the present invention: when the detection unit detects again that the calling terminal is in a stationary state, the calling terminal where the detection unit is located recalculates the first frame of the basic picture and sends the basic picture to the other calling terminal.

[0043] Compared with the prior art, the present invention has the following beneficial effects:

[0044] The present invention obtains a basic picture by analyzing multiple frames at the beginning of video communication, and compares the local picture with the basic picture for difference analysis, thereby reducing the amount of difference data sent and reducing the occupation of network bandwidth. It can improve the smoothness and clarity of video call pictures without sacrificing frame rate and picture quality, avoid the phenomenon of real-time video pictures being stuck under conditions of weak signals and narrow network bandwidth, and prevent the resolution of the picture from being reduced during the video call and affecting the experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] Figure 1 A flow chart of a method for enhancing the smoothness and clarity of video calls according to the present invention;

[0046] Figure 2 A system diagram of the method for enhancing the smoothness and clarity of video calls according to the present invention. DETAILED DESCRIPTION

[0047] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0048] Real-time example 1:

[0049] The present invention discloses a method for enhancing the smoothness and clarity of video calls under weak signals and narrow network bandwidth. The method is applied to a first video call terminal and a second video call terminal; a video communication connection is established between the first video call terminal and the second video call terminal; the first video call terminal includes a first main circuit unit, a first storage unit and a first image display unit; the second video call terminal includes a second main circuit unit, a second storage unit and a second image display unit; the second video call terminal receives multiple frames of images from the first video call terminal and stores them in the second storage unit, and the second main circuit board analyzes the common part of the received images and the local images and obtains a frame of images; the one frame of images is a basic image, which is sent by the second video call terminal to the first video call terminal; the first video call terminal compares the basic image from the second video call terminal with the local image, and sends the comparison result to the second video call terminal; the second video call terminal parses the comparison result from the first video call terminal to obtain a new image.

[0050] like Figure 1 The present invention is a flow chart of a method for enhancing the smoothness and clarity of a video call, which may include:

[0051] Step 100: Establishing a video communication connection of the call terminal;

[0052] The call terminal includes a first video call terminal and a second video call terminal, and the first video call terminal and the second video call terminal can be a mobile phone, a computer or a tablet computer;

[0053] The first video call terminal and the second video call terminal respectively include at least one multi-axis sensor unit and a motion amplitude detection unit, and the multi-axis sensor unit detects whether the first image display unit or the second image display unit is in a stationary state;

[0054] Step 101: Analyze the common part of the received picture and the local picture and obtain a frame of picture;

[0055] The received pictures are at least 100 frames. For example, when the received pictures are 100 frames, a common picture is obtained by analysis.

[0056] Step 102: taking a frame of picture in step 101 as a basic picture;

[0057] The basic picture is stored in a storage unit of the analyzed telephone terminal;

[0058] Step 103: Send the basic image in step 102 to the other terminal for difference comparison and compressing the difference data;

[0059] The comparison process includes the first video call terminal comparing the local data with the received frame of the basic picture to form difference data, and then sending the difference data to the second video terminal after compression.

[0060] Step 104: Send the difference data compressed in step 103 to the other terminal;

[0061] Step 105: The terminal receiving the difference data analyzes the difference data and supplements the difference data on the basic picture to obtain a new picture frame;

[0062] The analysis process includes the second video call terminal decoding and analyzing the difference data from the first video call terminal through the second main channel unit, and supplementing the difference data according to the basic picture.

[0063] like Figure 2 This is a system diagram of a method for enhancing the smoothness and clarity of video calls according to the present invention, wherein the system comprises:

[0064] The storage unit 200 is used to store the image information collected or received when establishing the video call communication;

[0065] Display unit 201, the display unit has a video enhancement mode and a real-time video communication mode;

[0066] The motion amplitude detection unit 202 calculates the posture feature value through normalization processing, and determines the change amplitude of the picture based on it.

[0067] A comparison unit 203, configured to compare the basic image received by the first video call terminal with the local image and obtain a comparison result;

[0068] A sending unit 204, configured to send a comparison result to a terminal of the other party;

[0069] The parsing unit 205 is used to parse the comparison processing result from the other party's call terminal to obtain a new picture;

[0070] The detection unit 206 is a multi-axis sensor unit, which is used to detect the activity state of the call terminal and send the detected state result to the state switching unit;

[0071] The multi-axis sensor unit includes a first three-axis sensing unit and a second three-axis sensing unit. The first three-axis sensing unit is electrically connected to the first main circuit unit, and the second three-axis sensing unit is electrically connected to the second main circuit unit.

[0072] The activity state includes a static state or a moving state;

[0073] Table 1 below is a mapping table of the active state and state switching of the call terminal:

[0074]

[0075]

[0076] The system further comprises:

[0077] A state switching unit 207, which switches the real-time video picture button according to the motion state of the call terminal;

[0078] The real-time video image buttons include an enhanced video button and a real-time video communication button;

[0079] When the detection unit detects that the call terminal is in a stationary state, a basic screen completed at the beginning of establishing the call terminal is run on the call terminal in the stationary state.

[0080] Embodiment 2:

[0081] The difference from the above embodiment is that:

[0082] When the multi-axis sensor unit detects that the first video call terminal is in an active state, the detection unit sends a switching signal to the state switching unit, and the state switching unit turns off the enhanced video button of the first call terminal and turns on the real-time video communication button. During the real-time video communication process, the storage unit stores multiple frames of images in real time;

[0083] The first video call terminal recalculates a frame of basic picture and sends the frame of basic picture to the second video call terminal;

[0084] Among them, the video enhancement mode is established based on a strong signal.

[0085] Embodiment 3:

[0086] The difference from the above embodiment is that:

[0087] When the multi-axis sensor unit detects that the second video call terminal is in an active state, the detection unit sends a switching signal to the state switching unit, and the state switching unit turns off the enhanced video button of the second call terminal and turns on the real-time video communication button. During the real-time video communication process, the storage unit stores multiple frames of images in real time.

[0088] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0089] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A method for enhancing the smoothness and clarity of video calls under weak signal and narrow network bandwidth, characterized in that: The method is applied to a first video call terminal and a second video call terminal; Establishing a video communication connection between a first video call terminal and a second video call terminal; the first video call terminal includes a first main circuit unit, a first storage unit and a first image display unit; The second video call terminal includes a second main circuit unit, a second storage unit and a second image display unit; The second video call terminal receives multiple frames of images from the first video call terminal and stores them in a second storage unit, and the second main circuit board analyzes the common part of the received images and the local images to obtain a frame of images; The one frame of picture is a basic picture, and is sent by the second video calling terminal to the first video calling terminal; The first video call terminal compares the basic image from the second video call terminal with the local image, and sends the comparison result to the second video call terminal; The second video call terminal parses the comparison result from the first video call terminal to obtain a new picture.

2. According to claim 1, a method for enhancing the smoothness and clarity of video calls under weak signal and narrow network bandwidth, characterized in that: The multiple frames are no less than 100 frames; The comparison process includes the first video call terminal comparing the local data with a received frame of basic picture to form difference data, and then sending the difference data to the second video terminal after compression.

3. According to claim 2, a method for enhancing the smoothness and clarity of video calls under weak signal and narrow network bandwidth, characterized in that: The analysis process includes the second video call terminal decoding and analyzing the difference data from the first video call terminal through the second main channel unit, and supplementing the difference data according to the basic picture.

4. According to claim 1, a method for enhancing the smoothness and clarity of video calls under weak signal and narrow network bandwidth, characterized in that: The first video call terminal and the second video call terminal respectively include at least one multi-axis sensor unit and a motion amplitude detection unit, and the multi-axis sensor unit detects whether the first image display unit or the second image display unit is in a stationary state; The motion amplitude detection unit calculates the posture feature value through normalization processing and judges the change amplitude of the picture based on it.

5. According to claim 4, a method for enhancing the smoothness and clarity of video calls under weak signal and narrow network bandwidth, characterized in that: The multi-axis sensor unit includes a first three-axis sensing unit and a second three-axis sensing unit. The first three-axis sensing unit is electrically connected to the first main circuit unit, and the second three-axis sensing unit is electrically connected to the second main circuit unit.

6. According to claim 4, a method for enhancing the smoothness and clarity of video calls under weak signal and narrow network bandwidth, characterized in that: The multi-axis sensor unit includes a first six-axis sensor unit and a second six-axis sensor unit. The first six-axis sensor unit is electrically connected to the first main circuit unit, and the second six-axis sensor unit is electrically connected to the second main circuit unit.

7. According to claim 4, a method for enhancing the smoothness and clarity of video calls under weak signal and narrow network bandwidth, characterized in that: When the multi-axis sensor unit detects that the first video call terminal is in a stationary state, the basic screen at the beginning of establishing the communication of the first video call terminal will be run; When the multi-axis sensor unit detects that the second video call terminal is in a stationary state, the basic screen at the beginning of establishing communication with the second video call terminal will be run.

8. The method for enhancing the smoothness and clarity of video calls under weak signal and narrow network bandwidth according to claim 7, characterized in that: The first image display unit and the second image display unit have a video enhancement mode and a real-time video communication mode respectively; Among them, the video enhancement mode is established based on a strong signal.

9. The method for enhancing the smoothness and clarity of video calls under weak signal and narrow network bandwidth according to claim 8, characterized in that: When the multi-axis sensor unit detects that the first video call terminal is in an active state, the first video call terminal recalculates a frame of basic picture and sends the frame of basic picture to the second video call terminal.

10. The method for enhancing the smoothness and clarity of video calls under weak signal and narrow network bandwidth according to claim 9, characterized in that: When the multi-axis sensor unit detects that the second video call terminal is in an active state, the second video call terminal recalculates a frame of basic picture and sends the frame of basic picture to the first video call terminal.