Video processing method, device, storage medium and video communication terminal

Abstract

The present application discloses a video processing method, device, storage medium and video communication terminal, including: obtaining a first video of a target object area in a shooting scene; obtaining a second video of a non-target object area in the shooting scene, wherein the video frame rate of the first video is greater than the video frame rate of the second video; and sending the first video and the second video to a receiving terminal. By obtaining a second video with a lower video frame rate than the first video, the overall data volume of the video is reduced, the transmission efficiency is improved, the progress of the first video and the second video received by the receiving terminal is guaranteed, and the first video and the second video will not be played on the receiving terminal. The situation of freeze, thereby improving the video display effect.

Description

Technical Field

[0001] The present application relates to the field of video communication technology, and in particular to a video processing method, device, storage medium and video communication terminal. Background Art

[0002] To meet the needs of video conferencing, terminal devices such as conference machines are needed to capture and transmit videos at the sending terminal, receive and display the transmitted videos at the receiving terminal, and thus realize video communication between the two terminals.

[0003] Among them, if the resolution of the video collected by the sending terminal is too high or too low, it will affect the display effect of the video on the receiving terminal. For example, the video image displayed by the receiving terminal is blurred, noisy or mosaic, or there is a display freeze phenomenon. Summary of the invention

[0004] The embodiments of the present application provide a video processing method, device, storage medium and video communication terminal, which can improve the video display effect.

[0005] In a first aspect, an embodiment of the present application provides a video processing method, including:

[0006] Acquire a first video of a target object area in a shooting scene;

[0007] Acquire a second video of a non-target object area in the shooting scene, wherein a video frame rate of the first video is greater than a video frame rate of the second video;

[0008] The first video and the second video are sent to a receiving terminal.

[0009] In a second aspect, an embodiment of the present application further provides a video processing device, including:

[0010] A first video processing module, used to obtain a first video of a target object area in a shooting scene;

[0011] A second video processing module is used to obtain a second video of a non-target object area in the shooting scene, wherein the video frame rate of the first video is greater than the video frame rate of the second video;

[0012] The video sending module is used to send the first video and the second video to a receiving terminal.

[0013] In a third aspect, an embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored. When the computer program runs on a computer, the computer executes a video processing method provided in any embodiment of the present application.

[0014] In a fourth aspect, an embodiment of the present application further provides a video communication terminal, including a processor and a memory, the memory having a computer program, and the processor calls the computer program to execute a video processing method provided in any embodiment of the present application.

[0015] The technical solution provided in the embodiment of the present application is to obtain a first video of the target object area in the shooting scene at the sending terminal, and obtain a second video of the non-target object area in the shooting scene, thereby separating the target object area and the non-target object area in the same shooting scene, and obtaining a first video of the target object area and a second video of the non-target object area, wherein the video frame rate of the first video is greater than the video frame rate of the second video. Compared with the prior art that does not distinguish between the target object area and the non-target object area, and transmits a video to the receiving terminal, the processing method of the prior art is bound to cause video jamming due to the large amount of video data, thereby affecting the display effect of the video on the receiving terminal. In the embodiment of the present application, since the video frame rate of the first video is higher and the video frame rate of the second video is lower, the overall data volume of the video will be reduced, thereby improving the transmission efficiency of the first video and the second video, so as to ensure that after the first video is sent to the receiving terminal, the first video and the second video on the receiving terminal can be displayed smoothly, thereby improving the display effect of the video. Furthermore, the first video and the second video can be transmitted separately, which can also reduce the transmission pressure, improve the video transmission efficiency, and thus ensure the smoothness of the transmission process. After the receiving terminal receives the first video and the second video, it can be displayed smoothly to ensure the display effect of the video. Based on this, the method provided in the embodiment of the present application will not cause the video playback to freeze when the video is displayed, and the display effect of the target object area is clear, and there will be no mosaic or noise phenomenon. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0017] Figure 1 A schematic diagram of a flow chart of a video processing method executed by a sending terminal provided in an embodiment of the present application.

[0018] Figure 2 A schematic diagram of a flow chart of a video processing method executed by a receiving terminal provided in an embodiment of the present application.

[0019] Figure 3 A schematic diagram of the structure of a video processing device provided in an embodiment of the present application.

[0020] Figure 4 A schematic diagram of the structure of a video communication terminal provided in an embodiment of the present application. DETAILED DESCRIPTION

[0021] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.

[0022] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0023] The embodiment of the present application provides a video processing method, and the execution subject of the video processing method can be a video processing device provided in the embodiment of the present application, or a video communication terminal integrated with the video processing device. The video processing device can be implemented in hardware or software, and the video communication terminal can be a terminal device that supports video calls, such as a smart phone, a tablet computer, a PDA, a conference machine, etc.

[0024] See also Figure 1 , Figure 1 A schematic diagram of a flow chart of a video processing method performed by a sending terminal according to an embodiment of the present application. The specific flow of the video processing method provided by an embodiment of the present application may be as follows:

[0025] 101. Obtain a first video of a target object area in a shooting scene.

[0026] Exemplarily, the sending terminal obtains a first video of the target object area in the shooting scene. The first video of the target object area can be shot by a camera configured on the sending terminal, or the first video of the target object area can be shot by an external camera and then sent to the sending terminal. It can be understood that the method of obtaining the first video is not limited here, as long as the first video can be obtained.

[0027] The target object area refers to the area where the target object is located. When the target object moves, the target object area changes accordingly. The target object can be a person or a moving object, etc. As long as a certain attribute of the target object is set, the target object can be distinguished according to the attribute characteristics to achieve the acquisition of the first video of the target object. Based on this, any method that can achieve the acquisition of the first video of the target object area can be used in this embodiment.

[0028] 102. Acquire a second video of a non-target object area in the shooting scene, wherein a video frame rate of the first video is greater than a video frame rate of the second video.

[0029] Among them, in the same shooting scene, after the target object area is located, the area other than the target object area is the non-target object area, and the non-target object area changes with the change of the target object area.

[0030] Exemplarily, the second video may be obtained by photographing the non-target object area through a camera configured by the sending terminal, or by photographing the non-target object area through another external camera.

[0031] The first video and the second video can be captured by the same camera or by different cameras, and this is not limited here. As long as two videos can be obtained, one of which is the first video and the other is the second video, it will be fine.

[0032] Among them, the video frame rate of the first video is greater than the video frame rate of the second video. Since the target object is the object that needs attention, as long as the first video has a higher video frame rate, the required display effect can be achieved, and the video frame rate of the second video only needs to be lower than the video frame rate of the first video. Among them, the video frame rate of the second video can also be set to the lowest value. When the first video is subsequently acquired, the video frame rate of the acquired first video must be greater than the video frame rate of the second video, so as to reduce the overall data volume of the first video and the second video, thereby ensuring transmission efficiency. It can be understood that the specific setting method of the video frame rate of the first video and the second video is not limited here. As long as the method of acquiring the video frame rate of the first video is greater than the video frame rate of the second video, it is within the protection scope required by this application.

[0033] By obtaining a first video with a higher video frame rate and a second video with a lower video frame rate, since the video frame rate of the first video is higher and the video frame rate of the second video is lower, the overall data volume of the video will be reduced, thereby improving the transmission efficiency of the first video and the second video. In this way, after the first video is sent to the receiving terminal, the first video and the second video on the receiving terminal can be displayed smoothly, ensuring the display effect of the video, and will not cause video playback to be stuck. In addition, the display effect of the target object area is clear, and there will be no mosaic or noise.

[0034] 103. Send the first video and the second video to a receiving terminal.

[0035] Among them, the first video and the second video can be sent to the receiving terminal as two video streams respectively, or the first video and the second video can be combined into one video stream and sent to the receiving terminal, and the video stream is parsed by the data terminal. The specific sending method is not limited here, as long as the first video and the second video can be sent to the receiving terminal.

[0036] Exemplarily, the first video and the second video may be compressed and then sent to the receiving terminal, thereby reducing the transmission volume of the video and improving the transmission efficiency. Accordingly, the display effect of the video on the receiving terminal is also guaranteed.

[0037] In specific implementation, the present application is not limited by the execution order of the various steps described. If no conflict occurs, some steps can be performed in other orders or simultaneously.

[0038] The sending terminal in the implementation of this application obtains the first video with a high frame rate and the second video with a low frame rate, and sends the first video and the second video to the receiving terminal. During the video transmission process, because the video frame rate of the second video is relatively small, compared with a video with a video frame rate in the prior art, the scheme of the embodiment of this application can reduce the amount of data of the second video during the transmission process, thereby reducing the overall amount of data of the first video and the second video, thereby improving the transmission efficiency of the first video and the second video. When the receiving terminal receives the first video and the second video, it can smoothly play the first video and the second video. At the same time, since the video frame rate of the first video is relatively high, it does not affect the playback of the first video, and the first video corresponds to the display of the target object, which can ensure the display effect of the target object on the receiving terminal. Therefore, in terms of the overall display effect, the scheme of this application can not only ensure that the video is played without freezing at the receiving terminal, but also ensure that the target object has sufficient clarity, so that the display effect of the target object is improved.

[0039] It can be understood that when the first video and the second video in the embodiment of the present application are both high-definition videos, the solution of the embodiment of the present application can also reduce the amount of data in the transmission process of the first video and the second video, thereby ensuring that there will be no playback jams when the receiving terminal receives the first video and the second video, thereby ensuring the smoothness of the playback of the first video and the second video. Furthermore, the first video records the video of the target object. By playing the first video smoothly at the receiving terminal, the clarity of the first video display can also be guaranteed, and the playback smoothness can be improved, thereby improving the overall video display effect.

[0040] Based on this, the solution provided in the embodiment of the present application can not only ensure the smoothness of video playback on the receiving terminal, but also ensure the clarity of display on the receiving terminal, thereby solving the problem of video stuttering when playing high-definition videos and video blur when playing non-high-definition videos in the prior art. It can simultaneously ensure high-definition display and playback smoothness, greatly improve the video display effect, and is more conducive to its application and popularization in the field of video communication.

[0041] The method described in the above embodiments is further described in detail below with examples.

[0042] There are multiple ways to obtain the first video of the target object area in the shooting scene and obtain the second video of the non-target object area in the shooting scene:

[0043] For example, the shooting frame rate of the camera may be directly set to obtain a first video with a high video frame rate and a second video with a low video frame rate.

[0044] For another example, there is no need to set the shooting frame rate of the camera in advance. After shooting the first video and the second video, the video frame rate of the first video can be encoded at a high frame rate and the video frame rate of the second video can be encoded at a low frame rate, thereby achieving that the video frame rate of the first video is greater than the video frame rate of the second video.

[0045] It can be understood that setting the video frame rate of the first video and setting the video frame rate of the second video can be achieved by setting the shooting frame rate of the camera, or by performing frame rate encoding processing after shooting, or by combining camera setting and frame rate encoding. The specific implementation method is not limited here, as long as the first video can have a higher video frame rate than the second video.

[0046] It should be noted that in the embodiments of the present application, the first video with a higher video frame rate, the second video with a lower video frame rate, the video frame rate of the first video is higher / greater than the video frame rate of the second video, and the high frame rate encoding and the low frame rate encoding, the descriptions of high and low are only relative expressions, and only refer to the relative numerical size of the video frame rate.

[0047] Regarding the methods of obtaining the first video and the second video, two of the methods will be described as examples in the following embodiments. It can be understood that these two methods of obtaining the first video and the second video should not be construed as limitations on the present application.

[0048] In one embodiment, the first video and the second video may be acquired by setting the camera, wherein step 101 includes:

[0049] Based on a first preset frame rate, shooting a target object area in a shooting scene to obtain a first video;

[0050] Step 102 includes:

[0051] Based on the second preset frame rate, a non-target object area in the shooting scene is photographed to obtain a second video, wherein the first preset frame rate is greater than the second preset frame rate.

[0052] For example, the target object area and the non-target object area may be photographed successively by one camera, or the target object area and the non-target object area may be photographed separately by two cameras.

[0053] When shooting with a camera, the shooting frame rate of the camera can be set to a first preset frame rate, and after the first video of the target object is obtained, the shooting frame rate of the camera is set to a second preset frame rate, and the second video of the non-target object is obtained by shooting. Shooting in this way can reduce the camera settings and distinguish the specific positions of the target object and the non-target object.

[0054] Of course, it is also possible to shoot separately through two cameras, wherein the shooting frame rate of one camera can be set to a first preset frame rate, thereby obtaining a first video with the first preset frame rate, and the shooting frame rate of the other camera can be set to a second preset frame rate, thereby obtaining a second video with the second preset frame rate.

[0055] In some embodiments, an AI camera may be used to automatically capture and track facial images, thereby distinguishing between target object areas and non-target object areas in the shooting scene.

[0056] It can be understood that the specific values ​​of the first preset frame rate and the second preset frame rate are not limited here, and the values ​​can be set by those skilled in the art according to actual needs.

[0057] In this embodiment, by setting the shooting frame rate of the camera, it is possible to directly obtain a first video with a first preset frame rate and a second video with a second preset frame rate, and the first preset frame rate is greater than the second preset frame rate, thereby avoiding the subsequent need to process the video frame rate and improving the video processing efficiency.

[0058] In another embodiment, video encoding processing may be performed on the first video and the second video respectively, so that the video frame rate of the first video is a first preset frame rate, and the video frame rate of the second video is a second preset frame rate.

[0059] Wherein, step 101 comprises:

[0060] Shooting a shooting scene to obtain a scene image of the shooting scene;

[0061] According to a first preset frame rate, video encoding is performed on the image content of the target object area in the scene image to obtain a first video.

[0062] Step 102 includes:

[0063] According to the second preset frame rate, video encoding is performed on the content of the non-target object area in the scene image to obtain a second video, and the first preset frame rate is greater than the second preset frame rate.

[0064] Among them, by shooting scene images with the same frame rate, when performing frame rate processing, the target object area and the non-target object area can be segmented from the scene image to obtain the video of the target object area and the non-target object area, and the video encoding processing is performed on the video of the target object area according to a first preset frame rate to obtain a first video, and the video encoding processing is performed on the video of the non-target object area according to a second preset frame rate to obtain a second video, and the first preset frame rate is greater than the second preset frame rate, thereby achieving that the video frame rate of the first video is greater than the second preset video frame rate.

[0065] Exemplarily, the segmentation of the target object area and the non-target object area can be obtained by using an image segmentation model, or by performing feature recognition on the image to extract the image content of the area where the target object is located. Since there are many ways to perform segmentation, they are not listed here. It can be understood that as long as the first video of the target object area is obtained, and the second video of the non-target object area is obtained, they can be used in this embodiment.

[0066] This embodiment obtains a first video by performing video encoding on the image content of the target object area at a first preset frame rate, and obtains a second video by performing video encoding on the image content of the non-target object area at a second preset frame rate, thereby achieving free adjustment of the video frame rate of the first video and / or the second video, and achieving real-time adjustment of the video frame rate to better meet data transmission requirements, thereby solving the limitation that the camera can only set a limited number of shooting frame rates.

[0067] Based on this, the first preset frame rate and the second preset frame rate in the present embodiment may not be fixed values, but may be automatically adjusted according to actual needs, or may be adjusted by user settings. When automatically adjusted, the adjustment may be based on network transmission volume or memory usage. The specific implementation method is not described in detail here, as long as adaptive adjustment of the first preset frame rate and / or the second preset frame rate can be achieved.

[0068] In some embodiments, after photographing the shooting scene and obtaining the scene image of the shooting scene, the method further includes:

[0069] Performing blur processing on the image content of the non-target object area in the scene image to obtain a blurred scene image;

[0070] The blurred scene image is encoded according to a first preset frame rate to obtain a first video.

[0071] Exemplarily, after a scene image is captured, the image content in the scene image where the non-target object area is located can also be blurred, so that the image of the non-target object appears blurred, thereby forming a contrast with the target object to highlight the display effect of the target object, making the target object appear visually clearer.

[0072] In this embodiment, it is not necessary to encode the image of the non-target object area according to the second preset frame rate. By blurring the image content of the non-target object area, the bit depth of each pixel of the image can be changed, thereby reducing the amount of data of the image in the non-target object area and improving the transmission efficiency, thereby improving the display effect of the target object at the receiving terminal.

[0073] Regarding sending the first video and the second video to the receiving terminal for playback, the first video and the second video may be processed at the sending terminal before being sent to the receiving terminal for direct playback and display, or may be sent to the receiving terminal first and then processed at the receiving terminal before being played. Therefore, the processing of the first video and the second video is not limited here to being based on the sending terminal or the receiving terminal.

[0074] There are also multiple ways to process the first video and the second video:

[0075] For example, the second video may be interpolated to obtain a video frame rate that is the same as that of the first video, and then each frame of the first video and the second video may be spliced ​​to obtain a spliced ​​image and played frame by frame.

[0076] For another example, the first video and the second video may be played simultaneously, and the first video may be superimposed on the second video for playback, as long as the display of the first video is not affected.

[0077] For another example, the second video may be subjected to frame extraction processing, and then image frames in the second video having the same timestamp as the image frames of the first video may be extracted to form a third video.

[0078] In the following embodiments, only two methods, namely, frame insertion and frame extraction, are used as examples. However, it should be noted that these two examples should not be construed as limitations on the present application.

[0079] In one embodiment, the second video is processed in a frame extraction manner, and step 103 includes:

[0080] Extracting image frames matching the first video from the second video according to timestamps of the image frames in the first video and the second video to obtain a third video;

[0081] The first video and the third video are sent to a receiving terminal.

[0082] Exemplarily, image frames in the second video may be extracted with the same timestamps as those in the first video, and the extracted image frames may be used as the third video, wherein each image frame in the third video has a matching image frame in the first video.

[0083] Among them, the consistency based on timestamp refers to screening out image frames of the second video that are synchronized in time with the image frames of the first video, that is, image frames that overlap in time, while image frames that do not overlap in time can be directly discarded, thereby achieving frame extraction processing of the second video.

[0084] After the third video is obtained, each image frame in the third video has an image frame that matches the timestamp in the first video. This method can reduce the image frames in the second video, so that the data volume of the obtained third video is smaller, which greatly improves the transmission efficiency of the first video and the third video.

[0085] In another embodiment, the second video is processed in an interpolation manner, and step 103 includes:

[0086] According to the first preset frame rate, the image frames of the second video are copied and inserted into the second video frame by frame to obtain a third video;

[0087] The first video and the third video are sent to a receiving terminal.

[0088] Exemplarily, the copy rate of the image frames of the second video can be obtained by calculating the difference between the first preset frame rate and the second preset frame rate. The image frames of the second video are copied and then inserted between two temporally adjacent image frames to thereby implement frame interpolation processing on the second video and increase the video frame rate of the second video to obtain a third video, wherein the video frame rate of the third video is the same as the video frame rate of the first video.

[0089] This interpolation method can realize synchronous playback of the first video and the third video, reducing the processing process of the first video and the third video. It can realize the simple superposition of the first video and the third video to restore the video of the shooting scene, and restore the video display effect of the shooting scene.

[0090] In some embodiments, the shooting scene is a conference scene, the target object area is the area where the speaker is located in the conference scene, and the non-target object area is the area other than the speaker, wherein the non-target object area may be the conference background;

[0091] Obtaining a first video of a target object area in a shooting scene, including:

[0092] The conference scene is photographed to obtain a conference image of the conference scene;

[0093] Get the first video of the speaker;

[0094] Acquiring a second video of a non-target object area in the shooting scene, including:

[0095] The second video is obtained by matching the conference image from a preset conference database.

[0096] For example, only the speaker in the conference scene may be filmed and video encoded to obtain the first video, while the second video of the non-target object area may be obtained by matching historical data.

[0097] Among them, the preset conference database stores videos of different conference scenes. After the processing method of the above embodiment, the obtained second videos can be stored in the preset conference database. When the second video needs to be used as the background, the video corresponding to the conference image can be directly matched from the preset conference database. When no match is found, the second video can be obtained by shooting.

[0098] It can be understood that the target object can be a conference speaker or a moving object in the meeting. Since all images except the target object can be called conference backgrounds, and the conference background is static, it is only necessary to capture the first video of the conference speaker, and it is not necessary to shoot a video of the conference background, as long as the first video can be captured and sent to the receiving terminal.

[0099] Furthermore, since the conference background is static, the second video of the conference background is processed at a lower frame rate. When playing, the second video does not change much and does not affect the display effect. Of course, a solid color background image can also be set to replace the second video, thereby greatly reducing the amount of video data and improving the video display effect.

[0100] The embodiment of the present application shoots the conference scene and then can match the conference background according to the shot conference image, wherein the conference background can be a video or a picture. This method avoids the need to shoot the conference background or process the conference image to obtain a video of the conference background, thereby eliminating the process of obtaining the second video, greatly improving the video processing efficiency, and for the receiving terminal, can greatly improve the video display effect.

[0101] As can be seen from the above, the receiving terminal in the embodiment of the present application can also be used as a sending terminal to implement the above-mentioned video processing method. When the receiving terminal receives the video sent from the sending terminal, the two received videos can be processed and then played, or the two processed videos can be directly played. In the following embodiments, the method of playing the two received videos after processing is described in detail.

[0102] like Figure 2 As shown, Figure 2 A schematic diagram of a flow chart of a receiving terminal performing a video processing method provided in an embodiment of the present application. In this embodiment, after the above step 103, the following steps are further included:

[0103] 201. Receive a fourth video and a fifth video, wherein a video frame rate of the fourth video is greater than a video frame rate of the fifth video;

[0104] 202. Splice the image frames in the fifth video to the image frames in the fourth video according to the timestamps to obtain a spliced ​​sixth video;

[0105] 203. Play the sixth video.

[0106] Among them, if the fifth video is a video after frame extraction processing is performed at the sending terminal, each image frame of the fifth video has a matching image frame in the fourth video, and the image frames of the fifth video and the fourth video can be directly spliced ​​according to the timestamp. It should be noted that the splicing here refers to the alignment processing of the target object area in the fourth video and the non-target object area in the fifth video, so that the stitched sixth video can achieve the effect of restoring the image of the shooting scene in terms of visual effect.

[0107] If the fifth video has not been subjected to frame extraction processing at the sending terminal, the fourth video and the fifth video may also be directly played in different mixed forms, and it is only necessary for the target object area and the non-target object area to be aligned in the image frame.

[0108] Of course, the fifth video can also be interpolated at the receiving terminal. The method of interpolation can refer to the contents mentioned in the above embodiment and will not be repeated here. By interpolating the fifth video and processing it into a video with the same video frame rate as the fourth video, the two videos can be spliced ​​to obtain the sixth video, thereby achieving the effect of synchronous playback.

[0109] The fifth video and the fourth video can also be processed by a neural network repair model, and the repaired sixth video can be obtained by inputting the fifth video and the fourth video into the neural network repair model. The neural network repair model can be obtained by training a sample set.

[0110] As can be seen from the above, the video processing method proposed in the embodiment of the present invention, when used as a sending terminal, can obtain a first video with a higher video frame rate and obtain a second video with a lower video frame rate. Since the video frame rate of the first video is higher and the video frame rate of the second video is lower, the overall data volume of the video will be reduced, thereby improving the transmission efficiency of the first video and the second video, so that it can be ensured that after the first video is sent to the receiving terminal, the first video and the second video on the receiving terminal can be displayed smoothly, ensuring the display effect of the video, and will not cause the video playback to be stuck, and the display effect of the target object area is clear, and there will be no mosaic or noise phenomenon. Furthermore, by performing frame extraction processing on the second video, the data volume can be greatly reduced, the transmission efficiency can be improved, and by dividing the video into the first video and the second video for separate transmission, the transmission pressure can be relieved and the transmission efficiency can be improved. Based on this, the scheme of the embodiment of the present application improves the transmission efficiency, thereby ensuring the display effect of the video at the receiving terminal. Furthermore, for high-definition video, this scheme is also applicable, thereby solving the problem of poor video display effect in the prior art.

[0111] In one embodiment, a video processing device is also provided. Figure 3 , Figure 3The video processing device 300 is a schematic diagram of the structure of the embodiment of the present application. The video processing device 300 is applied to a video communication terminal, and the video processing device 300 includes a first video processing module 301, a second video processing module 302, and a video sending module 303, as follows:

[0112] A first video processing module 301 is used to obtain a first video of a target object area in a shooting scene;

[0113] A second video processing module 302 is used to obtain a second video of a non-target object area in the shooting scene, wherein the video frame rate of the first video is greater than the video frame rate of the second video;

[0114] The video sending module 303 is used to send the first video and the second video to a receiving terminal.

[0115] In some embodiments, the first video processing module 301 is further configured to:

[0116] Extracting image frames matching the first video from the second video according to timestamps of the image frames in the first video and the second video to obtain a third video;

[0117] The first video and the third video are sent to a receiving terminal. In some embodiments, the first video processing module 301 is also used for:

[0118] Shooting a shooting scene to obtain a scene image of the shooting scene;

[0119] According to a first preset frame rate, video encoding is performed on the image content of the target object area in the scene image to obtain a first video.

[0120] In some embodiments, the first video processing module 301 is further configured to:

[0121] Performing blur processing on the image content of the non-target object area in the scene image to obtain a blurred scene image;

[0122] The blurred scene image is encoded according to a first preset frame rate to obtain a first video.

[0123] In some embodiments, the second video processing module 302 is further configured to:

[0124] According to the second preset frame rate, video encoding is performed on the content of the non-target object area in the scene image to obtain a second video, and the first preset frame rate is greater than the second preset frame rate.

[0125] In some embodiments, the video sending module 303 is further used to:

[0126] Extracting image frames matching the first video from the second video according to timestamps of the image frames in the first video and the second video to obtain a third video;

[0127] The first video and the third video are sent to a receiving terminal.

[0128] In some embodiments, the shooting scene is a conference scene, and the target object area is the area where the speaker in the conference scene is located:

[0129] The first video processing module 301 is also used for:

[0130] The conference scene is photographed to obtain a conference image of the conference scene;

[0131] Get the first video of the speaker;

[0132] The second video processing module 302 is further used for:

[0133] The second video is obtained by matching the conference image from a preset conference database.

[0134] In some embodiments, the video processing apparatus further comprises:

[0135] The video receiving module 304 is used to receive a fourth video and a fifth video, wherein the video frame rate of the fourth video is greater than the video frame rate of the fifth video;

[0136] splicing the image frames in the fifth video to the image frames in the fourth video according to the timestamps, to obtain a spliced ​​sixth video;

[0137] Play the sixth video.

[0138] It should be noted that the video processing device 300 provided in the embodiment of the present application belongs to the same concept as the video processing method in the above embodiment. Any method provided in the video processing method embodiment can be implemented through the video processing device 300. The specific implementation process is detailed in the video processing method embodiment and will not be repeated here.

[0139] As can be seen from the above, the video processing device proposed in the embodiment of the present application, when used as a sending terminal, can obtain a first video with a higher video frame rate and obtain a second video with a lower video frame rate. Since the video frame rate of the first video is higher and the video frame rate of the second video is lower, the overall data volume of the video will be reduced, thereby improving the transmission efficiency of the first video and the second video, so that it can be ensured that after the first video is sent to the receiving terminal, the first video and the second video on the receiving terminal can be displayed smoothly, ensuring the display effect of the video, and will not cause the video playback to freeze, and the display effect of the target object area is clear, and there will be no mosaic or noise phenomenon. Furthermore, by extracting the frame of the second video, the data volume can be greatly reduced, the transmission efficiency can be improved, and by dividing the video into the first video and the second video for separate transmission, the transmission pressure can be relieved and the transmission efficiency can be improved. Based on this, the scheme of the embodiment of the present application improves the transmission efficiency, thereby ensuring the display effect of the video at the receiving terminal. Furthermore, for high-definition video, this scheme is also applicable, thereby solving the problem of poor video display effect in the prior art.

[0140] The embodiment of the present application also provides a video communication terminal, which can be a terminal device supporting video calls such as a smart phone, a tablet computer, a PDA, a conference machine, etc. Figure 4 As shown, Figure 4 A schematic diagram of the structure of a video communication terminal provided in an embodiment of the present application. The video communication terminal 400 includes a processor 401 having one or more processing cores, a memory 402 having one or more computer-readable storage media, and a computer program stored in the memory 402 and executable on the processor. The processor 401 is electrically connected to the memory 402. Those skilled in the art will appreciate that the video communication terminal structure shown in the figure does not constitute a limitation on the video communication terminal, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0141] The processor 401 is the control center of the video communication terminal 400. It uses various interfaces and lines to connect the various parts of the entire video communication terminal 400, executes various functions of the video communication terminal 400 and processes data by running or loading software programs and / or modules stored in the memory 402, and calling data stored in the memory 402, thereby monitoring the video communication terminal 400 as a whole.

[0142] In the embodiment of the present application, the processor 401 in the video communication terminal 400 will load instructions corresponding to the processes of one or more applications into the memory 402 according to the following steps, and the processor 401 will run the application stored in the memory 402 to implement various functions:

[0143] Acquire a first video of a target object area in a shooting scene;

[0144] Acquire a second video of a non-target object area in the shooting scene, wherein a video frame rate of the first video is greater than a video frame rate of the second video;

[0145] The first video and the second video are sent to a receiving terminal.

[0146] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0147] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0148] As can be seen from the above, the video communication terminal provided in this embodiment, when used as a sending terminal, can obtain a first video with a higher video frame rate and a second video with a lower video frame rate. Since the video frame rate of the first video is higher and the video frame rate of the second video is lower, the overall data volume of the video will be reduced, thereby improving the transmission efficiency of the first video and the second video, so that it can be ensured that after the first video is sent to the receiving terminal, the first video and the second video on the receiving terminal can be displayed smoothly, ensuring the display effect of the video, and will not cause the video playback to be stuck, and the display effect of the target object area is clear, and there will be no mosaic or noise phenomenon. Furthermore, by extracting the frame of the second video, the data volume can be greatly reduced, the transmission efficiency can be improved, and by dividing the video into the first video and the second video for separate transmission, the transmission pressure can be relieved and the transmission efficiency can be improved. Based on this, the scheme of the embodiment of the present application improves the transmission efficiency, thereby ensuring the display effect of the video at the receiving terminal. Furthermore, for high-definition video, this scheme is also applicable, thereby solving the problem of poor video display effect in the prior art.

[0149] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0150] To this end, the embodiment of the present application provides a computer-readable storage medium. A person skilled in the art can understand that all or part of the steps in the above-mentioned embodiment method can be completed by instructing related hardware through a program. The program can be stored in a computer-readable storage medium. When the program is executed, it includes the following steps:

[0151] Acquire a first video of a target object area in a shooting scene;

[0152] Acquire a second video of a non-target object area in the shooting scene, wherein a video frame rate of the first video is greater than a video frame rate of the second video;

[0153] The first video and the second video are sent to a receiving terminal.

[0154] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0155] The above-mentioned storage medium may be ROM / RAM, a magnetic disk, an optical disk, etc. Since the computer program stored in the storage medium can execute the steps in any one of the video processing methods provided in the embodiments of the present application, the beneficial effects that can be achieved by any one of the video processing methods provided in the embodiments of the present application can be achieved, as detailed in the previous embodiments, which will not be repeated here.

[0156] The above is a detailed introduction to a video processing method, device, medium and video communication terminal provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the ideas of the present application, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A video processing method, characterized in that: include: Acquire a first video of a target object area in a shooting scene; Acquire a second video of a non-target object area in the shooting scene, wherein a video frame rate of the first video is greater than a video frame rate of the second video; Sending the first video and the second video to a receiving terminal; The first video and the second video are two video streams; The step of obtaining a first video of a target object area in a shooting scene includes: Shooting the shooting scene to obtain a scene image of the shooting scene; Performing video encoding on the image content of the target object area in the scene image according to a first preset frame rate to obtain the first video; The step of obtaining a second video of a non-target object area in the shooting scene includes: Performing video encoding on the content of the non-target object area in the scene image according to a second preset frame rate to obtain the second video, wherein the first preset frame rate is greater than the second preset frame rate; The sending the first video and the second video to a receiving terminal includes: Extracting, from the image frames of the second video, image frames that are synchronized in time with the image frames of the first video according to the timestamps of the image frames in the first video and the second video, to obtain a third video; The first video and the third video are sent to the receiving terminal.

2. The video processing method according to claim 1, characterized in that: After photographing the shooting scene and obtaining the scene image of the shooting scene, the method further includes: Performing blurring processing on the image content of the non-target object area in the scene image to obtain a blurred scene image; The blurred scene image is encoded according to the first preset frame rate to obtain the first video.

3. The video processing method according to claim 1 or 2, characterized in that: The shooting scene is a conference scene, and the target object area is an area where a speaker in the conference scene is located; The step of obtaining a first video of a target object area in a shooting scene includes: photographing the conference scene to obtain a conference image of the conference scene; Obtaining a first video of the speaker; The step of obtaining a second video of a non-target object area in the shooting scene includes: The second video is obtained by matching the conference image from a preset conference database.

4. The video processing method according to claim 1 or 2, characterized in that: The method further comprises: Receive a fourth video and a fifth video, wherein the video frame rate of the fourth video is greater than the video frame rate of the fifth video; the fourth video is a video of the target object area sent by the sending terminal to the receiving terminal, and the fifth video is a video of the non-target object area sent by the sending terminal to the receiving terminal; splicing the image frames in the fifth video to the image frames in the fourth video according to the timestamps, to obtain a spliced ​​sixth video; Play the sixth video.

5. A video processing device, characterized in that: include: A first video processing module, used to obtain a first video of a target object area in a shooting scene; A second video processing module is used to obtain a second video of a non-target object area in the shooting scene, wherein the video frame rate of the first video is greater than the video frame rate of the second video; A video sending module, used for sending the first video and the second video to a receiving terminal; the first video and the second video are two video streams; The first video processing module is also used for: Shooting the shooting scene to obtain a scene image of the shooting scene; Performing video encoding on the image content of the target object area in the scene image according to a first preset frame rate to obtain the first video; The second video processing module is also used for: Performing video encoding on the content of the non-target object area in the scene image according to a second preset frame rate to obtain the second video, wherein the first preset frame rate is greater than the second preset frame rate; The video sending module is also used for: Extracting, from the image frames of the second video, image frames that are synchronized in time with the image frames of the first video according to the timestamps of the image frames in the first video and the second video, to obtain a third video; The first video and the third video are sent to the receiving terminal.

6. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed on a computer, the computer is enabled to execute the video processing method according to any one of claims 1 to 4.

7. A video communication terminal, comprising a processor and a memory, wherein the memory stores a computer program, characterized in that: The processor is configured to execute the video processing method according to any one of claims 1 to 4 by calling the computer program.

Images