Conference video transmission method, device, equipment, and storage medium

Abstract

The present application discloses a conference video transmission method, device, equipment and storage medium, and relates to the field of image processing technology. The method includes: obtaining first video data collected synchronously by multiple cameras, dividing multiple first video frames with the same shooting order in the multiple first video data into the same video set, so as to obtain multiple video sets corresponding to the shooting order; wherein, multiple cameras shoot participants at different positions; according to the position sequence of multiple cameras, multiple first video frames in each video set are spliced ​​to generate corresponding second video frames; according to the shooting order corresponding to the multiple video sets, the second video frames corresponding to the multiple video sets are sorted to generate second video data, and the second video data is transmitted to the receiving end, so that the receiving end displays the second video data. Through the above-mentioned technical means, the problem of disordered order after video splicing in the prior art is solved, and the display effect of the receiving end is guaranteed.

Description

Technical Field

[0001] The present application relates to the field of image processing technology, and in particular to a conference video transmission method, device, equipment, and storage medium. Background Art

[0002] Meetings are a common social phenomenon, which refers to organized, led, and purposeful deliberative activities that are conducted at a limited time and place according to certain procedures. When there are many participants, meetings can be held in some large venues, and the video of the participants can be collected through cameras to transmit the collected video to a remote receiving end.

[0003] In the prior art, if the area of ​​the conference venue is increased and one camera cannot capture the complete screen of the participants, multiple cameras can be used to capture videos of different participants and transmit the captured videos to the receiving end. When the receiving end receives the videos captured by multiple cameras, it will splice the multiple videos into a complete video of the participants, but the video splicing may have sequence problems, which will affect the display effect of the receiving end. Summary of the invention

[0004] The present application provides a conference video transmission method, device, equipment and storage medium to solve the problem of disordered order after video splicing in the prior art and ensure the display effect at the receiving end.

[0005] In a first aspect, the present application provides a conference video transmission method, comprising:

[0006] Acquire first video data synchronously collected by multiple cameras, and group multiple first video frames in the first video data having the same shooting order into the same video set to obtain multiple video sets corresponding to the shooting order; wherein the multiple cameras shoot the participants at different positions;

[0007] According to the position sequence of the multiple cameras, splicing the multiple first video frames in each of the video sets to generate a corresponding second video frame;

[0008] According to the shooting order corresponding to the multiple video sets, the second video frames corresponding to the multiple video sets are sorted to generate second video data, and the second video data is transmitted to the receiving end so that the receiving end displays the second video data.

[0009] In a second aspect, the present application provides a conference video transmission device, comprising:

[0010] The video set generation module is configured to obtain first video data synchronously collected by multiple cameras, and divide multiple first video frames with the same shooting order in the multiple first video data into the same video set to obtain multiple video sets corresponding to the shooting order; wherein the multiple cameras shoot the participants at different positions;

[0011] A video frame splicing module is configured to splice a plurality of first video frames in each of the video sets to generate a corresponding second video frame according to a position sequence of the plurality of cameras;

[0012] The video data transmission module is configured to sort the second video frames corresponding to the multiple video sets according to the shooting order corresponding to the multiple video sets to generate second video data, and transmit the second video data to the receiving end so that the receiving end displays the second video data.

[0013] In a third aspect, the present application provides a conference video transmission device, including:

[0014] One or more processors; a memory storing one or more programs, when the one or more programs are executed by the one or more processors, the one or more processors implement the conference video transmission method as described in the first aspect.

[0015] In a fourth aspect, the present application provides a storage medium comprising computer executable instructions, which, when executed by a computer processor, are used to execute the conference video transmission method as described in the first aspect.

[0016] In the present application, after the conference end obtains the first video data collected by multiple cameras, according to the shooting order of the first video frame in the first video data, it is determined that the first video frame with the same shooting order is the first video frame shot synchronously by multiple cameras, and the first video frame shot synchronously is stored in the same video set. According to the position order of multiple cameras, the first video frames in the same video set are spliced ​​to obtain a second video frame with accurate video frame splicing. According to the shooting order of the video set, each second video frame is sorted to generate a second video data after the synchronous screen of multiple first video data is spliced, and the second video data is transmitted to the receiving end so that the receiving end plays the second video data. Through the above-mentioned technical means, the first video frames shot synchronously are spliced ​​according to the position order of multiple cameras to achieve accurate splicing of the video screen at the same time. The spliced ​​second video frame clearly records the actions and expressions of each participant at the corresponding time, ensuring the display effect of the second video frame at the receiving end. The second video frames are sorted according to the shooting order of the video collection to generate the second video data, so that the receiving end can play the second video frames in the accurate playback order. The second video frames in the accurate playback order demonstrate the changing process of the actions and expressions of each participant at each moment, ensuring the playback effect at the receiving end. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 is a flow chart of a conference video transmission method provided by an embodiment of the present application;

[0018] Figure 2 is a schematic diagram of three cameras provided in an embodiment of the present application installed in a conference venue;

[0019] Figure 3 is a flowchart of splicing the first video frame in a video set provided by an embodiment of the present application;

[0020] Figure 4 is a schematic diagram of all participants in the conference room provided in the embodiment of the present application;

[0021] Figure 5 is one of the schematic diagrams of the first video frame synchronously shot by three cameras provided in an embodiment of the present application;

[0022] Figure 6 This is a flow chart of generating a second video frame after deleting a first video frame provided by an embodiment of the present application;

[0023] Figure 7 This is a second schematic diagram of a first video frame captured synchronously by three cameras provided in an embodiment of the present application;

[0024] Figure 8It is a structural diagram of a conference video transmission device provided in an embodiment of the present application;

[0025] Fig. 9 It is a structural diagram of a conference video transmission device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0026] In order to make the purpose, technical scheme and advantages of the present application clearer, the specific embodiments of the present application are further described in detail below in conjunction with the accompanying drawings. It is understood that the specific embodiments described herein are only used to explain the present application, rather than to limit the present application. It should also be noted that, for the convenience of description, only the part related to the present application but not all the contents are shown in the accompanying drawings. Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flow charts. Although the flow chart describes each operation (or step) as a sequential process, many of the operations therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of each operation can be rearranged. The process can be terminated when its operation is completed, but it can also have additional steps not included in the accompanying drawings. The process can correspond to a method, a function, a procedure, a subroutine, a subprogram, etc.

[0027] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0028] In a more common existing implementation, multiple cameras are used to capture videos of different participants in the conference hall, and the captured multiple videos are transmitted to the receiving end. When the receiving end receives the videos captured by multiple cameras, it will splice the multiple videos into a complete video of the participants. However, when splicing, the receiving end cannot determine the video frames shot synchronously, nor can it know the accurate splicing order of the video frames, resulting in problems with the time sequence and splicing order of the final spliced ​​video, which affects the video playback effect of the receiving end.

[0029] To solve the above problems, this embodiment provides a conference video transmission method, which splices video frames with the same shooting order at the conference end according to the order of camera positions, and sorts the spliced ​​video frames according to the shooting order to obtain video data with accurate time sequence and splicing order, thereby ensuring the video playback effect at the receiving end.

[0030] The conference video transmission method provided in this embodiment can be executed by a conference video transmission device, which can be implemented by software and / or hardware, and can be composed of two or more physical entities or one physical entity. For example, the conference video transmission device can be a conference terminal, which refers to a computer terminal with certain processing capabilities.

[0031] The conference video transmission device is installed with at least one type of operating system, wherein the operating system includes but is not limited to Android system, Linux system and Windows system. The conference video transmission device can install at least one application based on the operating system, and the application can be an application that comes with the operating system or an application downloaded from a third-party device or server. In this embodiment, the conference video transmission device has at least an application that can execute the conference video transmission method.

[0032] For ease of understanding, this embodiment is described by taking the conference terminal as an example of the main body for executing the conference video transmission method.

[0033] Figure 1 1 is a flow chart of a conference video transmission method provided by an embodiment of the present application. Figure 1 As shown, the steps of the conference video transmission method include:

[0034] S110, obtaining first video data synchronously collected by multiple cameras, and dividing multiple first video frames with the same shooting order in the multiple first video data into the same video set to obtain multiple video sets corresponding to the shooting order; wherein the multiple cameras shoot the participants at different positions.

[0035] For example, cameras are installed in the venue where the meeting is held. The number of cameras is determined by the width of the venue and the camera's field of view. The wider the venue, the more cameras are installed in the venue, and the larger the camera's field of view, the fewer cameras are installed in the venue. Generally speaking, the staff will determine the minimum number of cameras that need to be installed in the venue in advance based on the width of the venue and the camera's field of view, and determine the installation position of each camera in the venue based on the number of cameras and the camera's field of view, so that multiple cameras can be installed at different locations in the venue to shoot participants, ensuring that the participants captured by multiple cameras include all participants.

[0036] This embodiment is described by taking three cameras installed in the conference venue as an example. Figure 2 Schematic diagram of three cameras provided in the embodiment of the present application installed in the conference room. Figure 2 As shown, three cameras 11 are installed at the front side of the conference room 10, and each camera 11 shoots toward the seats 12 in the conference room 10. When the participants sit on the seats 12 in the conference room 11, the participants enter the shooting area 13 of the camera 11. The shooting area 13 of the three cameras 11 covers all the seats 12 in the conference room 10, so after the meeting starts, the video images shot by the three cameras 11 can include all the participants.

[0037] The first video data is the video data generated by the corresponding camera collecting the picture of the shooting area frame by frame according to the preset shooting frequency. The first video frame is the video picture corresponding to any frame in the first video data. Exemplarily, the conference end is connected to the three cameras installed in the conference venue by communication, and the conference end can send a start instruction to the three cameras at the same time so that the three cameras start shooting video at the same time. The shooting frequency of the three cameras is the same, so after the three cameras start shooting video at the same time, they can synchronously shoot the video pictures of each frame. The camera sorts the corresponding collected video pictures according to the shooting order to generate the first video data, and transmits the first video data to the conference end through the communication connection with the conference end. After obtaining the first video data transmitted by the three cameras, the conference end can determine that the first video frames with the same shooting order in the three first video data obtained are the video pictures shot by the three cameras at almost the same time, and then divide the three first video frames with the same shooting order into the same video set. For example, the conference terminal can classify the first video frame ranked first among the three first video data obtained into the same video set. The first video frame ranked first is the video picture initially captured by the camera. The three cameras start to capture videos at the same time, so the first video frame ranked first can be regarded as the video pictures captured by the three cameras at the same time. Since the three cameras will shoot at the same shooting frequency after being started at the same time, the three cameras will shoot the video picture ranked first in the corresponding first video data at the same time, and then shoot the video picture ranked second in the corresponding first video data at the same time after the same interval. By analogy, the three cameras almost shoot the first video frames with the same shooting order in the corresponding first video data at the same time. The three first video frames with the same shooting order are classified into the same video set to ensure the subsequent splicing of the video pictures shot at the same time, and to ensure the accuracy of the time sequence of the spliced ​​video pictures.

[0038] In another embodiment, the conference terminal may obtain the first video frames most recently shot by the three cameras according to a preset period, and use the three first video frames obtained as the first video frames with the same shooting order in the first video data synchronously collected by the three cameras and store them in the same video set. Exemplarily, after the three cameras synchronously shoot video images each time, the conference terminal respectively obtains the most recently shot video images from the three cameras to obtain three synchronously shot video images, and stores the three synchronously shot video images in the same video set. The generation order of each video set is the shooting order of the corresponding first video frames in the video set, and the generation order of each video set can be determined as the shooting order of each video set.

[0039] S120 . According to the position sequence of the multiple cameras, splice the multiple first video frames in each video set to generate a corresponding second video frame.

[0040] The position sequence of multiple cameras can be understood as the sequence of camera installation positions from the left side to the right side or from the right side to the left side of the venue. This embodiment is described by taking the sequence of camera installation positions from the left side to the right side of the venue as an example. Figure 2 , the position sequence of the three cameras from the left to the right of the venue 10 is ABC. From the position sequence, it can be seen that camera A photographs the participants on the left side of the venue 10, camera B photographs the participants in the middle of the venue 10, and camera C photographs the participants on the right side of the venue 10. Therefore, the position sequence of multiple cameras can represent the sequence of video images captured by multiple cameras in the complete spliced ​​image. The first video frames captured at the same time in the video set are spliced ​​according to the position sequence to ensure the accuracy of the splicing order.

[0041] In one embodiment, the position sequence of multiple cameras can be pre-selected and set, and accordingly, before the first video frame in the video set is spliced, the preset position sequence of multiple cameras is obtained. In another embodiment, before the first video frame in the video set is spliced, the position sequence of multiple cameras can also be determined according to the positions of the multiple cameras. Exemplarily, the coordinates of multiple cameras and the coordinates of the left and right boundaries of the venue are obtained, and the coordinates of the multiple cameras and the coordinates of the left and right boundaries of the venue are compared to determine the position sequence of multiple cameras. In addition, the position sequence of multiple cameras can also be manually selected by the staff.

[0042] Furthermore, Figure 3 1 is a flow chart of splicing the first video frame in a video set provided by an embodiment of the present application. Figure 3 As shown, the step of splicing the first video frame in the video set specifically includes S1201-S1202:

[0043] S1201. Determine the order of cameras in the position sequence as the order of first video frames shot by the cameras in the corresponding second video frames in the video set.

[0044] The second video frame is a video image generated by splicing the first video frames in the corresponding video set. Figure 2 The position sequence of the three cameras from the left to the right of the venue 10 is ABC. Accordingly, it is determined that the first video frame shot by camera A is the first video picture from left to right in the second video frame, the first video frame shot by camera B is the second video picture from left to right in the second video frame, and the first video frame shot by camera C is the third video picture from left to right in the second video frame.

[0045] S1202: Splice a plurality of first video frames in the video set based on an order in a corresponding second video frame to obtain a second video frame corresponding to the video set.

[0046] For example, Figure 4 It is a schematic diagram of all participants in the conference room provided in the embodiment of the present application. Figure 5 is a schematic diagram of a first video frame shot synchronously by three cameras provided in an embodiment of the present application. Figure 2 , 4 5, the first video frame 111 shot by the camera A installed on the left side of the venue includes the participants sitting on the left, the first video frame 112 shot by the camera B installed in the middle of the venue includes the participants sitting in the middle, and the first video frame 113 shot by the camera C installed on the right side of the venue includes the participants sitting on the right. Correspondingly, according to the order of the first video frames shot by the camera A, the camera B and the camera C in the second video frame, the first video frame 111, the first video frame 112 and the first video frame 113 are spliced ​​from left to right, that is, the first video frame 112 is spliced ​​on the right side of the first video frame 111, and the first video frame 113 is spliced ​​on the right side of the first video frame 112, so that the second video frame containing all the participants and with accurate splicing order can be obtained.

[0047] In another embodiment, by Figure 2 It can be seen that the shooting areas 13 of camera A, camera B and camera C may overlap. Correspondingly, the first video frames shot synchronously by camera A, camera B and camera C have overlapping areas. If the first video frames in the video set are spliced ​​to generate the second video frame, there will be two overlapping areas with the same content in the second video frame, which will affect the display effect of the second video frame. In order to ensure the display effect of the second video frame generated by splicing, the overlapping areas in the first video frame can be deleted, and then the deleted first video frame can be spliced ​​into the second video frame. Exemplary, Figure 61 is a flow chart of generating a second video frame after deleting the first video frame provided by an embodiment of the present application. Figure 6 As shown, the step of generating the second video frame after deleting the first video frame specifically includes S12021-S12023:

[0048] S12021. Determine two adjacent spliced ​​first video frames according to the order of multiple first video frames in the video set in the corresponding second video frame.

[0049] Exemplarily, two sequentially adjacent first video frames in the second video frame are determined as two adjacent spliced ​​first video frames. Figure 7 is a schematic diagram of a first video frame shot synchronously by three cameras provided in an embodiment of the present application. Figure 2 , 4 7, the first video frame 111 taken by the camera A installed on the left side of the venue and the first video frame 112 taken by the camera B installed in the middle of the venue are respectively the first and second video pictures in the second video frame, so it can be determined that the first video frame 111 and the first video frame 112 are two adjacent spliced ​​first video frames. The first video frame 112 and the first video frame 113 taken by the camera C installed on the right side of the venue are respectively the second and third video pictures in the second video frame, so it can be determined that the first video frame 112 and the first video frame 113 are two adjacent spliced ​​first video frames. Figure 7 It can be seen that there is an overlapping area between two adjacent spliced ​​first video frames.

[0050] S12022: Determine an overlapping area between two adjacent spliced ​​first video frames, and delete the overlapping area of ​​any one of the two adjacent spliced ​​first video frames.

[0051] For example, the overlapping area between two adjacent spliced ​​first video frames may be determined according to the coordinates of the overlapping areas captured by two adjacent cameras in the corresponding video images. Figure 7, the pixel column coordinate ranges of the overlapping areas captured by the two adjacent cameras, camera A and camera B, in the first video frame 111 are [y1, y2] and [y3, y4] respectively. The pixel points whose pixel column coordinates fall into [y1, y2] in the first video frame 111 are taken as the pixel points in the overlapping area 114, and then the overlapping area 114 in the first video frame 111 is determined. The pixel points whose pixel column coordinates fall into [y3, y4] in the first video frame 112 are taken as the pixel points in the overlapping area 115, and then the overlapping area 115 in the first video frame 112 is determined. Similarly, the overlapping area 116 and the overlapping area 117 between the first video frame 112 and the first video frame 113 can be determined. The overlapping area 114 in the first video frame 111 can be deleted, and the overlapping area 117 in the first video frame 113 can be deleted, so as to retain only one overlapping area, so as to avoid displaying two overlapping areas with the same content in the subsequent second video frame.

[0052] In another embodiment, feature point matching may be performed on two adjacent spliced ​​first video frames to determine the matching feature points between the two spliced ​​first video frames, and the overlapping area between the two adjacent spliced ​​first video frames may be determined based on the area where the feature points are located. Alternatively, a staff member may manually mark the overlapping area between the two adjacent spliced ​​first video frames.

[0053] S12023. Splice the deleted first video frames to obtain second video frames.

[0054] refer to Figure 7 After deleting the overlapping area 114 in the first video frame 111 and deleting the overlapping area 117 in the first video frame 113, the first video frame 111, the first video frame 112 and the first video frame 113 are spliced ​​from left to right to obtain a second video frame containing all the participants and with an accurate splicing order. The display effect of the second video frame is Figure 5 It should be noted that the first video frame after deletion mentioned in this embodiment does not refer to the first video frame after the overlapping area is deleted, but includes the first video frame of each deleted overlapping area and the first video frame of each non-deleted overlapping area in the video set.

[0055] In this embodiment, the first video frame after the deletion process can be spliced, and the splicing edge of the first video frame can be Gaussian blurred to obtain a second video frame. Exemplarily, the first video frame 111, the first video frame 112 and the first video frame 113 after the deletion process are spliced ​​from left to right to obtain a spliced ​​picture, and the pixel points of the splicing edge of the first video frame 111 and the first video frame 112 in the spliced ​​picture are blurred by a Gaussian blur of 10 pixels, and the pixel points of the splicing edge of the first video frame 112 and the first video frame 113 in the spliced ​​picture are blurred to obtain a second video frame. After the splicing edge in the second video frame is blurred, the picture splicing is more natural and smooth, which effectively improves the display effect of the second video frame.

[0056] It should be noted that if there is no overlapping area between two adjacent spliced ​​first video frames, Gaussian blur processing can be performed on the spliced ​​edge pixels of the spliced ​​picture directly spliced ​​by the first video frames in the video set to obtain the second video frame.

[0057] S130. Sort the second video frames corresponding to the multiple video sets according to the shooting order corresponding to the multiple video sets to generate second video data, and transmit the second video data to a receiving end so that the receiving end displays the second video data.

[0058] Among them, the second video data is the video stream sent by the conference end to the receiving end. Exemplarily, whenever the conference end continuously generates a preset number of second video frames, the second video frames can be sorted to generate second video data according to the shooting order or generation order of the video set corresponding to the preset number of second video frames. The second video data is sent to the receiving end through network communication or other communication means, so that the receiving end plays the second video data on the corresponding display screen. The second video frame in the second video data is obtained by splicing the first video frame shot synchronously by the conference end in an accurate splicing order. The user at the receiving end can see the complete and correctly ordered participants, ensuring the video screen display effect of the receiving end. The second video frame in the second video data will be played in the accurate shooting order, and the user at the receiving end can see the changes in the movements and expressions of all participants, ensuring the video playback effect of the receiving end.

[0059] Since the second video frame is obtained by splicing a plurality of first video frames shot synchronously, the overall resolution of the second video frame is relatively large, resulting in a low transmission efficiency of the second video data. Therefore, the plurality of second video frames can be scaled down in proportion, and the plurality of scaled down second video frames can be sorted and generated into the second video data according to the shooting order of the video set corresponding to the plurality of second video frames. Exemplarily, the conference end can scale down the second video frame in proportion when each second video frame is spliced ​​and generated, and when a preset number of scaled down second video frames are generated, the second video frame is generated into the second video data and transmitted to the receiving end. Alternatively, after continuously generating a preset number of second video frames, the preset number of second video frames can be scaled down in proportion, and the preset number of scaled down second video frames can be generated into the second video data and transmitted to the receiving end. Compared with the second video data generated by the second video frame of the original resolution, the second video data generated by the scaled down second video frame has a smaller data volume, which can effectively improve the transmission efficiency of the second video data, thereby improving the video playback efficiency of the receiving end.

[0060] In this embodiment, the ratio of the second video frame generated by splicing multiple synchronously shot first video frames is no longer the screen display ratio of the receiving end. In order for the receiving end to directly play the second video data, the conference end can proportionally reduce the second video frame to the screen display ratio of the receiving end. For example, if the screen display ratio of the receiving end is 16:9, the second video frame can be proportionally reduced to a 16:9 video screen accordingly.

[0061] In summary, the conference video transmission method provided by the embodiment of the present application, after obtaining the first video data collected by multiple cameras at the conference end, determines that the first video frames with the same shooting order are the first video frames shot synchronously by multiple cameras according to the shooting order of the first video frames in the first video data, and stores the first video frames shot synchronously in the same video set. According to the position order of multiple cameras, the first video frames in the same video set are spliced ​​to obtain the second video frames with accurate splicing of the video frame pictures. According to the shooting order of the video set, the respective second video frames are sorted to generate the second video data after the synchronous pictures of the multiple first video data are spliced, and the second video data is transmitted to the receiving end so that the receiving end plays the second video data. Through the above-mentioned technical means, the first video frames shot synchronously are spliced ​​according to the position order of multiple cameras to achieve accurate splicing of the video pictures at the same time, and the spliced ​​second video frames clearly record the actions and expressions of each participant at the corresponding time, ensuring the display effect of the second video frame at the receiving end. The second video frames are sorted according to the shooting order of the video collection to generate the second video data, so that the receiving end can play the second video frames in the accurate playback order. The second video frames in the accurate playback order demonstrate the changing process of the actions and expressions of each participant at each moment, ensuring the playback effect at the receiving end.

[0062] Based on the above embodiments, Figure 8 This is a schematic diagram of the structure of a conference video transmission device provided in an embodiment of the present application. Figure 8 The conference video transmission device provided in this embodiment specifically includes: a video set generation module 21, a video frame splicing module 22 and a video data transmission module 23.

[0063] The video set generation module 21 is configured to obtain first video data synchronously collected by multiple cameras, and divide multiple first video frames with the same shooting order in the multiple first video data into the same video set to obtain multiple video sets corresponding to the shooting order; wherein the multiple cameras shoot the participants at different positions;

[0064] The video frame splicing module 22 is configured to splice a plurality of first video frames in each video set to generate a corresponding second video frame according to a position sequence of a plurality of cameras;

[0065] The video data transmission module 23 is configured to sort the second video frames corresponding to the multiple video sets according to the shooting order corresponding to the multiple video sets to generate second video data, and transmit the second video data to the receiving end so that the receiving end displays the second video data.

[0066] Based on the above embodiment, the video frame stitching module 22 includes: a first sequence acquisition submodule, which is configured to determine the position sequence of multiple cameras according to the positions of multiple cameras before stitching multiple first video frames in each video set to generate corresponding second video frames according to the position sequence of multiple cameras.

[0067] Based on the above embodiment, the video frame stitching module 22 includes: a second sequence acquisition submodule, which is configured to obtain a preset position sequence of multiple cameras before stitching multiple first video frames in each video set to generate corresponding second video frames according to the position sequence of multiple cameras.

[0068] On the basis of the above embodiment, the video frame stitching module 22 includes: a first order determination submodule, configured to determine the order of the cameras in the position sequence as the order of the first video frames taken by the cameras in the video set in the corresponding second video frames; a video frame stitching submodule, configured to stitch multiple first video frames in the video set based on the order in the corresponding second video frames to obtain the second video frames corresponding to the video set.

[0069] On the basis of the above embodiment, the video frame splicing submodule includes: an adjacent video frame determination unit, configured to determine two adjacent spliced ​​first video frames according to the order of multiple first video frames in the video set in the corresponding second video frame; a deletion processing unit, configured to determine the overlapping area between two adjacent spliced ​​first video frames, and delete the overlapping area of ​​any one of the two adjacent spliced ​​first video frames; a video frame splicing unit, configured to splice the first video frames after the deletion processing to obtain a second video frame.

[0070] Based on the above embodiment, the video frame splicing unit includes: a blur processing subunit configured to splice the first video frame after the deletion process, and perform Gaussian blur processing on the splicing edge of the first video frame to obtain a second video frame.

[0071] Based on the above embodiment, the video data transmission module 23 includes: a scaling-down submodule, which is configured to scale down multiple second video frames in equal proportions, and sort the multiple scaled-down second video frames according to the shooting order of the video set corresponding to the multiple second video frames to generate second video data.

[0072] As mentioned above, the conference video transmission device provided by the embodiment of the present application, after obtaining the first video data collected by multiple cameras at the conference end, determines that the first video frames with the same shooting order are the first video frames shot synchronously by multiple cameras according to the shooting order of the first video frames in the first video data, and stores the first video frames shot synchronously in the same video set. According to the position order of multiple cameras, the first video frames in the same video set are spliced ​​to obtain the second video frames with accurate splicing of the video frame pictures. According to the shooting order of the video set, the second video frames are sorted to generate the second video data after the synchronous pictures of the multiple first video data are spliced, and the second video data is transmitted to the receiving end so that the receiving end plays the second video data. Through the above technical means, the first video frames shot synchronously are spliced ​​according to the position order of multiple cameras to achieve accurate splicing of the video pictures at the same time, and the spliced ​​second video frames clearly record the actions and expressions of each participant at the corresponding time, ensuring the display effect of the second video frame at the receiving end. The second video frames are sorted according to the shooting order of the video collection to generate the second video data, so that the receiving end can play the second video frames in the accurate playback order. The second video frames in the accurate playback order demonstrate the changing process of the actions and expressions of each participant at each moment, ensuring the playback effect at the receiving end.

[0073] The conference video transmission device provided in the embodiment of the present application can be used to execute the conference video transmission method provided in the above embodiment, and has corresponding functions and beneficial effects.

[0074] Fig. 9 This is a schematic diagram of the structure of a conference video transmission device provided in an embodiment of the present application, with reference to Fig. 9 The conference video transmission device includes: a processor 31, a memory 32, a communication device 33, an input device 34 and an output device 35. The number of processors 31 in the conference video transmission device can be one or more, and the number of memories 32 in the conference video transmission device can be one or more. The processor 31, memory 32, communication device 33, input device 34 and output device 35 of the conference video transmission device can be connected through a bus or other methods.

[0075] The memory 32, as a computer-readable storage medium, can be used to store software programs, computer executable programs and modules, such as program instructions / modules corresponding to the conference video transmission method of any embodiment of the present application (for example, the video set generation module 21, the video frame splicing module 22 and the video data transmission module 23 in the conference video transmission device). The memory 32 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application required for at least one function; the data storage area may store data created according to the use of the device, etc. In addition, the memory 32 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some instances, the memory may further include a memory remotely arranged relative to the processor, and these remote memories may be connected to the device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network and a combination thereof.

[0076] The communication device 33 is used for data transmission.

[0077] The processor 31 executes various functional applications and data processing of the device by running the software programs, instructions and modules stored in the memory 32, that is, realizes the above-mentioned conference video transmission method.

[0078] The input device 34 may be used to receive input digital or character information and generate key signal input related to user settings and function control of the device. The output device 35 may include a display device such as a display screen.

[0079] The conference video transmission device provided above can be used to execute the conference video transmission method provided in the above embodiment, and has corresponding functions and beneficial effects.

[0080] An embodiment of the present application also provides a storage medium containing computer executable instructions, which are used to execute a conference video transmission method when executed by a computer processor. The conference video transmission method includes: obtaining first video data synchronously collected by multiple cameras, and dividing multiple first video frames with the same shooting order in the multiple first video data into the same video set to obtain multiple video sets corresponding to the shooting order; wherein the multiple cameras shoot participants at different positions; according to the position sequence of the multiple cameras, the multiple first video frames in each video set are spliced ​​to generate corresponding second video frames; according to the shooting order corresponding to the multiple video sets, the second video frames corresponding to the multiple video sets are sorted to generate second video data, and the second video data is transmitted to the receiving end so that the receiving end displays the second video data.

[0081] Storage medium - any of various types of memory devices or storage devices. The term "storage medium" is intended to include: installation media, such as CD-ROM, floppy disk or tape device; computer system memory or random access memory, such as DRAM, DDR RAM, SRAM, EDO RAM, Rambus RAM, etc.; non-volatile memory, such as flash memory, magnetic media (such as hard disk or optical storage); registers or other similar types of memory elements, etc. Storage media may also include other types of memory or combinations thereof. In addition, the storage medium may be located in the first computer system in which the program is executed, or may be located in a different second computer system, which is connected to the first computer system via a network (such as the Internet). The second computer system can provide program instructions to the first computer for execution. The term "storage medium" may include two or more storage media residing in different locations (for example, in different computer systems connected by a network). The storage medium may store program instructions (for example, embodied as a computer program) that can be executed by one or more processors.

[0082] Of course, the storage medium containing computer executable instructions provided in the embodiment of the present application, whose computer executable instructions are not limited to the above-mentioned conference video transmission method, can also execute related operations in the conference video transmission method provided in any embodiment of the present application.

[0083] The conference video transmission device, storage medium and conference video transmission equipment provided in the above embodiments can execute the conference video transmission method provided in any embodiment of the present application. For technical details not described in detail in the above embodiments, please refer to the conference video transmission method provided in any embodiment of the present application.

[0084] The above are only preferred embodiments of the present application and the technical principles used. The present application is not limited to the specific embodiments herein, and various obvious changes, readjustments and substitutions that can be made by those skilled in the art will not deviate from the protection scope of the present application. Therefore, although the present application is described in more detail through the above embodiments, the present application is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the scope of the claims.

Claims

1. A conference video transmission method, characterized in that: include: Acquire first video data synchronously collected by multiple cameras, and group multiple first video frames in the first video data having the same shooting order into the same video set to obtain multiple video sets corresponding to the shooting order; wherein the multiple cameras shoot the participants at different positions; According to the position sequence of the multiple cameras, splicing the multiple first video frames in each of the video sets to generate a corresponding second video frame; According to the shooting order corresponding to the multiple video sets, the second video frames corresponding to the multiple video sets are sorted to generate second video data, and the second video data is transmitted to the receiving end so that the receiving end displays the second video data.

2. The conference video transmission method according to claim 1, characterized in that: Before the step of splicing the plurality of first video frames in each of the video sets to generate corresponding second video frames according to the position sequence of the plurality of cameras, the step further includes: According to the positions of the multiple cameras, a position sequence of the multiple cameras is determined.

3. The conference video transmission method according to claim 1, characterized in that: Before the step of splicing the plurality of first video frames in each of the video sets to generate corresponding second video frames according to the position sequence of the plurality of cameras, the step further includes: Get the position sequence of multiple preset cameras.

4. The conference video transmission method according to any one of claims 1 to 3, characterized in that: The step of splicing a plurality of first video frames in each of the video sets to generate a corresponding second video frame according to the position sequence of the plurality of cameras includes: Determine the order of the cameras in the position sequence as the order of the first video frames corresponding to the first video frames taken by the cameras in the corresponding second video frames in the video set; Multiple first video frames in the video set are spliced ​​based on the order in the corresponding second video frame to obtain a second video frame corresponding to the video set.

5. The conference video transmission method according to claim 4, characterized in that: The step of splicing the plurality of first video frames in the video set based on the order in the corresponding second video frame to obtain the second video frame corresponding to the video set includes: Determine two adjacent spliced ​​first video frames according to the order of the plurality of first video frames in the video set in the corresponding second video frame; Determine an overlapping area between the two adjacent spliced ​​first video frames, and delete the overlapping area of ​​any one of the two adjacent spliced ​​first video frames; The first video frames after the deletion process are spliced ​​to obtain the second video frames.

6. The conference video transmission method according to claim 5, characterized in that: The step of splicing the deleted first video frames to obtain the second video frames includes: The first video frames after the deletion processing are spliced, and Gaussian blur processing is performed on the splicing edges of the first video frames to obtain the second video frames.

7. The conference video transmission method according to claim 1, characterized in that: The step of sorting the second video frames corresponding to the plurality of video sets according to the shooting order corresponding to the plurality of video sets to generate the second video data comprises: The plurality of second video frames are scaled down in equal proportions, and the plurality of scaled down second video frames are sorted according to the shooting order of the video set corresponding to the plurality of second video frames to generate second video data.

8. A conference video transmission device, characterized in that: include: The video set generation module is configured to obtain first video data synchronously collected by multiple cameras, and divide multiple first video frames with the same shooting order in the multiple first video data into the same video set to obtain multiple video sets corresponding to the shooting order; wherein the multiple cameras shoot the participants at different positions; A video frame splicing module is configured to splice a plurality of first video frames in each of the video sets to generate a corresponding second video frame according to a position sequence of the plurality of cameras; The video data transmission module is configured to sort the second video frames corresponding to the multiple video sets according to the shooting order corresponding to the multiple video sets to generate second video data, and transmit the second video data to the receiving end so that the receiving end displays the second video data.

9. A conference video transmission device, characterized in that: include: one or more processors; A memory stores one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the conference video transmission method as described in any one of claims 1-7.

10. A storage medium containing computer executable instructions, characterized in that: The computer executable instructions are used to execute the conference video transmission method as described in any one of claims 1-7 when executed by a computer processor.

Images