Video data processing method and system, electronic equipment and storage medium

Abstract

The embodiment of the invention provides a video data processing method and system, and the method comprises the steps: obtaining multiple paths of first video stream data; respectively extracting first video frame data of the multiple paths of first video stream data; according to target split screen layout information, synthesizing the multiple paths of first video frame data into one path of second video stream data; and displaying the second video stream data. According to the embodiment of the invention, multiple times of decoding and recoding in a traditional method are avoided, the calculation overhead and the processing delay are remarkably reduced, meanwhile, the burden of network transmission is reduced, and the synthesized video stream meeting the split-screen requirement can be quickly generated and displayed on the premise that the video quality is guaranteed.

Description

Technical Field

[0001] The present invention relates to the field of video processing technology, and in particular to a method for processing video data, a system for processing video data, an electronic device, and a computer-readable storage medium. Background Art

[0002] In existing video conferencing systems, the video streams of all participants are usually pushed to the monitoring terminal. The monitoring terminal is responsible for receiving the video stream, decoding it, re-encoding it, and then transmitting it back to the participants. This method can realize the centralized display and management of multi-party videos, but because it involves multiple decoding and re-encoding, the processing process is time-consuming and computationally expensive. It is easily affected by bandwidth limitations and jitters during network transmission, which will introduce high latency. Summary of the invention

[0003] In view of the above problems, embodiments of the present invention are proposed to provide a method for processing video data, a system for processing video data, an electronic device, and a computer-readable storage medium that overcome the above problems or at least partially solve the above problems.

[0004] In order to solve the above problem, an embodiment of the present invention discloses a method for processing video data, the method comprising:

[0005] Acquire multiple channels of first video stream data;

[0006] Respectively extracting first video frame data of multiple channels of the first video stream data;

[0007] According to the target split-screen layout information, synthesize the multiple channels of the first video frame data into one channel of the second video stream data;

[0008] Display the second video stream data.

[0009] Optionally, the synthesizing the multiple channels of the first video frame data into one channel of the second video stream data according to the target split-screen layout information includes:

[0010] Writing the multiple channels of the first video frame data into the target display area in the target split-screen layout information respectively;

[0011] The multiple channels of the first video frame data of the multiple target display areas are spliced ​​into one channel of the second video stream data.

[0012] Optionally, the step of writing the multiple channels of the first video frame data into the target display area in the target split-screen layout information respectively includes:

[0013] Acquire display parameters of a plurality of the target display areas and image parameters of a plurality of channels of the first video frame data;

[0014] Performing image processing on the multiple channels of the first video frame data according to the display parameter and the image parameter to obtain multiple channels of the second video frame data;

[0015] Writing multiple channels of the second video frame data into the corresponding target display area.

[0016] Optionally, respectively extracting the first video frame data of the multiple channels of the first video stream data includes:

[0017] The first video frame data is obtained by decoding multiple channels of the first video stream data in parallel.

[0018] Optionally, the acquiring of multiple channels of first video stream data includes:

[0019] The first video stream data of multiple channels are obtained from multiple conference terminals and / or servers through a video stream transmission network.

[0020] Optionally, before acquiring the multiple channels of first video stream data, the method further includes:

[0021] Obtaining the quantity and display requirement information of the first video stream data of multiple channels;

[0022] The target split-screen layout information is set according to the quantity and the display requirement information.

[0023] Optionally, presenting the second video stream data includes:

[0024] The second video stream data is transmitted to at least one display terminal, so that at least one display terminal displays the second video stream data.

[0025] The embodiment of the present invention further discloses a video data processing system, the system comprising:

[0026] A video stream data acquisition module, used to acquire multiple channels of first video stream data;

[0027] A video frame data extraction module, used to extract first video frame data of multiple channels of the first video stream data respectively;

[0028] A video stream data synthesis module, used for synthesizing a plurality of channels of the first video frame data into one channel of second video stream data according to target split-screen layout information;

[0029] The video stream data display module is used to display the second video stream data.

[0030] Optionally, the video stream data synthesis module includes:

[0031] A video frame data writing module, used for writing the multiple channels of the first video frame data into the target display area in the target split-screen layout information respectively;

[0032] The video frame data splicing module is used to splice multiple channels of the first video frame data of multiple target display areas into one channel of the second video stream data.

[0033] Optionally, the video frame data writing module includes:

[0034] A parameter acquisition module, used to acquire display parameters of the plurality of target display areas and image parameters of the plurality of channels of the first video frame data;

[0035] An image processing module, configured to perform image processing on the multiple channels of the first video frame data according to the display parameter and the image parameter to obtain multiple channels of second video frame data;

[0036] The display area writing module is used to write multiple channels of the second video frame data into the corresponding target display area.

[0037] Optionally, the video frame data extraction module is used to decode multiple channels of the first video stream data in parallel to obtain the first video frame data.

[0038] Optionally, the video stream data acquisition module is used to acquire multiple channels of the first video stream data from multiple conference terminals and / or servers through a video stream transmission network.

[0039] Optionally, the system further comprises:

[0040] A quantity demand acquisition module, used for acquiring the quantity and display demand information of the multiple channels of first video stream data before the video stream data acquisition module acquires the multiple channels of first video stream data;

[0041] The split-screen layout setting module is used to set the target split-screen layout information according to the quantity and the display requirement information.

[0042] Optionally, the video stream data display module is used to transmit the second video stream data to at least one display terminal, so that at least one of the display terminals displays the second video stream data.

[0043] An embodiment of the present invention further discloses an electronic device, comprising: one or more processors; and one or more machine-readable media storing instructions thereon, which, when executed by the one or more processors, enable the electronic device to execute the video data processing method as described above.

[0044] The embodiment of the present invention further discloses a computer-readable storage medium, which stores a computer program that enables a processor to execute the video data processing method as described above.

[0045] The embodiments of the present invention include the following advantages:

[0046] The video data processing scheme provided by the embodiment of the present invention obtains multiple channels of first video stream data; respectively extracts the first video frame data of the multiple channels of first video stream data; synthesizes the multiple channels of first video frame data into one channel of second video stream data according to the target split-screen layout information; and displays the second video stream data.

[0047] Compared with the background technology, the embodiments of the present invention have the following beneficial effects:

[0048] By directly extracting and synthesizing the first data frame data of multiple first video streams, the process of multiple decoding and re-encoding in traditional solutions is avoided, the computing overhead is reduced, and the delay of video processing is significantly reduced, thereby improving the real-time performance of the system. Under the guidance of the target split-screen layout information, multiple first video frame data are directly synthesized into one second video stream data, reducing the network bandwidth requirements for independent transmission of multiple video stream data, while reducing the risk of jitter and delay during transmission. The video frame-level processing method is adopted to centrally complete the synthesis and display of video frame data, simplify the video processing process, reduce the computing load of the monitoring terminal, and improve the overall processing efficiency of video data. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Figure 1 is a flowchart of the steps of a method for processing video data according to an embodiment of the present invention;

[0050] Figure 2 This is a flowchart of a solution for reducing video delay based on a multi-screen split-screen mode according to an embodiment of the present invention;

[0051] Figure 3 It is a structural block diagram of a video data processing system according to an embodiment of the present invention. DETAILED DESCRIPTION

[0052] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0053] The video data processing scheme proposed in the embodiment of the present invention directly extracts the first video frame data from multiple channels of first video stream data by acquiring the data, and synthesizes the multiple channels of first video frame data into one channel of second video stream data according to the target split-screen layout information, thereby realizing efficient integration and display of multiple channels of video stream data. Through direct processing at the video frame level, the scheme avoids multiple decoding and re-encoding in traditional methods, significantly reduces computing overhead and processing delay, and reduces the burden of network transmission. It can quickly generate and display a synthesized video stream that meets split-screen requirements while ensuring video quality.

[0054] Reference Figure 1 , shows a flowchart of the steps of a method for processing video data according to an embodiment of the present invention. The method for processing video data can be applied to a video data processing system or a video conferencing system, referred to as a system. The method for processing video data can specifically include the following steps:

[0055] Step 101, obtaining multiple channels of first video stream data.

[0056] This step can receive the first video stream data from multiple sources, usually including the video stream data of each participant. In practical applications, the system needs to have the ability to handle multiple video stream protocols to meet the needs of different devices and network environments. In the process of obtaining the first video stream time, a communication connection is first established with each data source, and the streaming data is transmitted through the network protocol. In order to improve the scalability of the system, it is key to support concurrent processing of multiple channels of first video stream data. When the number of participants is large, the system needs to optimize the scheduling strategy for data reception, such as using asynchronous I / O mechanism or multi-threading technology to ensure the efficiency and stability of the first video stream time reception.

[0057] Step 102: extract first video frame data of multiple channels of first video stream data respectively.

[0058] In this step, the acquired multiple first video stream times are parsed, and the first video frame data of each first video stream data is extracted respectively. Specifically, a video stream is usually composed of continuous video frames, and each video frame contains the timing and picture information of the video. During the extraction process, the frame rate, resolution and encoding format of the first video stream data need to be considered to ensure that all the first video frame data can be uniformly converted into a standardized data format for subsequent processing. In addition, during the extraction process, the first video frame data needs to be processed for timing synchronization to ensure the alignment of multiple first video frames on the time axis. For example, when a first video stream data has a large delay, the time point of the first video frame data of the first video stream data can be adjusted by buffering or timestamp calibration, so that each first video frame data can be synchronously entered into the next step of processing. This step ensures that subsequent synthesis operations can be processed based on unified and accurate first video frame data.

[0059] Step 103: synthesize multiple channels of first video frame data into one channel of second video stream data according to the target split-screen layout information.

[0060] The target split-screen layout information of this step usually includes the position, size, proportion and arrangement of each channel of first video frame data in the composite picture, such as the "2×2 grid layout" of 4-channel video or the "main picture + small picture" layout in master-slave mode. The system first calculates the target position and size of each first video frame data according to the target split-screen layout information, and crops, scales or adjusts the boundaries of each first video frame time to match the requirements of the composite picture. Subsequently, the system superimposes the adjusted multiple channels of first video frame data one by one into a unified canvas to generate a composite picture containing all the first video frame data. For example, in master-slave mode, if one channel of the picture occupies the main view and the remaining pictures are small windows, the system needs to scale and adjust the position of the small window pictures, and then superimpose them with the main picture.

[0061] Step 104, display the second video stream data.

[0062] The purpose of this step is to display the synthesized second video stream data to the user in a visual manner. The display method may vary according to the application scenario. For example, in a video conferencing system, the synthesized picture can be presented in real time on the screen of the conference terminal; in a monitoring scenario, it may be displayed through a large screen or a projection device. In actual operation, the conference terminal or the monitoring terminal decodes the second video stream data and converts it into a frame data format that is adapted to the display device. Subsequently, the video picture is rendered and output in real time according to the resolution and refresh rate of the display device. For example, on a high-resolution display, the video picture needs to be anti-aliased or image enhanced to ensure the clarity of the display effect. If the user can freely switch the split-screen layout or adjust the screen ratio, it is necessary to support dynamic adjustment of the display parameters to meet the interaction needs.

[0063] The video data processing scheme provided by the embodiment of the present invention obtains multiple channels of first video stream data; respectively extracts the first video frame data of the multiple channels of first video stream data; synthesizes the multiple channels of first video frame data into one channel of second video stream data according to the target split-screen layout information; and displays the second video stream data.

[0064] Compared with the background technology, the embodiments of the present invention have the following beneficial effects:

[0065] By directly extracting and synthesizing the first data frame data of multiple first video streams, the process of multiple decoding and re-encoding in traditional solutions is avoided, the computing overhead is reduced, and the delay of video processing is significantly reduced, thereby improving the real-time performance of the system. Under the guidance of the target split-screen layout information, multiple first video frame data are directly synthesized into one second video stream data, reducing the network bandwidth requirements for independent transmission of multiple video stream data, while reducing the risk of jitter and delay during transmission. The video frame-level processing method is adopted to centrally complete the synthesis and display of video frame data, simplify the video processing process, reduce the computing load of the monitoring terminal, and improve the overall processing efficiency of video data.

[0066] In an exemplary embodiment of the present invention, an implementation method of synthesizing multiple channels of first video frame data into one channel of second video stream data according to target split-screen layout information is as follows: writing the multiple channels of first video frame data into target display areas in the target split-screen layout information respectively; and splicing the multiple channels of first video frame data in multiple target display areas into one channel of second video stream data.

[0067] Specifically, the target split-screen layout information predefines the display position, size, ratio and other information of each channel of the first video frame data in the final composite picture. First, the system writes each channel of the first video frame data into its corresponding target display area according to the target split-screen layout information. For example, in a "2×2 grid layout", the system will allocate equal-sized rectangular areas to the 4 channels of first video frame time, and fill each channel of the first video frame data into these areas; while in the "main picture + small picture" mode, the main video frame in the first video frame data may be allocated a larger central area, and other video frames may be allocated to the surrounding small window areas. During the writing process, the system may perform cropping, scaling or border adjustment operations on each channel of the first video frame time to adapt it to the size and ratio of the target display area.

[0068] Subsequently, the system stitches together the multiple first video frame data in these target display areas one by one to generate the final composite image, i.e., one second video stream data. This stitching process can be regarded as integrating each display area into a unified canvas according to a predefined layout. After the stitching is completed, the system may convert the composite image into a format suitable for network transmission or display equipment to meet the real-time requirements.

[0069] This implementation method directly uses the target split-screen layout information to guide the writing and splicing of the first video frame data, avoiding the complex process of multiple decoding and re-encoding in the traditional method, reducing the computing overhead and processing delay. Secondly, by cutting and scaling the multiple first video frames as needed and directly filling them into the target display area, unnecessary pixel data processing is effectively reduced and resource utilization is optimized. In addition, since the display position and size of each first video frame data are determined by the target split-screen layout information, users can flexibly define the split-screen layout to achieve personalized presentation of multi-channel video content.

[0070] In an exemplary embodiment of the present invention, an implementation method of writing multiple channels of first video frame data into target display areas in target split-screen layout information respectively is: obtaining display parameters of multiple target display areas and image parameters of multiple channels of first video frame data; performing image processing on the multiple channels of first video frame data according to the display parameters and the image parameters to obtain multiple channels of second video frame data; and writing the multiple channels of second video frame data into corresponding target display areas.

[0071] Specifically, the system needs to extract the display parameters of multiple target display areas, such as the size, position, scaling, rotation angle, etc. of each area. These display parameters define the display rules of each first video frame data in the final picture. At the same time, the system needs to parse the image parameters of multiple first video frame data, such as resolution, pixel format, aspect ratio, etc., to ensure that the input first video frame data matches the requirements of the target display area. After obtaining these parameters, the system will perform image processing on the multiple first video frame data to generate multiple second video frame data adapted to the target display area. The content of image processing generally includes scaling (adjusting the size of the first video frame data to match the size of the display area), cropping (removing irrelevant areas), rotation (adjusting the time direction of the first video frame according to display requirements) and pixel format conversion (ensuring consistency). For example, when the resolution of the input first video frame time is high and the target display area is small, the system can reduce the first video frame data while maintaining the clarity of the picture.

[0072] After completing the image processing, the system writes the multiple second video frame data into the corresponding target display area one by one so that it can be accurately presented in the final screen. For example, in the "main screen + small screen" layout, the main video frame in the processed second video frame data will be filled into the main display area, and the other video frames will be scaled to the small screen area. Through this processing method, each target display area can present the screen content consistent with the target split-screen layout information, and prepare for the subsequent frame splicing and screen display.

[0073] This implementation achieves accurate matching of the first video frame data with the target display area by acquiring and combining display parameters and image parameters, ensuring the integrity and consistency of the final image. Secondly, the adjustment of the time of multiple first video frames based on image processing avoids the inefficient operations of repeated decoding and full-frame processing in traditional methods, significantly reducing the consumption of computing resources. At the same time, the distributed target display area writing method makes the layout adjustment more flexible, and users can dynamically modify the layout parameters according to actual needs without reprocessing the entire video stream.

[0074] In an exemplary embodiment of the present invention, an implementation method of respectively extracting first video frame data of multiple channels of first video stream data is: decoding multiple channels of first video stream data in parallel to obtain first video frame data.

[0075] Decoding is the process of converting compressed and encoded video data into original frame data for subsequent processing. In this embodiment, the system uses a parallel processing strategy, that is, decoding operations are performed on multiple first video streams at the same time, which significantly improves the efficiency of video frame extraction. Specifically, the system first allocates an independent decoding thread or task to each first video stream, and accelerates the decoding process using a multi-core central processing unit (CPU) or a graphics processing unit (GPU) if hardware support is available. The decoding task of each first video stream will run independently to extract the corresponding first video frame data. This parallel processing method can maximize the use of system resources and avoid the accumulation of delays caused by single-threaded decoding one by one.

[0076] This implementation method extracts the first video frame data through parallel decoding processing. Compared with serial decoding, parallel decoding fully utilizes the computing power of multi-core CPUs or GPUs and greatly shortens the total decoding time. This improvement is particularly obvious in scenarios with a large number of multi-channel video streams. Secondly, since the decoding task of each channel of the first video stream data is run independently, this implementation method has high scalability and can flexibly respond to different numbers of video stream processing requirements without significantly increasing system resource overhead.

[0077] In an exemplary embodiment of the present invention, an implementation method of obtaining multiple channels of first video stream data is: obtaining multiple channels of first video stream data from multiple conference terminals and / or servers through a video stream transmission network.

[0078] The video stream transmission network is the core channel for realizing data transmission, and is often implemented using a variety of protocols such as Real-time Transport Protocol (RTP), Real-time Streaming Protocol (RTSP), Real-time Messaging Protocol (RTMP) or Web Real-Time Communication (WebRTC). During the specific operation process, the system needs to establish a stable connection with multiple conference terminals or servers in order to receive the first video stream data generated by them in real time. The conference terminal may be a user device (such as a mobile phone, computer, camera, etc.), and the server is usually used to centrally manage, process or store video data. During the transmission process, the first video frame data of the first video stream data is usually transmitted in a compressed format to reduce bandwidth occupancy and improve transmission efficiency.

[0079] This implementation receives the first video stream data through a video stream transmission network, can adapt to different terminals and servers, realizes cross-platform and cross-device data transmission, and enhances the compatibility and applicability of the system.

[0080] In an exemplary embodiment of the present invention, an implementation method before obtaining multiple channels of first video stream data is: obtaining the quantity and display requirement information of multiple channels of first video stream data; and setting target split-screen layout information according to the quantity and display requirement information.

[0081] Specifically, the number of first video stream data indicates the total number of participants or video sources that need to be processed, and the display requirement information defines the user's expectations for the screen display, such as the layout method, the display priority of each first video stream data, the size ratio, etc. For example, in a video conference scenario, if there are four participants and the user wants to use a "2×2 grid layout", the system will automatically generate target split-screen layout information that meets this expectation based on the number and display requirements. The target split-screen layout information includes parameters such as the position, size, and hierarchical relationship of each first video frame in the composite screen.

[0082] For example, when some video sources need to occupy a larger display area, the system can prioritize these video sources to allocate higher resolution or bandwidth resources to ensure their picture quality. At the same time, the display demand information also provides the system with a basis for flexible layout adjustment, such as placing the speaker's video in the main display area when he is speaking, while other participants' videos are displayed in small windows.

[0083] This implementation method pre-plans the target split screen layout information to reduce the uncertainty in the subsequent processing process. Secondly, it gives users a high degree of personalized control ability. By inputting display demand information, users can dynamically define the layout style to meet the usage requirements of specific scenarios.

[0084] In an exemplary embodiment of the present invention, an implementation method of displaying the second video stream data is: transmitting the second video stream data to at least one display terminal, so that the at least one display terminal displays the second video stream data.

[0085] The display terminal can be a variety of devices, such as large-screen displays in conference rooms, personal computers, mobile devices, etc. In order to achieve efficient transmission, the system usually uses a dedicated video streaming transmission protocol, such as RTP, RTMP, etc. These protocols can be dynamically adjusted according to network conditions to ensure the stability and continuity of video streaming transmission.

[0086] For example, in a video conference, the display device at the main venue may need to fully display the images of all participants, while the display device at the branch venue may only need to display the image of the speaker. The system can dynamically adjust the resolution, frame rate, and content of the second video stream based on the characteristics of the display device and user needs. For example, when the display terminal is a mobile device, the system can compress the second video stream into a low-resolution version to adapt to a smaller screen and limited bandwidth.

[0087] This implementation supports the access of multiple display terminals, meeting the requirements of diverse application scenarios, such as adaptation from high-resolution large screens to portable devices. Moreover, the distribution mechanism of transmitting the second video stream data to multiple display terminals makes the video conferencing or monitoring system have good scalability and can support large-scale users to access simultaneously.

[0088] Based on the above description of an embodiment of a method for processing video data, a solution for reducing video delay based on a multi-screen split-screen mode is introduced below. The solution for reducing video delay based on a multi-screen split-screen mode mainly includes the following components:

[0089] Host terminal:

[0090] The host terminal is set to multi-screen split-screen mode to receive and display video stream data (such as first video stream data) from multiple conference participant terminals. The host terminal has a built-in high-performance video decoder that can simultaneously process the decoding tasks of multiple first video stream data to ensure the real-time and clarity of the first video stream data. In addition, the host terminal also supports a variety of split-screen layouts and participant information display methods, which can be flexibly configured according to actual needs.

[0091] Conference management system:

[0092] The conference management system is used to start and manage conferences, and push the first video stream data of the terminals of multiple participants in the conference to the host terminal. At the same time, the conference management system is also responsible for maintaining the conference status, participant information and the reliability of video stream transmission to ensure the smooth progress of the conference.

[0093] Video streaming network:

[0094] The video stream transmission network is used to transmit the first video stream data of the participant terminal from each conference site to the host terminal. In order to ensure the real-time transmission and reception of the first video stream data, the video stream transmission network needs to have sufficient bandwidth and stability.

[0095] Reference Figure 2 , shows a flowchart of the steps of a solution for reducing video delay based on a multi-screen split-screen mode according to an embodiment of the present invention. The solution for reducing video delay based on a multi-screen split-screen mode may specifically include the following steps:

[0096] Step 201, setting target split-screen layout information for the host terminal.

[0097] According to the number of participant terminals and display requirements, set the target split-screen layout information for the host terminal, including the display position, size, and priority of each video.

[0098] Step 202: The conference management system receives first video stream data from multiple conference participant terminals and transmits the data to the host terminal via a video stream transmission network.

[0099] The conference management system can transmit all or part of the received first video stream data to the host terminal. In the process of video stream transmission, an efficient data compression algorithm and redundancy elimination technology are used to reduce the size and number of data packets, reduce the delay and bandwidth occupation of network transmission.

[0100] Step 203: the host terminal decodes the multiple channels of first video stream data in parallel to obtain multiple channels of first video frame data.

[0101] The host terminal uses a multi-core processor and an efficient parallel decoding algorithm, which can handle decoding tasks from multiple participant terminals at the same time. Through hardware acceleration and algorithm optimization, the delay in the decoding process is reduced.

[0102] Step 204: the host terminal combines the multiple channels of first video frame data into one channel of second video stream data.

[0103] The host terminal adopts a non-coding synthesis algorithm to splice the decoded first video frame data into a complete picture according to the set rules based on the target split-screen layout information, and generates second video stream data.

[0104] The coding-free synthesis algorithm directly operates the first video frame data to synthesize multiple decoded first video frame data into a multi-screen second video stream data, avoiding the delay problem caused by multiple video encoding in traditional methods. The coding-free synthesis algorithm uses efficient image processing technology and data structure to ensure the real-time nature of the synthesis process.

[0105] Step 205: the host terminal transmits the second video stream data to the monitoring terminal via the video stream transmission network.

[0106] The host terminal sends the second video stream data to the monitoring terminal through the video stream transmission network, realizing the centralized display and monitoring of multiple videos and improving the processing efficiency and real-time performance of the system.

[0107] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0108] Reference Figure 3 , shows a structural block diagram of a video data processing system according to an embodiment of the present invention. The video data processing system may specifically include the following modules.

[0109] The video stream data acquisition module 31 is used to acquire multiple channels of first video stream data;

[0110] A video frame data extraction module 32, used to extract first video frame data of multiple channels of the first video stream data respectively;

[0111] A video stream data synthesis module 33, configured to synthesize a plurality of channels of the first video frame data into one channel of second video stream data according to target split-screen layout information;

[0112] The video stream data display module 34 is used to display the second video stream data.

[0113] In an exemplary embodiment of the present invention, the video stream data synthesis module 33 includes:

[0114] A video frame data writing module, used for writing the multiple channels of the first video frame data into the target display area in the target split-screen layout information respectively;

[0115] The video frame data splicing module is used to splice multiple channels of the first video frame data of multiple target display areas into one channel of the second video stream data.

[0116] In an exemplary embodiment of the present invention, the video frame data writing module includes:

[0117] A parameter acquisition module, used to acquire display parameters of the plurality of target display areas and image parameters of the plurality of channels of the first video frame data;

[0118] An image processing module, configured to perform image processing on the multiple channels of the first video frame data according to the display parameter and the image parameter to obtain multiple channels of second video frame data;

[0119] The display area writing module is used to write multiple channels of the second video frame data into the corresponding target display area.

[0120] In an exemplary embodiment of the present invention, the video frame data extraction module 32 is used to decode multiple channels of the first video stream data in parallel to obtain the first video frame data.

[0121] In an exemplary embodiment of the present invention, the video stream data acquisition module 31 is used to acquire multiple channels of the first video stream data from multiple conference terminals and / or servers through a video stream transmission network.

[0122] In an exemplary embodiment of the present invention, the system further comprises:

[0123] A quantity demand acquisition module, used for acquiring the quantity and display demand information of multiple channels of first video stream data before the video stream data acquisition module 31 acquires multiple channels of first video stream data;

[0124] The split-screen layout setting module is used to set the target split-screen layout information according to the quantity and the display requirement information.

[0125] In an exemplary embodiment of the present invention, the video stream data display module 34 is used to transmit the second video stream data to at least one display terminal, so that at least one display terminal displays the second video stream data.

[0126] As for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0127] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0128] It will be appreciated by those skilled in the art that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0129] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0130] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0131] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0132] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0133] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0134] The above is a detailed introduction to a video data processing method and a video data processing system provided by the present invention. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A method for processing video data, characterized in that: The method comprises: Acquire multiple channels of first video stream data; Respectively extracting first video frame data of multiple channels of the first video stream data; Combining the multiple channels of the first video frame data into one channel of the second video stream data according to the target split-screen layout information; Display the second video stream data.

2. The method according to claim 1, characterized in that The step of synthesizing the plurality of channels of the first video frame data into one channel of the second video stream data according to the target split-screen layout information includes: Writing the multiple channels of the first video frame data into the target display area in the target split-screen layout information respectively; The multiple channels of the first video frame data of the multiple target display areas are spliced ​​into one channel of the second video stream data.

3. The method according to claim 2, characterized in that The step of writing the plurality of channels of the first video frame data respectively into the target display area in the target split-screen layout information comprises: Acquire display parameters of a plurality of the target display areas and image parameters of a plurality of channels of the first video frame data; Performing image processing on the multiple channels of the first video frame data according to the display parameter and the image parameter to obtain multiple channels of the second video frame data; Writing multiple channels of the second video frame data into the corresponding target display area.

4. The method according to claim 1, characterized in that The extracting first video frame data of multiple channels of the first video stream data respectively includes: The first video frame data is obtained by decoding multiple channels of the first video stream data in parallel.

5. The method according to claim 1, characterized in that: The step of obtaining multiple channels of first video stream data includes: The first video stream data of multiple channels are obtained from multiple conference terminals and / or servers through a video stream transmission network.

6. The method according to claim 1, characterized in that Before acquiring the multiple channels of first video stream data, the method further includes: Obtaining the quantity and display requirement information of the first video stream data of multiple channels; The target split-screen layout information is set according to the quantity and the display requirement information.

7. The method according to claim 1, characterized in that The presenting of the second video stream data comprises: The second video stream data is transmitted to at least one display terminal, so that at least one display terminal displays the second video stream data.

8. A video data processing system, characterized in that: The system comprises: A video stream data acquisition module, used to acquire multiple channels of first video stream data; A video frame data extraction module, used to extract first video frame data of multiple channels of the first video stream data respectively; A video stream data synthesis module, used for synthesizing a plurality of channels of the first video frame data into one channel of second video stream data according to target split-screen layout information; The video stream data display module is used to display the second video stream data.

9. An electronic device, characterized in that: include: one or more processors; and One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, enable the electronic device to perform the video data processing method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer program stored therein enables the processor to execute the video data processing method as claimed in any one of claims 1 to 7.

Images