Method, apparatus and video splicer for multimedia data compression

Abstract

The application discloses a multimedia data compression method, device and video splicer. The method comprises the following steps: splicing received multi-channel multimedia data to obtain spliced multimedia data; obtaining effective data source information in the spliced multimedia data, and determining a layout mode according to the effective data source information; reorganizing the spliced multimedia data according to the layout mode to obtain to-be-transmitted multimedia data; compressing and encoding the to-be-transmitted multimedia data according to encoding information returned by a client to obtain a data stream, wherein the resolution of the data stream is less than or equal to the resolution of the spliced multimedia data. The application solves the technical problem that the prior art cannot simultaneously meet the quality requirement and network transmission requirement because the prior art processes video data at the cost of quality or bandwidth.

Description

Technical Field

[0001] This invention relates to the field of display technology, and more specifically, to a method, apparatus, and video splicer for multimedia data compression. Background Technology

[0002] In display technology, plug-in splicing devices are commonly used. These devices are assembled from various pluggable cards such as backplane, input cards, output cards, main control cards, and Aux cards.

[0003] In related technologies, the input video source is usually compressed to a low resolution and then stitched together to form a 1080P preview video, but the low resolution will result in blurry image quality;

[0004] Another related technology stitches the input video source into a 4K preview video at a higher resolution, but the higher resolution will consume more bandwidth, resulting in excessive network bandwidth usage.

[0005] There is currently no effective solution to the problem that existing technologies process video data at the expense of image quality or bandwidth, resulting in incompatibility between image quality requirements and network transmission requirements. Summary of the Invention

[0006] This invention provides a method, apparatus, and video splicer for multimedia data compression, which at least solves the technical problem that existing technologies process video data at the expense of image quality or bandwidth, resulting in incompatibility between image quality requirements and network transmission requirements.

[0007] According to one aspect of the present invention, a method for multimedia data compression is provided, comprising: splicing multiple received multimedia data streams to obtain spliced ​​multimedia data; obtaining valid data source information in the spliced ​​multimedia data and determining a layout mode based on the valid data source information; recombining the spliced ​​multimedia data according to the layout mode to obtain multimedia data to be transmitted; compressing and encoding the multimedia data to be transmitted according to encoding information returned by the client to obtain a data stream, wherein the resolution of the data stream is less than or equal to the resolution of the spliced ​​multimedia data.

[0008] Optionally, the received multi-channel multimedia data is spliced ​​together to obtain spliced ​​multimedia data, including: acquiring multi-channel multimedia data through an input sub-card; splicing together each channel of multimedia data with a first resolution to obtain spliced ​​multi-channel multimedia data, wherein the resolution of the spliced ​​multi-channel multimedia data is a second resolution, wherein the first resolution is smaller than the second resolution.

[0009] Optionally, valid data source information is used to characterize the number of rows and columns and the location of the valid data source.

[0010] Further, optionally, obtaining valid data source information in the spliced ​​multimedia data includes: obtaining the number of valid data sources in the spliced ​​multimedia data through the input sub-card; sending the number of valid data sources to the network end, and receiving the valid data source information returned by the network end based on the number of valid data sources, wherein the valid data source information is obtained by the network end based on the number of valid data sources, the number of rows and columns of valid data sources and the position of each valid data source.

[0011] Optionally, obtaining valid data source information in the spliced ​​multimedia data includes: obtaining the number of valid data sources in the spliced ​​multimedia data through the input sub-card; obtaining the number of rows and columns of valid data sources and the position of each valid data source based on the number of valid data sources; and generating valid data source information based on the number of rows and columns of valid data sources and the position of each valid data source.

[0012] Optionally, the multimedia data after splicing can be reorganized according to the layout pattern to obtain the multimedia data to be transmitted, including: arranging and reorganizing the valid data sources in the spliced ​​multimedia data according to the layout pattern to obtain the multimedia data to be transmitted.

[0013] According to another aspect of the present invention, a multimedia data compression apparatus is also provided, comprising: a splicing module for splicing multiple received multimedia data streams to obtain spliced ​​multimedia data; a mode determination module for acquiring valid data source information in the spliced ​​multimedia data and determining a layout mode based on the valid data source information; a reassembly module for reassembling the spliced ​​multimedia data according to the layout mode to obtain multimedia data to be transmitted; and a compression module for compressing and encoding the multimedia data to be transmitted according to encoding information returned by the client to obtain a data stream, wherein the resolution of the data stream is less than or equal to the resolution of the spliced ​​multimedia data.

[0014] Optionally, the splicing module includes: a data acquisition unit for acquiring multiple channels of multimedia data obtained through the input sub-card; and a splicing unit for splicing the multimedia data of each channel with a first resolution to obtain spliced ​​multi-channel multimedia data, wherein the resolution of the spliced ​​multi-channel multimedia data is a second resolution, and the first resolution is smaller than the second resolution.

[0015] Optionally, the pattern determination module includes: a first acquisition unit, used to acquire the number of valid data sources in the spliced ​​multimedia data through an input sub-card; and a communication unit, used to send the number of valid data sources to the network end and receive the valid data source information returned by the network end based on the number of valid data sources, wherein the valid data source information is obtained by the network end based on the number of valid data sources, the number of rows and columns of valid data sources and the position of each valid data source.

[0016] Optionally, the pattern determination module includes: a second acquisition unit, used to acquire the number of valid data sources in the spliced ​​multimedia data through the input sub-card; a third acquisition unit, used to acquire the number of rows and columns of valid data sources and the position of each valid data source based on the number of valid data sources; and an information generation unit, used to generate valid data source information based on the number of rows and columns of valid data sources and the position of each valid data source.

[0017] Optionally, the reassembly module includes: a reassembly unit, used to arrange and reassemble the valid data sources in the spliced ​​multimedia data according to the layout pattern to obtain the multimedia data to be transmitted.

[0018] According to another aspect of the present invention, a video splicer is also provided, comprising: an input sub-card, a splicing card, and a pre-monitoring card, wherein the input sub-card is used to receive multiple channels of multimedia data; the splicing card is connected to the input sub-card and is used to splice the received multiple channels of multimedia data to obtain spliced ​​multimedia data; the pre-monitoring card is connected to the splicing card and is used to obtain valid data source information in the spliced ​​multimedia data and determine a layout mode based on the valid data source information; reassemble the spliced ​​multimedia data according to the layout mode to obtain multimedia data to be transmitted; and compress and encode the multimedia data to be transmitted according to the encoding information returned by the client to obtain a data stream, wherein the resolution of the data stream is less than or equal to that of the spliced ​​multimedia data.

[0019] Optionally, the pre-monitoring card includes: a first data processing module and a second data processing module, wherein the first data processing module is used to transmit the spliced ​​multimedia data to the second data processing module in a preset format; the second data processing module is connected to the first data processing module and is used to determine the layout mode based on the number of specified data sources in the spliced ​​multimedia data; reassemble the spliced ​​multimedia data according to the layout mode to obtain the multimedia data to be transmitted; and compress and encode the multimedia data to be transmitted according to the encoding information returned by the client to obtain a data stream.

[0020] In this embodiment of the invention, multiple received multimedia data streams are spliced ​​together to obtain spliced ​​multimedia data; valid data source information is obtained from the spliced ​​multimedia data, and a layout mode is determined based on the valid data source information; the spliced ​​multimedia data is reassembled according to the layout mode to obtain multimedia data to be transmitted; the multimedia data to be transmitted is compressed and encoded according to the encoding information returned by the client to obtain a data stream, wherein the resolution of the data stream is less than or equal to the resolution of the spliced ​​multimedia data, thereby achieving the purpose of dynamically switching the input source resolution and reassembling the preview video. This achieves the technical effect of improving the preview image quality of the input source without increasing the encoding and decoding pressure of the preview card and network bandwidth, and solves the technical problem that existing technologies process video data at the expense of image quality or bandwidth, resulting in incompatibility between image quality requirements and network transmission requirements. Attached Figure Description

[0021] The accompanying drawings, which are included to provide a further understanding of the invention and form part of this application, illustrate exemplary embodiments of the invention and, together with their description, serve to explain the invention and do not constitute an undue limitation thereof. In the drawings:

[0022] Figure 1 This is a schematic diagram of a video splicer according to an embodiment of the present invention;

[0023] Figure 2 This is a schematic diagram of another video splicer according to an embodiment of the present invention;

[0024] Figure 3 This is a schematic diagram of video source reconstruction in a video splicer according to an embodiment of the present invention;

[0025] Figure 4 This is a flowchart illustrating a multimedia data compression method according to an embodiment of the present invention;

[0026] Figure 5 This is a schematic diagram of a multimedia data compression apparatus according to an embodiment of the present invention. Detailed Implementation

[0027] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0028] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0029] Technical terms used in this application:

[0030] Input Card: The daughter card in the H series products is responsible for video input. It receives video data such as HDMI, DVI, and online network video streams, and outputs RGBA signals to the Aux card connected through the backplane.

[0031] Preview Card: In the H-series products, this is the sub-card responsible for outputting the spliced ​​preview video and the edited echo video from the video input sub-card to the network as a video stream.

[0032] Aux: Responsible for receiving requests from the main control card and forwarding them to other sub-cards, forwarding the sub-card responses to the main control card's communication function card, and also responsible for forwarding the input card video splicing to the pre-monitoring card.

[0033] Example 1

[0034] According to another aspect of the present invention, a video splicer is also provided. Figure 1 This is a schematic diagram of a video splicer according to an embodiment of the present invention, such as... Figure 1 As shown, the system includes: an input sub-card 12, a splicing card 14, and a pre-monitoring card 16. The input sub-card 12 is used to receive multiple channels of multimedia data. The splicing card 14, connected to the input sub-card 12, is used to splice the received multimedia data to obtain spliced ​​multimedia data. The pre-monitoring card 16, connected to the splicing card 14, is used to obtain valid data source information from the spliced ​​multimedia data and determine the layout mode based on the valid data source information. The spliced ​​multimedia data is then reassembled according to the layout mode to obtain multimedia data to be transmitted. The multimedia data to be transmitted is compressed and encoded according to the encoding information returned by the client to obtain a data stream, wherein the resolution of the data stream is less than or equal to the resolution of the spliced ​​multimedia data.

[0035] Optionally, the pre-monitoring card 16 includes: a first data processing module and a second data processing module, wherein the first data processing module is used to transmit the spliced ​​multimedia data to the second data processing module in a preset format; the second data processing module is connected to the first data processing module and is used to determine the layout mode based on the number of specified data sources in the spliced ​​multimedia data; reassemble the spliced ​​multimedia data according to the layout mode to obtain the multimedia data to be transmitted; and compress and encode the multimedia data to be transmitted according to the encoding information returned by the client to obtain a data stream.

[0036] The first data processing module can be an FPGA, and the second data processing module can be an MPU.

[0037] Specifically, Figure 2 This is a schematic diagram of another video splicer according to an embodiment of the present invention, such as... Figure 2 As shown, in this embodiment of the application, the input sub-cards are labeled input1-3, the splicing card is labeled Aux, and the pre-monitoring card includes an FPGA (Field Programmable Gate Array) and an MPU (Micro Processor Unit).

[0038] The video splicer provided in this application embodiment performs multimedia data compression, where the multimedia data can be video data. Specifically, the video splicer performs video data compression as follows:

[0039] Step 1: The AUX stitches the video from the input daughter card into a 4K raw video by arranging it in 8 rows and 8 columns at a resolution of 480x270 and then transmitting it to the pre-monitoring card FPGA via serdes (SERializer / DESerializer).

[0040] Step 2: The FPGA transmits the 4K raw video in YUV format to the MPU via the BT1120 (digital interface standard for HDTV studio signals);

[0041] Step 3: The pre-monitoring card (MPU) determines the N×N layout mode based on the valid video source information. For example, if there are 1 to 16 valid video sources (i.e., valid data sources in this embodiment), a 4×4 layout is used; if there are 17 to 25, a 5×5 layout is used; if there are 26 to 36, a 6×6 layout is used for the guessing section; if there are 37 to 49, a 7×7 layout is used; and if there are 50 to 64, an 8×8 layout is used. Figure 3 As shown, Figure 3 This is a schematic diagram of video source reconstruction in a video splicer according to an embodiment of the present invention;

[0042] The pre-monitoring card (MPU) determines the N×N layout mode based on valid video source information (i.e., valid data source information in this embodiment of the application) in two ways:

[0043] Method 1: The main control card interacts with the network terminal via web to obtain valid video source information, and determines the layout mode based on the valid video source information;

[0044] Specifically, the MCU of the input sub-card determines the number of valid video sources and transmits this number to the MCU of the main control card. The MCU of the main control card then sends the number of valid video sources to the web interface. Based on the number of valid videos, the web interface sends the following to the MPU of the pre-monitoring card: the number of rows and columns to be monitored and the position determined according to the sequence number of each valid video source. Based on the number of rows and columns to be monitored and the position determined according to the sequence number of each valid video source, valid video source information is generated. Finally, the layout pattern is determined based on the position determined by the valid video source information.

[0045] Method 2: The main control card determines the valid video source information based on the number of valid video sources fed back by the input sub-card, and determines the layout mode based on the valid video source information;

[0046] Specifically, the MCU of the input sub-card determines the number of valid video sources and transmits the number of valid video sources to the MCU of the main control card; the MCU of the main control card determines the number of rows and columns to be monitored and the position to be determined based on the number of valid video sources and the sequence number of each valid video source; valid video source information is generated based on the number of rows and columns to be monitored and the position to be determined based on the sequence number of each valid video source; and finally, the layout mode is determined based on the position determined by the valid video source information.

[0047] Step 4, as Figure 3 As shown, the preview card MPU creates a new video buffer with a width of 480×N and a height of 270×N according to the N×N layout pattern.

[0048] Step 5, as follows Figure 3 As shown, the pre-monitoring card MPU extracts the valid YUV format input sources from the original 4K video and reassembles them compactly into a new video buffer.

[0049] Step 6, as follows Figure 3 As shown, the pre-monitoring card MPU compresses the new video buffer to 1080P resolution and encodes it for delivery to the streaming service (e.g., ...). Figure 2 As shown, it is sent to the client.

[0050] It should be noted that the above examples in this application are only preferred examples that can be implemented, and are intended to implement the video splicer provided in the embodiments of this application. No specific limitations are imposed.

[0051] Example 2

[0052] According to an embodiment of the present invention, a method embodiment for multimedia data compression is provided. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Furthermore, although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order than that shown here.

[0053] Figure 4 This is a flowchart illustrating a multimedia data compression method according to an embodiment of the present invention, as shown below. Figure 4 As shown, the method includes the following steps:

[0054] Step S402: The received multi-channel multimedia data is spliced ​​together to obtain spliced ​​multimedia data;

[0055] The multimedia data compression method provided in this application embodiment can be applied to a video splicer to splice multiple received multimedia data streams (each multimedia data stream can be video source data with a resolution of 480×270) to obtain spliced ​​multimedia data (with a resolution of 4K).

[0056] Optionally, the received multi-channel multimedia data is spliced ​​together to obtain spliced ​​multimedia data, including: acquiring multi-channel multimedia data through an input sub-card; splicing together each channel of multimedia data with a first resolution to obtain spliced ​​multi-channel multimedia data, wherein the resolution of the spliced ​​multi-channel multimedia data is a second resolution, wherein the first resolution is smaller than the second resolution.

[0057] Specifically, based on the video splicer in Embodiment 1, multiple multimedia data are acquired through the input sub-card. In this embodiment, the multimedia data can be video source data. Multiple video source data are spliced ​​together, and each video source data with a resolution of 480×270 is spliced ​​together to obtain multiple multimedia data with a combined spliced ​​resolution of 4K.

[0058] That is, such as Figure 2 As shown, the AUX stitches the video from the input daughter card into a 4K raw video at a resolution of 480x270, arranged in 8 rows and 8 columns, and transmits it to the pre-monitoring card FPGA via serdes (SERializer / DESerializer).

[0059] Furthermore, optionally, the FPGA inputs the spliced ​​multimedia data into the MPU in a preset format.

[0060] In this embodiment of the application, the preset format can be YUV format;

[0061] Specifically, the FPGA transmits the original 4K video (i.e., the spliced ​​multimedia data in this embodiment) to the MPU in YUV format via the BT1120 (digital interface standard for HDTV studio signals).

[0062] Step S404: Obtain valid data source information from the spliced ​​multimedia data, and determine the layout mode based on the valid data source information;

[0063] Specifically, based on the spliced ​​multimedia data obtained in step S402, the number of valid data sources in the spliced ​​multimedia data is used to determine the valid data source information, and the layout mode is determined based on the valid data source information.

[0064] Among them, the valid data source information is used to represent the number of rows and columns and the location of the valid data source.

[0065] It should be noted that, in the embodiments of this application, the valid data source can be a valid video source, and therefore the obtained valid data source information can be valid video source information;

[0066] In this application embodiment, obtaining valid data source information from the spliced ​​multimedia data includes two implementation methods:

[0067] Method 1: The main control card and the network terminal interact to obtain valid video source information;

[0068] Optionally, obtaining the valid data source information in the spliced ​​multimedia data in step S404 includes: obtaining the number of valid data sources in the spliced ​​multimedia data through the input sub-card; sending the number of valid data sources to the network end, and receiving the valid data source information returned by the network end based on the number of valid data sources. The valid data source information is obtained by the network end based on the number of valid data sources, the number of rows and columns of valid data sources and the position of each valid data source.

[0069] Specifically, the MCU of the input sub-card determines the number of valid video sources and transmits the number of valid video sources to the MCU of the main control card; the MCU of the main control card sends the number of valid video sources to the web terminal; based on the number of valid videos, the web terminal sends the following to the MPU of the pre-monitoring card: the number of pre-monitoring rows and columns and the position determined according to the sequence number of each valid video source, and generates valid video source information based on the number of pre-monitoring rows and columns and the position determined according to the sequence number of each valid video source.

[0070] Method 2: The main control card determines the valid video source information based on the number of valid video sources reported by the input sub-card;

[0071] Optionally, obtaining the valid data source information in the spliced ​​multimedia data in step S404 includes: obtaining the number of valid data sources in the spliced ​​multimedia data through the input sub-card; obtaining the number of rows and columns of valid data sources and the position of each valid data source based on the number of valid data sources; and generating valid data source information based on the number of rows and columns of valid data sources and the position of each valid data source.

[0072] Specifically, the MCU of the input sub-card determines the number of valid video sources and transmits the number of valid video sources to the MCU of the main control card; the MCU of the main control card determines the number of rows and columns to be monitored and the position to be determined based on the number of valid video sources and the sequence number of each valid video source; valid video source information is generated based on the number of rows and columns to be monitored and the position to be determined based on the sequence number of each valid video source; and finally, the layout mode is determined based on the position determined by the valid video source information.

[0073] In summary, as Figure 3 As shown, the pre-monitoring card MPU determines the N×N layout mode based on the number of valid video sources. For example, if there are 1 to 16 valid video sources, a 4×4 layout is used; if there are 17 to 25, a 5×5 layout is used; if there are 26 to 36, a 6×6 layout is used for the guessing part; if there are 37 to 49, a 7×7 layout is used; and if there are 50 to 64, an 8×8 layout is used.

[0074] Step S406: Reassemble the spliced ​​multimedia data according to the layout pattern to obtain the multimedia data to be transmitted.

[0075] Further, optionally, reorganizing the spliced ​​multimedia data according to the layout pattern to obtain the multimedia data to be transmitted includes: arranging and reorganizing the valid data sources in the spliced ​​multimedia data according to the layout pattern to obtain the multimedia data to be transmitted.

[0076] Specifically, such as Figure 3 As shown, the pre-monitoring card MPU creates a new video buffer with a width of 480×N and a height of 270×N according to the N×N layout pattern. The pre-monitoring card MPU cuts out the valid input sources in YUV format from the 4K original video and compactly reassembles them into the new video buffer.

[0077] Step S408: Compress and encode the multimedia data to be transmitted according to the encoding information returned by the client to obtain a data stream, wherein the resolution of the data stream is less than or equal to the resolution of the spliced ​​multimedia data.

[0078] Specifically, such as Figure 3 As shown, the pre-monitoring card MPU compresses the new video buffer to 1080P resolution and encodes it for delivery to the streaming service (e.g., ...). Figure 2 As shown, it is sent to the client.

[0079] In this embodiment of the invention, multiple received multimedia data streams are spliced ​​together to obtain spliced ​​multimedia data; valid data source information is obtained from the spliced ​​multimedia data, and a layout mode is determined based on the valid data source information; the spliced ​​multimedia data is reassembled according to the layout mode to obtain multimedia data to be transmitted; the multimedia data to be transmitted is compressed and encoded according to the encoding information returned by the client to obtain a data stream, wherein the resolution of the data stream is less than or equal to the resolution of the spliced ​​multimedia data, thereby achieving the purpose of dynamically switching the input source resolution and reassembling the preview video. This achieves the technical effect of improving the preview image quality of the input source without increasing the encoding and decoding pressure of the preview card and network bandwidth, and solves the technical problem that existing technologies process video data at the expense of image quality or bandwidth, resulting in incompatibility between image quality requirements and network transmission requirements.

[0080] Example 3

[0081] According to another aspect of the present invention, an apparatus for multimedia data compression is also provided. Figure 5 This is a schematic diagram of a multimedia data compression apparatus according to an embodiment of the present invention, such as... Figure 5 As shown, it includes: a splicing module 52, used to splice multiple received multimedia data to obtain spliced ​​multimedia data; a mode determination module 54, used to obtain valid data source information in the spliced ​​multimedia data and determine the layout mode based on the valid data source information; a reassembly module 56, used to reassemble the spliced ​​multimedia data according to the layout mode to obtain multimedia data to be transmitted; and a compression module 58, used to compress and encode the multimedia data to be transmitted according to the encoding information returned by the client to obtain a data stream, wherein the resolution of the data stream is less than or equal to the resolution of the spliced ​​multimedia data.

[0082] Optionally, the splicing module 52 includes: a data acquisition unit for acquiring multiple channels of multimedia data obtained through the input sub-card; and a splicing unit for splicing the multimedia data of each channel with a first resolution to obtain spliced ​​multiple channels of multimedia data, wherein the resolution of the spliced ​​multiple channels of multimedia data is a second resolution, wherein the first resolution is smaller than the second resolution.

[0083] Optionally, valid data source information is used to characterize the number of rows and columns and the location of the valid data source.

[0084] Further, optionally, the pattern determination module 54 includes: a first acquisition unit, used to acquire the number of valid data sources in the spliced ​​multimedia data through the input sub-card; and a communication unit, used to send the number of valid data sources to the network end and receive the valid data source information returned by the network end based on the number of valid data sources, wherein the valid data source information is obtained by the network end based on the number of valid data sources, the number of rows and columns of valid data sources and the position of each valid data source.

[0085] Optionally, the pattern determination module 54 includes: a second acquisition unit, used to acquire the number of valid data sources in the spliced ​​multimedia data through the input sub-card; a third acquisition unit, used to acquire the number of rows and columns of valid data sources and the position of each valid data source based on the number of valid data sources; and an information generation unit, used to generate valid data source information based on the number of rows and columns of valid data sources and the position of each valid data source.

[0086] Optionally, the reassembly module 56 includes: a reassembly unit, used to arrange and reassemble the valid data sources in the spliced ​​multimedia data according to the layout pattern to obtain the multimedia data to be transmitted.

[0087] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0088] In the above embodiments of the present invention, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0089] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units can be a logical functional division, and in actual implementation, there may be other division methods. For instance, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual coupling, direct coupling, or communication connection may be through some interfaces; the indirect coupling or communication connection between units or modules may be electrical or other forms.

[0090] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0091] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0092] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0093] The above description is only a preferred embodiment of the present invention. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. A method for multimedia data compression, characterized in that, include: According to a preset arrangement format, the multimedia data with a first resolution in each of the multiple multimedia data streams are spliced ​​together to obtain spliced ​​multimedia data, wherein the resolution of the spliced ​​multimedia data is a second resolution, and the first resolution is smaller than the second resolution; Obtain valid data source information from the spliced ​​multi-channel multimedia data, and determine the layout mode based on the valid data source information, wherein the spliced ​​multi-channel multimedia data is in YUV format; The process of obtaining valid data source information from the spliced ​​multi-channel multimedia data and determining the layout mode based on the valid data source information includes: determining the number of pre-monitored rows and columns based on the number of valid video sources in the multimedia data; obtaining valid video source information based on the number of pre-monitored rows and columns and the position determined by the sequence number of each valid video source; and determining the layout mode based on the position determined by the valid video source information. The spliced ​​multi-channel multimedia data is reassembled according to the layout pattern to obtain the multimedia data to be transmitted. The multimedia data to be transmitted is compressed and encoded according to the encoding information returned by the client to obtain a data stream, wherein the resolution of the data stream is less than or equal to the resolution of the spliced ​​multi-channel multimedia data. The process of recombining the spliced ​​multi-channel multimedia data according to the layout pattern to obtain the multimedia data to be transmitted includes: creating a new video buffer according to the layout pattern and cropping the effective data source from the spliced ​​multi-channel multimedia data; and recombining the cropped effective data source in the new video buffer to obtain the multimedia data to be transmitted.

2. The method according to claim 1, characterized in that, The method further includes: Multiple multimedia data streams can be obtained by inputting the daughter card.

3. The method according to claim 1, characterized in that, The valid data source information is used to characterize the number of rows and columns and the location of the valid data source.

4. The method according to claim 3, characterized in that, The step of obtaining valid data source information from the spliced ​​multi-channel multimedia data includes: The number of valid data sources in the spliced ​​multi-channel multimedia data is obtained by inputting the sub-card; The number of valid data sources is sent to the network end, and the valid data source information returned by the network end based on the number of valid data sources is received. The valid data source information is obtained by the network end based on the number of valid data sources, the number of rows and columns of valid data sources and the position of each valid data source.

5. The method according to claim 3, characterized in that, The step of obtaining valid data source information from the spliced ​​multi-channel multimedia data includes: The number of valid data sources in the spliced ​​multi-channel multimedia data is obtained by inputting the sub-card; Based on the number of valid data sources, obtain the number of rows and columns of the valid data sources and the position of each valid data source; The valid data source information is generated based on the number of rows and columns of the valid data source and the position of each valid data source.

6. A multimedia data compression apparatus, characterized in that, include: The splicing module is used to splice multimedia data from multiple channels of multimedia data, each channel having a first resolution, according to a preset arrangement format, to obtain spliced ​​multimedia data, wherein the resolution of the spliced ​​multimedia data is a second resolution, and the first resolution is smaller than the second resolution; The pattern determination module is used to obtain valid data source information from the spliced ​​multi-channel multimedia data and determine the layout pattern based on the valid data source information, wherein the spliced ​​multi-channel multimedia data is in YUV format; The mode determination module is used to obtain valid data source information in the spliced ​​multi-channel multimedia data by performing the following steps, and to determine the layout mode based on the valid data source information: determining the number of pre-monitored rows and columns based on the number of valid video sources in the multimedia data; obtaining valid video source information based on the number of pre-monitored rows and columns and the position determined by the sequence number of each valid video source; and determining the layout mode based on the position determined by the valid video source information. The reassembly module is used to reassemble the spliced ​​multi-channel multimedia data according to the layout pattern to obtain multimedia data to be transmitted. A compression module is used to compress and encode the multimedia data to be transmitted according to the encoding information returned by the client to obtain a data stream, wherein the resolution of the data stream is less than or equal to the resolution of the spliced ​​multi-channel multimedia data. The reassembly module is further configured to perform the following steps to reassemble the spliced ​​multi-channel multimedia data according to the layout mode to obtain the multimedia data to be transmitted: creating a new video buffer according to the layout mode and trimming the effective data sources in the spliced ​​multi-channel multimedia data; reassembling the trimmed effective data sources in the new video buffer to obtain the multimedia data to be transmitted.

7. The apparatus according to claim 6, characterized in that, The pattern determination module includes: The first acquisition unit is used to acquire the number of valid data sources in the spliced ​​multi-channel multimedia data by inputting a sub-card. The communication unit is used to send the quantity information of the valid data sources to the network end, and receive the valid data source information returned by the network end based on the quantity information. The valid data source information is obtained by the network end based on the number of rows and columns of the valid data sources and the position of each valid data source.

8. The apparatus according to claim 6, characterized in that, The pattern determination module includes: The second acquisition unit is used to acquire the number of valid data sources in the spliced ​​multi-channel multimedia data by inputting a sub-card. The third acquisition unit is used to acquire the number of rows and columns of the valid data sources and the position of each valid data source based on the quantity information of the valid data sources; The information generation unit is used to generate the valid data source information based on the number of rows and columns of the valid data source and the position of each valid data source.

9. A video splicer, characterized in that, include: Input sub-cards, splicing cards, and pre-monitoring cards, among which, The input sub-card is used to receive multiple multimedia data streams; The splicing card is connected to the input sub-card and is used to splice the multimedia data of each channel with a first resolution in the multi-channel multimedia data according to a preset arrangement format to obtain spliced ​​multi-channel multimedia data, wherein the resolution of the spliced ​​multi-channel multimedia data is a second resolution, and the first resolution is smaller than the second resolution; The pre-monitoring card is connected to the splicing card and is used to obtain valid data source information from the spliced ​​multi-channel multimedia data, and determine the layout mode based on the valid data source information, wherein the spliced ​​multi-channel multimedia data is in YUV format; the spliced ​​multimedia data is reassembled according to the layout mode to obtain multimedia data to be transmitted; the multimedia data to be transmitted is compressed and encoded according to the encoding information returned by the client to obtain a data stream, wherein the resolution of the data stream is less than or equal to that of the spliced ​​multi-channel multimedia data; The process of obtaining valid data source information from the spliced ​​multi-channel multimedia data and determining the layout mode based on the valid data source information includes: determining the number of pre-monitored rows and columns based on the number of valid video sources in the multimedia data; obtaining valid video source information based on the number of pre-monitored rows and columns and the position determined by the sequence number of each valid video source; and determining the layout mode based on the position determined by the valid video source information. The process of recombining the spliced ​​multi-channel multimedia data according to the layout pattern to obtain the multimedia data to be transmitted includes: creating a new video buffer according to the layout pattern and cropping the effective data source from the spliced ​​multi-channel multimedia data; and recombining the cropped effective data source in the new video buffer to obtain the multimedia data to be transmitted.

Images