Video processing method, card insertion type video processing equipment and storage medium

Abstract

The invention discloses a video processing method, a card insertion type video processing device and a storage medium. The method is applied to a plug-in card type video processing device, and comprises the following steps: receiving nth-level video data and (n-1) th-level pre-monitoring video data, n being an integer greater than 1 and less than or equal to M; performing pre-monitoring processing on the nth-level video data, and performing superposition processing on the nth-level video data subjected to the pre-monitoring processing and the (n-1) th-level pre-monitoring video data to obtain the nth-level pre-monitoring video data; and receiving the Mth-level pre-monitoring video data, and performing pre-monitoring display based on the Mth-level pre-monitoring video data. As the Mth input card already processes the Mth-level pre-monitoring video data, the pre-monitoring card does not need to process the Mth-level pre-monitoring video data, the computing resources of the pre-monitoring card are reduced, the cost is reduced, and the efficiency is improved.

Description

Technical Field

[0001] The present application relates to the field of video processing technology, and in particular to a video processing method, a plug-in card type video processing device and a storage medium. Background Art

[0002] At present, in the card-type video processing equipment, the video source output by each input card needs to be sent to the pre-monitoring card for pre-monitoring processing. When the card-type video processing equipment processes a large number of video sources, the input cards increase greatly, and the pre-monitoring card with greater computing resources is required, resulting in a large increase in costs. Summary of the invention

[0003] In view of this, the present application provides a video processing method, a plug-in video processing device and a storage medium to solve the above technical problems.

[0004] The first aspect of the present application provides a video processing method, which is applied to a plug-in video processing device, and the method includes: receiving n-th level video data and n-1-th level preview video data, where n is an integer greater than 1 and less than or equal to M; performing preview processing on the n-th level video data, superimposing the n-th level video data that has been subjected to preview processing with the n-1-th level preview video data to obtain the n-th level preview video data; receiving the M-th level preview video data, and performing preview display based on the M-th level preview video data.

[0005] In some embodiments, before the step of receiving the nth level video data and the n-1th level preview video data, the method further includes: obtaining the amount of video data received by the plug-in video processing device; dividing the display screen based on the amount to obtain multiple display areas, each of the display areas being set corresponding to the video data; and obtaining the position information of the display area corresponding to the nth level video data based on the size of the display screen.

[0006] In some embodiments, the step of superimposing the nth level video data that has been pre-monitored with the n-1th level preview video data to obtain the nth level preview video data includes: receiving position information corresponding to the nth level video data, and writing the position information into the nth level video data that has been pre-monitored to obtain the nth level write data; superimposing the n-1th level preview video data and the nth level write data to obtain the nth level preview video data.

[0007] In some embodiments, the step of receiving the Mth level preview video data and performing preview display based on the Mth level preview video data includes: parsing the Mth level preview video data to obtain the preview video data of each level and the position information corresponding to the preview video data of each level; performing typeset based on the preview video data of each level and the position information corresponding to the preview video data of each level to obtain typeset video data; and performing preview display based on the typeset video data.

[0008] In some embodiments, the step of receiving the Mth level preview video data and performing preview display based on the Mth level preview video data includes: receiving the Mth level preview video data, and parsing the Mth level preview video data to obtain the preview video data of each level; receiving the position information corresponding to the preview video data of each level, and typeset based on the preview video data of each level and the position information corresponding to the preview video data of each level to obtain typeset video data; and performing preview display based on the typeset video data.

[0009] In some embodiments, the step of pre-monitoring the n-th level video data includes: parsing the n-th level video data to obtain n-th level video data in a preset format; performing color space conversion processing on the n-th level video data in a preset format to obtain n-th level video data in a unified color space; performing scaling processing on the n-th level video data in a unified color space to obtain n-th level video data in a preset resolution.

[0010] In some embodiments, the nth level video data is the first level video data. Before the step of receiving the nth level video data and the n-1th level preview video data, the method further includes: receiving the first level video data, and performing preview processing on the first level video data; receiving position information corresponding to the first level video data, and writing the position information into the first level video data that has been preview processed, to obtain the first level preview video data.

[0011] The second aspect of the present application provides a plug-in video processing device, which includes: a processing chip; M input cards, respectively connected to the processing chip, the first input card among the M input cards is used to receive first-level video data, and perform pre-monitoring processing on the first-level video data to obtain first-level preview video data; the nth input card among the M input cards is connected to the n-1th input card, and is used to receive the nth level video data and the n-1th level preview video data, perform pre-monitoring processing on the nth level video data, and superimpose the nth level video data that has been pre-monitored with the n-1th level preview video data to obtain the nth level preview video data, where n is an integer greater than 1 and less than or equal to M; a preview card, connected to the Mth input card among the M input cards, receives the Mth level preview video data, and performs preview display based on the Mth level preview video data.

[0012] In some embodiments, the plug-in video processing device also includes: a control module, which is respectively connected to the M input cards and the pre-monitoring card, and is used to obtain the amount of video data received by the plug-in video processing device, divide the display screen based on the amount to obtain multiple display areas, each of the display areas is set corresponding to the video data, and based on the size of the display screen, obtain the position information of the display area corresponding to the nth level video data, and send the position information to the M input cards and / or the pre-monitoring card.

[0013] A third aspect of the present application provides a computer-readable storage medium having program instructions stored thereon, and when the program instructions are executed by a processor, the video processing method in the first aspect is implemented.

[0014] The present application provides a video processing method, a plug-in video processing device and a storage medium. The nth input card among the M input cards of the plug-in video processing device is connected to the n-1th input card, receives the nth level video data and the n-1th level preview video data, performs preview processing on the nth level video data, and superimposes the nth level video data that has been pre-monitored with the n-1th level preview video data to obtain the nth level preview video data; the preview card is connected to the Mth input card, receives the Mth level preview video data, and performs preview display based on the Mth level preview video data. Since the Mth input card has already processed the Mth level preview video data, the preview card does not need to process the Mth level preview video data, thereby reducing the computing resources of the preview card, reducing costs, and improving efficiency.

[0015] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0017] Figure 1 It is a flowchart of an embodiment of a video processing method of the present application;

[0018] Figure 2 yes Figure 1 A schematic diagram of a flow chart of an embodiment before step S11;

[0019] Figure 3 yes Figure 1 A schematic flow chart of an embodiment of step S12;

[0020] Figure 4 yes Figure 1 A schematic flow chart of an embodiment of step S13;

[0021] Figure 5 yes Figure 1 A schematic flow chart of another embodiment of step S13;

[0022] Figure 6 yes Figure 1 A schematic flow chart of another embodiment of step S12;

[0023] Figure 7 yes Figure 1 A schematic diagram of a flow chart of an embodiment before step S11;

[0024] Figure 8 It is a structural schematic diagram of an embodiment of the plug-in card type video processing device of the present application;

[0025] Fig. 9 It is a structural schematic diagram of another embodiment of the plug-in card type video processing device of the present application;

[0026] Fig.10 It is a structural schematic diagram of an embodiment of the nth input card of the present application;

[0027] Fig.11 It is a structural schematic diagram of an embodiment of the pre-monitoring card of the present application;

[0028] Fig.12 It is a schematic diagram of a framework of an embodiment of the non-volatile computer-readable storage medium of the present application. DETAILED DESCRIPTION

[0029] The scheme of the embodiment of the present application is described in detail below in conjunction with the drawings of the specification. It is particularly pointed out that the following embodiments are only used to illustrate the present application, but do not limit the scope of the present application. Similarly, the following embodiments are only some embodiments of the present application rather than all embodiments. All other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0030] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0031] In the description of the present application, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradicting each other.

[0032] The term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there may be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the objects associated before and after are in an "or" relationship. In addition, "many" in this article means two or more than two. In addition, the term "at least one" in this article means any combination of at least two of any one or more of a plurality of, for example, including at least one of A, B, and C, can mean including any one or more elements selected from the set consisting of A, B, and C.

[0033] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0034] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0035] At present, in card-based video processing equipment, the video source output by each input card needs to be sent to the pre-monitoring card for pre-monitoring processing. When card-based video processing equipment processes a large number of video sources, the number of input cards increases significantly, and the number of wiring between input cards and pre-monitoring cards also increases significantly. At the same time, pre-monitoring cards with greater computing resources are required, resulting in a significant increase in costs.

[0036] In order to solve the above problems, this application proposes a video processing method, please refer to Figure 1 , Figure 1 The video processing method of this embodiment is applied to a plug-in video processing device, which can be a personal computer, a professional workstation, a server, a monitoring system, a cinema equipment, a broadcasting equipment, a medical device, an industrial vision system, etc.

[0037] See also Figure 8 , Figure 8 1 is a schematic diagram of the structure of an embodiment of the plug-in video processing device of the present application. The plug-in video processing device 800 includes a processing chip 810, M input cards 820 and a pre-monitoring card 830, wherein the M input cards 820 include a first input card 821, an n-1th input card 822, an nth input card 823 and an Mth input card 824. The M input cards 820 are respectively connected to the processing chip 810, and the first input card 821 of the M input cards 820 is used to receive the first-level video data, and pre-monitor the first-level video data to obtain the first-level pre-monitoring video data. The nth input card 823 among the M input cards 820 is connected to the n-1th input card 822, and is used to receive the nth level video data and the n-1th level preview video data, perform preview processing on the nth level video data, and perform superposition processing on the nth level video data that has been subjected to the preview processing and the n-1th level preview video data to obtain the nth level preview video data, where n is an integer greater than 1 and less than or equal to M. The preview card 830 is connected to the Mth input card 824 among the M input cards 820, receives the Mth level preview video data, and performs preview display based on the Mth level preview video data.

[0038] The video processing method may include the following steps:

[0039] Step S11: receiving the nth level video data and the n-1th level preview video data, where n is an integer greater than 1 and less than or equal to M.

[0040] See also Figure 8 Each input card can receive one or more channels of video data, and the processing chip 810 can be a matrix switching chip (Cross Point, CP), where the matrix switching chip is a device for realizing signal switching and distribution between multiple inputs and one or more outputs. Its main function is to receive signals from multiple input ports and redistribute these signals to one or more output ports.

[0041] The nth input card 823 can receive the nth level video data. In some embodiments, the nth input card 823 can be connected to the n-1th input card 822 to receive the n-1th level preview video data, that is, the nth input card 823 can receive the nth level video data and the n-1th level preview video data.

[0042] Step S12: Previewing the n-th level video data, superimposing the previewed n-th level video data with the (n-1)-th level previewing video data to obtain the n-th level previewing video data.

[0043] See also Figure 8 , the nth input card 823 among the M input cards 820 can receive the nth level video data, and perform pre-monitoring processing on the nth level video data to obtain the nth level video data that has been pre-monitored. For example, the first input card 821 among the M input cards 820 can receive the first level video data, and perform pre-monitoring processing on the first level video data to obtain the first level video data that has been pre-monitored. For another example, the nth input card 823 can receive the nth level video data. And perform pre-monitoring processing on the nth level video data to obtain the nth level video data that has been pre-monitored.

[0044] Optionally, the overlay processing may include video picture overlay processing, image and text overlay processing, layer blending overlay processing, etc.

[0045] In some embodiments, the overlay processing may include video screen overlay processing, for example, merging the nth level video data that has been pre-monitored and the n-1th level preview video data into a display screen to obtain the nth level video data that has been pre-monitored.

[0046] In some embodiments, the overlay processing may include text and image overlay processing, for example, the n-1th level preview video data may be text or pattern, specifically, may include static text, real-time bullet screen information, audience interaction information, real-time game scores, trademark patterns, etc. The n-1th level preview video data is set above the nth level video data that has been pre-monitored to obtain the nth level preview video data.

[0047] In some embodiments, the overlay processing may include layer mixing overlay processing, for example, mixing the nth level video data that has been pre-monitored with the n-1th level preview video data according to a preset ratio and preset transparency to obtain the nth level preview video data.

[0048] Step S13: receiving the Mth level preview video data, and performing preview display based on the Mth level preview video data.

[0049] See also Figure 8 The preview card 830 is connected to the Mth input card 824 among the M input cards 820, receives the Mth level preview video data, and performs preview display based on the Mth level preview video data.

[0050] In some embodiments, the pre-monitoring card 830 can send the M-th level pre-monitoring video data to the host computer, and the host computer performs pre-monitoring display. The host computer can be a personal computer, a handheld device, a portable device, a tablet device, etc., and this application does not limit this.

[0051] In this embodiment, please refer to Figure 8 , the nth input card 823 among the M input cards 820 of the plug-in video processing device 800 is connected to the n-1th input card 822, receives the nth level video data and the n-1th level pre-monitoring video data, performs pre-monitoring processing on the nth level video data, and superimposes the nth level video data that has been pre-monitored with the n-1th level pre-monitoring video data to obtain the nth level pre-monitoring video data; the pre-monitoring card 830 is connected to the Mth input card 824, receives the Mth level pre-monitoring video data, and performs pre-monitoring display based on the Mth level pre-monitoring video data. Among the M input cards 820, only the Mth input card 824 is connected to the pre-monitoring card 830, and the number of wirings between the M input cards 820 and the pre-monitoring card 830 is greatly reduced. At the same time, the Mth input card 824 has processed the Mth level pre-monitoring video data, and the pre-monitoring card 830 does not need to process the Mth level pre-monitoring video data, thereby reducing the computing resources of the pre-monitoring card 830, reducing costs, and improving efficiency.

[0052] See also Fig. 9 , Fig. 9 It is a structural schematic diagram of another embodiment of the plug-in card type video processing device of the present application. Fig. 9 The plug-in video processing device 900 includes Figure 8The processing chip 810, M input cards 820 and pre-monitoring card 830, and the connection relationship and function definition between each module also include a control module 840. The control module 840 is connected to the M input cards 820 and the pre-monitoring card 830 respectively, and is used to obtain the number of video data received by the plug-in video processing device 900, divide the display screen based on the number, obtain multiple display areas, each display area is set corresponding to the video data, obtain the position information of the display area corresponding to the n-th level video data based on the size of the display screen, and send the position information to the M input cards 820 and / or the pre-monitoring card 830. Among them, the display screen can be a screen presented to the user by the host computer through the display screen, for example, a screen of a multi-person video conference is displayed through a tablet device.

[0053] Each display area is set corresponding to the video data. In some embodiments, the control module 840 can number the display areas and send the numbers to the corresponding n-th input card 823, and the n-th input card 823 writes the corresponding numbers into the n-th level video data. In other embodiments, the control module 840 can number the display areas and send the numbers to the pre-monitoring card 830, and the pre-monitoring card 830 writes the numbers into the received M-th level pre-monitoring video data.

[0054] The control module 840 can calculate the position information of the nth level display area based on the size of the display screen and the instructions of the host computer, where the size of the display screen can be the width of the display screen and the height of the display screen, and the instructions of the host computer may include: dividing the display screen into equal areas according to the amount of video data, and enlarging or reducing a specific display area in the display screen.

[0055] In some embodiments, the control module 840 may number the display area, and send the number of the display area and the position information of the display area to the corresponding n-th input card 823, and the n-th input card 823 writes the number and position information of the display area into the n-th level video data. In other embodiments, the control module 840 may number the display area, and send the number of the display area and the position information of the display area to the pre-monitoring card 830, and the pre-monitoring card 830 writes the number and position information of the display area into the M-th level pre-monitoring video data.

[0056] See also Figure 2 , Figure 2 yes Figure 1 A flow chart of an embodiment before step S11 in FIG. The steps before step S11 include the following steps:

[0057] Step S21: Acquire the amount of video data received by the card-type video processing device.

[0058] See also Fig. 9The control module 840 is connected to M input cards 820, obtains one or more video data received by each input card in the M input cards 820, and superimposes and calculates the amount of video data received by each input card to obtain the amount of video data received by the plug-in video processing device 900.

[0059] Step S22: dividing the display screen based on the quantity to obtain a plurality of display areas, each display area being set corresponding to the video data.

[0060] The display picture may be a picture presented to the user by the host computer through a display screen, for example, a picture of a multi-person video conference is displayed through a tablet device.

[0061] In some embodiments, the control module 840 divides the display screen into equal-sized segments based on the amount of video data, for example, displaying the images captured by multiple cameras in equal sizes on the display screen of the monitoring system.

[0062] In other embodiments, the control module 840 can enlarge or reduce the display screen corresponding to specific video data according to the instructions of the host computer. For example, in the display screen of the monitoring system, the display screen required by the user can be enlarged according to the instructions of the host computer; for example, in the display screen of the video conference, the display screen of the speaker in the multi-person video conference can be enlarged according to the instructions of the host computer.

[0063] Each display area is set corresponding to video data. In some embodiments, see Fig. 9 , the control module 840 can number the display area and send the number to the corresponding n-th input card 823, and the n-th input card 823 writes the corresponding number into the n-th level video data. In other embodiments, the control module 840 can number the display area and send the number to the pre-monitoring card 830, and the pre-monitoring card 830 writes the number into the received M-th level pre-monitoring video data.

[0064] Step S23: Based on the size of the display screen, obtain the position information of the display area corresponding to the n-th level video data.

[0065] See also Fig. 9 The control module 840 can calculate the position information of the nth level display area based on the size of the display screen and the instructions of the host computer, wherein the size of the display screen can be the width of the display screen and the height of the display screen, and the instructions of the host computer may include: dividing the display screen into equal areas according to the amount of video data, and enlarging or reducing a specific display area in the display screen.

[0066] In some embodiments, see Fig. 9, the control module 840 can number the display area, and send the number of the display area and the position information of the display area to the corresponding n-th input card 823, and the n-th input card 823 writes the number and position information of the display area into the n-th level video data. In other embodiments, the control module 840 can number the display area, and send the number of the display area and the position information of the display area to the pre-monitoring card 830, and the pre-monitoring card 830 writes the number and position information of the display area into the M-th level pre-monitoring video data.

[0067] See also Figure 3 , Figure 3 yes Figure 1 Schematic diagram of a flow chart of an embodiment of step S12 in FIG. Step S12 includes the following steps:

[0068] Step S31: receiving position information corresponding to the n-th level video data, and writing the position information into the n-th level video data that has been pre-monitored, to obtain n-th level written data.

[0069] See also Fig. 9 , the nth input card 823 is connected to the control module 840 to receive the position information corresponding to the nth level video data. In some embodiments, the nth level video data that has been pre-monitored can be provided with a coding segment about the position information, and the nth input card 823 can write the received position information into the coding segment to obtain the nth level write data.

[0070] In some embodiments, see Fig.10 , Fig.10 It is a structural diagram of an embodiment of the nth input card of the present application. The nth input card 823 can be provided with a storage unit 828. The storage unit 828 stores a canvas space. The nth input card 823 writes the nth level video data that has been pre-monitored into the canvas space according to the position information to obtain the nth level written data.

[0071] Step S32: superimposing the n-1th level preview video data and the nth level write data to obtain the nth level preview video data.

[0072] Optionally, the overlay processing may include video picture overlay processing, image and text overlay processing, layer blending overlay processing, etc.

[0073] In some embodiments, the overlay processing may include video screen overlay processing, for example, merging the nth level video data that has been pre-monitored with the n-1th level pre-monitored video data into a display screen to obtain the nth level video data that has been pre-monitored. For example, displaying the screens taken by multiple cameras in a monitoring system. For another example, a picture-in-picture effect is achieved during live broadcast, and the anchor screen and the live broadcast screen are displayed through the picture-in-picture.

[0074] In some embodiments, the overlay processing may include text and image overlay processing, for example, the n-1th level preview video data may be text or pattern, specifically, may include static text, real-time bullet screen information, audience interaction information, real-time game scores, trademark patterns, etc. The n-1th level preview video data is set above the nth level video data that has been pre-monitored to obtain the nth level preview video data.

[0075] In some embodiments, the overlay processing may include layer mixing overlay processing, for example, mixing the nth level video data that has been pre-monitored with the n-1th level preview video data according to a preset ratio and preset transparency to obtain the nth level preview video data.

[0076] See also Figure 4 , Figure 4 yes Figure 1 Schematic diagram of a flow chart of an embodiment of step S13 in FIG. Step S13 includes the following steps:

[0077] Step S41: parsing the M-th level preview video data to obtain each level of preview video data and position information corresponding to each level of preview video data.

[0078] In this example, see Fig. 9 The nth input card 823 of the M input cards 820 is connected to the control module 840, receives the position information sent by the control module 840, and writes the position information into the nth level video data that has been pre-monitored to obtain the nth level write data. The n-1th level pre-monitoring video data and the nth level write data are superimposed to obtain the nth level pre-monitoring video data. The pre-monitoring card 830 is connected to the Mth input card 824, receives the Mth level pre-monitoring video data, and parses the Mth level pre-monitoring video data to obtain each level of pre-monitoring video data and the position information corresponding to each level of pre-monitoring video data.

[0079] In some embodiments, the nth level video data that has been pre-monitored is provided with a coding segment related to position information, and the pre-monitoring card 830 can parse the coding segment related to position information to obtain the position information corresponding to each level of pre-monitoring video data.

[0080] Step S42: performing typeset based on each level of preview video data and the position information corresponding to each level of preview video data to obtain typeset video data.

[0081] In some embodiments, see Fig.11 , Fig.11It is a structural diagram of an embodiment of the pre-monitoring card of the present application. The pre-monitoring card 830 may be provided with a storage unit 829. The storage unit 829 stores a canvas space. The pre-monitoring card 830 writes into the canvas space based on each level of pre-monitoring video data and the position information corresponding to each level of pre-monitoring video data to obtain typeset video data.

[0082] In some embodiments, see Fig.10 The nth input card 823 is provided with a storage unit 828, and the storage unit 828 stores a canvas space. The nth input card 823 writes the nth level video data that has been pre-monitored into the canvas space according to the position information. Fig. 9 and Fig.10 The pre-monitoring card 830 is connected to the Mth input card 824 and reads the layout video data from the canvas space of the Mth input card 824.

[0083] Step S43: Preview display based on the layout video data.

[0084] Optional, see Fig. 9 The pre-monitoring card 830 can send the layout video data to the host computer, and the host computer can be used for pre-monitoring display. The host computer can be a personal computer, a handheld device, a portable device, a tablet device, etc., and this application does not limit this.

[0085] See also Figure 5 , Figure 5 yes Figure 1 FIG. 1 is a flow chart of another embodiment of step S13 in FIG.

[0086] Step S13 includes the following steps:

[0087] Step S51: receiving the Mth level preview video data, and parsing the Mth level preview video data to obtain each level of preview video data.

[0088] In this example, see Fig. 9 The nth input card 823 of the M input cards 820 is connected to the n-1th input card 822 to receive the n-1th level preview video data; the nth input card 823 receives the nth level video data, performs preview processing on the nth level video data, and superimposes the n-1th level preview video data and the nth level video data that has been pre-monitored to obtain the nth level preview video data. The preview card 830 is connected to the Mth input card 824 to receive the Mth level preview video data, and parses the Mth level preview video data to obtain each level of preview video data.

[0089] Step S52: receiving the position information corresponding to each level of preview video data, and performing typeset based on each level of preview video data and the position information corresponding to each level of preview video data to obtain typeset video data.

[0090] See also Fig. 9 , the pre-monitoring card 830 is connected to the control module 840 to receive the location information corresponding to each level of pre-monitoring video data. Fig.11 The preview card 830 may be provided with a storage unit 829, which stores a canvas space. The preview card 830 writes the preview video data of each level and the position information corresponding to the preview video data of each level into the canvas space to obtain the layout video data.

[0091] Step S53: Preview display based on the layout video data.

[0092] Step S53 in this embodiment is the same as step S43 in the above embodiment, and will not be described again here.

[0093] See also Figure 6 , Figure 6 Yes Figure 1 FIG. 1 is a flow chart of another embodiment of step S12 in FIG.

[0094] Step S12 includes the following steps:

[0095] Step S61: parsing the n-th level video data to obtain the n-th level video data in a preset format.

[0096] Optionally, the preset format may be a VOB (Video Object) format, etc. The VOB format is a data format for storing video and audio, and is widely used in video editing.

[0097] In some embodiments, when parsing the n-th level video data into the VOB format, it may go through processes such as video transcoding and packaging. Video transcoding means transcoding the n-th level video data, converting the n-th level video data into the encoding format of MPEG-2 (Moving Picture Experts Group-2), wherein MPEG-2 is a digital video encoding standard, which has certain advantages in transmitting and storing high-quality videos. For example, MPEG-2 encoding can delete unimportant detail information to reduce the size of video files. MPEG-2 supports video encoding of different resolutions, frame rates and bit rates, and can adjust parameters according to specific application scenarios to meet different performance requirements. Packaging means packaging the transcoded video into a VOB file.

[0098] Step S62: performing color space conversion processing on the n-th level video data in a preset format to obtain the n-th level video data in a unified color space.

[0099] Color space conversion refers to converting color data in a color space in the n-th level video data into color data in another color space, where a color space is a mathematical model used to describe colors. Common color spaces include RGB (Red Green Blue) color space, YUV (Luminance Chrominance) color space, etc.

[0100] In the RGB color space, color is represented by a combination of three components (red, green, and blue); in the YUV color space, the brightness information and the color difference information of the image are represented separately, wherein Y represents brightness, and U and V represent color difference.

[0101] Step S63: scaling the n-th level video data in the unified color space to obtain the n-th level video data of a preset resolution.

[0102] The scaling process means changing the resolution of the n-th level video data, that is, adjusting the width and height of the n-th level video data. In some embodiments, refer to Fig. 9 The nth input card 823 is connected to the control module 840, and receives the position information corresponding to the nth level video data. The nth input card 823 scales the nth level video data of the unified color space according to the width and height in the position information to obtain the nth level video data of the preset resolution.

[0103] In some embodiments, when scaling the n-th level video data in the uniform color space, an image interpolation algorithm may be used, wherein the image interpolation algorithm is used to estimate new pixel values. Specifically, the resolution of the n-th level video data and the preset resolution are determined, and an image interpolation operation is performed on the pixels of each frame in the n-th level video data in the uniform color space, for example, a weighted sum of multiple pixels is performed to obtain the n-th level video data of the preset resolution.

[0104] See also Figure 7 , Figure 7 yes Figure 1 A flow chart of an embodiment before step S11 in FIG. The steps before step S11 include the following steps:

[0105] Step S71: receiving first-level video data, and performing pre-monitoring processing on the first-level video data.

[0106] In this example, see Fig. 9The first input card 821 among the M input cards 820 receives the first-level video data and performs a pre-monitoring process on the first-level video data, wherein the pre-monitoring process includes parsing the first-level video data to obtain the first-level video data in a preset format, for details, please refer to step S61; performing a color space conversion process on the first-level video data in the preset format to obtain the first-level video data in a unified color space, for details, please refer to step S62; performing a scaling process on the first-level video data in the unified color space to obtain the first-level video data in a preset resolution, for details, please refer to step S63.

[0107] Step S72: receiving position information corresponding to the first-level video data, and writing the position information into the first-level video data that has been pre-monitored, to obtain the first-level pre-monitored video data.

[0108] See also Fig. 9 , the first input card 821 of the M input cards 820 is connected to the control module 840 to receive the position information corresponding to the first-level video data. In some embodiments, the first-level video data that has been pre-monitored can be provided with a coding segment about the position information, and the first input card 821 can write the received position information into the coding segment to obtain the first-level written data.

[0109] In some embodiments, see Fig.10 The first input card 821 may be provided with a storage unit 828, the storage unit storing a canvas space, and the first input card 821 writes the first-level video data that has been pre-monitored into the canvas space according to the position information to obtain the first-level written data.

[0110] See also Fig.12 , Fig.12 The non-volatile computer-readable storage medium 120 stores program instructions 1201 that can be run by a plug-in video processing device, and the program instructions 1201 are used to implement the steps of any of the above-mentioned video processing method embodiments.

[0111] In some embodiments, the functions or modules included in the device provided by the embodiments of the present disclosure can be used to execute the method described in the above method embodiments. The specific implementation can refer to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0112] The above description of various embodiments tends to emphasize the differences between the various embodiments. The same or similar aspects can be referenced to each other, and for the sake of brevity, they will not be repeated herein.

[0113] In the several embodiments provided in the present application, it should be understood that the disclosed methods and devices can be implemented in other ways. For example, the device implementation described above is only schematic. For example, the division of modules or units is only a logical function division. There may be other division methods in actual implementation, such as units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical or other forms.

[0114] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0115] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) or a processor (processor) to perform all or part of the steps of each implementation method of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program code.

Claims

1. A video processing method, characterized in that: Applied to a plug-in card type video processing device, the method comprises: Receiving the nth level video data and the n-1th level preview video data, where n is an integer greater than 1 and less than or equal to M; Performing a pre-monitoring process on the n-th level video data, superimposing the pre-monitoring processed n-th level video data with the n-1-th level pre-monitoring video data to obtain the n-th level pre-monitoring video data; Receive M-th level preview video data, and perform preview display based on the M-th level preview video data.

2. The method according to claim 1, characterized in that Before the step of receiving the nth level video data and the n-1th level preview video data, the method further comprises: Acquire the amount of video data received by the card-type video processing device; Dividing the display screen based on the number to obtain a plurality of display areas, each of the display areas being set corresponding to the video data; Based on the size of the display screen, position information of a display area corresponding to the n-th level video data is obtained.

3. The method according to claim 2, characterized in that The step of superimposing the nth level video data that has been pre-monitored with the n-1th level pre-monitored video data to obtain the nth level pre-monitored video data comprises: Receiving position information corresponding to the n-th level video data, and writing the position information into the n-th level video data that has been pre-monitored, to obtain n-th level written data; The n-1th level preview video data and the nth level write data are superimposed to obtain the nth level preview video data.

4. The method according to claim 3, characterized in that The step of receiving the Mth level preview video data and performing preview display based on the Mth level preview video data comprises: Parsing the M-th level of preview video data to obtain the preview video data of each level and the position information corresponding to the preview video data of each level; Perform typeset based on the preview video data of each level and the position information corresponding to the preview video data of each level to obtain typeset video data; A preview display is performed based on the typeset video data.

5. The method according to claim 2, characterized in that: The step of receiving the Mth level preview video data and performing preview display based on the Mth level preview video data comprises: Receiving the M-th level of preview video data, and parsing the M-th level of preview video data to obtain the preview video data of each level; Receiving the position information corresponding to the preview video data at each level, and performing typeset based on the preview video data at each level and the position information corresponding to the preview video data at each level, to obtain typeset video data; A preview display is performed based on the typeset video data.

6. The method according to claim 1, characterized in that The step of performing pre-monitoring processing on the n-th level video data comprises: Parsing the n-th level video data to obtain n-th level video data in a preset format; Performing color space conversion processing on the n-th level video data in the preset format to obtain the n-th level video data in a unified color space; Scaling is performed on the n-th level video data of the unified color space to obtain the n-th level video data of a preset resolution.

7. The method according to claim 2, characterized in that The n-th level video data is the first level video data. Before the step of receiving the n-th level video data and the n-1-th level preview video data, the method includes: receiving first-level video data and performing pre-monitoring processing on the first-level video data; Receive position information corresponding to the first-level video data, and write the position information into the first-level video data that has been pre-monitored to obtain the first-level pre-monitoring video data.

8. A card-type video processing device, characterized in that: The card-type video processing device comprises: Processing chip; M input cards are respectively connected to the processing chip, and the first input card among the M input cards is used to receive the first-level video data and perform preview processing on the first-level video data to obtain the first-level preview video data; The nth input card among the M input cards is connected to the n-1th input card, and is used to receive the nth level video data and the n-1th level preview video data, perform preview processing on the nth level video data, and perform superposition processing on the nth level video data that has been subjected to the preview processing and the n-1th level preview video data to obtain the nth level preview video data, where n is an integer greater than 1 and less than or equal to M; The preview monitoring card is connected to the Mth input card among the M input cards, receives the Mth level preview monitoring video data, and performs preview monitoring display based on the Mth level preview monitoring video data.

9. The card-type video processing device according to claim 8, characterized in that: The card-type video processing device also includes: A control module is connected to the M input cards and the pre-monitoring card, respectively, and is used to obtain the amount of video data received by the plug-in video processing device, divide the display screen based on the amount to obtain multiple display areas, each of the display areas is set corresponding to the video data, obtain the position information of the display area corresponding to the n-th level video data based on the size of the display screen, and send the position information to the M input cards and / or the pre-monitoring card.

10. A non-volatile computer-readable storage medium having program instructions stored thereon, characterized in that: When the program instructions are executed by a plug-in card-type video processing device, the method according to any one of claims 1 to 7 is implemented.

Images