Video overlay method, device and system

Abstract

The present application relates to a video overlay method, device and system. The method includes: dividing the acquired initial video memory unit to obtain an overlay information carrier and an image display carrier; based on the number of sub-display areas, the overlay information carrier is evenly divided in units of video memory pixels in the overlay information carrier to obtain sub-overlay information carriers corresponding to the pixels in the sub-display area, and the sub-overlay information carriers are divided according to a preset overlay information working state to obtain at least one layer of sub-overlay layers; based on the sub-overlay layers, the corresponding target enabling units in the initial enabling units of the sub-display area are enabled, and the corresponding sub-overlay layers are fused and superimposed with the data displayed in the sub-display area at the same position based on the enabling status of the initial enabling units in each sub-display area through a preset programming chip to obtain a video overlay result. The present application can reduce the storage space occupied by the overlay information and improve the quality of information overlay.

Description

Technical Field

[0001] The present application relates to the field of video processing technology, and in particular to a video overlay method, device and system. Background Art

[0002] There are several main methods for existing OSD (on-screen display) overlay technology. One is to convert ARGB data into YUV422 format, and use YUV444 as a data format carrier. A part of the data is stored in YUV422 data, and the other part of the U1 and V1 components are used to store transparency data. The transparency data and YUV422 data are taken in the overlay stage and merged with the video data. However, with this method, since the OSD data is in YUV422 format, the two horizontal pixels share a pair of UV components, the OSD boundary will be blurred, and the amount of stored OSD data will increase with the increase in the number of OSD overlays. The second method is to perform special encoding on the characters in the OSD menu, but this method occupies more FPGA storage resources, and through the import of storage resources, the number of tracking characters or color types continues to increase, and the speed of switching OSD information is slow.

[0003] At present, no effective solution has been proposed for the problems in the prior art that the superimposed OSD information occupies a large storage space and the quality of the superimposed OSD information is poor. Summary of the invention

[0004] Based on this, it is necessary to provide a video overlay method, device and system to address the above technical issues.

[0005] In a first aspect, the present application provides a video overlay method. The method comprises:

[0006] Dividing the acquired initial display memory unit to obtain a superimposed information carrier and an image display carrier; wherein the image display carrier includes at least one sub-display area;

[0007] Based on the number of sub-display areas, the overlay information carrier is evenly divided with the display memory pixel in the overlay information carrier as a unit to obtain sub-overlay information carriers corresponding to the pixels in the sub-display areas, and the sub-overlay information carriers are divided according to a preset overlay information working state to obtain at least one sub-overlay layer, wherein the sub-overlay layer is used to be superimposed in the corresponding sub-display area to display the preset overlay information;

[0008] Based on the sub-overlay layer, the corresponding target enabling unit in the initial enabling unit of the sub-display area is enabled, and through a preset programming chip, based on the enabling status of the initial enabling unit in each sub-display area, the corresponding sub-overlay layer is fused and superimposed with the data displayed in the sub-display area at the same position to obtain a video overlay result.

[0009] In one embodiment, the overlay information carrier is composed of a plurality of display memory pixels; based on the number of sub-display areas, the overlay information carrier is evenly divided to obtain sub-overlay information carriers corresponding to the sub-display areas, including:

[0010] Based on the number of sub-display regions, each video memory pixel is equally divided, and at least one sub-video memory pixel is obtained through each video memory pixel, wherein the sub-video memory pixels correspond point-to-point to corresponding positions of the sub-display regions.

[0011] In one of the embodiments, the sub-overlay information carrier is divided according to the preset overlay information working state to obtain at least one sub-overlay layer, including:

[0012] According to the working state of the overlay information, the sub-overlay information carrier corresponding to each pixel in the sub-display area is divided, wherein the size of the sub-overlay information carrier is the same as the maximum value of the size of the corresponding sub-overlay layer.

[0013] In one of the embodiments, the sub-overlay layer includes at least one of the following types: a static sub-overlay layer and a dynamic sub-overlay layer, wherein the static sub-overlay layer is used to display static data, and the dynamic sub-overlay layer is used to display dynamic data.

[0014] In one of the embodiments, the initial enabling unit includes an enabling register, a mode configuration register and a color configuration register; each enabling register corresponds to each mode configuration register one-to-one, each mode configuration register corresponds to a sub-overlay layer corresponding to the sub-display area one-to-one, and each mode configuration register corresponds to at least one color configuration register; based on the sub-overlay layer, the corresponding target enabling unit in the initial enabling unit of the sub-display area is enabled, and based on the enabling status of the initial enabling unit in each sub-display area, the corresponding sub-overlay layer is fused and superimposed with the data displayed in the sub-display area at the same position through a preset programming chip to obtain a video superposition result, including:

[0015] According to the division of the sub-overlay layers, the corresponding mode configuration register is enabled through the enable register;

[0016] Based on the preset business task, the corresponding color configuration register is selected through the mode configuration register, and the enabling process is performed to convert the dot matrix information of the corresponding sub-overlay layer into the color index dot matrix information implemented based on the color configuration register;

[0017] Based on the enabling condition, the programming chip is used to fuse and overlay the color index dot matrix information corresponding to the sub-overlay layer with the data displayed in the sub-display area at the same position to obtain a video overlay result.

[0018] In one embodiment, based on a preset business task, a corresponding color configuration register is selected through a mode configuration register, and color setting of a corresponding sub-overlay layer is completed through the color configuration register, including:

[0019] The color configuration register corresponding to each sub-overlay layer is determined based on the size of each sub-overlay layer; wherein the number of color configuration registers corresponding to the sub-overlay layer that need to be enabled is 2 n -1, the maximum number of color types on the sub-overlay layer is 2 n -1, where n is the size of the corresponding sub-overlay layer and n is an integer.

[0020] In one embodiment, the corresponding sub-overlay layer is fused and overlaid with the data displayed in the sub-display area at the same position to obtain a video overlay result, including:

[0021] In order from high bit to low bit, the data in all sub-overlay layers are fused and overlaid point by point with the data displayed in the sub-display area; wherein the number of sub-overlay layers is less than or equal to eight layers;

[0022] Generate the next moment's sub-overlay layer data based on the preset business task, and compare the next moment's sub-overlay layer data with the current moment's sub-overlay layer data. If the comparison result is detected to be inconsistent data, update the data in the sub-overlay layer based on the next moment's sub-overlay layer data.

[0023] In one embodiment, the method further comprises:

[0024] The data in the overlay information carrier and the data in the image display carrier are separated and transmitted to the programming chip through a preset display module, wherein the same frame of video data to be transmitted and the corresponding overlay information are transmitted alternately through the overlay information carrier and the image display carrier; the image display carrier is format converted through the display module.

[0025] In a second aspect, the present application also provides a video overlay device. The device includes:

[0026] An acquisition module, used for dividing the acquired initial display memory unit to obtain a superimposed information carrier and an image display carrier; wherein the image display carrier includes at least one sub-display area;

[0027] a calculation module, configured to evenly divide the overlay information carrier based on the number of sub-display areas to obtain sub-overlay information carriers corresponding to the sub-display areas, and divide the sub-overlay information carriers according to a preset overlay information working state to obtain at least one sub-overlay layer, wherein the sub-overlay layer is used to be superimposed in the corresponding sub-display area to display the preset overlay information;

[0028] A generation module is used to enable the corresponding target enabling unit in the initial enabling unit of the sub-display area based on the sub-overlay layer, and to fuse and superimpose the corresponding sub-overlay layer with the data displayed in the sub-display area at the same position based on the enabling status of the initial enabling unit in each sub-display area through a preset programming chip to obtain a video overlay result.

[0029] In a third aspect, the present application further provides a video overlay system, the system comprising: a display module, a programming chip and a display; the programming chip is connected to the display module and the display respectively;

[0030] The display module is used to divide the acquired initial display memory unit to obtain an overlay information carrier and an image display carrier; wherein the image display carrier includes at least one sub-display area; based on the number of sub-display areas, the overlay information carrier is evenly divided to obtain sub-overlay information carriers corresponding to the sub-display areas, and the sub-overlay information carriers are divided according to a preset overlay information working state to obtain at least one layer of sub-overlay layers, wherein the sub-overlay layers are used to be superimposed in the corresponding sub-display area to display the preset overlay information; based on the sub-overlay layers, the corresponding target enabling units in the initial enabling units of the sub-display area are enabled;

[0031] The programming chip is used to fuse and overlay the corresponding sub-overlay layer with the data displayed in the sub-display area at the same position based on the enabling status of the initial enabling unit in each sub-display area to obtain a video overlay result;

[0032] The display is used to display the video overlay result.

[0033] In the above-mentioned video overlay method, device and system, the initial video memory unit is divided in the present application to obtain an overlay information carrier and an image display carrier including a plurality of sub-display areas, the overlay information carrier is evenly divided based on the number of sub-display areas to obtain sub-overlay information carriers corresponding to the sub-display areas, and the sub-overlay information carriers are divided according to the preset overlay information working state to obtain at least one layer of sub-overlay layers, and the corresponding target enabling unit in the initial enabling unit of the sub-display area is enabled based on the sub-overlay layers, and the corresponding sub-overlay layers are fused and superimposed with the actual data in the sub-display area at the same position through the preset programming chip based on the enabling status of the initial enabling unit in each sub-display area to obtain the video overlay result. In the present application, part of the initial video memory unit is used as the overlay information carrier, that is, the pixel data of the overlay information is stored in the same way as the pixel data of the video, thereby ensuring that the stored overlay information data and the video / image data stored in the display area are point-to-point, and ensuring the accuracy of the subsequent overlay of the data carried in the sub-overlay layers. Furthermore, the sub-overlay information carriers are divided according to the working status of the overlay information to obtain at least one layer of sub-overlay layers, which can realize the flexible division of the sub-overlay information carriers according to the actual working status and scene requirements, effectively saving CPU and memory resources. Moreover, the technical solution proposed in this application occupies a fixed storage resource and will not increase with the increase of overlay information. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 1 is a flow chart of a video overlay method in one embodiment;

[0035] Figure 2 A schematic diagram of the initial display unit division structure in one embodiment;

[0036] Figure 3 A schematic diagram of video memory pixel splitting in one embodiment;

[0037] Figure 4 A schematic diagram of a structure in which a sub-overlay information carrier is divided to obtain a multi-layer sub-overlay layer in one embodiment;

[0038] Figure 5 A schematic diagram of the structure of a mode configuration register and an enable register in one embodiment;

[0039] Figure 6 A schematic diagram of the structure of a color configuration register and a mode configuration register in one embodiment;

[0040] Figure 7 A selection scheme for a color configuration register in one embodiment;

[0041] Figure 8A selection scheme for a color configuration register in another embodiment;

[0042] Fig. 9 A schematic diagram of the overlay operation of a sub-overlay layer in an embodiment;

[0043] Fig.10 A schematic diagram of a process for configuring overlay information in a preferred embodiment;

[0044] Fig.11 A schematic diagram of a process of programming a chip to superimpose superimposed information in a preferred embodiment;

[0045] Fig.12 is a structural block diagram of a video overlay device in one embodiment;

[0046] Fig.13 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0047] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0048] In one embodiment, Figure 1 As shown, a video overlay method is provided, comprising the following steps:

[0049] Step S110, dividing the acquired initial display memory unit to obtain a superimposed information carrier and an image display carrier; wherein the image display carrier includes at least one sub-display area.

[0050] Specifically, the above-mentioned initial video memory unit is generally a preset video memory unit, which is not completely the same as the memory. The video memory is based on the information on the memory, and the memory is converted into a two-dimensional space. The data in the video memory is usually organized in the form of a two-dimensional image, so as to facilitate the GPU to perform fast pixel access and rendering operations. In some embodiments, the format displayed in the above-mentioned video memory unit can be XRGB8888. The initial video memory unit is divided to obtain an overlay information carrier and an image display carrier, wherein the overlay information is information such as text, graphics, and images superimposed on the video / image signal, which can be provided as additional information without interfering with the user's viewing of the main video content. In practical applications, the above-mentioned overlay information is usually OSD (On-Screen Display) information. Further, in this embodiment, the initial video memory unit is split to obtain an overlay information carrier for storing overlay information and an image display carrier for storing the video to be played, that is, the storage method of the overlay information is the same as the storage method of the video to be played, and the storage space of the overlay information is fixed, and will not increase with the increase of the overlay information, and there will be no boundary blur when the overlay information is superimposed on the video to be played. Furthermore, in this embodiment, the image display carrier also includes multiple sub-display areas, and different sub-display areas display different videos to be played. In some embodiments, multiple sub-display areas can display different areas of the same video / image, that is, a complete video / image display is achieved through multiple sub-display areas; in other embodiments, different sub-display areas can each display unrelated videos / images. This embodiment does not impose too many restrictions on the relationship between the contents displayed in each sub-display area. In summary, it is preferred to divide the initial display unit into four equal parts in the horizontal direction, such as Figure 2As shown, it is a structural schematic diagram of dividing the initial display unit in an embodiment. The first one from the left is the above-mentioned superimposed information carrier 21, and the second, third and fourth from the left are different sub-display areas 22, sub-display areas 23 and sub-display areas 24 respectively. In actual applications, different division methods have different hardware specification requirements and software processing methods. The above-mentioned division method of dividing into four parts in the horizontal direction is related to the 1920x1080@60 monitoring display screen that is widely used on the market or the LED sending box device with a pixel clock of 148.5M with a non-fixed resolution, which can ensure the unified software processing and the unified hardware architecture. Among them, 1920x1080 refers to the resolution, that is, the pixel size of the screen or video picture. The above @ is generally used as a separator to separate the two parts of information, resolution and frame rate. The above 60 refers to the frame rate, that is, the number of pictures displayed per second. Similarly, if the SOC (System on Chip) chip supports 8K HDMI 2.1 output, the initial video memory unit can be divided into 8 equal parts, each carrying 1920x1080 data content, of which 2 parts are needed as overlay information carriers.

[0051] Step S120, based on the number of sub-display areas, the overlay information carrier is evenly divided in units of video memory pixels in the overlay information carrier to obtain sub-overlay information carriers corresponding to the pixels in the sub-display areas, and the sub-overlay information carriers are divided according to a preset overlay information working state to obtain at least one layer of sub-overlay layers, wherein the sub-overlay layers are used to be superimposed in the corresponding sub-display area to display the preset overlay information.

[0052] Specifically, in this embodiment, according to the number of sub-display areas, the overlay information carrier is evenly divided in units of video memory pixels to obtain sub-overlay information carriers corresponding point-to-point to the pixels in the sub-display areas. In some preferred embodiments, the image display carrier is divided into three parts, and accordingly, each video memory pixel also needs to be evenly divided into three sub-overlay information carriers.

[0053] Further, according to the different working states of the superimposed information in each sub-display area, the sub-superimposed information carrier is divided to obtain at least one layer of sub-superimposed layers, wherein the working state of the superimposed information is preset according to actual needs, and it is characterized that which different superimposed information needs to be set in different superimposed layers for display. For example, in general, it is necessary to set the static superimposed information and the dynamic superimposed information in different superimposed layers. In this way, in actual application, it is only necessary to update the layer data where the dynamic superimposed information is located as needed, without updating the layer where the static superimposed information is located, thereby reducing the computing resources occupied when the superimposed data is updated, effectively improving the updating efficiency of the superimposed information, and achieving the effect of low latency and low storage. Similarly, superimposed information with different update frequencies and different services (such as setting the license plate display information as one sub-superimposed layer, and setting the face recognition information as another sub-superimposed layer, etc.) can also be set in different layers according to actual needs. This embodiment does not impose too many restrictions on the splitting rules of the sub-superimposed layers, and all rules that can set the data with large differences in different sub-superimposed layers should fall within the scope of protection of this application. It should be noted that the sub-overlay information carrier in each sub-display area is an information carrier at a pixel position, that is, the division of the sub-overlay information carrier in this embodiment is to divide the information carrier at each pixel position in the sub-display area to obtain at least one layer of sub-overlay layers. Each sub-overlay layer is used to display the preset overlay information.

[0054] Step S130, based on the sub-overlay layer, enables the corresponding target enabling unit in the initial enabling unit of the sub-display area, and through a preset programming chip based on the enabling status of the initial enabling unit in each sub-display area, merges and superimposes the corresponding sub-overlay layer with the data displayed in the sub-display area at the same position to obtain a video overlay result.

[0055] Specifically, each sub-display area corresponds to a plurality of initial enabling units, which include but are not limited to color configuration registers, mode configuration registers, etc. According to the sub-overlay layers divided in the sub-display area, the corresponding and effective target enabling units are enabled. If it is obtained according to the working state of the overlay information that only one sub-overlay layer is needed at the corresponding position in the sub-display area, then the target enabling unit corresponding to the layer is enabled accordingly. At this time, the target enabling unit can be in an effective state and can perform corresponding work. The remaining enabling units do not need to be enabled because they are not needed. Then, the sub-overlay layer is fused and superimposed with the data displayed in the sub-display area at the corresponding position through a preset programming chip to obtain a video superposition result, wherein the programming chip preferably uses an FPGA (Field-Programmable Gate Array) chip. The programming chip performs superposition and fusion processing on the superposition information corresponding to the sub-overlay layer and the data at the corresponding position in the sub-display area according to the enabling status of the initial enabling unit to obtain a video superposition result. In practical applications, the pixels in the video superposition result are output through HDMI (High-DefinitionMultimedia Interface).

[0056] Through step S110 to step S130, the initial video memory unit is divided in the present application to obtain the superimposed information carrier and the image display carrier. First, the superimposed information carrier and the image display carrier can be separated, so that the superimposed information can be processed centrally, the CPU Cache can be effectively used, and the data processing performance can be improved; second, compared with the common use of OSD chips in the prior art, the restrictions in the present application are less. It can be understood by those skilled in the art that the HDMI output of the OSD chip has a maximum width (5120) and height (4320) restrictions, while the present solution has fewer restrictions on the width and height of the HDMI output, and can meet the requirements of ultra-high (8192) or ultra-wide (8192) in one direction; third, the continuity of video data and OSD data can be improved respectively, and the read and write performance can be improved. Further, the present application also includes dividing the sub-superimposed information carrier according to the preset superimposed information working state, so that only the layer data that needs to be updated needs to be updated separately, without updating the data of other layers that do not need to be updated, thereby saving CPU and memory resources. In the prior art, when performing overlay processing on overlay information, the data to be overlaid is generally overlaid onto the display data of each frame through CPU / GPU resources. However, the present application only needs to load the overlay information onto the overlay information carrier once, and the remaining operation is completed point-to-point by the programming chip to overlay the overlay information with the data at the corresponding position of the display area.

[0057] In some embodiments, the overlay information carrier is composed of a plurality of display memory pixels; based on the number of sub-display areas, the overlay information carrier is evenly divided to obtain sub-overlay information carriers corresponding to the sub-display areas, including:

[0058] Based on the number of sub-display regions, each video memory pixel is equally divided, and at least one sub-video memory pixel is obtained through each video memory pixel, wherein the sub-video memory pixels correspond point-to-point to corresponding positions of the sub-display regions.

[0059] Specifically, the superimposed information carrier is composed of a plurality of video memory pixels. In practical applications, each video memory pixel is XRGB data, which is 32 bits in total, and the data that can be effectively transmitted by each video memory pixel through the HDMI protocol is 24 bits. In this embodiment, each video memory pixel in the superimposed information carrier is taken as a unit, and each video memory pixel is evenly divided based on the number of sub-display areas. Each video memory pixel corresponds to a sub-display area after being evenly divided. Each video memory pixel is evenly divided by the above method to obtain a plurality of sub-superimposed information carriers. In some preferred embodiments, the number of sub-display areas is generally three. At this time, each video memory pixel can be evenly divided into three parts. Assuming that the effective data size of each video memory pixel is 24 bits, the size of each carrier is 8 bits. For the three evenly divided sub-video memory pixels, there are pixel positions in the sub-display area corresponding to them one by one. Each video memory pixel in the superimposed information carrier is evenly divided according to the above steps, thereby realizing that the superimposed information carrier is evenly divided into three sub-superimposed information carriers. Figure 3 The figure is a schematic diagram of splitting each video memory pixel in an embodiment. It can be seen from the figure that for sub-video memory pixel a, it can be allocated to the pixel position corresponding to it in sub-display area 1 point-to-point, and if the size of each sub-video memory pixel is 8 bits, the sum of the sizes of the sub-overlay layers corresponding to the pixel position in sub-display area 1 is 8 bits. Similarly, for sub-video memory pixel b, it can be allocated to the position corresponding to it in sub-display area 2 point-to-point, and for sub-video memory pixel c, it can be allocated to the position corresponding to it in sub-display area 3 point-to-point. Through this embodiment, the splitting is performed based on each video memory pixel as a unit, so that each sub-video memory pixel and the corresponding position in different sub-display areas are in a point-to-point relationship, thereby ensuring the accuracy of the overlay and will not be deformed due to the custom resolution output.

[0060] In some embodiments, the sub-overlay information carrier is divided according to a preset overlay information working state to obtain at least one sub-overlay layer, including:

[0061] According to the working state of the overlay information, the sub-overlay information carrier corresponding to each pixel in the sub-display area is divided, wherein the size of the sub-overlay information carrier is the same as the maximum value of the size of the corresponding sub-overlay layer.

[0062] Specifically, Figure 4 It is a structural schematic diagram of dividing the sub-overlay information carrier to obtain multiple layers of sub-overlay layers in one embodiment; the figure provides several feasible division methods. In practical applications, the specific division method can be determined by the working status of the overlay information. It can be seen from the figure that, taking the sub-overlay information carrier size corresponding to each pixel point as 8 bits as an example, one feasible division method is to divide 8 bits into 8 layers of sub-overlay layers, and the size of each sub-overlay layer is 1 bit; another feasible division method is to divide 8 bits into 4 layers of sub-overlay layers, and the size of each sub-overlay layer is 2 bits; another feasible division method is to divide 8 bits into 4 layers of sub-overlay layers, and the sizes of each sub-overlay layer are 3 bits, 2 bits, 2 bits and 1 bit respectively; another feasible division method is to divide 8 bits into 1 layer of sub-overlay layers, and the size of the sub-overlay layer is 8 bits, that is, the size of each sub-overlay layer is the same as the size of the sub-overlay information carrier. In summary, according to 8 bits, the free arrangement and combination function of the sub-overlay layers corresponding to each pixel realizes 2 8 = 256 schemes. It is understandable that the size of the sub-overlay layer should be an integer. Through this embodiment, the sub-overlay layer division method can be flexibly set to meet the actual application needs while avoiding the waste of computing resources to the greatest extent.

[0063] In some embodiments, the sub-overlay layer includes at least one of the following types: a static sub-overlay layer and a dynamic sub-overlay layer, wherein the static sub-overlay layer is used to display static data, and the dynamic sub-overlay layer is used to display dynamic data.

[0064] Specifically, this embodiment lists two types of overlay layers commonly used in practical applications, one is a static sub-overlay layer, that is, an overlay layer in which the data does not change or does not change for a long period of time, and the other is a dynamic sub-overlay layer, that is, an overlay layer in which the data changes at a higher frequency over time. Static sub-overlay layers do not need to be repeatedly overlaid according to different video images, while dynamic sub-overlay layers need to be repeatedly overlaid with video images according to actual conditions, but will not affect the data in the static sub-overlay layer. Therefore, in this embodiment, static sub-overlay layers and dynamic sub-overlay layers are distinguished, and static, long-term unchanged static data is set in the static sub-overlay layer for display, and dynamic data that changes more frequently is set in the dynamic sub-overlay layer for display, which effectively saves CPU and memory resources.

[0065] In one of the embodiments, the initial enabling unit includes an enabling register, a mode configuration register and a color configuration register; each enabling register corresponds to each mode configuration register one-to-one, each mode configuration register corresponds to a sub-overlay layer corresponding to the sub-display area one-to-one, and each mode configuration register corresponds to at least one color configuration register; based on the sub-overlay layer, the corresponding target enabling unit in the initial enabling unit of the sub-display area is enabled, and the corresponding sub-overlay layer is fused and superimposed with the data displayed in the sub-display area at the same position based on the enabling status of the initial enabling unit in each sub-display area through a preset programming chip, to obtain a video superposition result, including:

[0066] According to the division of the sub-overlay layers, the corresponding mode configuration register is enabled through the enable register;

[0067] Based on the preset business task, the corresponding color configuration register is selected through the mode configuration register, and the enabling process is performed to convert the dot matrix information of the corresponding sub-overlay layer into the color index dot matrix information implemented based on the color configuration register;

[0068] Based on the enabling condition, the programming chip is used to fuse and overlay the color index dot matrix information corresponding to the sub-overlay layer with the data displayed in the sub-display area at the same position to obtain a video overlay result.

[0069] Specifically, each sub-display area corresponds to a plurality of mode configuration registers, a plurality of enable registers and a plurality of color configuration registers. Each enable register corresponds to each mode configuration register one by one, and is used to enable the mode configuration register through the enable register. Each mode configuration register corresponds to a plurality of color configuration registers, and is used to select the required color configuration register through the mode configuration register based on the index of the color configuration register. In some preferred embodiments, the color configuration register is configured in the format of ARGB, and supports the alpha format. Furthermore, similar to the division of the sub-overlay layer, in this embodiment, when configuring the register, the corresponding register is configured in units of pixels in the sub-display area.

[0070] According to the division of the sub-overlay layer, the corresponding mode configuration register is enabled through the enable register. For example, the sub-overlay information carrier is divided into 8 sub-overlay layers according to the overlay information working status. At this time, the corresponding mode configuration registers need to be enabled through the first to the eighth enable registers respectively; similarly, if the sub-overlay information carrier is divided into one sub-overlay layer according to the overlay information working status, it is assumed that the sub-overlay layer is the nth layer, where n is any integer from 1 to 8. At this time, the corresponding nth mode configuration register is enabled through the nth enable register, and the remaining mode configuration registers are invalid registers at this time. Figure 5 Schematic diagram of the structure of mode configuration registers and enable registers in an embodiment. It can be seen from the figure that OSD0 to OSD7 are 8 mode configuration registers respectively, and OSD0 enable to OSD1 enable are 8 enable registers respectively. The mode configuration registers and the enable registers are in a one-to-one correspondence.

[0071] After the corresponding mode configuration register is enabled, the corresponding color configuration register is selected through the mode configuration register. In some preferred embodiments, the selection of the color configuration register is usually realized through the index value of the color configuration register. Each color configuration register has a one-to-one corresponding index value. When the index value is 0, it means that the pixel does not need color superposition. The required color configuration register is selected based on the preset business task and enabled. After the color configuration register is selected through the index value, the color setting of the corresponding sub-overlay layer is completed through the color configuration register, and the original dot matrix information of the sub-overlay layer is converted into the color index dot matrix information based on the valid and enabled color configuration register. The remaining unselected color configuration registers are invalid registers at this time, wherein the original dot matrix information of the sub-overlay layer is the dot matrix data of the text, graphics and other elements superimposed on the video or image, which defines the position of each pixel. Correspondingly, after determining the valid color configuration register, the dot matrix information is supplemented based on the color configuration register to obtain the color index dot matrix information carrying the required color. The color index dot matrix information is set for the color type and quantity required for each pixel in the form of recording the index of the color configuration register. Further, through the programming chip, which is mostly an FPGA chip in actual applications, based on the enabling status of the above-mentioned mode configuration register and the color configuration register, the color index dot matrix information is fused and superimposed with the data at the same position in the corresponding sub-display area to obtain the above-mentioned video superposition result. Through this embodiment, the required mode configuration register, enable register and color configuration register can be selected, and the remaining unselected registers are invalid registers, thereby minimizing the waste of computing resources, and the required registers can be flexibly and efficiently selected according to the actual situation. For example, for a certain pixel, the color information that needs to be superimposed on the pixel is converted into the number of bits corresponding to the sub-superimposed layer corresponding to the point, which can represent the color index. If the pixel is red and the sub-superimposed layer has only 2 bits, it means that only four digital combinations of 00b, 01b, 10b and 11b can be used to represent the message. Among them, 00b is used as no color superposition. Only the remaining 3 can represent 3 colors. If 10b means red, then the OSD corresponding pixel point is filled with 10b information. In actual applications, a display channel, that is, a sub-superimposed layer corresponding to a sub-display area, generally only designs 256 color registers, and its purpose is to reuse color registers as much as possible to reduce the waste of registers.

[0072] In one embodiment, based on a preset business task, a corresponding color configuration register is selected through a mode configuration register, and color setting of a corresponding sub-overlay layer is completed through the color configuration register, including:

[0073] The color configuration register corresponding to each sub-overlay layer is determined based on the size of each sub-overlay layer; wherein the number of color configuration registers corresponding to the sub-overlay layer that need to be enabled is 2 n -1, the maximum number of color types on the sub-overlay layer is 2 n -1, where n is the size of the corresponding sub-overlay layer and n is an integer.

[0074] Specifically, Figure 6 The diagram is a schematic diagram of the structure of a color configuration register and a mode configuration register in an embodiment, which includes eight mode configuration registers from OSD0 to OSD7, eight enable registers from OSD0 enable to OSD7 enable corresponding to the eight mode configuration registers, and each mode configuration register corresponds to 32 color configuration registers. It can be understood from the figure that OSD0 corresponds to color configuration registers from color0 to color031, OSD1 corresponds to color configuration registers from color1 to color131, and so on. After the required mode configuration registers are enabled, the color configuration register corresponding to the sub-overlay layer is selected according to the preset business task through the mode configuration register, wherein the size of each sub-overlay layer determines the maximum number of color configuration registers corresponding to the sub-overlay layer that can be selected. According to the content described above, it can be understood that the size of the sub-overlay layer is at least 1 bit and at most 8 bits (when the size of the sub-overlay information carrier is 8 bits), and 1 bit represents two situations of 1 and 0, that is, when the size of a sub-overlay layer is 1 bit, it means that the layer can only support one color, and the number of color configuration registers that need to be enabled for the layer is 1 (2 1 -1), the maximum number of colors on this layer is 1, and this layer is pure color (0 means none, that is, this pixel does not need color overlay, so there is only one color); similarly, if the size of the sub-overlay layer is 8 bits, it means that the number of color configuration registers that need to be enabled for this layer is 255 (2 8 -1), similarly, 00000000 means nothing, that is, the pixel does not need color overlay, so 1 needs to be subtracted, and the maximum number of colors on this layer is 255.

[0075] The following examples illustrate the selection of color configuration registers in two different situations, and assume that the maximum size of the sub-overlay layer is 8 bits, that is, assume that the size of the sub-overlay information carrier is 8 bits:

[0076] 1. Divide the sub-overlay information carrier into 8 sub-overlay layers, each sub-overlay layer is 1 bit in size, and the color configuration register is selected by Figure 7As shown in the red box in , since the size of each sub-overlay layer is 1 bit, the optional values ​​for each layer are 0 and 1, and 0 means no color overlay is required, so each layer only supports 1 color, that is, pure color.

[0077] 2. The sub-overlay information carrier has only one sub-overlay layer, that is, the size of the sub-overlay layer is 8 bits. At this time, the color configuration register is selected by Figure 8 As shown in the red solid line frame in , that is, at this time, the mode configuration register 0 is configured with 8 consecutive 1 bits, indicating that the layer can support 255 colors. The remaining mode configuration registers 1 to 7 in the red dotted line frame, the enable registers 1 to 7 are invalid registers, and the color register color0 is also an invalid register. Among them, since it is necessary to select the most compatible index to indicate that no color is added in actual applications, only 0 is the same value for all 1 to 8 powers of 2, so index=0 is selected to indicate that the pixel does not need OSD overlay. In this way, each pixel only needs to obtain the index color index value from the overlay layer and select the color of the corresponding index value for fusion. In this way, color0 will never be used and can be used as an invalid color register. Similarly, in other embodiments, the color register color255 can also be used as an invalid color register. At this time, it is necessary to obtain the index color index value from the overlay layer. If it is found to be 0, it will not be overlaid. If it is found to be greater than 0, it is necessary to obtain the index color index value from the OSD overlay layer, and perform a corresponding minus one process to find the corresponding color register information. In this way, the color value of color255 will never be used and can be regarded as an invalid color register value.

[0078] In summary, through this embodiment, the corresponding required effective color configuration register can be selected according to the division situation of each sub-overlay layer, without enabling all color configuration registers, which can effectively save computing resources.

[0079] In one embodiment, the corresponding sub-overlay layer is fused and overlaid with the data displayed in the sub-display area at the same position to obtain a video overlay result, including:

[0080] In order from low bit to high bit, the data in all sub-overlay layers are fused and overlaid point by point with the data displayed in the sub-display area; wherein the number of sub-overlay layers is less than or equal to eight layers;

[0081] Generate the next moment's sub-overlay layer data based on the preset business task, and compare the next moment's sub-overlay layer data with the current moment's sub-overlay layer data. If the comparison result is detected to be inconsistent data, update the data in the sub-overlay layer based on the next moment's sub-overlay layer data.

[0082] Specifically, Fig. 9 This is a schematic diagram of the overlay operation of sub-overlay layers in an embodiment. In this embodiment, the data in all sub-overlay layers and the data displayed in the display area are point-to-point fused and overlaid in order from low bits to high bits. There are 8 sub-overlay layers in the figure, and the size of each layer is 1 bit. It can be understood that the number and size of the sub-overlay layers can be determined according to actual needs.

[0083] Determine whether the next moment sub-overlay layer data generated at the next moment is the same as the current sub-overlay layer data at the current moment. For example, the check values ​​can be compared by md5. If they are not the same, the update mechanism will be triggered to update the current sub-overlay layer data through the next moment sub-overlay layer data. If they are the same, no update will be made, and the vsync (Vertical Synchronization) count will be updated. After determining that the vsync calculation is updated, the display data will be switched accordingly.

[0084] In one embodiment, the method further comprises:

[0085] The data in the overlay information carrier and the data in the image display carrier are separated and transmitted to the programming chip through a preset display module, wherein the same frame of video data to be transmitted and the corresponding overlay information are transmitted alternately through the overlay information carrier and the image display carrier; the image display carrier is format converted through the display module.

[0086] Specifically, after the display module obtains the transmitted video data to be played and the superimposed information carrier with superimposed information set, the data in the superimposed information carrier and the data in the image display carrier (i.e., the video data to be played) are split based on the HDMI protocol and placed in independent line cache data FIFOs, wherein the superimposed information carrier data and the image display carrier data need to be split, and the image display carrier data can also be split according to actual needs. Among them, when transmitting the superimposed information carrier data and the image display carrier data, for the same frame of data, the superimposed information carrier data and the image display carrier data are transmitted simultaneously, and further for the data content in the same frame, the superimposed information carrier data and the image display carrier data are interleaved. Then, the corresponding mode configuration register and color configuration register in the enabled state are judged through the above-mentioned enable register, and according to the enabling status of the mode configuration register and the color configuration register, the video data and superimposed information data at the corresponding video channel position are taken, and the order from low bit to high bit is sequentially merged into new data, and finally the merged data is output through HDMI.

[0087] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0088] The present application also provides a preferred embodiment of a video overlay method.

[0089] Fig.10 The figure is a flow chart of configuring overlay information in a preferred embodiment.

[0090] Step S1010, determining the configuration mode of the overlay information according to the preset overlay information working state. Specifically, firstly, the sub-overlay information carriers corresponding to each pixel in each sub-display area are divided according to the overlay information working state to obtain at least one sub-overlay layer.

[0091] Step S1020, select the corresponding mode configuration register according to the division of the sub-overlay layer. For example, if the sub-overlay layer is divided into 8 layers, each layer is 1 bit, then 8 mode configuration registers are selected accordingly; similarly, if the sub-overlay layer is divided into 1 layer, the size of the layer is 8 bits, and the layer is the third layer, then the third mode configuration register is selected accordingly.

[0092] Step S1030, according to the preset business task and the size of each sub-overlay layer, select the color value of the color configuration register corresponding to the layer. The maximum number of types of color configuration registers that can be selected for each sub-overlay layer is 2. n -1, where n is the bit size of the sub-overlay layer and n is an integer.

[0093] Step S1040: Enable the above-mentioned mode configuration register and color configuration register through corresponding enable registers.

[0094] Step S1050, determine whether the vsync count is updated, if so, update the display data, if not, continue to wait until the vsync count is updated.

[0095] Step S1060, displaying the preset overlay information based on the configured sub-overlay layer, and periodically determining whether the data in the sub-overlay layer is updated; if so, updating the displayed data, otherwise jumping to step S1050.

[0096] Step S1070, update the current sub-overlay layer data according to the sub-overlay layer data at the next moment, convert the overlay information into the color index value of the color configuration register, store the corresponding overlay information in accordance with the video output mode.

[0097] Furthermore, after the above-mentioned superimposed information is configured, the present embodiment also includes a solution of fusing and superimposing the superimposed information with the data in the corresponding sub-display area through a programming chip. Fig.11 It is a schematic diagram of a flow chart of programming a chip to superimpose superimposed information in a preferred embodiment.

[0098] Step S1110, split the data in the superimposed information carrier and the data in the image display carrier, and save them separately. After the display module obtains the transmitted video data to be played and the superimposed information carrier with superimposed information set, it splits the data in the superimposed information carrier and the data in the image display carrier, and puts them into independent line cache data FIFOs respectively.

[0099] Step S1120, judging whether the mode configuration register is in an enabled state through the enable register, if so, jumping to step S1130, if not, no superposition is performed, and the pixel data is directly outputted through HDMI.

[0100] Step S1130, according to the enabling status of the mode configuration register, the video data and the superimposed information data at the same position in the sub-display area are obtained, and point-to-point fusion and superposition are performed from high bit to low bit.

[0101] Step S1140, outputting the superimposed pixel data.

[0102] Based on the same inventive concept, the embodiment of the present application also provides a video superposition device for implementing the video superposition method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more video superposition device embodiments provided below can refer to the limitations on the video superposition method above, and will not be repeated here.

[0103] In one embodiment, Fig.12 As shown, a video overlay device is provided, including: an acquisition module 121, a calculation module 122 and a generation module 123, wherein:

[0104] The acquisition module 121 is used to divide the acquired initial display memory unit to obtain a superimposed information carrier and an image display carrier; wherein the image display carrier includes at least one sub-display area;

[0105] The calculation module 122 is used to evenly divide the overlay information carrier based on the number of sub-display areas to obtain sub-overlay information carriers corresponding to the sub-display areas, and divide the sub-overlay information carriers according to a preset method to obtain at least one sub-overlay layer, wherein the sub-overlay layer is used to be superimposed in the corresponding sub-display area to display the preset overlay information;

[0106] The generation module 123 is used to enable the corresponding target enabling unit in the initial enabling unit of the sub-display area based on the sub-overlay layer, and fuse and superimpose the corresponding sub-overlay layer with the data displayed in the sub-display area at the same position based on the enabling status of the initial enabling unit in each sub-display area through a preset programming chip to obtain a video overlay result.

[0107] The acquisition module 121 is used to divide the acquired initial video memory unit to obtain an overlay information carrier and an image display carrier, wherein the image display carrier includes a plurality of sub-display areas; the calculation module 122 is used to evenly divide the overlay information carrier based on the number of sub-display areas to obtain sub-overlay information carriers corresponding to the sub-display areas, and divide according to the sub-overlay information carriers to obtain at least one layer of sub-overlay layers; the generation module 123 enables the corresponding target enabling unit in the initial enabling unit of the sub-display area based on the sub-overlay layers, and fuses and superimposes the corresponding sub-overlay layers with the data displayed in the sub-display area at the same position based on the enabling status of the initial enabling unit in each sub-display area through the programming chip to obtain a video overlay result.

[0108] Each module in the above video overlay device can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0109] In some embodiments, a video overlay system is provided, including a display module, a programming chip, and a display; the programming chip is connected to the display module and the display respectively;

[0110] The display module is used to divide the acquired initial display memory unit to obtain an overlay information carrier and an image display carrier; wherein the image display carrier includes at least one sub-display area; based on the number of sub-display areas, the overlay information carrier is evenly divided to obtain sub-overlay information carriers corresponding to the sub-display areas, and the sub-overlay information carriers are divided according to a preset to obtain at least one layer of sub-overlay layers, wherein the sub-overlay layers are used to be superimposed in the corresponding sub-display area to display the preset overlay information; based on the sub-overlay layers, the corresponding target enabling units in the initial enabling units of the sub-display area are enabled;

[0111] The programming chip is used to fuse and overlay the corresponding sub-overlay layer with the data displayed in the sub-display area at the same position based on the enabling status of the initial enabling unit in each sub-display area to obtain a video overlay result;

[0112] The display is used to display the video overlay result.

[0113] In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as follows: Fig.13 As shown. The computer device includes a processor, a memory and a network interface connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store video overlay algorithm data. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a video overlay method is implemented.

[0114] Those skilled in the art will understand that Fig.13 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0115] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties.

[0116] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.

[0117] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0118] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A video overlay method, It is characterized in that The method comprises: Dividing the acquired initial display memory unit to obtain a superimposed information carrier and an image display carrier; wherein the image display carrier includes at least one sub-display area; Based on the number of the sub-display areas, the overlay information carrier is evenly divided with the memory pixels in the overlay information carrier as the unit to obtain sub-overlay information carriers corresponding to the pixels in the sub-display area, and the sub-overlay information carriers are divided according to a preset overlay information working state to obtain at least one sub-overlay layer, wherein the sub-overlay layer is used to be superimposed in the corresponding sub-display area to display the preset overlay information; the overlay information working state represents that the preset overlay information is set in different sub-overlay layers for display; wherein, based on the number of the sub-display areas, the overlay information carrier is evenly divided with the memory pixels in the overlay information carrier as the unit to obtain sub-overlay information carriers corresponding to the pixels in the sub-display area, including: based on the number of the sub-display areas, each of the memory pixels is evenly divided to obtain at least one sub-memory pixel through each of the memory pixels, wherein the sub-memory pixels correspond point-to-point to the corresponding positions of the sub-display areas; Based on the sub-overlay layer, the corresponding target enabling unit in the initial enabling unit of the sub-display area is enabled, and based on the enabling status of the initial enabling unit in each sub-display area, the corresponding sub-overlay layer is fused and superimposed with the data displayed in the sub-display area at the same position through a preset programming chip to obtain a video superposition result; wherein, the initial enabling unit includes a mode configuration register, and each of the mode configuration registers corresponds one-to-one to the sub-overlay layer corresponding to the sub-display area.

2. The method according to claim 1, It is characterized in that The sub-overlay information carrier is divided according to the preset overlay information working state to obtain at least one sub-overlay layer, including: The sub-overlay information carrier corresponding to each pixel in the sub-display area is divided according to the overlay information working state, wherein the size of the sub-overlay information carrier is the same as the maximum value of the size of the corresponding sub-overlay layer.

3. The method according to claim 1, It is characterized in that The sub-overlay layer includes at least one of the following types: a static sub-overlay layer and a dynamic sub-overlay layer, wherein the static sub-overlay layer is used to display static data, and the dynamic sub-overlay layer is used to display dynamic data.

4. The method according to claim 1, It is characterized in that The initial enabling unit includes an enabling register, a mode configuration register and a color configuration register; each enabling register corresponds to each mode configuration register one by one, and each mode configuration register corresponds to at least one color configuration register; based on the sub-overlay layer, the corresponding target enabling unit in the initial enabling unit of the sub-display area is enabled, and the corresponding sub-overlay layer is fused and superimposed with the data displayed in the sub-display area at the same position based on the enabling status of the initial enabling unit in each sub-display area through a preset programming chip, to obtain a video superposition result, including: According to the division of the sub-overlay layers, enabling the corresponding mode configuration register through the enable register; Based on the preset business task, the corresponding color configuration register is selected through the mode configuration register, and an enabling process is performed to convert the dot matrix information of the corresponding sub-overlay layer into color index dot matrix information implemented based on the color configuration register; Based on the enabling condition, the programming chip fuses and superimposes the color index dot matrix information corresponding to the sub-overlay layer with the data displayed in the sub-display area at the same position to obtain the video superposition result.

5. The method according to claim 4, It is characterized in that The method of selecting the corresponding color configuration register through the mode configuration register based on the preset business task, and completing the color setting of the corresponding sub-overlay layer through the color configuration register, includes: The color configuration register corresponding to each sub-overlay layer is determined based on the size of each sub-overlay layer; wherein the number of the color configuration registers corresponding to the sub-overlay layer that need to be enabled is 2 n -1, the maximum number of color types on the sub-overlay layer is 2 n -1, wherein n is the size of the corresponding sub-overlay layer, and n is an integer.

6. The method according to claim 1, It is characterized in that The step of fusing and superimposing the corresponding sub-overlay layer with the data displayed in the sub-display area at the same position to obtain a video superposition result includes: In order from high bit to low bit, the data in all the sub-overlay layers are fused and overlaid point by point with the data displayed in the sub-display area; wherein the number of the sub-overlay layers is less than or equal to eight layers; Generate the next moment sub-overlay layer data based on the preset business task, and compare the next moment sub-overlay layer data with the current sub-overlay layer data at the current moment. If the comparison result is detected to be data inconsistency, update the data in the sub-overlay layer based on the next moment sub-overlay layer data.

7. The method according to claim 1, It is characterized in that The method further comprises: The data in the overlay information carrier and the data in the image display carrier are separated and transmitted to the programming chip through a preset display module, wherein the same frame of video data to be transmitted and the corresponding overlay information are transmitted alternately through the overlay information carrier and the image display carrier; and the image display carrier is format converted through the display module.

8. A video overlay device, It is characterized in that The device comprises: An acquisition module, used for dividing the acquired initial display memory unit to obtain a superimposed information carrier and an image display carrier; wherein the image display carrier includes at least one sub-display area; A calculation module, configured to divide the superimposed information carrier evenly based on the number of the sub-display areas and using the video memory pixels in the superimposed information carrier as a unit to obtain sub-superimposed information carriers corresponding to the pixels in the sub-display areas, and divide the sub-superimposed information carriers according to a preset superimposed information working state to obtain at least one sub-superimposed layer, wherein the sub-superimposed layer is used to be superimposed in the corresponding sub-display area to display the preset superimposed information; the superimposed information working state represents that the preset superimposed information is set in different sub-superimposed layers for display; wherein, based on the number of the sub-display areas and using the video memory pixels in the superimposed information carrier as a unit, dividing the superimposed information carrier evenly based on the number of the sub-display areas and using the video memory pixels in the superimposed information carrier as a unit to obtain sub-superimposed information carriers corresponding to the pixels in the sub-display areas comprises: evenly dividing each of the video memory pixels based on the number of the sub-display areas, obtaining at least one sub-video memory pixel through each of the video memory pixels, wherein the sub-video memory pixels correspond point-to-point to the corresponding positions of the sub-display areas; A generation module is used to enable the corresponding target enabling unit in the initial enabling unit of the sub-display area based on the sub-overlay layer, and fuse and superimpose the corresponding sub-overlay layer with the data displayed in the sub-display area at the same position based on the enabling status of the initial enabling unit in each sub-display area through a preset programming chip to obtain a video superposition result; wherein the initial enabling unit includes a mode configuration register, and each of the mode configuration registers corresponds one-to-one to the sub-overlay layer corresponding to the sub-display area.

9. A video overlay system, It is characterized in that The system includes a display module, a programming chip and a display; the programming chip is connected to the display module and the display respectively; The display module is used to divide the acquired initial video memory unit to obtain an overlay information carrier and an image display carrier; wherein the image display carrier includes at least one sub-display area; based on the number of the sub-display areas, the overlay information carrier is evenly divided with the video memory pixels in the overlay information carrier as the unit to obtain sub-overlay information carriers corresponding to the pixels in the sub-display area, and the sub-overlay information carriers are divided according to a preset overlay information working state to obtain at least one layer of sub-overlay layers, wherein the sub-overlay layers are used to be superimposed in the corresponding sub-display area to display the preset overlay information; the overlay information working state represents The preset overlay information is set to be displayed in different sub-overlay layers; based on the sub-overlay layers, the corresponding target enabling unit in the initial enabling unit of the sub-display area is enabled; wherein, based on the number of the sub-display areas, the overlay information carrier is evenly divided with the memory pixel in the overlay information carrier as a unit to obtain the sub-overlay information carrier corresponding to the pixel in the sub-display area, including: based on the number of the sub-display areas, each of the memory pixels is evenly divided, and at least one sub-memory pixel is obtained through each of the memory pixels, wherein the sub-memory pixels correspond point-to-point to the corresponding positions of the sub-display areas; The programming chip is used to fuse and superimpose the corresponding sub-overlay layer with the data displayed in the sub-display area at the same position based on the enabling status of the initial enabling unit in each sub-display area to obtain a video superposition result; wherein the initial enabling unit includes a mode configuration register, and each mode configuration register corresponds to the sub-overlay layer corresponding to the sub-display area one by one; The display is used to display the video superposition result.

Images