Compensation devices and methods, equipment, storage media and program products
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- BOE TECHNOLOGY GROUP CO LTD
- Filing Date
- 2024-11-27
- Publication Date
- 2026-07-31
AI Technical Summary
Image retention issues in spliced displays severely impact the user's visual experience. Existing technologies that compensate for this by estimating the display's temperature characteristics are inaccurate, resulting in poor compensation effects.
By acquiring the temperature of each unit screen of the splicing display in real time, real-time compensation is performed based on the temperature-chromaticity characteristic model and the spatiotemporal model to generate compensation image frames to eliminate afterimages.
It improves the uniformity of display and user experience of the splicing display screen, reduces image retention, and enhances the stability and accuracy of the display effect.
Smart Images

Figure CN122497992A_ABST
Abstract
Description
Compensation devices and methods, equipment, storage media and program products Technical Field
[0001] Embodiments of this disclosure relate to a compensation device and method, apparatus, storage medium, and program product. Background Technology
[0002] With advancements in display technology and growing market demand, video wall displays have become widely used. Composed of multiple independent display units (unit screens), video wall displays can achieve ultra-large display effects. However, image retention remains a significant technical challenge. Image retention refers to the temporary "trace" left by an image on the display screen, severely impacting the user's visual experience. This issue may stem from inconsistent pixel response speeds due to hardware physical characteristics, or from pixel luminous efficiency degradation caused by prolonged display of static images. To mitigate this problem, compensation methods are needed to adjust and balance the brightness performance of each pixel, thereby extending the display's lifespan and optimizing image quality. Summary of the Invention
[0003] At least one embodiment of this disclosure provides a compensation device configured to perform real-time compensation on a first image frame of a plurality of image frames to be displayed on a unit screen based on the temperature of each unit screen in a plurality of unit screens constituting a splicing display screen, to obtain a compensated first image frame, wherein the first compensated image frame is used to drive the unit screen to present the first image frame.
[0004] For example, in at least one embodiment of the compensation device provided in this disclosure, there are: a first compensation value acquisition module, configured to acquire a first compensation value of the unit screen based on the temperature-chromaticity characteristic model of the unit screen; and a second compensation map acquisition module, configured to acquire a second compensation map of the unit screen based on a time domain model and / or a spatial domain model, wherein the time domain model reflects the influence of historical images on the temperature of the unit screen, and the spatial domain model reflects the heat diffusion law inside the unit screen.
[0005] For example, in at least one embodiment of the compensation device provided in this disclosure, there is further: a real-time compensation map acquisition module, configured to obtain a real-time compensation map of the unit screen based on the first compensation value and the second compensation map; and a compensation calculation module, configured to compensate the first image frame based on the real-time compensation map to obtain the first compensated image frame.
[0006] For example, in the compensation device provided in at least one embodiment of this disclosure, the first compensation value acquisition module includes: a temperature acquisition unit configured to acquire the temperature of the unit screen; a chromaticity acquisition unit configured to acquire the chromaticity of the unit screen based on the temperature of the unit screen and the temperature-chromaticity characteristic model of the unit screen; and a first compensation value acquisition unit configured to acquire a first compensation value of the unit screen based on the difference between the chromaticity of the unit screen and a reference chromaticity, wherein the reference chromaticity is the highest chromaticity among the chromaticities of the plurality of unit screens.
[0007] For example, in the compensation device provided in at least one embodiment of this disclosure, the first compensation value acquisition unit is further configured to multiply the difference by a preset compensation coefficient to obtain the first compensation value of the unit screen.
[0008] For example, in the compensation device provided in at least one embodiment of this disclosure, the temperature-color characteristic model of the unit screen is obtained through the following steps: repeatedly acquiring the temperature and color at different times during the process from the time the unit screen is turned on to the time when the temperature fluctuation value reaches a preset range when displaying a full white screen; and constructing the temperature-color characteristic model of the unit screen based on the temperature and color at the different times.
[0009] For example, in the compensation device provided in at least one embodiment of this disclosure, the second compensation map acquisition module includes: a predicted temperature image acquisition unit, configured to acquire the current predicted temperature image of the unit screen based on the historical image; and a second compensation map acquisition unit, configured to obtain the second compensation map based on the predicted temperature image and the spatial domain model.
[0010] For example, in the compensation device provided in at least one embodiment of this disclosure, the predicted temperature image acquisition unit is further configured to: obtain the current predicted temperature image of the unit screen based on the time window weight and the historical heat time accumulation information of the unit screen recorded by the historical image, wherein the time window weight is used to describe the weight coefficient of the influence of the historical image in the current time window on the temperature of the unit screen.
[0011] For example, in the compensation apparatus provided in at least one embodiment of this disclosure, the predicted temperature image acquisition unit is further configured to: use the time window weight to perform weighted fusion on a first number of historical images accumulated in the cache pool to obtain a heat time accumulation image; and convert the heat time accumulation image into a predicted temperature image based on the mapping relationship between the heat time accumulation image and temperature.
[0012] For example, in the compensation apparatus provided in at least one embodiment of this disclosure, the predicted temperature image acquisition unit is further configured to: after obtaining the current predicted temperature image of the unit screen, update the cache pool based on the first image frame to obtain a heat time accumulation image corresponding to at least another image frame after the first image frame.
[0013] For example, in the compensation device provided in at least one embodiment of this disclosure, the predicted temperature image acquisition unit is further configured to: perform grayscale processing on the first image frame to obtain a first grayscale image corresponding to the first image frame; add the first grayscale image corresponding to the first image frame to the cache pool, and in response to the fact that the number of historical images in the cache pool has reached a preset number threshold before adding the first grayscale image corresponding to the first image frame, remove the historical image frame furthest from the current time in the cache pool.
[0014] For example, in the compensation device provided in at least one embodiment of this disclosure, the time window weight is obtained through the following steps: obtaining the temperature rise curve from the time the unit screen displays a full white image until the temperature fluctuation value reaches a preset range; and obtaining the time window weight based on the temperature rise curve.
[0015] For example, in the compensation device provided in at least one embodiment of this disclosure, the predicted temperature image acquisition unit is further configured to: perform grayscale processing on the first image frame to obtain a first grayscale image corresponding to the first image frame; and calculate the current heat time accumulation image of the unit screen based on the following formula: in, For the current time-accumulated heat image, For the current thermal time-accumulated image, it is the thermal time-accumulated image of the previous frame. The first grayscale image corresponds to the first image frame. α controls the magnitude of temperature change, and β controls the rate of temperature change. Based on the mapping relationship between the heat time-accumulation image and temperature, the heat time-accumulation image is converted into the predicted temperature image.
[0016] For example, in the compensation device provided in at least one embodiment of this disclosure, the second compensation map acquisition unit is further configured to: perform intra-screen diffusion filtering on the predicted temperature image to obtain the second compensation map.
[0017] For example, in the compensation device provided in at least one embodiment of this disclosure, the real-time compensation map acquisition module is further configured to: normalize the second compensation map and multiply it by the first compensation value to obtain the real-time compensation map of the unit screen.
[0018] For example, in the compensation device provided in at least one embodiment of this disclosure, the compensation calculation module is further configured to perform pixel-level subtraction operations between the three color channel components of the first image frame and the weighted real-time compensation map based on the following formula: I C_R =I R -C R ×C w I C_G =I G -C G ×C w I C_B =I B -C B ×C w
[0019] Among them, C w For the real-time compensation diagram, I R I G I B These are the values of the three color channel components in the first image frame, I. C_R I C_G I C_B The values of C after compensation for the three color channel components are respectively. R C G C B These are the compensation coefficients corresponding to the three color channel components, I. C_R I C_G and I C_B The first compensated image frame is obtained after integration.
[0020] For example, in at least one embodiment of the compensation device provided in this disclosure, the compensation device includes: a real-time compensation value acquisition module, configured to obtain a real-time compensation value of the unit screen based on the current temperature of the unit screen; and a compensation calculation module, configured to compensate the first image frame based on the real-time compensation value to obtain the first compensated image frame.
[0021] For example, in the compensation device provided in at least one embodiment of this disclosure, the real-time compensation value acquisition module is further configured to obtain the real-time compensation value of the unit screen based on the following formula: real-time compensation value = (1 - Norm (current temperature)) × preset compensation coefficient, where Norm represents normalization operation.
[0022] For example, in the compensation device provided in at least one embodiment of this disclosure, the real-time compensation value acquisition module is further configured to obtain the real-time compensation value of the unit screen based on the following formula: real-time compensation value = Conv(1-Norm(current temperature-initial temperature)×preset compensation coefficient), where Conv represents filtering operation, Norm represents normalization operation, and the initial temperature represents the temperature of the unit screen when it is not lit.
[0023] At least one embodiment of this disclosure provides a display device, which includes a display controller that includes the compensation device provided in at least one embodiment of this disclosure.
[0024] For example, in a display device provided in at least one embodiment of this disclosure, the display controller further includes: a data buffer configured to temporarily store the plurality of externally input image frames for provision to the compensation device; a parameter storage device configured to store compensation parameters of the compensation device; and a logic control device configured to control the operation of the compensation device.
[0025] For example, in at least one embodiment of the display device provided in this disclosure, the display device further includes the splicing display screen.
[0026] At least one embodiment of this disclosure provides a compensation method, which includes: for each of a plurality of unit screens constituting a splicing display screen, performing real-time compensation on a first image frame of a plurality of image frames to be displayed on the unit screen based on the temperature of the unit screen, to obtain a compensated first image frame, wherein the first compensated image frame is used to drive the unit screen to present the first image frame.
[0027] For example, in at least one embodiment of the compensation method provided in this disclosure, the step of real-time compensation of a first image frame among multiple image frames to be displayed on the unit screen based on the temperature of the unit screen to obtain a compensated first image frame includes: obtaining a first compensation value of the unit screen based on a temperature-chromaticity characteristic model of the unit screen; obtaining a second compensation map of the unit screen based on a temporal model and a spatial model, wherein the temporal model reflects the influence of historical images on the temperature of the unit screen, and the spatial model reflects the heat diffusion law within the unit screen;
[0028] For example, in the compensation method provided in at least one embodiment of this disclosure, the step of performing real-time compensation on a first image frame among a plurality of image frames to be displayed on the unit screen based on the temperature of the unit screen to obtain a compensated first image frame further includes: obtaining a real-time compensation value of the unit screen based on the first compensation value and the second compensation map; and compensating the first image frame based on the real-time compensation value to obtain the first compensated image frame.
[0029] For example, in the compensation method provided in at least one embodiment of this disclosure, the step of real-time compensation of a first image frame among a plurality of image frames to be displayed on the unit screen based on the temperature of the unit screen to obtain a compensated first image frame includes: obtaining a real-time compensation value of the unit screen based on the current temperature of the unit screen; and compensating the first image frame based on the real-time compensation value to obtain the first compensated image frame.
[0030] At least one embodiment of this disclosure provides an electronic device, the electronic device comprising: at least one processor; at least one memory including one or more computer program modules; wherein the one or more computer program modules are stored in the at least one memory and configured to be executed by the at least one processor, the one or more computer program modules being used to implement the compensation method provided in at least one embodiment of this disclosure.
[0031] At least one embodiment of this disclosure provides a non-transitory readable storage medium having computer instructions stored thereon, wherein the computer instructions, when executed by at least one processor, implement the compensation method provided in at least one embodiment of this disclosure.
[0032] At least one embodiment of this disclosure provides a computer program product, including computer instructions, wherein the computer instructions, when executed by at least one processor, perform the compensation method provided in at least one embodiment of this disclosure. Attached Figure Description
[0033] To more clearly illustrate the technical solutions of the embodiments of this disclosure, the accompanying drawings of the embodiments will be briefly described below. Obviously, the drawings described below only relate to some embodiments of this disclosure and are not intended to limit this disclosure.
[0034] Figure 1A is a schematic block diagram of a compensation device provided in at least one embodiment of the present disclosure;
[0035] Figures 1B to 1D are schematic diagrams of the compensation device performing compensation operation according to at least one embodiment of the present disclosure;
[0036] Figure 2A is a schematic block diagram of another compensation device provided in at least one embodiment of the present disclosure;
[0037] Figure 2B is a schematic diagram of the unit screen temperature-chromaticity curve provided in at least one embodiment of the present disclosure;
[0038] Figure 2C is a schematic diagram of the temperature-colorimetric characteristic fitting results of multiple unit screens provided in at least one embodiment of this disclosure;
[0039] Figure 2D is a schematic diagram of a time-cumulative image of heat acquisition provided in at least one embodiment of the present disclosure;
[0040] Figure 2E is a schematic diagram of intra-screen diffusion filtering provided in at least one embodiment of the present disclosure;
[0041] Figure 3 is a schematic block diagram of a display device provided in at least one embodiment of the present disclosure;
[0042] Figure 4 is a schematic block diagram of a display controller provided in at least one embodiment of the present disclosure;
[0043] Figure 5 is a flowchart of a compensation method provided in at least one embodiment of this disclosure;
[0044] Figure 6 is a flowchart of a compensation method provided in at least one embodiment of the present disclosure;
[0045] Figure 7 is a flowchart of a compensation method provided in at least one embodiment of the present disclosure;
[0046] Figure 8 is a schematic block diagram of an electronic device provided in at least one embodiment of the present disclosure;
[0047] Figure 9 is a schematic block diagram of another electronic device provided in at least one embodiment of the present disclosure;
[0048] Figure 10 is a schematic block diagram of a non-transiently readable storage medium provided in at least one embodiment of the present disclosure. Detailed Implementation
[0049] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this disclosure. All other embodiments obtained by those skilled in the art based on the described embodiments of this disclosure without creative effort are within the scope of protection of this disclosure.
[0050] Unless otherwise defined, the technical or scientific terms used in this disclosure shall have the ordinary meaning understood by one of ordinary skill in the art to which this disclosure pertains. The terms “first,” “second,” and similar terms used in this disclosure do not indicate any order, quantity, or importance, but are merely used to distinguish different components. Terms such as “comprising” or “including” mean that the element or object preceding the word encompasses the elements or objects listed following the word and their equivalents, without excluding other elements or objects. Terms such as “connected” or “linked” are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. Terms such as “upper,” “lower,” “left,” and “right” are used only to indicate relative positional relationships, and these relative positional relationships may change accordingly when the absolute position of the described objects changes.
[0051] The present disclosure will now be described through several specific embodiments. To keep the following description of the embodiments of the present disclosure clear and concise, detailed descriptions of known functions and known components may be omitted. When any component of an embodiment of the present disclosure appears in more than one drawing, that component is represented by the same or similar reference numerals in each drawing.
[0052] With the advancement of display technology and the growth of market demand, video wall displays have been widely used. A video wall display is composed of multiple independent display units (unit screens) spliced together, enabling ultra-large display effects. Examples of video wall displays include light-emitting diode (LED) video wall displays, organic light-emitting diode (OLED) self-illuminating liquid crystal video wall displays, and digital light processing (DLP) rear-projection video wall displays, among others.
[0053] LED splicing displays include micro-LED (MLED) and other splicing screens with high pixel density, high brightness, high contrast and low power consumption. Micro-LED (MLED) technology is an emerging display technology. MLED displays are composed of a high pixel density two-dimensional MLED array. Each pixel can be addressed, controlled and driven to emit light independently, with the advantages of high brightness, high contrast and low energy consumption.
[0054] OLED self-illuminating LCD video walls use OLED technology, which has the characteristic of self-illumination and can be bent within a certain curvature, making them suitable for occasions that require flexible displays.
[0055] DLP rear projection video walls use DLP projection technology to display images through a projector. They have high brightness and contrast, but are relatively thick, making them suitable for occasions that require a large screen.
[0056] However, image retention in video wall displays remains a significant technical challenge. Image retention refers to the temporary "trace" of an image left on the display screen, a problem that severely impacts the user's visual experience. This issue may stem from inconsistent pixel response times due to the hardware physical characteristics of the video wall display, or from the degradation of pixel luminous efficiency caused by displaying static images for extended periods.
[0057] The inventors of this disclosure have noted that one of the fundamental reasons for image retention on a display screen is that the light-emitting elements of the three colors (RGB) of the display screen generate heat after being lit. For example, the luminous efficiency of the red light-emitting element will decrease significantly due to the increase in temperature, which in turn affects its brightness and color performance.
[0058] Specifically, during operation, when different grayscale levels are displayed in different areas of the screen, the luminous efficiency of the light-emitting elements varies due to varying heat accumulation in different areas. For example, the luminous efficiency decreases in areas with high heat accumulation, while it remains high in areas with low heat accumulation. After displaying an image for an extended period, switching the entire screen to the same grayscale level can easily result in image retention in areas with high heat accumulation and low luminous efficiency. Ultimately, this leads to uneven display quality when the entire screen switches to the same grayscale, negatively impacting the user experience.
[0059] The inventors of this disclosure have noted that some methods rely on the prior knowledge that images with different gray levels and brightness levels will result in different display screen temperatures. They estimate the current display screen temperature using historical accumulated images and display screen temperature characteristics, then extrapolate the display screen brightness based on the estimated temperature, and compensate for image retention based on the brightness difference. However, these methods are based on estimations, which may differ from the actual display screen temperature characteristics, leading to inaccurate estimations and ultimately affecting the compensation effect.
[0060] At least one embodiment of this disclosure provides a compensation device configured to perform real-time compensation on a first image frame among a plurality of image frames to be displayed on a unit screen based on the temperature of each unit screen in a splicing display screen, thereby obtaining a compensated first image frame, which is used to drive the unit screen to present the first image frame.
[0061] In the compensation device provided in at least one embodiment of this disclosure, the image corresponding to each unit screen is compensated in real time based on the measured temperature of the unit screen. This avoids the inaccuracies caused by temperature estimation and helps to adjust the color of the image in the area with high luminous efficiency of the light-emitting element in the splicing display to be consistent with the color of the area with low luminous efficiency, thereby eliminating image retention. Even after the splicing display has displayed a certain image for a long time, when the entire splicing display is switched to the same grayscale display, the uniformity of the displayed image can still be ensured, improving the display effect and user experience.
[0062] In the embodiments of this disclosure, the light-emitting element in the display screen can be, for example, a mini-LED, a micro-LED, or an LED. This disclosure does not limit the specific circuit structure (e.g., the connection method and number of transistors and capacitors), the manufacturing materials (e.g., gallium nitride), the manufacturing process (e.g., semiconductor manufacturing process), or the packaging method of these LEDs.
[0063] The compensation device provided in the present disclosure is described in a non-limiting manner through multiple embodiments and examples. As described below, different features in these specific examples or embodiments can be combined with each other without conflict to obtain new examples or embodiments, and these new examples or embodiments also fall within the scope of protection of this disclosure.
[0064] The compensation device and method provided in at least one embodiment of this disclosure can be applied to various types of displays that can be intervened and adjusted by pixel compensation methods to adjust the light emission operation of different areas of the display screen to eliminate afterimages. These displays include, but are not limited to, MLED displays, such as splicing displays that include multiple MLED displays. The embodiments of this disclosure do not limit this.
[0065] At least one embodiment of this disclosure provides a compensation device. This compensation device can be used in a display device including a video wall display screen, which receives and displays image pixel data based on the image pixel data. During the display process, the screen can display dynamic images (e.g., videos) or static images (e.g., photographs), and refreshes the display of image frames during the display process; these image frames can be color image frames or black-and-white image frames.
[0066] For example, the compensation device is configured to perform real-time compensation on a first image frame among multiple image frames to be displayed on a unit screen based on the temperature of each unit screen in a multi-unit display screen, to obtain a compensated first image frame, which is then used to drive the unit screen to present the first image frame.
[0067] For example, the first image frames corresponding to each unit screen are combined to form the complete image frame that will be displayed on the splicing display screen. That is, the complete image frame will be divided into multiple parts according to the number and arrangement of the unit screens, and each unit screen will display one part, namely the first image frame.
[0068] For example, the multiple image frames shown above can be a segment of multiple complete image frames that are displayed consecutively in a video, or a segment of multiple complete image frames that are displayed repeatedly to realize a static image; here, "first image frame" is used to refer to the image frame that is the current object of description (rather than being the first image frame in time order of the multiple image frames), and it can be any of the multiple image frames mentioned above.
[0069] For example, based on the temperature of a single screen, the compensation value that needs to be increased or decreased for each pixel in the first image frame can be obtained. By processing the original first image frame pixel-by-pixel based on these compensation values, a first compensated image frame can be generated. Thus, compensation can be applied to the first image frame corresponding to each single screen, thereby achieving compensation for the complete image frame corresponding to the spliced display screen.
[0070] Figure 1A is a schematic block diagram of a compensation device provided in at least one embodiment of the present disclosure.
[0071] For example, as shown in Figure 1A, the compensation device 100 includes a real-time compensation value acquisition module 101 and a compensation calculation module 102.
[0072] For example, in at least one embodiment of this disclosure, the compensation device 100 further includes a temperature acquisition module configured to acquire the current temperature of the unit screen.
[0073] For example, the temperature of a single screen can be acquired by a temperature sensor and transmitted to a temperature acquisition module. For instance, a temperature sensor can be installed for each single screen, either within the back structure of the single screen or inside the single screen itself.
[0074] For example, in at least one embodiment of this disclosure, the real-time compensation value acquisition module 101 is configured to obtain the real-time compensation value of a unit screen based on the current temperature.
[0075] For example, the current temperature of a unit screen measured by a temperature sensor can be processed to obtain the real-time compensation value for the unit screen.
[0076] For example, in at least one embodiment of this disclosure, the real-time compensation value acquisition module 101 is further configured to obtain the real-time compensation value of the unit screen based on the following formula: Real-time compensation value = (1 - Norm (current temperature)) × preset compensation coefficient
[0077] Norm represents the normalization operation.
[0078] For example, the current temperature of all unit screens can be normalized to a fixed range, such as between 0 and 1. For example, a preset compensation coefficient can be used to adjust the compensation effect; its specific value can be set according to actual needs, and this disclosure does not impose any restrictions on it.
[0079] For example, in at least one embodiment of this disclosure, the compensation calculation module 102 is configured to compensate the first image frame based on the real-time compensation value to obtain the first compensated image frame.
[0080] For example, for each unit screen, the real-time compensation value is a single numerical value. This real-time compensation value can be copied and expanded to the size of the unit screen to generate a real-time compensation map. The size of this real-time compensation map is the same as the size of the unit screen and the first image frame, where the value of each pixel is the aforementioned real-time compensation value. The real-time compensation map can then be applied to the first image frame for real-time compensation.
[0081] For example, after obtaining the real-time compensation image, compensation processing can be performed on the first image frame. The calculation method involves subtracting the weighted real-time compensation image from the three color channel components of the first image frame at the pixel level. The compensation coefficients for the three independent color channels of the RGB primary colors are not the same. The specific calculation formulas for each channel after compensation are as follows: I C_R =I R -C R ×C w I C_G =I G -C G ×C w I C_B =I B -C B ×C w
[0082] Among them, C w For real-time compensation diagrams, I R I G I B These are the values of the RGB three channels in the first image frame, I C_R I C_G I C_B These are the values after compensation for the RGB three channels, C R C G C B These are the compensation coefficients for the three RGB channels, and the compensated RGB three-channel values I are... C_R I C_G and I C_B The images are integrated into a single image, which serves as the output of the final compensation process for the current first image frame, i.e., the first compensated image frame. It should be noted that the compensation coefficients for each color channel are set according to actual needs, and this embodiment does not impose any limitations on this.
[0083] Of course, to save storage space and improve processing efficiency, the copying and expansion of the real-time compensation value can be omitted, and the pixel value of each color channel in the first image frame can be directly subtracted from the weighted real-time compensation value. This disclosure does not limit this approach.
[0084] For example, in at least one embodiment of this disclosure, the temperature acquisition module is further configured to acquire the initial temperature of the unit screen when it is not lit. Correspondingly, the real-time compensation value acquisition module is further configured to obtain the real-time compensation value of the unit screen based on the following formula: Real-time compensation value = Conv(1 - Norm(current temperature - initial temperature) × preset compensation coefficient)
[0085] Here, Conv represents the filtering operation, and Norm represents the normalization operation.
[0086] Filtering operations can smooth the transition in a video wall display, preventing uneven display transitions between adjacent unit screens. For example, the filtering operation can be a 3×3 filter, but this embodiment does not limit the scope of the present disclosure.
[0087] Furthermore, different ambient temperatures can cause inconsistent screen temperature changes under the same usage conditions. For example, even if the same image is displayed for the same amount of time, the final screen temperature will differ depending on the ambient temperature. The formula described above allows for the calculation of a real-time compensation value based on the difference between the current and initial temperatures, thus avoiding inconsistencies in compensation.
[0088] For example, a preset compensation coefficient is used to adjust the compensation effect, and its specific value can be set according to actual needs. This disclosure does not impose any restrictions on this.
[0089] It should be noted that these temperature acquisition modules, real-time compensation value acquisition modules, and compensation calculation modules can be implemented by software, hardware, firmware, or any combination thereof. For example, they can be implemented as time-temperature acquisition circuits, real-time compensation value acquisition circuits, and compensation calculation circuits, respectively. The embodiments of this disclosure do not limit their specific implementation methods.
[0090] Figures 1B to 1D are specific examples of compensation operations performed by the compensation device provided in at least one embodiment of this disclosure.
[0091] For example, as shown in Figure 1B, the video wall display consists of 4×6 unit screens. When the entire screen is illuminated with a black circle in the center surrounded by white, after a period of time, the display switches to full white, resulting in an afterimage. It should be noted that the dashed lines in Figure 1B are only used to indicate the boundaries between unit screens to facilitate understanding of the layout of the unit screens within the video wall display; these dashed lines will not appear during actual display.
[0092] The current temperature of all unit screens acquired by the temperature acquisition module is shown in Figure 1C. In the table in Figure 1C (and Figure 1D below), each square corresponds to one unit screen. It can be seen that the temperature in the central area is lower, while the temperature around the perimeter is higher. Since the lower the temperature, the higher the brightness when displaying a white image on the entire screen, and the more compensation value is required, a real-time compensation value can be obtained based on the current temperature.
[0093] The real-time compensation value acquisition module normalizes and inverts the current temperature, then multiplies it by the preset compensation coefficient to obtain the real-time compensation value per unit screen, as shown in Figure 1D.
[0094] The compensation calculation module can compensate the first image frame corresponding to each unit screen based on the real-time compensation value corresponding to each unit screen, and obtain the first compensated image frame corresponding to each unit screen.
[0095] The compensation device provided in at least one embodiment of this disclosure, by acquiring the current temperature of the unit screen in real time, can more accurately reflect the temperature changes of the unit screen under actual working conditions, thereby providing more reliable data support for image compensation. Compared with the method of estimating temperature through historical image data, this method not only simplifies the operation process but also improves real-time performance and accuracy.
[0096] The inventors of this disclosure also noted that a video wall display requires multiple consistency calibrations before being put into normal use to ensure that the multiple unit screens within the display can accurately and consistently display the corresponding colors. However, consistency calibration requires illuminating the entire screen with patterns of the same grayscale, and then using chromaticity and brightness data from images captured by a camera to perform uniformity compensation on the pixels of the display. This process often takes several hours. Prolonged consistency calibration can lead to differences in the temperature-chromaticity characteristics of different unit screens, thus affecting the accuracy of image retention compensation.
[0097] Specifically, video wall displays are typically placed vertically to the ground, resulting in varying distances between individual screens at different heights and the ground. When the entire screen displays the same grayscale image, heat is conducted from the bottom to the top, causing the top of the screen to be hotter than the bottom. Simultaneously, the screens at the edges of the video wall have a larger contact area with the air, dissipating heat more quickly, and therefore their temperatures are usually lower than those of the screens in the center. During consistency calibration, the colorimetry of all screens is calibrated to be consistent, but the effect of temperature variations is not considered. That is, because the temperature of screens in different locations differs, even if colorimetry and brightness are calibrated to be consistent, the temperature-colorimetry characteristics of each screen still differ.
[0098] Figure 2A is a schematic block diagram of another compensation device provided in at least one embodiment of the present disclosure.
[0099] For example, as shown in Figure 2A, the compensation device 200 includes a first compensation value acquisition module 201, a second compensation map acquisition module 202, a real-time compensation map acquisition module 203, and a compensation calculation module 204.
[0100] For example, in at least one embodiment of this disclosure, the first compensation value acquisition module 201 is configured to acquire the first compensation value of the unit screen based on the temperature-colorimetric characteristic model of the unit screen.
[0101] Figure 2B is a schematic diagram of the unit screen temperature-chromaticity curve provided in at least one embodiment of the present disclosure.
[0102] For example, Figure 2B shows the temperature-chromaticity curves of the individual unit screens that make up the video wall display. The temperature-chromaticity characteristics of a unit screen describe its chromaticity performance at different temperatures. Furthermore, the temperature-chromaticity characteristics of different unit screens in a video wall display are not consistent.
[0103] For example, by establishing a temperature-colorimetric characteristic model of a unit screen through experimental data or theoretical analysis, the colorimetric properties of the unit screen at a certain temperature can be predicted.
[0104] For each unit screen, the first compensation value of the unit screen can be obtained based on the temperature-chromaticity characteristic model of the unit screen. The first image frame can be processed pixel by pixel based on the first compensation value. At this time, the compensation value of all pixels in the unit screen is consistent.
[0105] For example, in at least one embodiment of the present disclosure, the second compensation map acquisition module 202 is configured to acquire a second compensation map of a unit screen based on a temporal model and / or a spatial model, wherein the temporal model reflects the temperature influence of historical images on the unit screen, and the spatial model reflects the heat diffusion pattern inside the unit screen.
[0106] The aforementioned first compensation value is consistent for every pixel within a unit screen. However, since the illuminated patterns within a unit screen may differ, the temperatures of different pixels within the unit screen will also vary, leading to inconsistencies in color. Therefore, considering the effects of time and space is beneficial to improving the accuracy of the compensation value.
[0107] For example, time-domain models primarily focus on changes over time, specifically the temperature variation patterns of a unit screen over time. Historical images can include one or more image frames preceding the current first image frame, or images obtained after further processing (e.g., grayscale conversion). Historical images can also include grayscale images from a past period (e.g., 10 minutes, 20 minutes, or half an hour). Spatial-domain models primarily focus on spatial changes, specifically how to describe the heat distribution and diffusion patterns within a region.
[0108] For example, in at least one embodiment of the present disclosure, the real-time compensation map acquisition module 203 is configured to obtain a real-time compensation map of a unit screen based on a first compensation value and a second compensation map.
[0109] For example, in at least one embodiment of this disclosure, the real-time compensation map acquisition module 203 is further configured to normalize the second compensation map and multiply it by the first compensation value to obtain a real-time compensation map of a unit screen.
[0110] For example, to improve the accuracy of compensation value calculation, the second compensation image can be normalized by adjusting all pixel values to a fixed range, such as between 0 and 1. The value of each pixel in the normalized second compensation image is then multiplied by the previously obtained first compensation value to generate the final real-time compensation image. This step ensures that the real-time compensation value for each pixel incorporates temperature-chromaticity information and spatiotemporal information, taking into account not only the overall environmental influence but also local differences within the screen.
[0111] For example, in at least one embodiment of this disclosure, the compensation calculation module 204 is configured to compensate the first image frame based on the real-time compensation map to obtain the first compensated image frame.
[0112] The method for compensating the first image frame using a real-time compensation map can be found in the above embodiments and will not be repeated here.
[0113] It should be noted that these first compensation value acquisition module, second compensation map acquisition module, real-time compensation map acquisition module and compensation calculation module can be implemented by software, hardware, firmware or any combination thereof. For example, they can be implemented as a first compensation value acquisition circuit, a second compensation map acquisition circuit, a real-time compensation map acquisition circuit and a compensation calculation circuit, respectively. The embodiments of this disclosure do not limit their specific implementation methods.
[0114] In the compensation device provided in at least one embodiment of this disclosure, the first compensation value acquisition module 201 includes a temperature acquisition unit, a colorimetric acquisition unit, and a first compensation value acquisition unit.
[0115] For example, in at least one embodiment of this disclosure, the temperature acquisition unit is configured to acquire the temperature of the unit screen.
[0116] For example, the temperature of a unit screen can be acquired by a temperature sensor and transmitted to a temperature acquisition unit. For instance, a temperature sensor can be installed for each unit screen, and the temperature sensor can be located on the back structure of the unit screen.
[0117] For example, in at least one embodiment of this disclosure, the chromaticity acquisition unit is configured to acquire the chromaticity of the unit screen based on the temperature of the unit screen and the temperature-chromaticity characteristic model of the unit screen.
[0118] For example, the temperature-chromaticity characteristic model of a unit screen records the correspondence between temperature and chromaticity, and the corresponding chromaticity can be found in the temperature-chromaticity characteristic model based on the temperature of the unit screen.
[0119] For example, in at least one embodiment of this disclosure, the first compensation value acquisition unit is configured to acquire a first compensation value for a unit screen based on the difference between the chromaticity of the unit screen and the reference chromaticity, wherein the reference chromaticity is the highest chromaticity among the chromaticities of multiple unit screens.
[0120] By using the above method, the chromaticity of all unit screens can be adjusted based on the highest chromaticity, thus improving the consistency of compensation.
[0121] For example, in at least one embodiment of this disclosure, the first compensation value acquisition unit is further configured to multiply the difference by a preset compensation coefficient to obtain a first compensation value for a unit screen.
[0122] For example, a preset compensation coefficient is used to adjust the compensation effect, and its specific value can be set according to actual needs. This disclosure does not impose any restrictions on this.
[0123] It should be noted that these temperature acquisition units, colorimetric acquisition units, and first compensation value acquisition units can be implemented by software, hardware, firmware, or any combination thereof. For example, they can be implemented as temperature acquisition sub-circuit, colorimetric acquisition sub-circuit, and first compensation value acquisition sub-circuit, respectively. The embodiments of this disclosure do not limit their specific implementation methods.
[0124] In the compensation device provided in at least one embodiment of this disclosure, the temperature-color characteristic model of a unit screen can be pre-constructed through the following steps S201 to S202.
[0125] Step S201: Acquire the temperature and color at different times during the process from the moment the unit screen displays a completely white image until the temperature fluctuation value reaches the preset range.
[0126] Step S202: Based on the temperature and chromaticity at different times, construct a temperature-chromaticity characteristic model for a unit screen.
[0127] For example, the temperature fluctuation value referred to here reaching the preset range can mean that the temperature itself remains unchanged, or that the temperature changes steadily over time, only showing a small range of temperature fluctuations. The embodiments of this disclosure do not limit the size or calculation method of the preset range.
[0128] For example, for each unit screen in a video wall display, multiple sets of temperature-color data can be collected from the moment the unit screen displays a full white image until the temperature fluctuation value reaches a preset range. For example, temperature-color data of the unit screen can be collected every three minutes as the temperature rises from the lowest to the highest temperature. This embodiment of the disclosure does not limit the frequency of data collection. For example, a temperature sensor can be used to measure the temperature of the unit screen, and a colorimeter can be used to measure the colorimetry of the unit screen. This embodiment of the disclosure does not limit this.
[0129] For example, based on multiple sets of collected temperature-colorimetric data, a temperature-colorimetric characteristic model for a unit screen can be fitted. For instance, depending on the actual situation, the temperature-colorimetric characteristics of a unit screen can be described by a straight line, a quadratic curve, or a more complex nonlinear relationship; this disclosure does not impose any limitations on this. Depending on actual needs, the temperature-colorimetric characteristic model of a unit screen can be fitted using linear regression, multinomial regression, neural networks, etc.; this disclosure does not impose any limitations on this either.
[0130] Figure 2C illustrates a schematic diagram of the temperature-chromaticity characteristic fitting results of multiple unit screens provided in at least one embodiment of this disclosure. For example, as shown in Figure 2C, the splicing display screen includes 4×8 unit screens, each with a different temperature-chromaticity characteristic model, but all approximating a straight line. By collecting and analyzing the chromaticity data of the unit screens at different temperatures, the influence of temperature changes on the screen display characteristics can be obtained. It should be noted that Figure 2C is only an example, and the temperature-chromaticity characteristic model may also present as a quadratic curve or a more complex shape.
[0131] In the compensation device provided in at least one embodiment of this disclosure, the second compensation map acquisition module 202 includes a predicted temperature image acquisition unit and a second compensation map acquisition unit.
[0132] For example, in at least one embodiment of this disclosure, the predicted temperature image acquisition unit is configured to acquire the current predicted temperature image of the unit screen based on historical images.
[0133] For example, the definition of historical images can be found in the description above; it can be multiple frames from the past or a single frame from the past, depending on specific requirements. By analyzing images displayed on a unit screen in the past, the current temperature distribution of the unit screen can be predicted.
[0134] For example, in at least one embodiment of this disclosure, the second compensation map acquisition unit is configured to obtain a second compensation map based on a predicted temperature image and a spatial domain model.
[0135] In this way, the second compensation map integrates a dual compensation strategy encompassing both temporal and spatial dimensions. By comprehensively considering spatiotemporal factors, this method allows for the adjustment and optimization of display effects from multiple perspectives, resulting in a more accurate compensation outcome and significantly improving the display performance per unit screen.
[0136] It should be noted that these predicted temperature image acquisition units and the second compensation image acquisition units can be implemented by software, hardware, firmware or any combination thereof. For example, they can be implemented as predicted temperature image acquisition sub-circuit and second compensation image acquisition sub-circuit, respectively. The embodiments of this disclosure do not limit their specific implementation.
[0137] For example, in at least one embodiment of this disclosure, the predicted temperature image acquisition unit is further configured to obtain a current predicted temperature image of the unit screen based on time window weights and historical heat accumulation information of the unit screen recorded in historical images. The time window weights are weighted coefficients used to describe the influence of historical images within the current time window on the temperature of the unit screen.
[0138] For example, images from a past period (e.g., 10 minutes, 20 minutes, or half an hour) are saved (historical images). These images are then weighted and fused using time window weights to obtain a cumulative heat image per unit screen over time. For instance, the time window weights are weighted coefficients used to describe the current impact of historical images within the current time window on the temperature of the display screen. These weights can be obtained from experiments or simulations, or by processing measured temperature rise curves; this disclosure does not impose any limitations on this.
[0139] For example, in at least one embodiment of this disclosure, the predicted temperature image acquisition unit is further configured to perform weighted fusion of a first number of historical images accumulated in the cache pool using time window weights to obtain a heat time accumulation image; and to convert the heat time accumulation image into a predicted temperature image based on the mapping relationship between the heat time accumulation image and temperature.
[0140] For example, the cache pool stores multiple (historical) images obtained within a certain period of time (e.g., up to the current image frame, i.e., the first image frame, within a predetermined time period). The historical images are weighted and fused using time window weights to obtain the current heat time accumulation image of the unit screen.
[0141] It should be noted that the aforementioned time length can be any value, and this disclosure does not impose any restrictions on it. For example, the time length can be the time from when the unit screen displays a completely white image until the temperature fluctuation value reaches a preset range. For example, the time length can be half an hour, and if one frame is collected per second (i.e., the sampling frequency is 1), then the corresponding first quantity is 1800.
[0142] For example, taking a time period of half an hour and a first quantity of 1800, the cache pool stores 1800 historical images accumulated over the past half hour.
[0143] For example, when a unit screen is turned on, since there is no historical data, 1800 frames of all-white or all-black images can be filled into the cache pool as an initial baseline.
[0144] For example, the predicted temperature image acquisition unit can convert a heat time-cumulative image into a predicted temperature image based on the mapping relationship between the heat time-cumulative image and temperature. Each pixel value in the heat time-cumulative image represents the heat value accumulated at that location over a period of time (heat time-cumulative value).
[0145] The above mapping relationship can be a gamma mapping, and an example calculation formula is as follows: T(x,y)=H(x,y) γ
[0146] Where T(x,y) represents the temperature value at pixel (x,y) in the predicted temperature image, H(x,y) represents the cumulative heat value at pixel (x,y) in the heat time accumulation image, and γ is the gamma value used to control the degree of nonlinearity of the mapping. A suitable gamma value can be determined according to actual needs, and this disclosure does not impose any limitations on this.
[0147] For example, the predicted temperature image acquisition unit can perform gamma mapping on each pixel value in the heat time accumulation image, converting it into a temperature value. The image composed of the converted temperature values of each pixel is the predicted temperature image. It should be noted that, in order to improve the accuracy of the mapping, data processing steps such as normalization can also be added, and this disclosure does not limit this.
[0148] For example, in at least one embodiment of this disclosure, the predicted temperature image acquisition unit is further configured to update the cache pool based on the first image frame after obtaining the current predicted temperature image of the unit screen, so as to obtain a heat time accumulation image for at least another image frame after the first image frame.
[0149] For example, the other image frame may be an image frame that is immediately after the first image frame in time, or an image frame that is to be displayed after a predetermined time period (e.g., 0.1 seconds or 1 second, etc.). The embodiments of this disclosure do not limit this, so the compensation operation for the other image frame takes into account the influence of the parameters of the display process of the preceding first image frame.
[0150] For example, in at least one embodiment of this disclosure, the temperature prediction image acquisition unit is further configured to perform grayscale processing on the first image frame to obtain a first grayscale image corresponding to the first image frame; and to add the first grayscale image corresponding to the first image frame to a cache pool, and in response to the fact that the number of historical images in the cache pool has reached a preset number threshold before the first grayscale image corresponding to the first image frame is added, to remove the historical image frame furthest from the current time in the cache pool.
[0151] For example, the temperature prediction image acquisition unit can perform grayscale processing on the first image frame to obtain a first grayscale image. In the case of a color image, grayscale processing mainly involves converting the color information of each pixel in the original color image (usually including red, green, and blue (RGB) color channels) into a single grayscale value; in the case of a black and white image, grayscale processing can include converting the grayscale information of each pixel in the original black and white image into the grayscale value corresponding to the aforementioned unit screen. For example, the grayscale value can be calculated using a specific conversion function, such as ITU-R 601, ITU-R 709, or the averaging method. For example, the grayscale processing scaling factor can also be obtained based on the three-channel temperature rise curve of the unit screen. The temperature rise curve can be an empirical temperature rise curve obtained from experiments or simulations, or it can be a measured temperature rise curve; this disclosure does not impose any limitations on this.
[0152] In at least one embodiment, taking a resolution of 160×180 pixels per unit screen as an example, in order to reduce the complexity of storage and computation while ensuring the basic pattern outline, the first grayscale image can also be averaged after grayscale processing.
[0153] For example, a first grayscale image with a size of 160×180 pixels is downsampled and divided into 8×9 first regions of size 20×20 pixels. The grayscale mean value of the grayscale image pixels in each first region is calculated to obtain a value representing the overall grayscale characteristics of that region, thus obtaining a first grayscale image of size 8×9.
[0154] For example, taking a time period of half an hour and a first quantity of 1800, the cache pool stores 1800 historical images accumulated in the past half hour. Each historical image is obtained by performing the above grayscale processing on another image frame before the first image frame.
[0155] For example, the current first image frame is acquired every second, and after grayscale processing, a first grayscale image is obtained. When the first grayscale image is added to the buffer pool, if the number of historical images in the buffer pool has reached 1800 before the first grayscale image corresponding to the first image frame is added, the historical image frame furthest from the current time in the buffer pool is removed to ensure that the data in the buffer pool is always the most recent half hour. The data in the current buffer pool is used to generate the heat time accumulation image of at least one other image frame after the first image frame. It should be noted that the above-mentioned preset quantity threshold is not limited in the embodiments of this disclosure and can be adjusted according to actual conditions; for example, the preset quantity threshold can be fixedly set (i.e., cannot be modified) in the corresponding processing device, or it can be flexibly set or modified, for example, through a writable memory (e.g., a register).
[0156] In the compensation device provided in at least one embodiment of this disclosure, the time window weight of a unit screen can be pre-constructed through the following steps S203 to S204.
[0157] Step S203: Obtain the temperature rise curve from the moment the unit screen displays a completely white image until the temperature fluctuation value reaches the preset range.
[0158] Step S204: Obtain the time window weight based on the temperature rise curve.
[0159] Figure 2D is a schematic diagram of a cumulative heat acquisition time image provided in at least one embodiment of the present disclosure.
[0160] For example, as shown in Figure 2D, the time window weight is obtained by sampling the temperature rise curve from the moment the unit screen displays a full white image until the temperature fluctuation value reaches a preset range. For example, as shown in Figure 2D, the temperature rise curve is processed to obtain the time window weight corresponding to 1800 frames, and the time window weight is a 1×1800 vector. For example, the data processing includes at least one of mirroring, inversion, and normalization operations. For example, the temperature fluctuation value reaching the preset range can mean that the temperature itself remains constant, or that the temperature changes smoothly over time, exhibiting only a small range of temperature fluctuations. This embodiment of the disclosure does not limit the size or calculation method of the preset range.
[0161] For example, as shown in Figure 2D, the weight value on the far right of the time window weight represents the weight value of the frame closest to the current time. The weight values of the approximately 300 frames closest to the current time are significantly higher than the weight values of other earlier historical frames. This means that when estimating temperature-related compensation, the closer the data is to the current time, the greater its contribution to the current compensation value.
[0162] For example, to efficiently process these weights in hardware or algorithms, the weights for the time window with values in the range [0,1] need to be multiplied by a scaling factor (e.g., 2). 18 A fixed-point transformation is performed to obtain the fixed-point time window weights. For example, by multiplying all historical images in the cache pool with the corresponding fixed-point time window weights and summing them, a fixed-point heat time accumulation image can be obtained.
[0163] In the process of acquiring the accumulated heat images over time, a dynamic weighting strategy with strong real-time performance is achieved by using time window weights to weight and fuse historically accumulated grayscale images.
[0164] It should be noted that, in at least one embodiment of this disclosure, the generated heat time accumulation image and predicted temperature image are the same size as the first grayscale image. Therefore, if, after grayscale processing, the first grayscale image with a size of 160×180 pixels is subjected to mean averaging processing according to the above embodiment to obtain a first grayscale image with a size of 8×9 pixels, then the generated heat time accumulation image and predicted temperature image will also be 8×9 pixels in size.
[0165] In at least one embodiment of this disclosure, in addition to the above-described method of obtaining a thermal time-accumulated image based on time window weights and historical images, a thermal time-accumulated image can also be calculated by iterative accumulation.
[0166] For example, in at least one embodiment of this disclosure, the predicted temperature image acquisition unit is further configured to perform grayscale processing on the first image frame to obtain a first grayscale image corresponding to the first image frame; calculate the current heat time accumulation image of the unit screen; and convert the heat time accumulation image into a predicted temperature image based on the mapping relationship between the heat time accumulation image and temperature.
[0167] For example, the predicted temperature image acquisition unit uses the following formula to obtain the current heat time-accumulated image of the unit screen:
[0168] in, For the current time-accumulated heat image, For the current thermal time-accumulated image, it is the thermal time-accumulated image of the previous frame. This is the first grayscale image corresponding to the first image frame. α is used to control the magnitude of temperature change, and β is used to control the rate of temperature change.
[0169] For example, the heat accumulation image at time t can be calculated from the heat accumulation image at time t-1 and the first grayscale image corresponding to the first image frame at time t using the formula above. Compared with the method of weighting historical images based on time window weights, this iterative accumulation method does not require storing a large number of images, which can significantly reduce the required computational and storage resources, while simplifying the simulation process.
[0170] It should be noted that the values of α and β can be determined according to actual needs, and this disclosure does not impose any limitations on them. The specific methods for grayscale processing, the mapping relationship between the heat time accumulation image and temperature, and the conversion of the heat time accumulation image into a predicted temperature image can be referred to the description in the above embodiments, and will not be repeated here.
[0171] Similarly, the size of the heat time accumulation image and the predicted temperature image generated in the above manner is the same as the size of the first grayscale image. Therefore, if, after grayscale processing, the first grayscale image with a size of 160×180 pixels is averaged according to the above embodiment to obtain a first grayscale image with a size of 8×9 pixels, then the size of the generated heat time accumulation image and the predicted temperature image is also 8×9 pixels.
[0172] For example, in at least one embodiment of this disclosure, the second compensation map acquisition unit is further configured to perform intra-screen diffusion filtering on the predicted temperature image to obtain a second compensation map.
[0173] For example, to describe the heat diffusion phenomenon within a unit screen, a Gaussian filter kernel can be used to perform intra-screen diffusion filtering on the heat time accumulation image, resulting in a second compensation image. The size of the Gaussian filter kernel can be set as needed, for example, it can be 9×9.
[0174] Figure 2E is a schematic diagram of intra-screen diffusion filtering provided in at least one embodiment of the present disclosure.
[0175] For example, assuming each unit screen size is 160×180 pixels, the predicted temperature image size is 8×9 pixels. As shown in Figure 2E, the second compensation image acquisition unit is further configured to perform the following steps S211 to S216.
[0176] Step S211: Expand the 8×9 predicted temperature image to 16×18 size using bilinear interpolation to improve spatial resolution and filtering effect.
[0177] Step S212: Fill the 16×18 predicted temperature image with four rings of all zero values around it, making it 24×26 in size, so that the filtering operation will not be affected by boundary effects.
[0178] Step S213: Perform in-screen diffusion filtering on the 24×26 predicted temperature image using a 9×9 Gaussian filter kernel to obtain the in-screen diffusion filtered matrix K1. For example, the filtering operation is a convolution operation. For example, the coefficients of the 9×9 Gaussian filter kernel are normalized floating-point numbers, which need to be fixed-point converted before the filtering operation, i.e., multiplied by 2. 18 This yields a fixed-point 9×9 Gaussian filter kernel.
[0179] Step S214: Calculate the thermal diffusion compensation value within the screen using the following formula: Thermal diffusion compensation value within the screen = 2 10 –1–K1.
[0180] Step S215: Shift and round the calculated in-screen thermal diffusion compensation value to 10 bits.
[0181] Step S216: Extend the 16×18 result to 160×180 using bilinear interpolation to obtain the second compensation image. Each pixel in the second compensation image corresponds one-to-one with each physical pixel of the unit screen.
[0182] When pixel values differ at different locations within a unit screen, the temperature distribution within that unit screen also varies, resulting in different compensation values for different locations. The above operations can address the impact of uneven temperature distribution within the unit screen. Specifically, based on the actual temperature differences at various locations within the unit screen, a thermal diffusion model can be used to generate more accurate compensation values, ultimately achieving dynamic temperature compensation for the unit screen image.
[0183] It should be noted that the modules or units included in the compensation device provided in at least one embodiment of this disclosure can be implemented by software, hardware, firmware or any combination thereof, and the embodiments of this disclosure do not limit their specific implementation.
[0184] It should be noted that the compensation device provided in at least one embodiment of this disclosure may include more or fewer circuits or units, and the connection relationship between the various circuits or units is not limited and can be determined according to actual needs. The specific configuration of each circuit is not limited and can be constructed from analog devices, digital chips, or other suitable methods according to circuit principles.
[0185] The compensation device provided in at least one embodiment of the present disclosure takes into account the differences in display screen production, the differences in display screen consistency correction, and the differences in display screen usage environment. By designing a unique characteristic model for each unit screen, it compensates for the display differences between unit screens, thereby achieving a better image retention compensation effect.
[0186] Figure 3 is a schematic block diagram of a display device provided in at least one embodiment of the present disclosure.
[0187] For example, as shown in FIG3, at least one embodiment of this disclosure provides a display device 300, including a display controller 310. The display controller 310 includes a compensation device 311. For example, the compensation device 311 is a compensation device provided in at least one embodiment of this disclosure, such as the compensation device 100 in FIG1A or the compensation device 200 in FIG2A.
[0188] For example, as shown in FIG3, the display device 300 provided in at least one embodiment of this disclosure further includes a video wall display 320. The video wall display can be, for example, an LED video wall display, an OLED self-illuminating liquid crystal video wall display, a DLP rear projection video wall display, etc., and the embodiments of this disclosure do not limit this.
[0189] It should be noted that the display controller provided in this embodiment can achieve both unified control and distributed control. In the case of unified control, the entire splicing display screen is managed by a single display controller, which is responsible for the compensation and control of all individual screens. In the case of distributed control, a display controller is assigned to each individual screen that makes up the splicing display screen, and different individual screens are controlled by different display controllers; alternatively, all individual screens can be grouped, with each group corresponding to a display controller. For example, these display controllers can communicate with each other, and this embodiment does not impose any limitations on this approach.
[0190] Figure 4 is a schematic block diagram of a display controller provided in at least one embodiment of the present disclosure.
[0191] For example, as shown in Figure 4, the display controller 310 also includes a data buffer 312, a parameter storage device 313, and a logic control device 314. The display controller can be implemented using hardware logic components such as a field-programmable gate array (FPGA), an application-specific integrated circuit (ASIC), or a system-on-a-chip (SOC).
[0192] For example, in at least one embodiment of this disclosure, the data buffer 312 is configured to temporarily store multiple externally input image frames for provision to the compensation device 311. For example, the data buffer can receive multiple externally input image frames through an input interface.
[0193] For example, in at least one embodiment of this disclosure, the parameter storage device 313 is configured to store compensation parameters of the compensation device.
[0194] For example, in at least one embodiment of this disclosure, the logic control device 314 is configured to control the operation of the compensation device 311. For example, as shown in FIG4, the display controller 310 further includes a clock (i.e., a clock generator) 315, and the logic control device 314 is configured to control the operation of the compensation device under the action of the clock 315.
[0195] For example, as shown in Figure 4, the first compensated image frame, after being processed by the compensation device, is output from the output interface to be sent to the unit screen for display.
[0196] The display controller provided in at least one embodiment of this disclosure can support real-time parallel processing of input data, thereby improving processing efficiency. Furthermore, this display controller supports highly customizable design; hardware accelerators can be designed according to specific application requirements to optimize the performance of image processing algorithms, and it can also be flexibly improved according to application needs.
[0197] Figure 5 is a flowchart of a compensation method provided in at least one embodiment of this disclosure.
[0198] For example, as shown in FIG5, the compensation method provided in this embodiment of the present disclosure includes step S500.
[0199] Step 500: For each of the multiple unit screens that make up the splicing display screen, the first image frame among the multiple image frames to be displayed on the unit screen is compensated in real time based on the temperature of the unit screen to obtain the compensated first image frame, wherein the first compensated image frame is used to drive the unit screen to present the first image frame.
[0200] Figure 6 is a flowchart of a compensation method provided in at least one embodiment of this disclosure.
[0201] For example, as shown in Figure 6, one example of the above method step S500, "real-time compensation of the first image frame among multiple image frames to be displayed on the unit screen based on the temperature of the unit screen, to obtain the compensated first image frame", may include the following steps S601 to S602.
[0202] Step S601: Obtain the real-time compensation value of the unit screen based on the current temperature of the unit screen.
[0203] Step S602: Compensate the first image frame based on the real-time compensation value to obtain the first compensated image frame.
[0204] Steps S601 to S602 can be implemented by the real-time compensation value acquisition module and the compensation calculation module in the above-described device-type embodiments, respectively. Please refer to the relevant descriptions of the above modules, which will not be repeated here.
[0205] For example, one embodiment of step S602 can be: obtaining the real-time compensation value of the unit screen based on the following formula: Real-time compensation value = (1 - Norm (current temperature)) × preset compensation coefficient
[0206] Norm represents the normalization operation.
[0207] For example, prior to step S601, the compensation method may further include acquiring the current temperature of the unit screen. This step can be implemented by the temperature acquisition module in the above-described device-type embodiments.
[0208] For example, before step S601, the compensation method may further include obtaining the initial temperature of the unit screen when it is not lit. This step can be implemented by the temperature acquisition module in the above-described device-type embodiments. Correspondingly, an example of step S602 can be to obtain the real-time compensation value of the unit screen based on the following formula: Real-time compensation value = Conv(1 - Norm(current temperature - initial temperature) × preset compensation coefficient)
[0209] Here, Conv represents the filtering operation, and Norm represents the normalization operation.
[0210] Figure 7 is a flowchart of a compensation method provided in at least one embodiment of this disclosure.
[0211] For example, as shown in Figure 7, another example of the above method step S500, "based on the temperature of the unit screen, the first image frame among the multiple image frames to be displayed on the unit screen is compensated in real time to obtain the compensated first image frame", may include the following steps S701 to S704.
[0212] Step S701: Obtain the first compensation value of the unit screen based on the temperature-colorimetric characteristic model of the unit screen.
[0213] Step S702: Obtain the second compensation map of the unit screen based on the temporal model and the spatial model, wherein the temporal model reflects the influence of historical images on the temperature of the unit screen, and the spatial model reflects the heat diffusion law within the unit screen.
[0214] Step S703: Obtain the real-time compensation value of the unit screen based on the first compensation value and the second compensation map.
[0215] Step S704: Compensate the first image frame based on the real-time compensation value to obtain the first compensated image frame.
[0216] Steps S701 to S704 can be implemented by the first compensation value acquisition module, the second compensation map acquisition module, the real-time compensation map acquisition module, and the compensation calculation module in the above-described device-type embodiments, respectively. Please refer to the relevant descriptions of the above modules, which will not be repeated here.
[0217] For example, in at least one embodiment of this disclosure, step S701 may include steps S7011 to S7013.
[0218] Step S7011: Obtain the temperature of the unit screen.
[0219] Step S7012: Obtain the chromaticity of the unit screen based on the temperature of the unit screen and the temperature-chromaticity characteristic model of the unit screen.
[0220] Step S7013: Based on the difference between the chromaticity of the unit screen and the reference chromaticity, obtain the first compensation value of the unit screen, wherein the reference chromaticity is the highest chromaticity among the chromaticities of multiple unit screens.
[0221] Steps S7011 to S7013 can be implemented by the temperature acquisition unit, colorimetric acquisition unit, and first compensation value acquisition unit in the above-described device embodiments, respectively. Please refer to the relevant descriptions of the above units, which will not be repeated here.
[0222] For example, one embodiment of step S7013 may include multiplying the difference by a preset compensation coefficient to obtain a first compensation value per unit screen.
[0223] For example, the temperature-chromaticity characteristic model of a unit screen can be constructed through the following steps S721 to S722. Steps S721 to S722 need to be completed before performing the compensation method provided in the embodiments of this disclosure.
[0224] Step S721: Acquire the temperature and color at different times during the process from the moment the unit screen displays a completely white image until the temperature fluctuation value reaches the preset range.
[0225] Step S722: Based on the temperature and chromaticity at different times, construct a temperature-chromaticity characteristic model for a unit screen.
[0226] For example, in at least one embodiment of this disclosure, step S702 may include steps S7021 to S7022.
[0227] Step S7021: Obtain the current predicted temperature image of the unit screen based on historical images.
[0228] Step S7022: Obtain the second compensation map based on the predicted temperature image and the spatial domain model.
[0229] Steps S7021 to S7022 can be implemented by the predicted temperature image acquisition unit and the second compensation image acquisition unit in the above-described device embodiments, respectively. Please refer to the relevant descriptions of the above units, which will not be repeated here.
[0230] For example, one example of step S7021 is: based on the time window weight and the historical heat time accumulation information of the unit screen recorded in historical images, the current predicted temperature image of the unit screen is obtained, wherein the time window weight is used to describe the weight coefficient of the influence of the historical images in the current time window on the temperature of the unit screen.
[0231] For example, one example of step S7021 may include steps S7021a to S7021b.
[0232] Step S7021a: Use time window weights to perform weighted fusion on the first number of historical images accumulated in the cache pool to obtain the heat time accumulation image.
[0233] Step S7021b: Based on the mapping relationship between the heat time accumulation image and temperature, convert the heat time accumulation image into a predicted temperature image.
[0234] After obtaining the current predicted temperature image of the unit screen, an example of step S7021 may further include updating the buffer pool based on the first image frame to obtain a heat time accumulation image for at least another image frame after the first image frame.
[0235] For example, one example of the above steps may include steps S7021c to S7021d.
[0236] Step S7021c: Perform grayscale processing on the first image frame to obtain the first grayscale image corresponding to the first image frame.
[0237] Step S7021d: Add the first grayscale image corresponding to the first image frame to the cache pool, and in response to the fact that the number of historical images in the cache pool has reached a preset threshold before the first grayscale image corresponding to the first image frame is added, remove the historical image frame that is furthest from the current time in the cache pool.
[0238] For example, the temperature rise curve can be constructed through the following steps S731 to S732. Steps S731 to S732 need to be completed before performing the compensation method provided in the embodiments of this disclosure.
[0239] Step S731: Obtain the temperature rise curve from the moment the unit screen displays a completely white image until the temperature fluctuation value reaches the preset range.
[0240] Step S732: Obtain the time window weight based on the temperature rise curve.
[0241] For example, another example of step S7021 may include steps S7021e to S7021g.
[0242] Step S7021e: Perform grayscale processing on the first image frame to obtain the first grayscale image corresponding to the first image frame.
[0243] Step S7021f: Calculate the current heat accumulation image of the unit screen based on the following formula:
[0244] in, For the current time-accumulated heat image, For the current thermal time-accumulated image, it is the thermal time-accumulated image of the previous frame. This is the first grayscale image corresponding to the first image frame. α is used to control the magnitude of temperature change, and β is used to control the rate of temperature change.
[0245] Step S7021g: Based on the mapping relationship between the heat time accumulation image and temperature, convert the heat time accumulation image into a predicted temperature image.
[0246] For example, one example of step S7022 is: performing intra-screen diffusion filtering on the predicted temperature image to obtain a second compensation image.
[0247] For example, one example of step S703 is: normalizing the second compensation map and multiplying it by the first compensation value to obtain the real-time compensation map of the unit screen.
[0248] Each of the above steps can be implemented by the modules or units in the above-described device embodiments. Please refer to the relevant descriptions of the modules or units above, which will not be repeated here.
[0249] It should also be noted that the execution order of the various steps of the compensation method in the various embodiments of this disclosure is not limited. Although the execution process of each step has been described in a specific order above, this does not constitute a limitation on the embodiments of this disclosure. The various steps in the compensation method can be executed sequentially or in parallel, which can be determined according to actual needs. For example, the compensation method may also include more or fewer steps, and the embodiments of this disclosure do not limit this.
[0250] It should be understood that the compensation method provided in at least one embodiment of this disclosure can be implemented by the aforementioned compensation device, and can also achieve similar technical effects as the aforementioned compensation device, which will not be elaborated here.
[0251] Figure 8 is a schematic block diagram of an electronic device provided in at least one embodiment of the present disclosure.
[0252] For example, as shown in FIG8, an electronic device 800 includes at least one processor 801 and at least one memory 802. The at least one memory 802 includes one or more computer program modules. The one or more computer program modules are stored in the at least one memory 802 and configured to be executed by the at least one processor 801. These computer program modules include instructions for performing the compensation method provided in at least one embodiment of the present disclosure. When executed by the at least one processor 801, they can perform one or more steps of the compensation method provided in at least one embodiment of the present disclosure. The memory 802 and the processor 801 can be interconnected via a bus system and / or other forms of connection mechanism (not shown).
[0253] For example, processor 801 can be a central processing unit (CPU), a digital signal processor (DSP), or other processing units with data processing and / or program execution capabilities, such as a field-programmable gate array (FPGA); for example, the central processing unit (CPU) can be an x86 or ARM architecture. Processor 801 can be a general-purpose processor or a special-purpose processor, and can control other components in electronic device 800 to perform desired functions.
[0254] For example, memory 802 may include any combination of one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. Volatile memory may include, for example, random access memory (RAM) and / or cache memory. Non-volatile memory may include, for example, read-only memory (ROM), hard disk, erasable programmable read-only memory (EPROM), portable compact disc read-only memory (CD-ROM), USB memory, flash memory, etc. One or more computer program modules may be stored on the computer-readable storage medium, and processor 801 may run one or more computer program modules to implement various functions of electronic device 800. Various application programs and various data, as well as various data used and / or generated by the application programs, may also be stored in the computer-readable storage medium. The specific functions and technical effects of electronic device 800 can be referred to the description of the compensation method above, and will not be repeated here.
[0255] Figure 9 is a schematic block diagram of another electronic device provided in at least one embodiment of the present disclosure.
[0256] The electronic devices in this disclosure may include, but are not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (PADs), portable multimedia players (PMPs), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. The electronic device 900 shown in Figure 9 is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments of this disclosure.
[0257] For example, as shown in Figure 9, in some examples, electronic device 900 includes a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 901, which can perform various appropriate actions and processes according to a program stored in read-only memory (ROM) 902 or a program loaded from storage device 908 into random access memory (RAM) 903. The RAM 903 also stores various programs and data required for the operation of the computer system. The processing unit 901, ROM 902, and RAM 903 are connected via bus 904. An input / output (I / O) interface 905 is also connected to bus 904.
[0258] For example, the following components can be connected to I / O interface 905: input devices 906 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 907 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 908 including, for example, magnetic tapes, hard disks, etc.; and communication devices 909 including, for example, network interface cards such as LAN cards, modems, etc. Communication device 909 allows electronic device 900 to communicate wirelessly or wiredly with other devices to exchange data and perform communication processing via networks such as the Internet. Drive 910 is also connected to I / O interface 905 as needed. Removable media 911, such as disks, optical disks, magneto-optical disks, semiconductor memories, etc., are installed on drive 910 as needed so that computer programs read from them can be installed into storage device 908 as needed. Although FIG9 shows electronic device 900 including various devices, it should be understood that it is not required to implement or include all the devices shown. More or fewer devices may be implemented or included alternatively.
[0259] For example, the electronic device 900 may further include a peripheral interface (not shown in the figure). This peripheral interface can be various types of interfaces, such as a USB interface, a Lightning interface, etc. The communication device 909 can communicate wirelessly with a network and other devices, such as the Internet, an intranet, and / or a wireless network such as a cellular telephone network, a wireless local area network (LAN), and / or a metropolitan area network (MAN). Wireless communication can use any of a variety of communication standards, protocols, and technologies, including but not limited to Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Wi-Fi (e.g., based on IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, and / or IEEE 802.11n standards), Voice over Internet Protocol (VoIP), Wi-MAX, protocols for email, instant messaging, and / or Short Message Service (SMS), or any other suitable communication protocol.
[0260] For example, the electronic device 900 can be any device such as a mobile phone, tablet computer, laptop computer, e-book, game console, television, digital photo frame, or navigator, or any combination of data processing device and hardware. The embodiments disclosed herein do not limit this.
[0261] For example, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For instance, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 909, or installed from a storage device 908, or installed from a ROM 902. When the computer program is executed by a processing device 901, the compensation method disclosed in embodiments of this disclosure is performed.
[0262] It should be noted that the computer-readable medium described above in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In embodiments of this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In embodiments of this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.
[0263] The aforementioned computer-readable medium may be included in the aforementioned electronic device 900; or it may exist independently and not assembled into the electronic device 900.
[0264] Figure 10 is a schematic block diagram of a non-transiently readable storage medium provided in at least one embodiment of the present disclosure.
[0265] For example, as shown in FIG10, a computer-readable instruction 1001 is stored on a non-transiently readable storage medium 1000, which, when executed by a processor, performs one or more steps of the compensation method described above.
[0266] For example, the non-transiently readable storage medium 1000 can be any combination of one or more computer-readable storage media. For instance, a computer-readable storage medium may contain computer-readable program code for real-time compensation of a first image frame among a plurality of image frames to be displayed on each of the plurality of unit screens constituting a video wall display, based on the temperature of the unit screen, to obtain a compensated first compensated image frame. Of course, the aforementioned program code may also be stored in the same computer-readable medium, and the embodiments of this disclosure do not limit this.
[0267] For example, when the program code is read by a computer, the computer can execute the program code stored in the computer's storage medium to perform, for example, the compensation method provided in any embodiment of this disclosure.
[0268] For example, the storage medium may include a memory card for a smartphone, a storage component for a tablet computer, a hard disk for a personal computer, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), portable compact disc read-only memory (CD-ROM), flash memory, or any combination of the above storage media, or other suitable storage media. For example, the readable storage medium may also be the memory 802 in Figure 8, and the relevant description can be found in the foregoing content, which will not be repeated here.
[0269] At least one embodiment of this disclosure provides a computer program product, including a computer program / instructions, wherein when the computer program / instructions are executed by at least one processor, they perform the compensation method provided in at least one embodiment of this disclosure.
[0270] Although the present disclosure has been described in detail above with general descriptions and specific embodiments, modifications or improvements can be made to the embodiments of the present disclosure, which will be obvious to those skilled in the art. Therefore, all such modifications or improvements made without departing from the spirit of the present disclosure are within the scope of protection claimed by the present disclosure.
[0271] The following points should be noted regarding this disclosure:
[0272] (1) The accompanying drawings of the embodiments of this disclosure only involve the structures involved in the embodiments of this disclosure. Other structures can be referred to the general design.
[0273] (2) For clarity, the thickness of layers or regions in the drawings used to describe embodiments of the present disclosure is enlarged or reduced, i.e., these drawings are not drawn to actual scale.
[0274] (3) Where there is no conflict, the embodiments of this disclosure and the features in the embodiments can be combined with each other to obtain new embodiments.
[0275] The above description is merely a specific embodiment of this disclosure, but the scope of protection of this disclosure is not limited thereto. The scope of protection of this disclosure should be determined by the scope of protection of the claims.
Claims
1. A compensation device configured to, for each of a plurality of unit screens constituting a video wall display, perform real-time compensation on a first image frame of a plurality of image frames to be displayed on the unit screen based on the temperature of the unit screen, to obtain a compensated first compensated image frame, wherein, The first compensated image frame is used to drive the unit screen to display the first image frame.
2. The compensation device according to claim 1, comprising: The first compensation value acquisition module is configured to acquire the first compensation value of the unit screen based on the temperature-colorimetric characteristic model of the unit screen. The second compensation map acquisition module is configured to acquire a second compensation map of the unit screen based on a temporal model and / or a spatial model, wherein the temporal model reflects the influence of historical images on the temperature of the unit screen, and the spatial model reflects the heat diffusion pattern inside the unit screen.
3. The compensation device according to claim 2 further includes: The real-time compensation map acquisition module is configured to obtain the real-time compensation map of the unit screen based on the first compensation value and the second compensation map; The compensation calculation module is configured to compensate the first image frame based on the real-time compensation map to obtain the first compensated image frame.
4. The compensation device according to claim 2, wherein, The first compensation value acquisition module includes: A temperature acquisition unit is configured to acquire the temperature of the unit screen; The chromaticity acquisition unit is configured to acquire the chromaticity of the unit screen based on the temperature of the unit screen and the temperature-chromaticity characteristic model of the unit screen; The first compensation value acquisition unit is configured to acquire a first compensation value for the unit screen based on the difference between the chromaticity of the unit screen and the reference chromaticity, wherein the reference chromaticity is the highest chromaticity among the chromaticities of the plurality of unit screens.
5. The compensation device according to claim 4, wherein, The first compensation value acquisition unit is further configured to multiply the difference by a preset compensation coefficient to obtain the first compensation value of the unit screen.
6. The compensation device according to claim 4, wherein, The temperature-colorimetric characteristic model of the unit screen is obtained through the following steps: The temperature and chromaticity at different times during the process from the moment the unit screen displays a completely white image until the temperature fluctuation value reaches a preset range are obtained multiple times. Based on the temperature and chromaticity at different times, a temperature-chromaticity characteristic model of the unit screen is constructed.
7. The compensation device according to any one of claims 2-6, wherein, The second compensation map acquisition module includes: The predicted temperature image acquisition unit is configured to acquire the current predicted temperature image of the unit screen based on the historical images; The second compensation map acquisition unit is configured to obtain the second compensation map based on the predicted temperature image and the spatial domain model.
8. The compensation device according to claim 7, wherein, The predicted temperature image acquisition unit is further configured to: Based on the time window weight and the historical heat accumulation information of the unit screen recorded in the historical images, the current predicted temperature image of the unit screen is obtained. The time window weight is used to describe the weight coefficient of the influence of the historical images in the current time window on the temperature of the unit screen.
9. The compensation device according to claim 8, wherein, The predicted temperature image acquisition unit is further configured to: The first number of historical images accumulated in the cache pool are weighted and fused using the time window weights to obtain a heat time accumulation image. Based on the mapping relationship between the thermal time-accumulated image and temperature, the thermal time-accumulated image is converted into the predicted temperature image.
10. The compensation device according to claim 9, wherein, The predicted temperature image acquisition unit is further configured to: After obtaining the current predicted temperature image of the unit screen, the cache pool is updated based on the first image frame to obtain a heat time accumulation image for at least another image frame after the first image frame.
11. The compensation device according to claim 10, wherein, The predicted temperature image acquisition unit is further configured to: The first image frame is converted to grayscale to obtain a first grayscale image corresponding to the first image frame. The first grayscale image corresponding to the first image frame is added to the cache pool, and in response to the fact that the number of historical images in the cache pool has reached a preset threshold before the first grayscale image corresponding to the first image frame is added, the historical image frame furthest from the current time in the cache pool is removed.
12. The compensation device according to any one of claims 8-11, wherein, The time window weight is obtained through the following steps: Obtain the temperature rise curve from the moment the unit screen displays a completely white image until the temperature fluctuation value reaches a preset range; The time window weight is obtained based on the temperature rise curve.
13. The compensation device according to claim 7, wherein, The predicted temperature image acquisition unit is further configured to: The first image frame is converted to grayscale to obtain a first grayscale image corresponding to the first image frame. The current heat accumulation image of the unit screen is calculated based on the following formula: in, For the current time-accumulated heat image, For the current thermal time-accumulated image, it is the thermal time-accumulated image of the previous frame. The first grayscale image is the first image frame corresponding to the first image frame. α is used to control the magnitude of temperature change, and β is used to control the rate of temperature change. Based on the mapping relationship between the thermal time-accumulated image and temperature, the thermal time-accumulated image is converted into the predicted temperature image.
14. The compensation device according to any one of claims 7-13, wherein, The second compensation map acquisition unit is further configured to: The predicted temperature image is subjected to intra-screen diffusion filtering to obtain the second compensation image.
15. The compensation device according to any one of claims 3-14, wherein, The real-time compensation map acquisition module is further configured to: The second compensation map is normalized and multiplied by the first compensation value to obtain the real-time compensation map of the unit screen.
16. The compensation device according to any one of claims 3-15, wherein, The compensation calculation module is further configured to perform pixel-level subtraction operations between the three color channel components of the first image frame and the weighted real-time compensation map based on the following formula: I C_R =I R -C R ×C w I C_G =I G -C G ×C w I C_B =I B -C B ×C w Among them, C w For the real-time compensation diagram, I R I G I B These are the values of the three color channel components in the first image frame, I. C_R I C_G I C_B The values of C after compensation for the three color channel components are respectively. R C G C B These are the compensation coefficients corresponding to the three color channel components, I. C_R I C_G and I C_B The first compensated image frame is obtained after integration.
17. The compensation device according to claim 1, wherein, The compensation device includes: The real-time compensation value acquisition module is configured to obtain the real-time compensation value of the unit screen based on the current temperature of the unit screen. The compensation calculation module is configured to compensate the first image frame based on the real-time compensation value to obtain the first compensated image frame.
18. The compensation device according to claim 17, wherein, The real-time compensation value acquisition module is further configured to obtain the real-time compensation value of the unit screen based on the following formula: Real-time compensation value = (1 - Norm (current temperature)) × preset compensation coefficient Norm represents the normalization operation.
19. The compensation device according to claim 17, wherein, The real-time compensation value acquisition module is also configured to obtain the real-time compensation value of the unit screen based on the following formula: Real-time compensation value = Conv(1 - Norm(current temperature - initial temperature) × preset compensation coefficient) Where Conv represents filtering operation, Norm represents normalization operation, and the initial temperature represents the temperature of the unit screen when it is not lit.
20. A display device, comprising: The display controller includes the compensation device according to any one of claims 1-19.
21. The display device according to claim 20, wherein, The display controller further includes: A data buffer is configured to temporarily store the plurality of externally input image frames for use with the compensation device; A parameter storage device is configured to store compensation parameters of the compensation device; A logic control device is configured to control the operation of the compensation device.
22. The display device according to claim 20 or 21, wherein, The display device also includes the splicing display screen.
23. A compensation method, comprising: For each of the multiple unit screens that make up the splicing display screen, the first image frame among the multiple image frames to be displayed on the unit screen is compensated in real time based on the temperature of the unit screen to obtain a compensated first image frame, wherein the first compensated image frame is used to drive the unit screen to present the first image frame.
24. The compensation method according to claim 23, wherein, The real-time compensation of the first image frame among multiple image frames to be displayed on the unit screen based on the temperature of the unit screen, to obtain the compensated first image frame, includes: The first compensation value of the unit screen is obtained based on the temperature-colorimetric characteristic model of the unit screen. The second compensation map of the unit screen is obtained based on the temporal and spatial models, wherein the temporal model reflects the influence of historical images on the temperature of the unit screen, and the spatial model reflects the heat diffusion pattern within the unit screen.
25. The compensation method according to claim 24, wherein, The step of real-time compensation of the first image frame among multiple image frames to be displayed on the unit screen based on the temperature of the unit screen to obtain the compensated first image frame further includes: The real-time compensation value of the unit screen is obtained based on the first compensation value and the second compensation map; The first image frame is compensated based on the real-time compensation value to obtain the first compensated image frame.
26. The compensation method according to claim 23, wherein, The real-time compensation of the first image frame among multiple image frames to be displayed on the unit screen based on the temperature of the unit screen, to obtain the compensated first image frame, includes: The real-time compensation value of the unit screen is obtained based on the current temperature of the unit screen; The first image frame is compensated based on the real-time compensation value to obtain the first compensated image frame.
27. An electronic device comprising: At least one processor; At least one memory, including one or more computer program modules; The one or more computer program modules are stored in the at least one memory and configured to be executed by the at least one processor, and the one or more computer program modules are used to implement the compensation method according to any one of claims 23-26.
28. A non-transitory readable storage medium having computer instructions stored thereon, wherein, When the computer instructions are executed by at least one processor, they implement the compensation method according to any one of claims 23-26.
29. A computer program product comprising computer instructions, wherein, When the computer instructions are executed by at least one processor, the compensation method according to any one of claims 23-26 is performed.