Compensation method and apparatus, and display device, electronic device and storage medium
Patent Information
- Application Number
- PCT/CN2025/084408
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-03-24
- Publication Date
- 2026-10-01
Smart Images

Figure CN2025084408_01102026_PF_FP_ABST
Abstract
Description
Compensation methods and devices, display devices, electronic devices and storage media Technical Field
[0001] Embodiments of this disclosure relate to a compensation method and apparatus, a display device, an electronic device, and a storage medium. Background Technology
[0002] Currently, image retention in displays is a significant technical challenge. Image retention refers to the temporary "trace" of an image left on the screen, severely impacting the user's visual experience. This issue may stem from inconsistent pixel response speeds due to the physical characteristics of the hardware, or from the degradation of pixel luminous efficiency caused by displaying static images for extended periods. To mitigate this problem, compensation methods are needed to adjust and balance the brightness performance of each pixel, thereby extending the lifespan of the display and optimizing image quality. Summary of the Invention
[0003] At least one embodiment of this disclosure provides a compensation method applied to a display screen. The compensation method includes: compensating a first image frame to be displayed on the display screen based on the full-screen temperature steady-state characteristics of the display screen to obtain a compensated first image frame, wherein the first compensated image frame is used to drive the display screen to present the first image frame.
[0004] In the compensation method provided in at least one embodiment of this disclosure, the steady-state temperature characteristics of the whole screen include: after the temperature fluctuation value of the whole screen reaches a preset range, the relative temperature difference of each part of the whole screen is less than a preset threshold.
[0005] In at least one embodiment of the compensation method provided in this disclosure, the display screen is divided into multiple display areas. The compensation of a first image frame to be displayed on the display screen based on the full-screen temperature steady-state characteristics of the display screen includes: obtaining a basic compensation map for each of the multiple display areas of the display screen based on the full-screen temperature steady-state characteristics of the display screen; for each display area, compensating a first local image frame corresponding to the display area based on the basic compensation map of the display area to obtain a first local compensated image frame corresponding to the display area, wherein the first local image frame is the part of the first image frame corresponding to the display area, and the first local compensated image frame is the part of the first compensated image frame corresponding to the display area.
[0006] In at least one embodiment of the compensation method provided in this disclosure, the display screen is a spliced display screen composed of multiple unit screens. The compensation of the first image frame to be displayed on the display screen based on the full-screen temperature steady-state characteristics of the display screen includes: obtaining a basic compensation map of each display area in multiple display areas of the display screen based on the full-screen temperature steady-state characteristics of the display screen, wherein the multiple display areas correspond one-to-one with the multiple unit screens; for each unit screen, obtaining an adjustment compensation map of the unit screen based on a time-domain model and a spatial-domain model, wherein the time-domain model reflects the influence of historical images on the temperature of the unit screen, and the spatial-domain model reflects the heat diffusion law within the unit screen and / or the influence of the physical structure of the unit screen on heat diffusion; obtaining a real-time compensation map of the unit screen based on the basic compensation map and the adjustment compensation map of the unit screen; and compensating the first local image frame corresponding to the unit screen based on the real-time compensation map to obtain a first local compensated image frame corresponding to the unit screen, wherein the first local image frame is the part of the first image frame corresponding to the unit screen, and the first local compensated image frame is the part of the first compensated image frame corresponding to the unit screen.
[0007] In the compensation method provided in at least one embodiment of this disclosure, the step of obtaining a basic compensation map of each display area in a plurality of display areas of the display screen based on the full-screen temperature steady-state characteristics of the display screen includes: obtaining a current temperature matrix of the display screen, wherein each value in the current temperature matrix represents the current temperature of the corresponding display area; and obtaining a basic compensation map of each display area in the plurality of display areas based on the steady-state temperature matrix of the display screen and the current temperature matrix, wherein each value in the steady-state temperature matrix reflects the steady-state temperature of the corresponding display area.
[0008] In the compensation method provided in at least one embodiment of this disclosure, the process of obtaining the steady-state temperature matrix includes: obtaining the full-screen temperature matrix when the display screen shows a completely white image and the temperature fluctuation value reaches a preset range; and normalizing the full-screen temperature matrix to obtain the steady-state temperature matrix.
[0009] In at least one embodiment of the compensation method provided in this disclosure, the step of obtaining a basic compensation map for each of the plurality of display areas based on the steady-state temperature matrix of the display screen and the current temperature matrix includes: determining the maximum temperature value in the current temperature matrix and the target position of the maximum temperature value; determining the steady-state temperature value in the steady-state temperature matrix corresponding to the target position; determining the difference between the maximum value of the current temperature matrix and the steady-state temperature value, and obtaining an alignment matrix based on the difference; and obtaining a basic compensation map for each of the plurality of display areas based on the alignment matrix and the steady-state temperature matrix.
[0010] In at least one embodiment of the compensation method provided in this disclosure, determining the difference between the maximum value of the current temperature matrix and the steady-state temperature value, and obtaining an alignment matrix based on the difference, includes: normalizing the current temperature matrix to obtain a normalized current temperature matrix; calculating the ratio of the steady-state temperature value to the maximum value of the normalized current temperature matrix to obtain a difference ratio; and multiplying the normalized current temperature matrix by the difference ratio to obtain the alignment matrix.
[0011] In the compensation method provided in at least one embodiment of this disclosure, the step of obtaining a basic compensation map for each of the plurality of display areas based on the alignment matrix and the steady-state temperature matrix includes: performing an element-wise subtraction operation between the alignment matrix and the steady-state temperature matrix to obtain a compensation value coefficient matrix, wherein each value in the compensation value coefficient matrix represents a compensation value coefficient for the corresponding display area; and for each display area, obtaining a basic compensation map for the display area based on a first local image frame corresponding to the display area and the compensation value coefficient of the display area.
[0012] In at least one embodiment of the compensation method provided in this disclosure, the step of obtaining a basic compensation map of the display area based on a first local image frame corresponding to the display area and the compensation value coefficient of the display area includes: performing grayscale processing on the first local image frame corresponding to the display area to obtain a first grayscale image corresponding to the first local image frame; multiplying the first grayscale image with the compensation value coefficient of the display area to obtain a first intermediate image; then adding the first intermediate image and the first grayscale image pixel by pixel to obtain a second intermediate image; performing a scale transformation on the second intermediate image to obtain a third intermediate image; and performing a pixel-by-pixel subtraction operation between the first grayscale image and the third intermediate image to obtain the basic compensation map of the display area.
[0013] In at least one embodiment of the compensation method provided in this disclosure, obtaining the adjustment compensation map of the unit screen based on the time domain model and the spatial domain model includes: obtaining the predicted temperature image of the unit screen based on historical images; and obtaining the adjustment compensation map of the unit screen based on the predicted temperature image and the spatial domain model.
[0014] In the compensation method provided in at least one embodiment of this disclosure, the step of obtaining the predicted temperature image of the unit screen based on historical images includes: converting the heat time accumulation image into the predicted temperature image based on the mapping relationship between the heat time accumulation image and temperature, wherein the heat time accumulation image is obtained based on historical images; updating the heat time accumulation image based on the first grayscale image to obtain the heat time accumulation image corresponding to at least another local image frame after the first local image frame.
[0015] In at least one embodiment of the compensation method provided in this disclosure, updating the heat time accumulation image based on the first grayscale image includes: performing neighborhood pixel weighting processing on each pixel in the first grayscale image based on a preset weight template to obtain a neighborhood influence image; and updating the heat time accumulation image based on the neighborhood influence image.
[0016] In the compensation method provided in at least one embodiment of this disclosure, updating the heat time-accumulated image based on the first grayscale image further includes: updating an amplitude coefficient and / or a velocity coefficient based on the first grayscale image, wherein the amplitude coefficient is used to control the amplitude of temperature change and the velocity coefficient is used to control the rate of temperature change; updating the heat time-accumulated image based on the neighborhood influence image includes: updating the heat time-accumulated image based on the neighborhood influence image, the updated amplitude coefficient, and / or the updated velocity coefficient.
[0017] In the compensation method provided in at least one embodiment of this disclosure, updating the heat time accumulation image based on the first grayscale image further includes: reducing the amplitude coefficient in response to the presence of a target pixel in the heat time accumulation image whose pixel value differs from a preset brightness value within a preset range.
[0018] In at least one embodiment of the compensation method provided in this disclosure, the step of obtaining the adjustment compensation map of the unit screen based on the predicted temperature image and the spatial domain model includes: performing thermal diffusion simulation on the unit screen based on the specifications of the structural components of the unit screen to obtain a structural thermal diffusion map; performing internal thermal diffusion filtering on the predicted temperature image to obtain a content thermal diffusion map; and obtaining the adjustment compensation map of the unit screen based on the structural thermal diffusion map and the content thermal diffusion map.
[0019] In at least one embodiment of the compensation method provided in this disclosure, obtaining the real-time compensation map of the unit screen based on the basic compensation map and the adjustment compensation map of the unit screen includes: normalizing the adjustment compensation map and fusing it with the basic compensation map to obtain the real-time compensation map of the unit screen.
[0020] In at least one embodiment of the compensation method provided in this disclosure, the step of compensating the first local image frame corresponding to the unit screen based on the real-time compensation map to obtain the first local compensated image frame corresponding to the unit screen includes: performing pixel-level subtraction operations on the three color channel components of the first local image frame with the weighted real-time compensation map to obtain the first local compensated image frame.
[0021] At least one embodiment of this disclosure provides a compensation device applied to a display screen. The compensation device includes a compensation module configured to compensate a first image frame to be displayed on the display screen based on the full-screen temperature steady-state characteristics of the display screen, to obtain a compensated first image frame, wherein the first compensated image frame is used to drive the display screen to present the first image frame.
[0022] At least one embodiment of this disclosure provides a display device, which includes: a display controller and a display screen, wherein the display controller includes: a compensation device provided in the above-described at least one embodiment; a data buffer configured to temporarily store at least one externally input image frame to provide to the compensation device; a parameter storage device configured to store compensation parameters of the compensation device; and a logic control device configured to control the operation of the compensation device.
[0023] At least one embodiment of this disclosure provides an electronic device, the electronic device comprising: at least one processor; at least one memory including one or more computer program modules; wherein the one or more computer program modules are stored in the at least one memory and configured to be executed by the at least one processor, the one or more computer program modules including instructions for performing the compensation method provided in at least one embodiment of this disclosure.
[0024] At least one embodiment of this disclosure provides a non-transitory computer-readable storage medium having computer instructions stored thereon, wherein the computer instructions, when executed by at least one processor, constitute a compensation method provided by at least one embodiment of this disclosure. Attached Figure Description
[0025] To more clearly illustrate the technical solutions of the embodiments of this disclosure, the accompanying drawings of the embodiments will be briefly described below. Obviously, the drawings described below only relate to some embodiments of this disclosure and are not intended to limit this disclosure.
[0026] Figure 1 is a flowchart of a compensation method provided in at least one embodiment of the present disclosure;
[0027] Figure 2A is a schematic diagram of acquiring a first grayscale image according to at least one embodiment of the present disclosure;
[0028] Figure 2B is a schematic diagram of obtaining a basic compensation map provided in at least one embodiment of this disclosure;
[0029] Figure 3A is a schematic diagram of a cumulative heat acquisition time image provided in at least one embodiment of the present disclosure;
[0030] Figure 3B is a schematic diagram of a 3×3 preset weight template provided in at least one embodiment of the present disclosure;
[0031] Figure 4A is a schematic diagram of a unit screen provided in at least one embodiment of this disclosure;
[0032] Figure 4B is a schematic diagram of thermal diffusion simulation provided by at least one embodiment of the present disclosure;
[0033] Figure 4C is a schematic diagram of an intra-screen thermal diffusion filter provided in at least one embodiment of the present disclosure;
[0034] Figure 5 is an exemplary schematic diagram of a compensation method provided in at least one embodiment of this disclosure;
[0035] Figure 6 is a schematic block diagram of a compensation device provided in at least one embodiment of the present disclosure;
[0036] Figure 7A is a schematic block diagram of a display device provided in at least one embodiment of the present disclosure;
[0037] Figure 7B is a schematic block diagram of a display controller provided in at least one embodiment of the present disclosure;
[0038] Figure 8 is a schematic block diagram of an electronic device provided in at least one embodiment of the present disclosure;
[0039] Figure 9 is a schematic block diagram of another electronic device provided in at least one embodiment of the present disclosure;
[0040] Figure 10 is a schematic block diagram of a non-transitory computer-readable storage medium provided in at least one embodiment of the present disclosure. Detailed Implementation
[0041] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this disclosure. All other embodiments obtained by those skilled in the art based on the described embodiments of this disclosure without creative effort are within the scope of protection of this disclosure.
[0042] Unless otherwise defined, the technical or scientific terms used in this disclosure shall have the ordinary meaning understood by one of ordinary skill in the art to which this disclosure pertains. The terms “first,” “second,” and similar terms used in this disclosure do not indicate any order, quantity, or importance, but are merely used to distinguish different components. Terms such as “comprising” or “including” mean that the element or object preceding the word encompasses the elements or objects listed following the word and their equivalents, without excluding other elements or objects. Terms such as “connected” or “linked” are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. Terms such as “upper,” “lower,” “left,” and “right” are used only to indicate relative positional relationships, and these relative positional relationships may change accordingly when the absolute position of the described objects changes.
[0043] The present disclosure will now be described through several specific embodiments. To keep the following description of the embodiments of the present disclosure clear and concise, detailed descriptions of known functions and known components may be omitted. When any component of an embodiment of the present disclosure appears in more than one drawing, that component is represented by the same or similar reference numerals in each drawing.
[0044] Depending on the display technology, displays can be divided into different types such as light-emitting diode (LED) displays, organic light-emitting diode (OLED) self-illuminating liquid crystal displays, and digital light processing (DLP) rear projection displays.
[0045] LED displays include conventional LED displays or micro-LED (MLED) displays. MLED displays are displays with high pixel density, high brightness, high contrast and low power consumption. MLED technology is a newly emerging display technology in recent years. MLED displays include a high pixel density two-dimensional MLED array, where each pixel can be addressed, controlled and driven to emit light independently, with the advantages of high brightness, high contrast and low energy consumption.
[0046] OLED self-illuminating liquid crystal displays use OLED technology and have the characteristic of self-illumination. They can be bent within a certain curvature, making them suitable for applications requiring flexible displays.
[0047] DLP rear projection displays use DLP projection technology to achieve display through a projector. They have high brightness and contrast, but are relatively thick, making them suitable for occasions that require a larger screen.
[0048] The development of display technology has enabled display devices to evolve beyond traditional single screens, moving towards larger and more flexible designs. With increasing demand and advancements in display technology, video wall displays have become widely used. These displays are composed of multiple independent display units (unit screens) spliced together to achieve ultra-large display effects.
[0049] Currently, image retention in displays is a significant technical challenge. Image retention refers to the temporary "trace" of an image left on a display screen, a problem that severely impacts the user's visual experience. This can stem from inconsistent pixel response times due to the display's hardware physical characteristics, or from the degradation of pixel luminous efficiency caused by displaying static images for extended periods.
[0050] One of the fundamental reasons for image retention on a display screen is that the three color (RGB) light-emitting elements generate heat when lit. For example, the luminous efficiency of the red light-emitting element decreases significantly with increased temperature, affecting its brightness and color performance. Specifically, during operation, when different grayscale levels are displayed in different areas of the screen, the luminous efficiency of the light-emitting elements varies due to different heat accumulation in those areas. For instance, in areas with high heat accumulation, the luminous efficiency decreases, while in areas with low heat accumulation, the luminous efficiency remains high. After displaying an image for an extended period, switching the entire screen to the same grayscale level can cause image retention in areas with high heat accumulation and low luminous efficiency. Ultimately, this results in uneven image display when the entire screen switches to the same grayscale, reducing display quality and impacting user experience.
[0051] Some methods rely on the prior knowledge that images with different gray levels and brightness levels will cause different display temperatures. They estimate the current display temperature using historical accumulated images and display temperature characteristics, then extrapolate the display brightness based on the estimated display temperature, and compensate for image retention based on the brightness difference. However, the inventors of this disclosure have noted that the above methods are based on estimations, which may differ from the actual display temperature characteristics, leading to inaccurate estimations of display temperature characteristics and ultimately affecting the compensation effect.
[0052] Other methods applicable to video wall displays utilize the temperature-chromaticity characteristics of individual screens for image retention compensation. However, the inventors of this disclosure have noted that the characteristics of different individual screens within the same video wall display differ, making it difficult to achieve full-screen color consistency. Specifically, a video wall display requires multiple consistency calibrations before being put into normal use to ensure that the multiple individual screens within the display can accurately and consistently display the corresponding colors. However, due to the inherent characteristics, physical location, and back-end circuitry of each individual screen, the temperatures of the individual screens may differ even when displaying a consistent color across the entire screen. This inconsistency leads to potential temperature differences between individual screens, even if their chromaticity is the same. Therefore, methods that rely solely on temperature differences between individual screens for image retention compensation have limited effectiveness.
[0053] In response to the above problems, the inventors of this disclosure noted that when the entire display screen displays a picture of the same color (e.g., full screen white, full screen red, etc.), the full screen temperature has the following characteristics: (1) regardless of the color of the picture displayed, the temperature rise trend of the entire screen (all unit screens) is consistent; (2) at different times, the temperature difference characteristics of the entire screen are consistent, that is, the relative temperature difference of each part of the screen (each unit screen) remains basically unchanged. Therefore, the inventors of this disclosure innovatively utilize the above-mentioned steady-state temperature characteristics of the entire display screen to achieve temperature difference image retention compensation, thereby improving the quality of compensation.
[0054] At least one embodiment of this disclosure provides a compensation method applied to a display screen, comprising: compensating a first image frame to be displayed on the display screen based on the full-screen temperature steady-state characteristics of the display screen to obtain a compensated first image frame, wherein the first compensated image frame is used to drive the display screen to present the first image frame.
[0055] In the compensation method provided in at least one embodiment of this disclosure, compensation is performed on the first image frame to be displayed on the display screen based on the steady-state temperature characteristics of the entire screen. This not only avoids inaccuracies caused by temperature estimation but also avoids inaccuracies caused by differences in the characteristics of different unit screens. It helps to adjust the image chromaticity of areas with high luminous efficiency of the light-emitting elements in the display screen to match the chromaticity of areas with low luminous efficiency, thereby eliminating image retention. Even after the display screen has displayed an image for a long time, when the entire display screen is switched to the same grayscale display, the uniformity of the displayed image can still be ensured, improving the display effect and user experience.
[0056] The compensation method provided by the present disclosure is described in a non-limiting manner through multiple embodiments and examples. As described below, different features in these specific examples or embodiments can be combined with each other without conflict, so as to obtain new examples or embodiments, and these new examples or embodiments also fall within the scope of protection of the present disclosure.
[0057] The compensation method provided in at least one embodiment of this disclosure is applicable to various types of displays that can be adjusted by compensation methods to regulate the light emission operation of different areas of the display screen, thereby eliminating image retention. Examples include conventional displays and splicing displays; this disclosure does not limit the types of displays. The light-emitting elements in the display screen can be, for example, mini-LEDs, micro-LEDs, or LEDs. This disclosure does not limit the specific circuit structure (e.g., the connection method and number of transistors and capacitors), manufacturing materials (e.g., gallium nitride), manufacturing processes (e.g., semiconductor manufacturing processes), or packaging methods of these LEDs.
[0058] The compensation method provided in at least one embodiment of this disclosure can be used in a display device including a display screen, the display screen receiving image pixel data and displaying it according to the image pixel data, the display screen can display dynamic images (e.g., videos) or static images (e.g., photos) during the display process, and refresh the display of image frames during the display process; these image frames can be color image frames or black and white image frames.
[0059] Figure 1 is a flowchart of a compensation method provided in at least one embodiment of this disclosure.
[0060] For example, as shown in FIG1, the compensation method provided in this embodiment includes the following step S10.
[0061] S10: Based on the full-screen temperature steady-state characteristics of the display screen, the first image frame to be displayed on the display screen is compensated to obtain the compensated first image frame, wherein the first compensated image frame is used to drive the display screen to present the first image frame.
[0062] For example, in step S10, the first image frame refers to the image frame that is currently being described. It can be any image frame among multiple image frames displayed consecutively in the video (rather than necessarily being the first image frame in time sequence among these multiple image frames), or it can be any image frame among multiple image frames that are repeatedly displayed to achieve a static image. Each pixel of the first image frame corresponds one-to-one with each physical pixel of the display screen.
[0063] For example, in step S10, the steady-state temperature characteristic of the whole screen refers to the temperature difference characteristic of the whole screen after the temperature fluctuation value of the whole screen reaches the preset range. That is, after the temperature fluctuation value of the whole screen reaches the preset range, the relative temperature difference of each part of the whole screen is less than the preset threshold.
[0064] For example, the temperature fluctuation value referred to here reaching the preset range could mean that the temperature itself remains constant, or that the temperature changes smoothly over time, exhibiting only a small range of temperature fluctuations. This disclosure does not limit the size or calculation method of the preset range. For example, the preset threshold can be set according to actual needs, such as 0.1, and this disclosure does not limit this.
[0065] In some examples, the full-screen temperature steady-state characteristic refers to the fact that after the full-screen temperature reaches a steady state, the relative temperature difference between different parts of the screen remains basically unchanged.
[0066] For example, based on the steady-state temperature characteristics of the display screen, the compensation value that needs to be increased or decreased for each pixel in the first image frame can be obtained. Based on the compensation value, the original first image frame is processed pixel-by-pixel to generate a first compensated image frame. For example, the obtained first compensated image frame is transmitted to the display screen's controller (e.g., a timing controller (e.g., T-con)). The controller then drives each pixel unit of the display screen to operate according to the compensated value, thereby maintaining the consistency and accuracy of image quality even when the display screen has been operating for a long time during actual display.
[0067] For example, in the compensation method provided in at least one embodiment of this disclosure, the display screen can be divided into multiple display areas, and a temperature sensor is provided for each display area to collect the temperature of the corresponding display area in real time. The temperature sensor can be located, for example, in the back structure of the display screen or inside the display screen. For example, the multiple display areas can be evenly divided. An example of step S10 above may include the following steps S101 to S102.
[0068] Step S101: Obtain the basic compensation map of each display area in multiple display areas of the display screen based on the full-screen temperature steady-state characteristics of the display screen.
[0069] For example, in step S101, a basic compensation map corresponding to each display area can be generated based on the full-screen temperature steady-state characteristics of the display screen. Each display area has a corresponding basic compensation map, and each pixel of the basic compensation map corresponds one-to-one with each physical pixel of the display area. It should be noted that "basic" in the basic compensation map means that it is the basis for subsequent operations during the implementation of the technical solution, and does not mean that it is original or the most basic.
[0070] For example, in step S101, the full-screen temperature steady-state characteristic refers to the fact that after the full-screen temperature fluctuation value reaches a preset range, the relative temperature difference between the display areas of the screen is less than a preset threshold. In some examples, the full-screen temperature steady-state characteristic refers to the fact that after the full-screen temperature reaches a stable state, the relative temperature difference between the display areas of the screen remains basically unchanged.
[0071] Step S102: For each display area, the first local image frame corresponding to the display area is compensated based on the basic compensation map of the display area to obtain the first local compensated image frame corresponding to the display area. The first local image frame is the part of the first image frame that corresponds to the display area, and the first local compensated image frame is the part of the first compensated image frame that corresponds to the display area.
[0072] For example, in step S102, according to the division method of the display area, the first image frame can also be divided into multiple first local image frames, and each first local image frame corresponds to a display area.
[0073] For example, in step S102, for each display area, the three color channel components of the first local image frame corresponding to that display area can be subtracted pixel-wise from the base compensation image corresponding to that display area to obtain the first local compensation image frame. Alternatively, the base compensation image can be further processed, and then the three color channel components of the first local image frame can be subtracted pixel-wise from the further processed base compensation image to obtain the first local compensation image frame. Combining the first local compensation image frames of all display areas yields the complete first compensation image frame.
[0074] For example, in the compensation method provided in at least one embodiment of this disclosure, the display screen is a spliced display screen composed of multiple unit screens. A temperature sensor is set for each unit screen to collect the temperature of the corresponding unit screen in real time. The temperature sensor can be set in the back structure of the unit screen, or inside the unit screen. An example of step S10 above may include the following steps S111 to S112.
[0075] Step S111: Based on the steady-state temperature characteristics of the full screen, obtain the basic compensation map of each display area in the multiple display areas of the display screen, wherein the multiple display areas correspond one-to-one with multiple unit screens.
[0076] For example, in step S111, a basic compensation map corresponding to each unit screen can be generated based on the steady-state temperature characteristics of the entire display screen. Each unit screen has a corresponding basic compensation map, and each pixel of the basic compensation map corresponds one-to-one with each physical pixel of that unit screen.
[0077] For example, in step S111, the full-screen temperature steady-state characteristic refers to the fact that after the temperature fluctuation value of the entire splicing display screen reaches a preset range, the relative temperature difference of each unit screen is less than a preset threshold. In some examples, the full-screen temperature steady-state characteristic refers to the fact that after the temperature of the entire splicing display screen reaches a stable state, the relative temperature difference of each unit screen remains basically unchanged.
[0078] Next, for each unit screen, perform the following steps S112 to S114 respectively.
[0079] Step S112: Obtain the adjustment compensation map of the unit screen based on the temporal and spatial models. The temporal model reflects the influence of historical images on the temperature of the unit screen, and the spatial model reflects the heat diffusion law within the unit screen and / or the influence of the physical structure of the unit screen on heat diffusion.
[0080] For example, in step S112, the time-domain model primarily focuses on changes over time, specifically the temperature variation pattern of the unit screen over time. For example, for a unit screen, the first local image frame mentioned above is the portion of the first image frame corresponding to that unit screen, which is the image frame to be displayed on that unit screen. For example, historical images can include portions of one or more image frames preceding the current first image frame that correspond to the unit screen (e.g., first local image frames from a past period), or images obtained after further processing (e.g., grayscale conversion) of the first local image frame. For example, historical images can include grayscale images from a past period (e.g., 10 minutes, 20 minutes, or half an hour).
[0081] For example, in step S112, the spatial domain model mainly focuses on spatial changes, that is, how to describe the heat distribution and diffusion patterns within a region. Since the illuminated images within a unit screen may be inconsistent, temperature differences may also occur within the unit screen, resulting in temperature difference afterimages within the unit screen. However, since each unit screen only has one temperature sensor at its center, it is difficult to detect the temperature at all locations within the unit screen. Therefore, the temperature difference characteristics within the unit screen need to be simulated using the spatial domain model. When constructing the spatial domain model, it can be based on the heat diffusion patterns within the unit screen, the influence of the unit screen's physical structure on heat diffusion, or both. This embodiment of the disclosure does not impose any limitations on this approach.
[0082] Step S113: Obtain the real-time compensation map of the unit screen based on the basic compensation map and the adjustment compensation map of the unit screen.
[0083] For example, one example of step S113 is: normalizing the adjustment compensation map and merging it with the basic compensation map to obtain the real-time compensation map of the unit screen.
[0084] For example, to improve the accuracy of compensation value calculation, the adjustment compensation map can be normalized, adjusting all pixel values of the adjustment compensation map to a fixed range, such as between 0 and 1. The normalized adjustment compensation map is then fused with the previously obtained base compensation map to generate the final real-time compensation map. For example, the fusion can be performed by multiplication, addition, or weighted accumulation, and this disclosure does not limit this method.
[0085] This step allows the real-time compensation value of each pixel to combine steady-state temperature characteristics and spatiotemporal information, that is, it not only takes into account the influence of the overall environment, but also the local differences within the unit screen.
[0086] Step S114: Compensate the first local image frame corresponding to the unit screen based on the real-time compensation image to obtain the first local compensated image frame corresponding to the unit screen. The first local image frame is the part of the first image frame that corresponds to the unit screen, and the first local compensated image frame is the part of the first compensated image frame that corresponds to the unit screen.
[0087] For example, in step S114, the splicing display screen composed of multiple unit screens can also be regarded as dividing the complete display screen into multiple unit screens. According to this division method, the first image frame can also be divided into multiple first local image frames, and each first local image frame corresponds to a unit screen.
[0088] For example, one example of step S114 is to perform pixel-level subtraction operations between the three color channel components of the first local image frame and the weighted real-time compensation image to obtain the first local compensation image frame.
[0089] For example, for each unit screen, the real-time compensation map corresponding to the unit screen can be applied to the first local image frame corresponding to the unit screen for real-time compensation. The compensation coefficients for the three independent color channels of the RGB primary colors are not the same, and the specific calculation formulas for each channel after compensation are as follows: I C_R =I R -C R ×C w I C_G =I G -C G ×C w I C_B =I B -C B ×C w
[0090] Among them, C w For real-time compensation diagrams, I R I G I B These are the values of the RGB three channels in the first local image frame, I C_R I C_G I C_B These are the values after compensation for the RGB three channels, C R C G C B These are the compensation coefficients for the three RGB channels, and the compensated RGB three-channel values I are... C_R I C_G and I C_BThe images are integrated into a single image, which serves as the output of the final compensation processing of the current first local image frame, i.e., the first locally compensated image frame. It should be noted that the compensation coefficients for each color channel are set according to actual needs, and this embodiment does not impose any limitations on this. The complete first compensated image frame is obtained by combining the first locally compensated image frames from all unit screens.
[0091] An example of steps S101 and S111 above may include steps S201 to S202.
[0092] Step S201: Obtain the current temperature matrix of the display screen, where each value in the current temperature matrix represents the current temperature of the corresponding display area.
[0093] For example, in the case of a non-splicing display screen, the screen is divided into multiple display areas, which together form a complete display. A temperature sensor can be placed behind each display area to collect its temperature in real time. In the case of a splicing display screen, multiple individual screens form a complete display. A temperature sensor can be placed behind each individual screen to collect its temperature in real time. In this case, the splicing display screen can be considered as divided into multiple display areas, with a one-to-one correspondence between these areas and individual screens; that is, each individual screen corresponds to one display area. Regardless of the image currently displayed on the screen, the temperature data collected in real time by the temperature sensor reflects the overall temperature characteristics of the entire screen.
[0094] For example, in step S201, assuming the display screen is divided into m rows and n columns, forming m×n display areas, the current temperature matrix is also an m-row, n-column matrix. Each value in the current temperature matrix represents the temperature of the corresponding display area collected in real time by the temperature sensor. An example is shown below:
[0095] Among them, T now For the current temperature matrix, T now (m,n) represents the current temperature of the display area in the m-th row and n-th column.
[0096] For example, in step S201, if the display screen is a splicing display screen, assuming that the splicing display screen is composed of m rows and n columns of unit screens, then the current temperature matrix is also a matrix of m rows and n columns. Each value in the current temperature matrix represents the temperature of the corresponding unit screen collected in real time by the temperature sensor.
[0097] Step S202: Based on the steady-state temperature matrix and the current temperature matrix of the display screen, obtain the basic compensation map of each display area in multiple display areas, wherein each value in the steady-state temperature matrix reflects the steady-state temperature of the corresponding display area.
[0098] For example, in step S202, when the display screen is a non-splicing display screen, the steady-state temperature matrix reflects the steady-state temperature of each display area in the display screen, and the current temperature matrix reflects the current temperature of each display area in the display screen. Based on the difference between the steady-state temperature matrix and the current temperature matrix, the basic compensation map corresponding to each display area can be calculated.
[0099] For example, in step S202, when the display screen is a splicing display screen, the steady-state temperature matrix reflects the steady-state temperature of each unit screen that makes up the splicing display screen, and the current temperature matrix reflects the current temperature of each unit screen. The compensation value can be calculated based on the difference between the steady-state temperature matrix and the current temperature matrix, and the basic compensation map corresponding to each unit screen is calculated.
[0100] For example, the steady-state temperature matrix in step S202 can be obtained according to the following steps S202A to S202B.
[0101] Step S202A: Obtain the full-screen temperature matrix when the display screen shows a completely white image and the temperature fluctuation value reaches the preset range.
[0102] For example, in step S202A, the entire display screen shows a white image. The temperature sensor described above is used to monitor the temperature of each display area. When the temperature fluctuation value reaches a preset range, a full-screen temperature matrix is collected. Similar to the current temperature matrix in step S201, each value in the full-screen temperature matrix represents the steady-state temperature of the corresponding display area. For example, the temperature fluctuation value reaching the preset range here could mean that the temperature itself remains constant, or that the temperature changes smoothly over time, exhibiting only a small range of temperature fluctuations. This embodiment of the disclosure does not limit the size or calculation method of the preset range.
[0103] Step S202B: Normalize the full-screen temperature matrix to obtain the steady-state temperature matrix.
[0104] For example, in step S202B, the normalization process involves finding the maximum value in the full-screen temperature matrix and then dividing each value in the full-screen temperature matrix by that maximum value. Therefore, each value in the steady-state temperature matrix represents the normalized steady-state temperature value of the corresponding display area.
[0105] Steps S202A to S202B described above can be performed before executing the compensation method provided in this embodiment of the disclosure; that is, the steady-state temperature matrix can be obtained in advance. For each display screen, the steady-state temperature matrix only needs to be calculated once.
[0106] The compensation method provided by one or more embodiments of this disclosure can be deployed in hardware logic components such as field-programmable gate arrays (FPGAs) and run in real time. In this case, it is necessary to perform fixed-point conversion on the floating-point numbers during the calculation process. Fixed-point conversion refers to the process of converting floating-point numbers to fixed-point numbers, for example, by multiplying the floating-point number by a suitable scaling factor and then rounding it. This is because most hardware and low-level operations tend to handle integers rather than floating-point numbers, especially in scenarios such as field-programmable gate arrays (FPGAs), embedded systems, digital signal processors (DSPs), or display driver circuits. To improve computational efficiency and reduce resource consumption, fixed-point representation and calculation are typically used.
[0107] For example, the steady-state temperature matrix can be fixed-pointed using the above fixed-point processing method, such as fixing the data in the steady-state temperature matrix into data with a data width of 14 bits.
[0108] For example, for a video wall display consisting of 4 rows and 8 columns of individual screens, assuming the full-screen temperature matrix T of the video wall display is... s as follows:
[0109] The 14-bit fixed-point steady-state temperature matrix T is obtained by normalizing and localizing the full-screen temperature matrix. s_normFP for:
[0110] The inventors of this disclosure noted that the display area with the highest current temperature on the screen does not require compensation. Based on this, by locating the display area with the highest current temperature, the chromaticity of other display areas on the screen can be adjusted to match that of the currently hottest display area, thereby achieving image retention compensation. Since the currently hottest display area is not necessarily the same as the hottest display area under steady-state conditions, it is necessary to determine the temperature difference between the currently hottest display area and that area under steady-state conditions. This difference is then used to determine the temperature difference between other display areas on the screen and other display areas under steady-state conditions, and compensation is performed accordingly.
[0111] Therefore, one example of step S202 above may include steps S211 to S214.
[0112] Step S211: Determine the maximum temperature value and the target location of the maximum temperature value in the current temperature matrix.
[0113] For example, in step S211, all temperature values in the current temperature matrix are traversed, the maximum temperature value is found, and the specific position of the maximum temperature value in the current temperature matrix is recorded. For example, the target position can be represented by row index and column index.
[0114] Step S212: Determine the steady-state temperature value corresponding to the target location in the steady-state temperature matrix.
[0115] For example, in step S212, since the steady-state temperature matrix and the current temperature matrix have the same dimensions, the steady-state temperature value can be obtained from the steady-state temperature matrix based on the target position determined in step S211. Specifically, the steady-state temperature value can be obtained by directly accessing the position corresponding to the target position in the steady-state temperature matrix. For example, if the maximum temperature value of the current temperature matrix is determined to be located in the second row and third column of the current temperature matrix in step S211, then the steady-state temperature value is the temperature value in the second row and third column of the steady-state temperature matrix.
[0116] Step S213: Determine the difference between the maximum value of the current temperature matrix and the steady-state temperature value, and obtain the alignment matrix based on this difference.
[0117] For example, in step S213, determining the temperature difference between the display area with the highest current temperature and that display area under steady-state conditions can be used to determine the temperature differences between other display areas on the current screen and other display areas under steady-state conditions. The alignment matrix is the result of aligning the maximum value of the current temperature matrix with the steady-state temperature matrix.
[0118] Step S214: Based on the alignment matrix and steady-state temperature matrix, obtain the basic compensation map for each display area in multiple display areas.
[0119] For example, in step S214, the temperature difference between other display areas in the current display screen and other display areas under steady-state conditions can be determined according to the alignment matrix, and the basic compensation map of each area can be calculated based on these temperature differences.
[0120] An example of step S213 may include steps S231 to S233.
[0121] Step S231: Normalize the current temperature matrix to obtain the normalized current temperature matrix.
[0122] For example, in step S231, after obtaining the current temperature matrix, it needs to be normalized. The specific operation of the normalization process is to find the maximum value in the current temperature matrix, and then divide each value in the current temperature matrix by the maximum value.
[0123] In some examples, when the compensation method provided in this disclosure embodiment needs to be run in real time in hardware such as an FPGA, a lookup table can be used for normalization calculation. The maximum value in the current temperature matrix obtained at different times and under different screen conditions will vary. The value obtained by looking up "1 / maximum value in the current temperature matrix" after fixed-point normalization can be found through a lookup table. Then, all data in the current temperature matrix are multiplied by this value to obtain the normalized value of the fixed-point current temperature data. In some examples, the current screen temperature data can be fixed-point normalized to 18-bit data. The lookup table for the fixed-point normalization value is shown in Table 1.
[0124] Table 1: Fixed-point value lookup table
[0125] It should be noted that the above fixed-point value lookup table can also be adjusted according to actual needs, and this disclosure does not impose any restrictions on it.
[0126] Step S232: Calculate the ratio of the steady-state temperature value to the maximum value of the normalized current temperature matrix to obtain the difference ratio.
[0127] For example, in step S232, the steady-state temperature value is the temperature value in the steady-state temperature matrix that corresponds to the position of the maximum temperature value in the current temperature matrix. The result of dividing the steady-state temperature value by the maximum value of the normalized current temperature matrix is the difference ratio.
[0128] In some examples, see Table 1, the maximum value of the normalized current temperature matrix is 262143, which is 18 bits of data. After calculating the difference ratio, the difference ratio is fixed-point normalized to 14 bits of data.
[0129] Step S233: Multiply the normalized current temperature matrix by the difference ratio to obtain the alignment matrix.
[0130] For example, in step S233, multiplying the normalized current temperature matrix by the difference ratio obtained in step S232 can align the current temperature data with the steady-state temperature data, resulting in an alignment matrix. In some examples, the data in the alignment matrix can be fixed-point converted to 14-bit data using the fixed-point conversion process described above.
[0131] An example of step S214 may include steps S241 to S242.
[0132] Step S241: Perform element-wise subtraction between the alignment matrix and the steady-state temperature matrix to obtain the compensation value coefficient matrix, where each value in the compensation value coefficient matrix represents the compensation value coefficient of the corresponding display area.
[0133] For example, in step S241, since the alignment matrix and the steady-state temperature matrix have the same dimension, they can be directly subtracted element by element. That is, the elements in the alignment matrix are subtracted from the corresponding elements in the steady-state temperature matrix to obtain the compensation value coefficient matrix.
[0134] The compensation coefficients calculated in step S241 can have both positive and negative values. A positive value indicates that the temperature of the display area is higher than the steady-state temperature, while a negative value indicates that the temperature of the display area is lower than the steady-state temperature. In some examples, the compensation coefficients can be fixed-point converted into 14-bit data using the fixed-point conversion process described above.
[0135] Step S242: For each display area, obtain the basic compensation map of the display area based on the first local image frame corresponding to the display area and the compensation value coefficient of the display area.
[0136] For example, the compensation value coefficient matrix can be obtained through the above step S241. Each value in the compensation value coefficient matrix represents the compensation value coefficient of the corresponding display area. The basic compensation map can be calculated using the compensation value coefficient of each display area.
[0137] An example of step S242 may include performing steps S251 to S254 for each display area.
[0138] Step S251: Perform grayscale processing on the first local image frame corresponding to the display area to obtain the first grayscale image corresponding to the first local image frame.
[0139] For example, in step S251, for a color image, grayscale processing mainly involves converting the color information (usually including red, green, and blue (RGB) color channels) of each pixel in the original color image into a single grayscale value; for a black and white image, grayscale processing may include converting the grayscale information of each pixel in the original black and white image into the grayscale value corresponding to the display screen. For example, the grayscale value can be calculated using a specific conversion function, such as ITU-R 601, ITU-R 709, or the averaging method. For example, the grayscale processing scaling factor can also be obtained based on the three-channel temperature rise curve of the display screen. The temperature rise curve can be an empirical temperature rise curve obtained from experiments or simulations, or it can be a measured temperature rise curve; this disclosure does not impose any limitations on this.
[0140] For example, in step S251, the temperature rise curve of the display screen when the temperature fluctuation value reaches the preset range under the condition of displaying red, blue and green screens can be obtained, and the grayscale processing ratio coefficient can be obtained according to the temperature rise curve under the three conditions. The first local image frame is then grayscale processed according to the ratio coefficient to obtain the first grayscale image corresponding to the first local image frame.
[0141] Figure 2A is a schematic diagram of acquiring a first grayscale image according to at least one embodiment of the present disclosure.
[0142] For example, as shown in Figure 2A, by measuring the temperature rise curves (R channel, B channel, and G channel temperature rise curves) of the display screen after a certain period of time when the temperature fluctuation value reaches the preset range under the conditions of displaying full red, full blue, and full green images respectively, the temperature rise ratio of the RGB three channels in the display screen is obtained as T. R :T G :T B =0.596577:0.13018:0.27324, and use this ratio as the grayscale processing coefficient to perform grayscale conversion on the first local image frame. For example, the temperature fluctuation value referred to here reaching the preset range can mean that the temperature itself remains unchanged, or that the temperature change tends to be stable over time, only showing a small range of temperature fluctuations. This embodiment of the present disclosure does not limit this. For example, this embodiment of the present disclosure does not limit the preset range of temperature fluctuation values.
[0143] It should be noted that the above-mentioned scaling factor is related to the characteristics of the display screen. Different display screens will have different scaling factors. The above three-channel temperature rise ratio is only an example and does not constitute a limitation of this disclosure.
[0144] For example, the first grayscale image I is calculated based on the grayscale processing scaling factor. Gray An example formula is as follows: I Gray =T R ×I R +T G ×I G +T B ×I B =0.596577×I R +0.13018×I G +0.27324×I B
[0145] Among them, I R I G I B These are the values of the RGB three channels in the first local image frame.
[0146] For example, the first local image frame is 8-bit unsigned data with a value range of [0, 255]. The scaling factor used for adjustment in the above formula is a floating-point number, which needs to be converted to a fixed-point value. For example, multiplying the scaling factor matrix [0.596577, 0.13018, 0.243243] by a scaling factor (e.g., 2) 20 ), thus obtaining the fixed-point scaling coefficient matrix [625556,136503,286516].
[0147] For example, the first grayscale image I is calculated based on the scaling factor after point-to-point processing. Gray An example formula is as follows: I Gray =625556×I R +136503×I G +286516×I B
[0148] For example, I after the calculation is completed Gray The data has a bit width of 28 bits. After shifting and rounding, an 8-bit first grayscale image is obtained.
[0149] Step S252: Multiply the first grayscale image by the compensation value coefficient of the display area to obtain the first intermediate image, and then add the first intermediate image and the first grayscale image pixel by pixel to obtain the second intermediate image.
[0150] For example, in step S252, a second intermediate image for any display area can be calculated according to the following exemplary formula: new comp =I Gray +I Gray ×comp norm
[0151] For the same display area, I Gray For the first grayscale image corresponding to this display area, comp norm The compensation value coefficient corresponding to this display area, new comp This is the second intermediate image corresponding to the display area. In some examples, the data in the second intermediate image can be converted to 9-bit data using the point-to-point conversion process described above.
[0152] Step S253: Perform scale transformation on the second intermediate image to obtain the third intermediate image.
[0153] For example, in step S253, in order to obtain a more ideal compensation value, the second intermediate image of any display area can be scaled according to the following exemplary formula:
[0154] For the same display area, convert comp For the third intermediate image corresponding to this display area, max(new) comp ) represents the maximum value in the second intermediate image corresponding to the display area, and β is the scale transformation coefficient. It should be noted that the value of the scale transformation coefficient β can be set according to actual needs, and this embodiment does not impose any limitations on it. For example, β = 0.3.
[0155] For example, the above calculations can be performed using lookup tables and fixed-point processing, which can simplify the calculations. The lookup tables used are shown in Tables 2 and 3.
[0156] Table 2: Fixed-point value lookup table
[0157] Table 3: Fixed-point value lookup table
[0158] For example, suppose that the corresponding pixel is obtained through calculation If the value is 1 / 2, then it can be found in the fixed-point value lookup table shown in Table 2. The corresponding fixed-point value is 16383. With β = 0.3, it can be found in the fixed-point lookup table shown in Table 3. That is, 16383 0.3 The fixed-point value is 16383.
[0159] Step S254: Perform pixel-by-pixel subtraction between the first grayscale image and the third intermediate image to obtain the basic compensation map of the display area.
[0160] For example, in step S254, the base compensation map for any display area can be calculated according to the following exemplary formula: C b =I Gray -convert comp
[0161] Among them, C b This is the base compensation map for the display area, I Gray It is the first grayscale image corresponding to this display area, convert comp This is the third intermediate image corresponding to the display area. Using the above method, a base compensation image can be calculated for each display area.
[0162] Similarly, when the display screen is a spliced display screen composed of multiple unit screens, since there is a one-to-one correspondence between multiple display areas and multiple unit screens, a basic compensation map can also be calculated for each unit screen.
[0163] For example, assuming the video wall display consists of multiple unit screens S1 to S16, it is considered that the video wall display is divided into multiple display areas A1 to A16, and each display area A1 to A16 corresponds one-to-one with a unit screen S1 to S16. Therefore, the basic compensation map of display area A1 calculated using the above formula is the basic compensation map of unit screen S1. The calculation method for the basic compensation maps of the other unit screens is similar and will not be elaborated here. Using the above method, a basic compensation map can be calculated for each unit screen.
[0164] Figure 2B is a schematic diagram of obtaining the basic compensation map according to at least one embodiment of this disclosure. Figure 2B is a specific example of steps S201 to S202 described above.
[0165] For example, as shown in Figure 2B, the current temperature matrix and steady-state temperature matrix of the display screen are first obtained, where the steady-state temperature matrix can be obtained in advance.
[0166] Next, the maximum temperature value and the target location of the maximum temperature value in the current temperature matrix are determined, and the steady-state temperature value corresponding to the target location in the steady-state temperature matrix is also determined. The current temperature matrix is normalized to obtain a normalized current temperature matrix; the ratio of the steady-state temperature value to the maximum value of the normalized current temperature matrix is calculated to obtain the difference ratio; the normalized current temperature matrix is multiplied by the difference ratio to obtain the alignment matrix.
[0167] Next, the alignment matrix and the steady-state temperature matrix are subtracted element by element to obtain the compensation coefficient matrix.
[0168] Finally, for each display area, the first local image frame corresponding to the display area is grayscaled to obtain a first grayscale image; the first grayscale image is multiplied by the compensation value coefficient of the display area to obtain a first intermediate image; the first intermediate image is then added pixel by pixel to the first grayscale image to obtain a second intermediate image; the second intermediate image is scaled to obtain a third intermediate image; and the first grayscale image and the third intermediate image are subtracted pixel by pixel to obtain the base compensation map of the display area.
[0169] The compensation method provided in at least one embodiment of this disclosure proposes a compensation method that conforms to the temperature rise law. It not only considers the real-time temperature of each area of the display screen, but also the steady-state temperature characteristics of the display screen, which can effectively improve the compensation quality and enhance the consistency and stability of the display effect.
[0170] An example of step S112 may include steps S301 to S302.
[0171] Step S301: Obtain the predicted temperature image of the unit screen based on historical images.
[0172] For example, the definition of historical images can be found in the description above; it can be multiple frames from the past or a single frame from the past, depending on specific requirements. By analyzing images displayed on a unit screen in the past, the current temperature distribution of the unit screen can be predicted.
[0173] Step S302: Obtain the adjustment compensation map of the unit screen based on the predicted temperature image and the spatial domain model.
[0174] The above method integrates a dual compensation strategy encompassing both temporal and spatial dimensions in the adjustment and compensation map. By comprehensively considering spatiotemporal factors, this approach allows for the adjustment and optimization of display effects from multiple perspectives, resulting in more accurate compensation outcomes and significantly improving the display performance per unit screen.
[0175] An example of step S301 may include the following steps S311 to S312.
[0176] Step S311: Based on the mapping relationship between the heat time-accumulation image and temperature, convert the heat time-accumulation image into a predicted temperature image, wherein the heat time-accumulation image is obtained based on historical images.
[0177] Step S312: Update the heat time accumulation image based on the first grayscale image to obtain the heat time accumulation image corresponding to at least another local image frame after the first local image frame.
[0178] For example, for a single screen, the other partial image frame may be an image frame that is immediately after the first partial image frame in time, or a partial image frame that is to be displayed after a predetermined time period (e.g., 0.1 seconds or 1 second). The embodiments of this disclosure do not limit this, and thus the compensation operation for the other partial image frame takes into account the influence of the display process of the preceding first partial image frame.
[0179] The following is an example of steps S311 to S312.
[0180] For example, a weighted fusion of a first number of historical images accumulated in the cache pool can be performed using time window weights to obtain a cumulative heat time image; and based on the mapping relationship between the cumulative heat time image and temperature, the cumulative heat time image can be converted into a predicted temperature image. For example, the time window weights are weight coefficients used to describe the current impact of historical images in the current time window on the temperature of the display screen. These weights can be obtained from experiments or simulations, or from processing measured temperature rise curves; this disclosure does not impose any limitations on this. For example, multiple (historical) images obtained within a past period (e.g., up to the current image frame, i.e., the first image frame, within a predetermined time period) are stored in the cache pool. The cumulative heat time image for the current unit screen is obtained by weighted fusion of these historical images using time window weights.
[0181] It should be noted that the aforementioned time length can be any value, and this disclosure does not impose any restrictions on it. For example, the time length can be the time from when the unit screen displays a completely white image until the temperature fluctuation value reaches a preset range. For example, the time length can be half an hour, and if one frame is collected per second (i.e., the sampling frequency is 1), then the corresponding first quantity is 1800. For example, taking a time length of half an hour and a first quantity of 1800 as an example, the cache pool stores 1800 historical images accumulated over the past half hour.
[0182] For example, when a unit screen is turned on, since there is no historical data, 1800 frames of all-white or all-black images can be filled into the cache pool as an initial baseline.
[0183] For example, a thermal time-cumulative image can be converted into a predicted temperature image based on the mapping relationship between thermal time-cumulative images and temperature. Each pixel value in the thermal time-cumulative image represents the accumulated heat value at that location over a period of time (thermal time-cumulative value).
[0184] The above mapping relationship can be a gamma mapping, and an example calculation formula is as follows: T(x,y)=H(x,y) γ
[0185] Where T(x,y) represents the temperature value at pixel (x,y) in the predicted temperature image, H(x,y) represents the cumulative heat value at pixel (x,y) in the heat time accumulation image, and γ is the gamma value used to control the degree of nonlinearity of the mapping. A suitable gamma value can be determined according to actual needs, and this disclosure does not impose any limitations on this.
[0186] For example, gamma mapping can be performed on each pixel value in the heat time-cumulative image to convert it into a temperature value. The image composed of the converted temperature values of each pixel is the predicted temperature image. It should be noted that, in order to improve the accuracy of the mapping, data processing steps such as normalization can also be added, and this disclosure does not limit this.
[0187] After obtaining the current predicted temperature image of the unit screen, the buffer pool is updated based on the first grayscale image corresponding to the first local image frame of the unit screen to obtain the heat time accumulation image corresponding to at least another local image frame that will be displayed on the unit screen after the first local image frame.
[0188] For example, for a single screen, the other partial image frame may be an image frame that is immediately after the first partial image frame in time, or a partial image frame that is to be displayed after a predetermined time period (e.g., 0.1 seconds or 1 second). The embodiments of this disclosure do not limit this, and thus the compensation operation for the other partial image frame takes into account the influence of all parameters of the display process of the preceding first partial image frame.
[0189] For example, the first grayscale image corresponding to the first local image frame is added to the cache pool, and in response to the fact that the number of historical images in the cache pool has reached a preset threshold before the first grayscale image corresponding to the first local image frame is added, the historical image frame furthest from the current time in the cache pool is removed.
[0190] In at least one embodiment, taking a resolution of 160×180 pixels per unit screen as an example, in order to reduce the complexity of storage and computation while ensuring the basic pattern outline, the first grayscale image can also be averaged after grayscale processing.
[0191] For example, a first grayscale image with a size of 160×180 pixels is downsampled and divided into 8×9 first regions of size 20×20 pixels. The grayscale mean value of the grayscale image pixels in each first region is calculated to obtain a value representing the overall grayscale characteristics of that region, thus obtaining a first grayscale image of size 8×9.
[0192] For example, taking a time length of half an hour and a first quantity of 1800 as an example, the cache pool stores 1800 historical images accumulated in the past half hour. Each historical image is obtained by performing the above grayscale processing on another local image frame before the first local image frame.
[0193] For example, the current first image frame is acquired every second, thereby obtaining the first local image frame corresponding to the current unit screen. After grayscale processing, a first grayscale image is obtained. When the first grayscale image is added to the cache pool, if the number of historical images in the cache pool has reached 1800 before the first grayscale image corresponding to the first local image frame is added, the historical image frame furthest from the current time in the cache pool is removed to keep the data in the cache pool always from the most recent half hour. The data in the current cache pool is used to generate the heat time accumulation image of at least one other local image frame after the first local image frame. It should be noted that the above-mentioned preset quantity threshold is not limited in the embodiments of this disclosure and can be adjusted according to actual conditions; for example, the preset quantity threshold can be fixedly set (i.e., cannot be modified) in the corresponding processing device, or it can be flexibly set or modified, for example, through a writable memory (e.g., a register).
[0194] The time window weight of a unit screen can be pre-constructed through the following steps: obtain the temperature rise curve from the moment the unit screen displays a full white image until the temperature fluctuation value reaches the preset range; obtain the time window weight based on the temperature rise curve.
[0195] Figure 3A is a schematic diagram of a cumulative heat acquisition time image provided in at least one embodiment of the present disclosure.
[0196] For example, as shown in Figure 3A, the time window weight is obtained by sampling the temperature rise curve from the moment the unit screen displays a full white image until the temperature fluctuation value reaches a preset range. For example, as shown in Figure 3A, the temperature rise curve is processed to obtain the time window weight corresponding to 1800 frames, and the time window weight is a 1×1800 vector. For example, the data processing includes at least one of mirroring, inversion, and normalization operations. For example, the temperature fluctuation value reaching the preset range can mean that the temperature itself remains constant, or that the temperature changes smoothly over time, exhibiting only a small range of temperature fluctuations. This embodiment of the disclosure does not limit the size or calculation method of the preset range.
[0197] For example, as shown in Figure 3A, the weight value on the far right of the time window weight represents the weight value of the frame closest to the current time. The weight values of the approximately 300 frames closest to the current time are significantly higher than the weight values of other earlier historical frames. This means that when estimating temperature-related compensation, the closer the data is to the current time, the greater its contribution to the current compensation value.
[0198] For example, to efficiently process these weights in hardware or algorithms, the weights for the time window with values in the range [0,1] need to be multiplied by a scaling factor (e.g., 2). 18 A fixed-point transformation is performed to obtain the fixed-point time window weights. For example, by multiplying all historical images in the cache pool with the corresponding fixed-point time window weights and summing them, a fixed-point heat time accumulation image can be obtained.
[0199] In the process of acquiring the accumulated heat images over time, a dynamic weighting strategy with strong real-time performance is achieved by using time window weights to weight and fuse historically accumulated grayscale images.
[0200] In at least one embodiment of this disclosure, in addition to the above-described method of obtaining a thermal time-accumulated image based on time window weights and historical images, a thermal time-accumulated image can also be calculated by iterative accumulation.
[0201] The following is another example of steps S311 to S312. Compared with the method of weighting historical images based on time window weights, the iterative accumulation method below does not require storing a large number of images, which can significantly reduce the required computational and storage resources, while simplifying the simulation process.
[0202] For example, in step S311, when the unit screen is turned on, the heat time accumulation image can be initialized to a blank value, or it can be set according to experience or actual needs. Subsequently, the heat time accumulation image can be iteratively updated based on step S312. Similarly, the conversion between the heat time accumulation image and the predicted temperature image can be realized according to the gamma mapping described above.
[0203] For example, in step S312, the heat accumulation time image can be updated according to the following iterative formula: ACC update =ACC+[α*(I gray -ACC)] μ
[0204] For a single screen, ACC is the heat time-accumulated image at the current moment, used for calculating the compensation value of the current local image frame, and I... gray This is the first grayscale image corresponding to the first local image frame (the current local image frame), where α controls the magnitude of temperature change and μ controls the rate of temperature change. ACC update The updated thermal time-accumulated image is used to calculate compensation values for at least one more local image frame (e.g., the next local image frame) following the current local image frame.
[0205] The inventors of this disclosure have noted that while the above iterative formula reduces computational and storage resources, it still has some problems. For example, the iterative formula is sensitive to initial values; if the initial values of the heat time-accumulation image are not selected properly, it may lead to deviations in the final accumulation result. Another example is that the parameters α and μ in the above iterative formula need to be adjusted according to the actual application scenario and the desired effect, but there are no general rules to determine the optimal values of parameters α and μ. Furthermore, the above iterative formula is fixed and lacks flexibility, and may not be applicable to various types of image processing.
[0206] Considering the problems with the above iterative formula, an example of step S312 may include the following steps S321 to S322.
[0207] Step S321: Perform neighborhood pixel weighting on each pixel in the first grayscale image based on a preset weight template to obtain a neighborhood influence image.
[0208] Step S322: Update the heat time accumulation image based on the neighborhood influence image.
[0209] For example, in step S321, for a single pixel in the display screen, the surrounding pixels also have a significant impact on the temperature of the pixel location. Therefore, when updating the heat accumulation image, it is also necessary to consider the influence of the surrounding pixels on each pixel.
[0210] For example, in step S321, for each pixel in the first grayscale image, its neighborhood influence value can be calculated using a preset weight template. The preset weight template simulates the influence of surrounding pixels on that pixel. For instance, when calculating the neighborhood influence value of a certain pixel, with that pixel as the center, the center of an m×m preset weight template is aligned with that pixel, and the pixel values of the m×m neighborhood are multiplied and accumulated with the preset weight template accordingly to obtain the neighborhood influence value of that pixel. The neighborhood influence values of all pixels constitute the neighborhood influence image.
[0211] For example, the size of the preset weight template can be set according to actual needs, such as 3×3, 5×5 (unit is pixels), etc., and the weight values in the preset weight template can also be set according to actual needs. Figure 3B shows a 3×3 preset weight template provided by at least one embodiment of the present disclosure, which can reflect the pixel influence of a 3×3 neighborhood.
[0212] An example of step S312 may also include step S323. Step S323 may be performed before step S322.
[0213] Step S323: Update the amplitude coefficient and / or velocity coefficient based on the first grayscale image. The amplitude coefficient is used to control the amplitude of temperature change, and the velocity coefficient is used to control the rate of temperature change.
[0214] For example, in step S323, the parameters are adaptively adjusted based on the grayscale value of the first grayscale image. The larger the grayscale value, the greater the impact on temperature, and the more drastic the change at the corresponding position in the heat accumulation time image; therefore, the values of the amplitude coefficient and velocity coefficient should also be larger. Depending on actual needs, the amplitude coefficient and velocity coefficient can be updated, or only one of them can be updated; this embodiment of the disclosure does not impose any limitations on this.
[0215] For example, the amplitude coefficient can be updated using the following formula: α new (x,y)=P(x,y)*α(x,y)
[0216] The velocity coefficient can be updated using the following formula: μ new (x,y)=P(x,y)*μ(x,y)
[0217] Where P(x,y) is the grayscale value at pixel (x,y) in the first grayscale image, and α(x,y) is the amplitude coefficient at pixel (x,y) before the update.new (x,y) represents the updated amplitude coefficient at pixel (x,y), and μ(x,y) represents the unupdated velocity coefficient at pixel (x,y). new (x,y) represents the updated velocity coefficient at pixel (x,y).
[0218] In the compensation method provided by at least one embodiment of this disclosure, the amplitude coefficient and velocity coefficient can be adaptively adjusted according to changes in the first grayscale image, reducing reliance on manual parameter tuning and lowering the complexity of design and debugging. Furthermore, it can cope with external interference, improving the robustness of the system.
[0219] Correspondingly, one example of step S322 may be: updating the heat time accumulation image based on the neighborhood influence image, the updated amplitude coefficient, and / or the updated velocity coefficient.
[0220] For example, if only the amplitude coefficient is updated in step S323, the heat time accumulation image can be updated based on the neighborhood influence image and the updated amplitude coefficient; if only the velocity coefficient is updated in step S323, the heat time accumulation image can be updated based on the neighborhood influence image and the updated velocity coefficient; if both the amplitude coefficient and the velocity coefficient are updated in step S323, the heat time accumulation image can be updated based on the neighborhood influence image, the updated amplitude coefficient, and the updated velocity coefficient.
[0221] For example, in some examples, the update of the heat accumulation time image can be achieved according to the following exemplary formula: ACC update (x,y)=ACC(x,y)+[α new (x,y)*(Neigh(x,y)-ACC(x,y))] μnew(x,y)
[0222] For a single screen, ACC(x,y) represents the value of pixel (x,y) in the current time-stamped heat accumulation image, used for calculating the compensation value of the current local image frame; Neigh(x,y) represents the value of pixel (x,y) in the neighboring influence image; and α... new (x,y) represents the updated amplitude coefficient at pixel (x,y), μ new (x,y) represents the updated velocity coefficient at pixel (x,y), ACC update (x,y) represents the value of pixel (x,y) in the updated thermal time-cumulative image, which is used to calculate the compensation value for at least one more local image frame (e.g., the next local image frame) after the current local image frame.
[0223] An example of step S312 may also include step S324.
[0224] Step S324: In response to the presence of a target pixel in the heat time accumulation image whose pixel value differs from the preset brightness value within a preset range, reduce the amplitude coefficient.
[0225] For example, the preset brightness value can be a maximum brightness of 255 or a minimum brightness of 0. The preset range can be set according to actual needs, such as less than 1, less than 5, etc. For target pixels in the thermal time-accumulation image whose pixel values are close to 255 or 0, their amplitude coefficient can be reduced, thereby reducing their update amplitude. For example, assuming the preset brightness value is 255 and the preset range is 3, then for a pixel with a pixel value of 254 in the thermal time-accumulation image, the difference between it and the preset brightness value is within the preset range, so the update amplitude corresponding to that pixel needs to be reduced. For example, it can be reduced to 50%, 80%, etc. of the original amplitude coefficient, or it can be reduced to other values, which can be set according to actual needs. This disclosure embodiment does not limit this. The above method introduces a negative feedback mechanism in the process of calculating the thermal time-accumulation image, which can realize the adjustment of the update rhythm according to the current state of the thermal time-accumulation image.
[0226] In the compensation method provided in at least one embodiment of the present disclosure, a negative feedback iterative accumulation algorithm scheme for adaptive parameter adjustment is proposed. By introducing adaptive parameters and a negative feedback adjustment mechanism, the sensitivity to initial values can be reduced, the flexibility of parameter selection can be improved, and the computational complexity can be reduced.
[0227] An example of step S302 may include steps S401 to S403.
[0228] Step S401: Perform thermal diffusion simulation on the unit screen based on the specifications of the structural components of the unit screen to obtain the structural thermal diffusion diagram.
[0229] Figure 4A is a schematic diagram of a unit screen provided in at least one embodiment of the present disclosure.
[0230] For example, as shown in Figure 4A, a unit screen can include a display panel and structural components. The display panel is typically assembled within the structural components, which are used to fix the display panel and assemble it with other accessories to form a display module. Since the structural components are in contact with the display panel, they play a role in auxiliary heat dissipation and have a significant impact on the display panel's temperature. Therefore, the influence of the structural components needs to be considered when estimating heat dissipation. Structural components in unit screens from different manufacturers, models, and batches may vary; for example, the materials and shapes of the structural components may differ, leading to different heat dissipation effects. Thermal diffusion simulation of the unit screen can be performed based on the specifications of the structural components.
[0231] Figure 4B is a schematic diagram of thermal diffusion simulation provided by at least one embodiment of this disclosure.
[0232] For example, as shown in FIG4B, the thermal diffusion simulation method provided in at least one embodiment of the present disclosure may include the following steps S4011 to S4013.
[0233] Step S4011: Obtain the specification drawing of the structural component. The specification drawing includes information such as dimensions, materials, and assembly relationships.
[0234] Step S4012: Perform thermal diffusion simulation on the specification drawing of the structural component to obtain the thermal diffusion simulation diagram.
[0235] For example, based on the specifications of a structural component, a model of the structural component can be created using simulation software, and a thermal diffusion simulation can be performed to obtain a thermal diffusion simulation diagram.
[0236] Step S4013: Normalize the thermal diffusion simulation diagram to obtain the structural thermal diffusion diagram.
[0237] Through the above steps, a structural thermal diffusion map can be obtained, in which each pixel of the structural thermal diffusion map corresponds one-to-one with each physical pixel of the unit screen.
[0238] Step S402: Perform intra-screen thermal diffusion filtering on the predicted temperature image to obtain the content thermal diffusion map.
[0239] For example, in step S402, to describe the heat diffusion phenomenon within a unit screen, a Gaussian filter kernel can be used to perform heat diffusion filtering on the heat time accumulation image within the unit screen to obtain a content heat diffusion map. The size of the Gaussian filter kernel can be set as needed, for example, it can be 9×9.
[0240] Figure 4C is a schematic diagram of a unit screen thermal diffusion filter provided in at least one embodiment of the present disclosure.
[0241] For example, assuming each unit screen is 160×180 pixels in size, the predicted temperature image size is 8×9 pixels. As shown in Figure 4C, thermal diffusion filtering within the unit screen can be achieved through the following steps S4021 to S4026.
[0242] Step S4021: Expand the 8×9 predicted temperature image to 16×18 size using bilinear interpolation to improve spatial resolution and filtering effect.
[0243] Step S4022: Fill the 16×18 predicted temperature image with four rings of all zero values around it, making it 24×26 in size, so that the filtering operation will not be affected by boundary effects.
[0244] Step S4023: Perform in-screen thermal diffusion filtering on the 24×26 predicted temperature image using a 9×9 Gaussian filter kernel to obtain the filtered matrix K1. For example, the filtering operation is a convolution operation. For example, the coefficients of the 9×9 Gaussian filter kernel are normalized floating-point numbers, which need to be fixed-point converted before the filtering operation, i.e., multiplied by 2. 18 This yields a fixed-point 9×9 Gaussian filter kernel.
[0245] Step S4024: Calculate the thermal diffusion compensation value within the screen using the following formula: Thermal diffusion compensation value within the screen = 2 10 –1–K1.
[0246] Step S4025: Shift and round the calculated in-screen thermal diffusion compensation value to 10 bits.
[0247] Step S4026: The 16×18 result is expanded to 160×180 using bilinear interpolation to obtain the final content heat spread map. Each pixel of the content heat spread map corresponds one-to-one with each physical pixel of the unit screen.
[0248] When pixel values differ at different locations within a unit screen, the temperature distribution within that unit screen also varies, resulting in different compensation values for different locations. The above operations can address the impact of uneven temperature distribution within the unit screen. Specifically, based on the actual temperature differences at various locations within the unit screen, a thermal diffusion model can be used to generate more accurate compensation values, ultimately achieving dynamic temperature compensation for the unit screen image.
[0249] Step S403: Obtain the adjustment compensation map of the unit screen based on the structural heat diffusion map and the content heat diffusion map.
[0250] For example, in step S403, for each unit screen, the structural heat spread map and the content heat spread map of the unit screen can be superimposed to obtain the adjustment compensation map of the unit screen, which is the output of the spatial domain model. For example, the superposition can be performed by multiplication, addition, or weighted accumulation, etc., and the embodiments of this disclosure do not limit this.
[0251] Based on the above operations, the adjustment compensation map integrates a dual compensation strategy of time and space dimensions. Among them, the spatial dimension compensation covers the compensation of structure and content. By comprehensively considering spatiotemporal factors, the display effect can be accurately adjusted and optimized from multiple perspectives. Subsequently, the basic compensation map is optimized based on the adjustment compensation map, so that the final compensation result is more accurate, thereby significantly improving the long-term stability and visual consistency of the display screen content.
[0252] Figure 5 is an exemplary schematic diagram of a compensation method provided in at least one embodiment of this disclosure.
[0253] For example, Figure 5 illustrates an example of a compensation method provided by at least one embodiment of this disclosure, applied to a display screen. In particular, the display screen can be a splicing display screen composed of multiple unit screens.
[0254] First, based on the steady-state temperature characteristics of the entire splicing display screen, a basic compensation map for each of the multiple unit screens is obtained. Specifically, based on temperature sensor data, the current temperature matrix and steady-state temperature matrix of the splicing display screen are obtained. The maximum temperature value and target position of the maximum temperature value in the current temperature matrix are determined, and the steady-state temperature value corresponding to the target position in the steady-state temperature matrix is determined. The current temperature matrix is normalized to obtain a normalized current temperature matrix; the ratio of the steady-state temperature value to the maximum value of the normalized current temperature matrix is calculated to obtain the difference ratio; the normalized current temperature matrix is multiplied by the difference ratio to obtain the alignment matrix. The alignment matrix and the steady-state temperature matrix are subtracted element-wise to obtain the compensation value coefficient matrix. For each unit screen, the first local image frame corresponding to the unit screen is grayscaled to obtain a first grayscale image. The first grayscale image is multiplied by the compensation value coefficient of the unit screen, and then added pixel by pixel to the first grayscale image. After scaling, the first grayscale image and the scaled result are subtracted pixel by pixel to obtain the basic compensation map of the unit screen.
[0255] Next, adjustment compensation maps for each unit screen are obtained based on temporal and spatial models. Specifically, based on the mapping relationship between the heat time-accumulation image and temperature, the heat time-accumulation image is converted into a predicted temperature image. It should be noted that the initial heat time-accumulation image can be set as needed, for example, as a blank image. Then, each pixel in the first grayscale image is weighted by its neighboring pixels based on a preset weight template to obtain a neighborhood influence image; the amplitude coefficient and velocity coefficient are updated based on the first grayscale image; the heat time-accumulation image is updated based on the neighborhood influence image, the updated amplitude coefficient, and the updated velocity coefficient to obtain the heat time-accumulation image for at least one other local image frame after the current local image frame (the first local image frame). In response to the presence of target pixels in the heat time-accumulation image whose pixel value differs from the preset brightness value within a preset range, the amplitude coefficient is reduced. Next, thermal diffusion simulation is performed on the unit screen based on the specifications of the unit screen's structural components to obtain a structural thermal diffusion map; thermal diffusion filtering is applied to the predicted temperature image within the unit screen to obtain a content thermal diffusion map; and the adjustment compensation map for the unit screen is obtained based on the structural thermal diffusion map and the content thermal diffusion map.
[0256] Finally, for each unit screen, the adjustment compensation map of the unit screen is normalized and merged with the base compensation map of the unit screen to obtain the real-time compensation map of the unit screen. The three color channel components of the first local image frame corresponding to the unit screen are then subtracted pixel-level from the weighted real-time compensation map to obtain the first local compensation image frame corresponding to the unit screen. Combining the first local compensation image frames of all unit screens yields the complete first compensation image frame, which is used to drive the display screen to present the current image frame (first image frame) to be displayed on the screen.
[0257] It should also be noted that the execution order of the various steps of the compensation method in the various embodiments of this disclosure is not limited. Although the execution process of each step has been described in a specific order above, this does not constitute a limitation on the embodiments of this disclosure. The various steps in the compensation method can be executed sequentially or in parallel, which can be determined according to actual needs. For example, the compensation method may also include more or fewer steps, and the embodiments of this disclosure do not limit this.
[0258] At least one embodiment of this disclosure also provides a compensation device that compensates for the first image frame to be displayed on the display screen based on the screen's overall temperature steady-state characteristics. This not only avoids inaccuracies caused by temperature estimation but also avoids inaccuracies caused by differences in the characteristics of different unit screens. It helps to adjust the image chromaticity of areas with high luminous efficiency of the light-emitting elements in the display screen to match the chromaticity of areas with low luminous efficiency, thereby eliminating image retention. Even after the display screen has displayed an image for a long time, when the entire display screen is switched to the same grayscale display, it can still ensure uniform image display, improving display effect and user experience.
[0259] Figure 6 is a schematic block diagram of a compensation device provided in at least one embodiment of the present disclosure.
[0260] For example, as shown in Figure 6, the compensation device 600 includes a compensation module 601. This compensation device can be used in a display device including a display screen that receives and displays image pixel data. During the display process, the display screen can display dynamic images (e.g., videos) or static images (e.g., photographs), and refreshes the display of image frames; these image frames can be color image frames or black-and-white image frames.
[0261] For example, in at least one embodiment of this disclosure, the compensation module 601 is configured to compensate for a first image frame to be displayed on the display screen based on the full-screen temperature steady-state characteristics of the display screen, to obtain a compensated first image frame, wherein the first compensated image frame is used to drive the display screen to present the first image frame.
[0262] For example, in at least one embodiment of this disclosure, the steady-state temperature characteristics of the entire screen include: after the temperature fluctuation value of the entire screen reaches a preset range, the relative temperature difference of each part of the entire screen is less than a preset threshold.
[0263] For example, in at least one embodiment of this disclosure, the display screen is divided into multiple display areas, and the compensation module includes a basic compensation map acquisition unit and a compensation calculation unit. The basic compensation map acquisition unit is configured to acquire a basic compensation map for each display area in the multiple display areas of the display screen based on the full-screen temperature steady-state characteristics of the display screen. The compensation calculation unit is configured to, for each display area, compensate a first local image frame corresponding to the display area based on the basic compensation map of the display area to obtain a first local compensated image frame corresponding to the display area, wherein the first local image frame is the part of the first image frame corresponding to the display area, and the first local compensated image frame is the part of the first compensated image frame corresponding to the display area.
[0264] For example, in at least one embodiment of this disclosure, the display screen is a splicing display screen composed of multiple unit screens, and the compensation module includes a basic compensation map acquisition unit, an adjustment compensation map acquisition unit, a real-time compensation map acquisition unit, and a compensation calculation unit.
[0265] The basic compensation map acquisition unit is configured to acquire the basic compensation map of each display area in multiple display areas of the display screen based on the steady-state temperature characteristics of the full screen, wherein multiple display areas correspond one-to-one with multiple unit screens; the adjustment compensation map acquisition unit is configured to acquire the adjustment compensation map of each unit screen based on a time-domain model and a spatial-domain model, wherein the time-domain model reflects the influence of historical images on the temperature of the unit screen, and the spatial-domain model reflects the heat diffusion law within the unit screen and / or the influence of the physical structure of the unit screen on heat diffusion; the real-time compensation map acquisition unit is configured to obtain the real-time compensation map of each unit screen based on the basic compensation map and the adjustment compensation map of the unit screen; the compensation calculation unit is configured to compensate the first local image frame corresponding to the unit screen based on the real-time compensation map of the unit screen for each unit screen, thereby obtaining the first local compensated image frame corresponding to the unit screen, wherein the first local image frame is the part of the first image frame corresponding to the unit screen, and the first local compensated image frame is the part of the first compensated image frame corresponding to the unit screen.
[0266] For example, in at least one embodiment of this disclosure, the basic compensation map acquisition unit is configured to: for each unit screen, acquire the current temperature matrix of the display screen, wherein each value in the current temperature matrix represents the current temperature of the corresponding display area; based on the steady-state temperature matrix of the display screen and the current temperature matrix, acquire the basic compensation map of each display area in multiple display areas, wherein each value in the steady-state temperature matrix reflects the steady-state temperature of the corresponding display area.
[0267] For example, in at least one embodiment of this disclosure, the step of obtaining the steady-state temperature matrix includes: obtaining the full-screen temperature matrix when the display screen shows a completely white image and the temperature fluctuation value reaches a preset range; and normalizing the full-screen temperature matrix to obtain the steady-state temperature matrix.
[0268] For example, in at least one embodiment of this disclosure, the basic compensation map acquisition unit is further configured to: determine the maximum temperature value and the target position of the maximum temperature value in the current temperature matrix; determine the steady-state temperature value corresponding to the target position in the steady-state temperature matrix; determine the difference between the maximum value and the steady-state temperature value in the current temperature matrix, and obtain an alignment matrix based on the difference; and acquire the basic compensation map of each display area in multiple display areas based on the alignment matrix and the steady-state temperature matrix.
[0269] For example, in at least one embodiment of this disclosure, the basic compensation map acquisition unit is further configured to: normalize the current temperature matrix to obtain a normalized current temperature matrix; calculate the ratio of the steady-state temperature value to the maximum value of the normalized current temperature matrix to obtain a difference ratio; and multiply the normalized current temperature matrix by the difference ratio to obtain an alignment matrix.
[0270] For example, in at least one embodiment of this disclosure, the basic compensation map acquisition unit is further configured to: perform element-wise subtraction operation between the alignment matrix and the steady-state temperature matrix to obtain a compensation value coefficient matrix, wherein each value in the compensation value coefficient matrix represents the compensation value coefficient of the corresponding display area; and for each display area, acquire a basic compensation map of the display area based on the first local image frame corresponding to the display area and the compensation value coefficient of the display area.
[0271] For example, in at least one embodiment of this disclosure, the basic compensation map acquisition unit is further configured to: for each display area, perform grayscale processing on the first local image frame corresponding to the display area to obtain a first grayscale image corresponding to the first local image frame; multiply the first grayscale image with the compensation value coefficient of the display area to obtain a first intermediate image; then add the first intermediate image and the first grayscale image pixel by pixel to obtain a second intermediate image; perform scale transformation on the second intermediate image to obtain a third intermediate image; and perform pixel-by-pixel subtraction operation on the first grayscale image and the third intermediate image to obtain the basic compensation map of the display area.
[0272] For example, in at least one embodiment of this disclosure, the adjustment compensation map acquisition unit includes a time-domain model subunit and a spatial-domain model subunit. The time-domain model subunit is configured to acquire a predicted temperature image of each unit screen based on historical images; the spatial-domain model subunit is configured to acquire an adjustment compensation map of each unit screen based on the predicted temperature image and the spatial-domain model.
[0273] For example, in at least one embodiment of this disclosure, the time-domain model subunit includes a transformation subunit and an update subunit. The transformation subunit is configured to transform a thermal time-accumulated image into a predicted temperature image based on the mapping relationship between the thermal time-accumulated image and temperature, wherein the thermal time-accumulated image is obtained based on historical images; the update subunit is configured to update the thermal time-accumulated image based on a first grayscale image to obtain a thermal time-accumulated image for at least another local image frame following the first local image frame.
[0274] For example, in at least one embodiment of this disclosure, the updating subunit is further configured to perform neighborhood pixel weighting processing on each pixel in the first grayscale image based on a preset weight template to obtain a neighborhood influence image; and update the heat time accumulation image based on the neighborhood influence image.
[0275] For example, in at least one embodiment of this disclosure, the updating subunit is further configured to update the amplitude coefficient and / or the velocity coefficient based on the first grayscale image, wherein the amplitude coefficient is used to control the amplitude of temperature change and the velocity coefficient is used to control the rate of temperature change; and to update the heat time accumulation image based on the neighborhood influence image, the updated amplitude coefficient and / or the updated velocity coefficient.
[0276] For example, in at least one embodiment of this disclosure, the updating subunit is further configured to reduce the amplitude coefficient in response to the presence of a target pixel in the heat time-accumulation image whose pixel value differs from a preset brightness value within a preset range.
[0277] For example, in at least one embodiment of this disclosure, the spatial domain model subunit is configured to perform thermal diffusion simulation on each unit screen based on the specifications of the structural components of the unit screen to obtain a structural thermal diffusion map; perform internal thermal diffusion filtering on the predicted temperature image to obtain a content thermal diffusion map; and obtain an adjustment compensation map of the unit screen based on the structural thermal diffusion map and the content thermal diffusion map.
[0278] For example, in at least one embodiment of this disclosure, the real-time compensation map acquisition unit is further configured to normalize the adjustment compensation map of each unit screen and merge it with the basic compensation map of the unit screen to obtain the real-time compensation map of the unit screen.
[0279] For example, in at least one embodiment of this disclosure, the compensation calculation unit is further configured to perform pixel-level subtraction operations on the three color channel components of the first local image frame of the unit screen with the weighted real-time compensation map for each unit screen, so as to obtain the first local compensation image frame of the unit screen.
[0280] It should be noted that the above-mentioned compensation module 601 and each unit and sub-unit can be implemented by software, hardware, firmware or any combination thereof. For example, the compensation module 601 can be implemented as a compensation circuit, and other modules or units can also be implemented as corresponding circuits or sub-circuits, etc. The embodiments of this disclosure do not limit their specific implementation methods.
[0281] It should be understood that the compensation device 600 provided in this embodiment can be used to implement the aforementioned compensation method and can also achieve similar technical effects as the aforementioned compensation method, which will not be elaborated here.
[0282] It should be noted that in the embodiments of this disclosure, the compensation device 600 may include more or fewer circuits or units, and the connection relationship between the various circuits or units is not limited and can be determined according to actual needs. The specific configuration of each circuit is not limited and can be constructed from analog devices, digital chips, or other suitable methods according to circuit principles.
[0283] Figure 7A is a schematic block diagram of a display device provided in at least one embodiment of the present disclosure.
[0284] For example, as shown in FIG7A, at least one embodiment of this disclosure provides a display device 700, including a display controller 710. The display controller 710 includes a compensation device 711. For example, the compensation device 711 is a compensation device provided in at least one embodiment of this disclosure, such as the compensation device 600 in FIG6.
[0285] For example, as shown in FIG7A, the display device 700 provided in at least one embodiment of the present disclosure further includes a display screen 720. The display screen may be, for example, an LED display screen, an OLED self-illuminating liquid crystal display screen, a DLP rear projection display screen, etc. The display screen may be a non-splicing display screen or a non-splicing display screen, and the embodiments of the present disclosure do not limit this.
[0286] It should be noted that when the display screen is a splicing display screen, the display screen controller provided in this embodiment can achieve unified control or distributed control. In the case of unified control, the entire splicing display screen is managed by a single display screen controller, which is responsible for the compensation and control of all individual screens. In the case of distributed control, a display screen controller is set up for each individual screen that makes up the splicing display screen, and different individual screens are controlled by different display screen controllers; alternatively, all individual screens can be grouped, with each group corresponding to a display screen controller. For example, these display screen controllers can communicate with each other, and this embodiment does not impose any limitations on this approach.
[0287] Figure 7B is a schematic block diagram of a display controller provided in at least one embodiment of the present disclosure.
[0288] For example, as shown in Figure 7B, the display controller 710 also includes a data buffer 712, a parameter storage device 713, and a logic control device 714. The display controller can be implemented using hardware logic components such as a field-programmable gate array (FPGA), an application-specific integrated circuit (ASIC), or a system-on-a-chip (SOC).
[0289] For example, in at least one embodiment of this disclosure, the data buffer 712 is configured to temporarily store at least one image frame from an external input for provision to the compensation device 711. For example, the data buffer may receive at least one image frame from an external input via an input interface.
[0290] For example, in at least one embodiment of this disclosure, the parameter storage device 713 is configured to store compensation parameters of the compensation device.
[0291] For example, in at least one embodiment of this disclosure, the logic control device 714 is configured to control the operation of the compensation device 711. For example, as shown in FIG7B, the display controller 710 further includes a clock (i.e., a clock generator) 715, and the logic control device 714 is configured to control the operation of the compensation device under the action of the clock 715.
[0292] For example, as shown in Figure 7B, the first compensated image frame, after being processed by the compensation device, is output from the output interface to be sent to the display screen for display.
[0293] The display controller provided in at least one embodiment of this disclosure can support real-time parallel processing of input data, thereby improving processing efficiency. Furthermore, this display controller supports highly customizable design; hardware accelerators can be designed according to specific application requirements to optimize the performance of image processing algorithms, and it can also be flexibly improved according to application needs.
[0294] Figure 8 is a schematic block diagram of an electronic device provided in at least one embodiment of the present disclosure.
[0295] For example, as shown in FIG8, an electronic device 800 includes at least one processor 801 and at least one memory 802. The at least one memory 802 includes one or more computer program modules. The one or more computer program modules are stored in the at least one memory 802 and configured to be executed by the at least one processor 801. These computer program modules include instructions for performing the compensation method provided in at least one embodiment of the present disclosure. When executed by the at least one processor 801, they can perform one or more steps of the compensation method provided in at least one embodiment of the present disclosure. The memory 802 and the processor 801 can be interconnected via a bus system and / or other forms of connection mechanism (not shown).
[0296] For example, processor 801 can be a central processing unit (CPU), a digital signal processor (DSP), or other processing units with data processing and / or program execution capabilities, such as a field-programmable gate array (FPGA); for example, the central processing unit (CPU) can be an x86 or ARM architecture. Processor 801 can be a general-purpose processor or a special-purpose processor, and can control other components in electronic device 800 to perform desired functions.
[0297] For example, memory 802 may include any combination of one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. Volatile memory may include, for example, random access memory (RAM) and / or cache memory. Non-volatile memory may include, for example, read-only memory (ROM), hard disk, erasable programmable read-only memory (EPROM), portable compact disc read-only memory (CD-ROM), USB memory, flash memory, etc. One or more computer program modules may be stored on the computer-readable storage medium, and processor 801 may run one or more computer program modules to implement various functions of electronic device 800. Various application programs and various data, as well as various data used and / or generated by the application programs, may also be stored in the computer-readable storage medium. The specific functions and technical effects of electronic device 800 can be referred to the description of the compensation method above, and will not be repeated here.
[0298] Figure 9 is a schematic block diagram of another electronic device provided in at least one embodiment of the present disclosure.
[0299] The electronic devices in this disclosure may include, but are not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (PADs), portable multimedia players (PMPs), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. The electronic device 900 shown in Figure 9 is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments of this disclosure.
[0300] For example, as shown in Figure 9, in some examples, electronic device 900 includes a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 901, which can perform various appropriate actions and processes according to a program stored in read-only memory (ROM) 902 or a program loaded from storage device 908 into random access memory (RAM) 903. The RAM 903 also stores various programs and data required for the operation of the computer system. The processing unit 901, ROM 902, and RAM 903 are connected via bus 904. An input / output (I / O) interface 905 is also connected to bus 904.
[0301] For example, the following components can be connected to I / O interface 905: input devices 906 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 907 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 908 including, for example, magnetic tapes, hard disks, etc.; and communication devices 909 including, for example, network interface cards such as LAN cards, modems, etc. Communication device 909 allows electronic device 900 to communicate wirelessly or wiredly with other devices to exchange data and perform communication processing via networks such as the Internet. Drive 910 is also connected to I / O interface 905 as needed. Removable media 911, such as disks, optical disks, magneto-optical disks, semiconductor memories, etc., are installed on drive 910 as needed so that computer programs read from them can be installed into storage device 908 as needed. Although FIG9 shows electronic device 900 including various devices, it should be understood that it is not required to implement or include all the devices shown. More or fewer devices may be implemented or included alternatively.
[0302] For example, the electronic device 900 may further include a peripheral interface (not shown in the figure). This peripheral interface can be various types of interfaces, such as a USB interface, a Lightning interface, etc. The communication device 909 can communicate wirelessly with a network and other devices, such as the Internet, an intranet, and / or a wireless network such as a cellular telephone network, a wireless local area network (LAN), and / or a metropolitan area network (MAN). Wireless communication can use any of a variety of communication standards, protocols, and technologies, including but not limited to Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Wi-Fi (e.g., based on IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, and / or IEEE 802.11n standards), Voice over Internet Protocol (VoIP), Wi-MAX, protocols for email, instant messaging, and / or Short Message Service (SMS), or any other suitable communication protocol.
[0303] For example, the electronic device 900 can be any device such as a mobile phone, tablet computer, laptop computer, e-book, game console, television, digital photo frame, or navigator, or any combination of data processing devices and hardware. The embodiments disclosed herein do not limit this.
[0304] For example, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For instance, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 909, or installed from a storage device 908, or installed from a ROM 902. When the computer program is executed by a processing device 901, the compensation method disclosed in embodiments of this disclosure is performed.
[0305] It should be noted that the computer-readable medium described above in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In embodiments of this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In embodiments of this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.
[0306] The aforementioned computer-readable medium may be included in the aforementioned electronic device 900; or it may exist independently and not assembled into the electronic device 900.
[0307] Figure 10 is a schematic block diagram of a non-transiently readable storage medium provided in at least one embodiment of the present disclosure.
[0308] For example, as shown in FIG10, a computer-readable instruction 1001 is stored on a non-transiently readable storage medium 1000, which, when executed by a processor, performs one or more steps of the compensation method described above.
[0309] For example, when the program code is read by a computer, the computer can execute the program code stored in the computer's storage medium to perform, for example, the compensation method provided in any embodiment of this disclosure.
[0310] For example, the storage medium may include a memory card for a smartphone, a storage component for a tablet computer, a hard disk for a personal computer, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), portable compact disc read-only memory (CD-ROM), flash memory, or any combination of the above storage media, or other suitable storage media. For example, the readable storage medium may also be the memory 802 in Figure 8, and the relevant description can be found in the foregoing content, which will not be repeated here.
[0311] At least one embodiment of this disclosure provides a computer program product, including a computer program / instructions, wherein when the computer program / instructions are executed by at least one processor, they perform the compensation method provided in at least one embodiment of this disclosure.
[0312] Although the present disclosure has been described in detail above with general descriptions and specific embodiments, modifications or improvements can be made to the embodiments of the present disclosure, which will be obvious to those skilled in the art. Therefore, all such modifications or improvements made without departing from the spirit of the present disclosure are within the scope of protection claimed by the present disclosure.
[0313] The following points should be noted regarding this disclosure:
[0314] (1) The accompanying drawings of the embodiments of this disclosure only involve the structures involved in the embodiments of this disclosure. Other structures can be referred to the general design.
[0315] (2) For clarity, the thickness of layers or regions in the drawings used to describe embodiments of the present disclosure is enlarged or reduced, i.e., these drawings are not drawn to actual scale.
[0316] (3) Where there is no conflict, the embodiments of this disclosure and the features in the embodiments can be combined with each other to obtain new embodiments.
[0317] The above description is merely a specific embodiment of this disclosure, but the scope of protection of this disclosure is not limited thereto. The scope of protection of this disclosure should be determined by the scope of protection of the claims.
Claims
1. A compensation method applied to a display screen, the compensation method comprising: Based on the full-screen temperature steady-state characteristics of the display screen, compensation is performed on the first image frame to be displayed on the display screen to obtain the compensated first image frame. The first compensated image frame is used to drive the display screen to present the first image frame.
2. The compensation method according to claim 1, wherein, The full-screen temperature steady-state characteristics include: after the full-screen temperature fluctuation value reaches a preset range, the relative temperature difference of each part of the full screen is less than a preset threshold.
3. The compensation method according to claim 1, wherein, The display screen is divided into multiple display areas. The compensation for the first image frame to be displayed on the display screen based on the full-screen temperature steady-state characteristics of the display screen includes: Based on the full-screen temperature steady-state characteristics of the display screen, a basic compensation map for each display area in multiple display areas of the display screen is obtained; For each display area, a first local image frame corresponding to the display area is compensated based on the base compensation map of the display area to obtain a first local compensated image frame corresponding to the display area. The first local image frame is the part of the first image frame that corresponds to the display area, and the first local compensated image frame is the part of the first compensated image frame that corresponds to the display area.
4. The compensation method according to claim 1, wherein, The display screen is a spliced display screen composed of multiple unit screens. The compensation for the first image frame to be displayed on the display screen based on the full-screen temperature steady-state characteristics of the display screen includes: Based on the full-screen temperature steady-state characteristics of the display screen, a basic compensation map of each display area in multiple display areas of the display screen is obtained, wherein the multiple display areas correspond one-to-one with the multiple unit screens; For each unit screen The adjustment compensation map of the unit screen is obtained based on the time domain model and the spatial domain model. The time domain model reflects the influence of historical images on the temperature of the unit screen, and the spatial domain model reflects the heat diffusion law within the unit screen and / or the influence of the physical structure of the unit screen on heat diffusion. The real-time compensation map of the unit screen is obtained based on the basic compensation map of the unit screen and the adjustment compensation map of the unit screen. The first local image frame corresponding to the unit screen is compensated based on the real-time compensation image to obtain the first local compensated image frame corresponding to the unit screen. The first local image frame is the part of the first image frame corresponding to the unit screen, and the first local compensated image frame is the part of the first compensated image frame corresponding to the unit screen.
5. The compensation method according to claim 3 or 4, wherein, The process of obtaining the basic compensation map for each display area in multiple display areas of the display screen based on the full-screen temperature steady-state characteristics of the display screen includes: Obtain the current temperature matrix of the display screen, wherein each value in the current temperature matrix represents the current temperature of the corresponding display area; Based on the steady-state temperature matrix of the display screen and the current temperature matrix, a basic compensation map of each display area in the plurality of display areas is obtained, wherein each value in the steady-state temperature matrix reflects the steady-state temperature of the corresponding display area.
6. The compensation method according to claim 5, wherein, The process of obtaining the steady-state temperature matrix includes: Obtain the full-screen temperature matrix when the display screen shows a completely white image and the temperature fluctuation value reaches a preset range; The full-screen temperature matrix is normalized to obtain the steady-state temperature matrix.
7. The compensation method according to claim 5, wherein, The process of obtaining a base compensation map for each of the multiple display areas based on the steady-state temperature matrix and the current temperature matrix of the display screen includes: Determine the maximum temperature value in the current temperature matrix and the target location of the maximum temperature value; Determine the steady-state temperature value corresponding to the target location in the steady-state temperature matrix; Determine the difference between the maximum value of the current temperature matrix and the steady-state temperature value, and obtain an alignment matrix based on the difference; Based on the alignment matrix and the steady-state temperature matrix, a basic compensation map for each of the multiple display areas is obtained.
8. The compensation method according to claim 7, wherein, The step of determining the difference between the maximum value of the current temperature matrix and the steady-state temperature value, and obtaining an alignment matrix based on the difference, includes: The current temperature matrix is normalized to obtain a normalized current temperature matrix; The difference ratio is obtained by calculating the ratio of the steady-state temperature value to the maximum value of the normalized current temperature matrix. The alignment matrix is obtained by multiplying the normalized current temperature matrix by the difference ratio.
9. The compensation method according to claim 7 or 8, wherein, The step of obtaining the base compensation map for each of the multiple display areas based on the alignment matrix and the steady-state temperature matrix includes: The alignment matrix and the steady-state temperature matrix are subtracted element by element to obtain the compensation value coefficient matrix, wherein each value in the compensation value coefficient matrix represents the compensation value coefficient of the corresponding display area. For each display area, a basic compensation map of the display area is obtained based on the first local image frame corresponding to the display area and the compensation value coefficient of the display area.
10. The compensation method according to claim 9, wherein, The step of obtaining the basic compensation map of the display area based on the first local image frame corresponding to the display area and the compensation value coefficient of the display area includes: The first local image frame corresponding to the display area is grayscaled to obtain a first grayscale image corresponding to the first local image frame. The first grayscale image is multiplied by the compensation value coefficient of the display area to obtain the first intermediate image, and then the first intermediate image is added to the first grayscale image pixel by pixel to obtain the second intermediate image. The second intermediate image is scaled to obtain the third intermediate image; The first grayscale image and the third intermediate image are subtracted pixel by pixel to obtain the basic compensation map of the display area.
11. The compensation method according to any one of claims 4-10, wherein, The process of obtaining the adjustment compensation map of the unit screen based on the time-domain model and the spatial-domain model includes: The predicted temperature image of the unit screen is obtained based on historical images; The adjustment compensation map of the unit screen is obtained based on the predicted temperature image and the spatial domain model.
12. The compensation method according to claim 11, wherein, The step of obtaining the predicted temperature image of the unit screen based on historical images includes: Based on the mapping relationship between the heat time-accumulation image and temperature, the heat time-accumulation image is converted into the predicted temperature image, wherein the heat time-accumulation image is obtained based on historical images; The heat time accumulation image is updated based on the first grayscale image to obtain a heat time accumulation image for at least another local image frame after the first local image frame.
13. The compensation method according to claim 12, wherein, Updating the heat time accumulation image based on the first grayscale image includes: Based on a preset weight template, each pixel in the first grayscale image is subjected to neighbor pixel weighting processing to obtain a neighborhood influence image. The heat time accumulation image is updated based on the neighborhood influence image.
14. The compensation method according to claim 13, wherein, The step of updating the heat time accumulation image based on the first grayscale image further includes: Based on the first grayscale image, update the amplitude coefficient and / or the velocity coefficient, wherein the amplitude coefficient is used to control the amplitude of temperature change and the velocity coefficient is used to control the rate of temperature change. The step of updating the heat time accumulation image based on the neighborhood influence image includes: The heat time accumulation image is updated based on the neighborhood influence image, the updated amplitude coefficient, and / or the updated velocity coefficient.
15. The compensation method according to claim 14, wherein, The step of updating the heat time accumulation image based on the first grayscale image further includes: In response to the presence of a target pixel in the accumulated heat image whose pixel value differs from a preset brightness value within a preset range, the amplitude coefficient is reduced.
16. The compensation method according to any one of claims 11-15, wherein, The step of obtaining the adjustment compensation map of the unit screen based on the predicted temperature image and the spatial domain model includes: Based on the specifications of the structural components of the unit screen, a thermal diffusion simulation was performed on the unit screen to obtain a structural thermal diffusion diagram; The predicted temperature image is subjected to in-screen thermal diffusion filtering to obtain a content thermal diffusion map; The adjustment compensation map of the unit screen is obtained based on the structural thermal diffusion map and the content thermal diffusion map.
17. The compensation method according to any one of claims 4-16, wherein, The process of obtaining the real-time compensation map of the unit screen based on the basic compensation map and the adjustment compensation map of the unit screen includes: The adjustment compensation map is normalized and merged with the basic compensation map to obtain the real-time compensation map of the unit screen.
18. The compensation method according to any one of claims 4-16, wherein, The step of compensating the first local image frame corresponding to the unit screen based on the real-time compensation map to obtain the first locally compensated image frame corresponding to the unit screen includes: The first local image frame is obtained by performing pixel-level subtraction operations between the three color channel components of the first local image frame and the weighted real-time compensation image.
19. A compensation device applied to a display screen, comprising: The compensation module is configured to compensate for the first image frame to be displayed on the display screen based on the full-screen temperature steady-state characteristics of the display screen, thereby obtaining a compensated first image frame. The first compensated image frame is used to drive the display screen to present the first image frame.
20. A display device, comprising a display controller and a display screen, in, The display controller includes: The compensation device according to claim 19; A data buffer is configured to temporarily store at least one image frame from external input for use with the compensation device; A parameter storage device is configured to store compensation parameters of the compensation device; A logic control device is configured to control the operation of the compensation device.
21. An electronic device, comprising: At least one processor; At least one memory, including one or more computer program modules; The one or more computer program modules are stored in the at least one memory and configured to be executed by the at least one processor, and the one or more computer program modules include instructions for performing the compensation method according to any one of claims 1 to 18.
22. A non-transitory computer-readable storage medium having computer instructions stored thereon, wherein, When the computer instructions are executed by at least one processor, the compensation method according to any one of claims 1 to 18 is performed.