Image processing method, projection device, and storage medium

Abstract

The application relates to an image processing method, a projection device and a storage medium, which comprises the following steps: acquiring a source image, determining a brightness parameter of the source image according to pixel information of the source image; determining a target light source brightness required for displaying the source image based on the brightness parameter of the source image; and making a light source module emit light with the target light source brightness; updating the brightness value of each pixel point in the source image based on the brightness parameter to obtain a target brightness matrix; modulating the source image based on the target light source brightness and the target brightness matrix to obtain a modulated source image, and making the projection device project and display the modulated source image. According to the application, the dynamic contrast of the image can be ensured while effectively reducing power consumption, and the overall viewing effect of the projection can be improved.

Description

Technical Field

[0001] This application relates to the field of projection technology, specifically to an image processing method, a projection device, and a storage medium. Background Technology

[0002] As the projector market develops, users have increasingly higher demands for the subjective visual experience of projected images. Among these demands, contrast ratio is crucial to visual effects; high contrast ratio significantly improves the clarity, detail, and grayscale performance of the projected image.

[0003] However, in practical applications, it is usually necessary to increase the output power of the projector to improve the dynamic contrast of the image. Such an operation will result in high power consumption, making the projector prone to overheating during operation, which is energy-consuming and not conducive to energy saving. Summary of the Invention

[0004] This application discloses an image processing method, a projection device, and a storage medium, which can improve the dynamic contrast of the image while effectively reducing power consumption and enhancing the overall viewing experience of the projection.

[0005] In a first aspect, this application relates to an image processing method, comprising: acquiring a source image; determining a brightness parameter of the source image based on pixel information of the source image; determining a target light source brightness required to display the source image based on the brightness parameter; and causing a light source module to emit light of the target light source brightness; updating the brightness value of each pixel in the source image based on the brightness parameter to obtain a target brightness matrix; modulating the source image based on the target light source brightness and the target brightness matrix to obtain a modulated source image, and causing a projection device to project and display the modulated source image.

[0006] Optionally, the step of determining the brightness parameters of the source image based on the pixel information of the source image includes: taking the maximum value of the sub-pixels of each pixel in the source image as the brightness value of that pixel; wherein each pixel in the source image contains multiple sub-pixels; determining a first brightness matrix of the source image based on the brightness values ​​of each pixel in the source image; and determining the brightness parameters of the source image based on the first brightness matrix.

[0007] Optionally, the step of determining the target light source brightness required to display the source image based on the brightness parameter includes: determining the light source adjustment coefficient of the source image based on the brightness parameter; determining the target number of light source modules to be turned on based on the light source adjustment coefficient; wherein, when the target number of light source modules are turned on, they can emit light of the target light source brightness.

[0008] Optionally, the above method further includes: obtaining the real-time temperature of each primary color lamp in the light source module, wherein each light source module contains multiple primary color lamps; determining the temperature compensation coefficient corresponding to each primary color lamp based on the real-time temperature of each primary color lamp; and adjusting the brightness of each primary color lamp according to the temperature compensation coefficient.

[0009] Optionally, each light source module includes a red primary color lamp, a green primary color lamp, and a blue primary color lamp. The above-mentioned step of adjusting the brightness of each primary color lamp according to the temperature compensation coefficient includes: adjusting the brightness of the red primary color lamp, the green primary color lamp, and the blue primary color lamp respectively, so that the second brightness ratio among the adjusted red primary color lamp, the adjusted green primary color lamp, and the adjusted blue primary color lamp is the same as the first brightness ratio; the first brightness ratio is the brightness ratio value among red light, green light, and blue light in the source image.

[0010] Optionally, the above steps of updating the brightness values ​​of each pixel in the source image based on brightness parameters to obtain the target brightness matrix include: determining the pixel compensation coefficient of the source image according to the brightness parameters; performing a mapping transformation on the first brightness matrix based on a preset mapping relationship to obtain a second brightness matrix; and obtaining the target brightness matrix according to the pixel compensation coefficient and the second brightness matrix.

[0011] Optionally, the step of performing a mapping transformation on the first luminance matrix to obtain the second luminance matrix includes: finding a corresponding mapping value for each luminance value in the first luminance matrix based on the mapping relationship, updating the corresponding luminance value according to the mapping value, and obtaining the second luminance matrix.

[0012] Optionally, the step of obtaining the target brightness matrix based on the pixel compensation coefficient and the second brightness matrix includes: letting the target brightness matrix P = β * Lum', where β represents the pixel compensation coefficient and Lum' represents the second brightness matrix.

[0013] Secondly, this application also provides a projection device, including: one or more processors; a memory; and one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the processor to implement the image processing method of the first aspect described above.

[0014] Thirdly, this application also provides a computer-readable storage medium having a computer program stored thereon, the computer program being loaded by a processor to perform the image processing method of the first aspect described above.

[0015] This application relates to an image processing method, a projection device, and a storage medium. The method dynamically adjusts and determines the required target light source brightness for each source image frame based on the pixel information of each frame and the brightness parameters of the entire image, reducing overall power consumption while ensuring the projected image is not distorted. For changes in the output light source brightness, corresponding pixel compensation is performed on each source image frame, thereby improving the dynamic contrast of the projected image. Attached Figure Description

[0016] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0017] Figure 1 This is an application environment diagram of the image processing method provided in the embodiments of this application.

[0018] Figure 2 This is a flowchart illustrating the image processing method provided in the embodiments of this application. Figure 1 .

[0019] Figure 3 This is a schematic diagram illustrating the application of the image processing method provided in the embodiments of this application.

[0020] Figure 4 This is a flowchart for determining the brightness of a target light source, provided in an embodiment of this application.

[0021] Figure 5 This is a flowchart of obtaining the target brightness matrix provided in an embodiment of this application.

[0022] Figure 6 This is an example diagram of the mapping relationship provided in the embodiments of this application.

[0023] Figure 7 This is a flowchart illustrating the image processing method provided in the embodiments of this application. Figure 2 .

[0024] Figure 8 This is a schematic diagram of the projection device provided in the embodiments of this application. Detailed Implementation

[0025] Embodiments of this application will now be described in more detail with reference to the accompanying drawings. While some embodiments of this application are shown in the drawings, it should be understood that this application can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this application. It should be understood that the drawings and embodiments of this application are for illustrative purposes only and are not intended to limit the scope of protection of this application.

[0026] It should be understood that the various steps described in the method embodiments of this application may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of this application is not limited in this respect.

[0027] The term "comprising" and its variations as used herein are open-ended inclusions, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Definitions of other terms will be given in the description below.

[0028] It should be noted that the concepts of "first" and "second" mentioned in this application are only used to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.

[0029] It should be noted that the terms "a" and "a plurality of" used in this application are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0030] The names of messages or information exchanged between multiple devices in the embodiments of this application are for illustrative purposes only and are not intended to limit the scope of these messages or information.

[0031] For example Figure 1 The diagram shown illustrates the application environment of the image processing method provided in this embodiment. When a projection device (e.g., Figure 1 The projection device 101 projects the original image to be projected (hereinafter referred to as the source image) onto the projection plane (e.g., the projection device 101) onto the projection plane. Figure 1 When the image on the projection plane (102) is visualized, the brightness, contrast and other attributes of the image will change accordingly with the brightness of the light source of the projection device, and the brightness of the light source of the projection device is closely related to the light source controller of the projection device.

[0032] In current common projection display technologies, the output of the light source controller in projection devices is typically a fixed voltage and current, without dynamic adjustment based on the image input from the front end. If the light source controller maintains a high current output, it results in high power consumption; conversely, if it maintains a low current output, it reduces the brightness of the projected image, affecting the user's visual experience. Therefore, current static dimming methods cannot simultaneously achieve improved image contrast and energy savings.

[0033] The image processing method provided in this application embodiment can be applied to determine the target light source brightness of the projector based on the pixel information of the source image, and to perform pixel compensation on the source image, thereby using the target light source brightness to visualize the pixel-compensated source image. This can reduce the power of the projector while enhancing the dynamic contrast of the image, providing users with a better visual experience.

[0034] See Figure 2 The diagram shown is a flowchart of the image processing method provided in an embodiment of this application. Figure 1 .

[0035] In this embodiment, the data image processing method can be applied to a projection device (e.g., Figure 8 For computer devices that require image processing and storage, the image processing functions provided by the method of this application can be directly integrated into the projection device, or the projection device can be run in the form of a software development kit (SDK).

[0036] like Figure 2 As shown, the image processing method specifically includes the following steps. Depending on different needs, the order of the steps in this flowchart can be changed, and some steps can be omitted.

[0037] Step S1: Obtain the source image and determine the brightness parameters of the source image based on the pixel information of the source image.

[0038] In one embodiment, the source image refers to the image to be projected by the projection device. For example, the projection device can receive a video to be projected from an external electronic device or each frame of multiple images to be projected as a source image, or it can use each frame of images to be projected that is pre-stored within the projection device or received from a server as a source image. In subsequent steps, multiple source images can be processed in parallel.

[0039] In one embodiment, the source image may include a variety of images. For example, the source image may be an 8-bit RGB (Red, Green, Blue) rectangular image, where each pixel of the source image contains three sub-pixels (R, G, B), and the brightness value of the source image ranges from [0, 255], with a maximum grayscale value of 255.

[0040] In one embodiment, the pixel information of the source image includes the number of pixels contained in the long side of the source image, the number of pixels contained in the short side of the source image, and the brightness value of each pixel. The position of each pixel in the source image can be determined based on the number of pixels contained in the long side and the number of pixels contained in the short side of the source image.

[0041] For example, the lower left corner of the source image can be used as the origin of the coordinate system, the longer side of the source image can be used as the horizontal axis, the shorter side of the source image can be used as the vertical axis, and the size of a single pixel can be used as the unit length to determine the position of any pixel in the source image.

[0042] In one embodiment, determining the brightness parameters of the source image based on the pixel information of the source image includes:

[0043] Step S11: Take the maximum value of the sub-pixels of each pixel in the source image as the brightness value of that pixel; wherein, each pixel in the source image contains multiple sub-pixels.

[0044] Step S12: Determine the first brightness matrix of the source image based on the brightness values ​​of each pixel in the source image.

[0045] Step S13: Determine the brightness parameters of the source image based on the first brightness matrix, wherein the brightness parameters include: a first brightness parameter and a second brightness parameter, wherein the first brightness parameter includes the maximum brightness and the second brightness parameter includes the average brightness.

[0046] For example, determine the brightness value of each pixel in the source image. Each pixel contains multiple sub-pixels, which include R, G, and B (for example, the brightness value of a certain pixel is (128, 64, 64), where the brightness value of sub-pixel R is 128, the brightness value of sub-pixel G is 64, and the brightness value of sub-pixel B is 64).

[0047] The maximum value of each sub-pixel of each pixel in the source image is taken as the brightness value of that pixel. The maximum values ​​include max(LR(i,j), LG(i,j), LB(i,j)), where max() represents the maximum value function (e.g., max(128, 64, 64) = 128), (i,j) represents the position of the pixel in the source image, LR(i,j) represents the brightness value of sub-pixel R of the pixel at (i,j), LG(i,j) represents the brightness value of sub-pixel G of the pixel at (i,j), and LB(i,j)) represents the brightness value of sub-pixel B of the pixel at (i,j).

[0048] Based on the brightness values ​​of each pixel in the source image, the first brightness matrix of the source image is determined, including: setting the elements in the first brightness matrix Lum to be Lum(i,j)=max(LR(i,j),LG(i,j),LB(i,j));

[0049] Based on the maximum value of all brightness values ​​in the first brightness matrix, the first brightness parameter of the source image is determined, including: setting the first brightness parameter Lmax = the maximum value of all brightness values ​​in the first brightness matrix Lum max(Lum(i,j));

[0050] The average value of all brightness values ​​is determined based on the first brightness matrix, and the second brightness parameter of the source image is determined based on the average value, including setting the second brightness parameter Lave to be equal to the average value of all brightness values ​​in the brightness matrix Lum.

[0051] In one embodiment, a first luminance matrix is ​​constructed based on the maximum luminance values ​​of sub-pixels of each pixel in the source image, which can better preserve the color details of the source image.

[0052] In one embodiment, the calculation method for confirming the maximum brightness value, the first brightness matrix Lum, the first brightness parameter Lmax, and the second brightness parameter Lave in the above embodiments may also include other calculation methods, such as setting different scaling factors, etc., and this application does not limit this.

[0053] In one embodiment, such as Figure 3 The diagram shown is an application illustration of the image processing method provided in the embodiments of this application. It can be used... Figure 3 The front-end image processor shown performs the preprocessing in step S1 on the source image.

[0054] also, Figure 3 The front-end image processor shown can also be used in Figure 8 The corresponding part is the image processing unit of the projection device. Figure 3 The light source controller shown can also be used in Figure 8 The corresponding part in the diagram represents the control unit of the projection device. Figure 3The debug display shown can also be used in Figure 8 The corresponding representation in the image is the light modulator of the projection device.

[0055] Step S2: Based on the brightness parameters, determine the target light source brightness required to display the source image; and make the light source module emit light of the target light source brightness.

[0056] In one embodiment, the brightness, color contrast, and other attributes of the image projected onto the projection plane by the projection device will change accordingly with the brightness of the light source of the projection device.

[0057] Projection devices can employ various combinations of lighting and projection methods, such as multi-unit light source modules, multi-lamp modules, and single-lamp modules. In the embodiments of this application, the projection device uses a multi-unit light source module (e.g., ...). Figure 3 Multiple light sources (as shown) are used for lighting.

[0058] Projection devices can utilize light source controllers (e.g.) Figure 3 (As shown) Adjust the number of light source modules that are turned on (e.g.) Figure 3 The number of light sources (n) and the power of each light source module are shown to control the output brightness of the light source, thereby effectively reducing power consumption and avoiding image distortion caused by excessive brightness loss.

[0059] Specifically, the more light source modules used in projection and the higher the power of each module, the brighter the output light from the projection device, but the higher its power consumption. Each light source module can include multiple primary color lamps, and the color of the light emitted by these lamps corresponds one-to-one with the color of each sub-pixel of the source image. For example, when illuminating an 8-bit RGB image, R, G, and B primary color lamps can be used (e.g., ...). Figure 3 (As shown).

[0060] In one embodiment, the pixel information of each source image frame is different, and the light source brightness value (hereinafter referred to as the target light source brightness) required to maintain image detail and save power during projection is also different. The target light source brightness can be obtained by determining the number of light source modules and the brightness value emitted by each light source module.

[0061] Therefore, when projecting the source image, it is necessary to determine the number of light source modules required to illuminate the source image (hereinafter referred to as "target number") and the brightness value that each light source module needs to emit (hereinafter referred to as "target brightness value") based on the first brightness parameter and the second brightness parameter of the source image.

[0062] In one embodiment, the target light source brightness required to display the source image is determined based on brightness parameters, including, for example... Figure 4Steps S21-S23 in the flowchart shown for determining the brightness of the target light source:

[0063] Step S21: Determine the light source adjustment coefficient of the source image based on the brightness parameter.

[0064] In one embodiment, the light source adjustment coefficient is obtained based on the first luminance matrix Lum, the first luminance parameter Lmax, and the second luminance parameter Lave, including: letting L = Lave + (Ldiff + L²diff / 255) / 2, where Ldiff = Lmax – Lave, and letting the light source adjustment coefficient λ = L / 255. Therefore, the value range of the light source adjustment coefficient λ is [0,1].

[0065] It can be seen that the range of values ​​for L is the same as the range of values ​​for the brightness of the pixels in the source image (e.g., [0, 255] above), and L = 0 when the brightness of all pixels in the source image is 0; when L ≠ 0, L is greater than or equal to the average brightness Lave.

[0066] Step S22: Determine the target number of light source modules to be turned on based on the light source adjustment coefficient; wherein, when the target number of light source modules are turned on, they can emit light of the target light source brightness.

[0067] In one embodiment, determining the target number of light source modules to be activated required to display the source image includes: determining the target number of light source modules to be activated based on the light source adjustment coefficient and the total number of light source modules, including: letting the target number m = [λ*n], where n is a positive integer, n represents the total number of all light source modules, and [λ*n] represents rounding down λ*n.

[0068] In one embodiment, in order for the light source module to emit light of the target light source brightness, it is also necessary to determine the target brightness value of each primary color lamp in each light source module of the target number of light source modules. Therefore, the method provided in this application embodiment further includes:

[0069] Step S101: Obtain the real-time temperature of each primary color lamp in the light source module, wherein each light source module contains multiple primary color lamps.

[0070] Step S102: Confirm the real-time temperature of each primary color lamp and the corresponding temperature compensation coefficient.

[0071] Step S103: Adjust the brightness of each primary color lamp according to the temperature compensation coefficient.

[0072] In one embodiment, each light source module includes a red primary color lamp, a green primary color lamp, and a blue primary color lamp; adjusting the brightness of each primary color lamp according to the temperature compensation coefficient includes:

[0073] Adjust the brightness of the red, green, and blue primary light sources respectively, so that the second brightness ratio among the adjusted red, green, and blue primary light sources is the same as the first brightness ratio; the first brightness ratio is the brightness ratio among the red, green, and blue light sources in the source image.

[0074] In one embodiment, the current of each primary color lamp can also be adjusted according to the temperature compensation coefficient, including:

[0075] Adjust the current of each primary color lamp individually so that the current of each primary color lamp after adjustment is the same as the current of each primary color lamp corresponding to the ambient temperature.

[0076] In one embodiment, a temperature detector can be used to measure the real-time temperature of each primary color lamp (e.g., Figure 3 As shown in the figure, the temperature compensation coefficients corresponding to each primary color lamp at different temperatures are found in the preset ambient temperature compensation coefficient table. For example, the temperature compensation coefficients (λR', λG', λB') corresponding to the real-time temperature of the three primary color lamps are 30 degrees and the ambient temperature is 24 degrees.

[0077] Specifically, when the real-time temperature is 30 degrees Celsius, the currents of the three-primary-color lamps are IR, IG, and IB, respectively. The corresponding ambient temperature compensation coefficient table stores the currents of the three-primary-color lamps at an ambient temperature of 24 degrees Celsius as IR', IG', and IB'. Therefore, the ambient temperature compensation coefficients (λR', λG', λB') in the ambient temperature compensation coefficient table serve to ensure that IR' = λR' * IR, IG' = λG' * IG, and IB' = λB' * IB.

[0078] In addition, the temperature compensation coefficients (λR', λG', λB') also serve to ensure that the second brightness ratio between each primary color lamp (e.g., red primary color lamp, green primary color lamp and blue primary color lamp) after adjustment is still consistent with the first brightness ratio of each primary color light (e.g. red light R, green light G and blue light B) in the source image.

[0079] Specifically, if the light source luminances of the R, G, and B primary colors in the source image are KLR, KLG, and KLB respectively, and the light source luminances of the adjusted red, green, and blue primary colors are KLR', KLG', and KLB' respectively, then KLR : KLG : KLB = KLR' : KLG' : KLB'. This ensures that the source image after lighting presents the same hue as the original source image, avoiding color cast issues in the projected image.

[0080] In one embodiment, the light source module may include multiple primary color lamps (e.g., red, green, and blue primary color lamps), or it may include only primary color lamps of the same color (e.g., all blue primary color lamps). When the light source module includes only primary color lamps of the same color, the current of the primary color lamps can be directly adjusted according to the temperature compensation coefficient.

[0081] As can be seen from the above, the current of the primary color lamps can be adjusted according to the temperature compensation coefficient to make the luminous intensity of the primary color lamps consistent with the luminous intensity at the ambient temperature. This will adjust the light source brightness of each primary color lamp to the target brightness value corresponding to the real-time ambient temperature, thereby achieving the effect of reducing power consumption while ensuring the same hue as the source image.

[0082] In one embodiment, after determining the target number of light source modules to be turned on for the source image and the target brightness value of the primary color lamps in each light source module, the primary color lamps in each of the target number of light source modules are used to illuminate according to the target brightness value, so that light of the target light source brightness can be emitted.

[0083] In one embodiment, as can be seen from the above relationship analysis, the brightness of the target light source is determined by the average brightness values ​​Lave and Ldiff of the source image.

[0084] Specifically: a) When the Lave value is large and the source image has many high-brightness pixels, the target light source brightness required for projection is high, necessitating a high current output from the light source module. This effectively ensures the overall brightness of the source image and reduces image distortion after projection. b) When the Lave value is in the intermediate brightness range, such as between 100 and 150, the brightness of the source image is relatively uniform, allowing for a reduction in the target light source brightness during projection to decrease the power consumption of the projection device. c) When the Lave value is low, if the maximum brightness of the source image is also low, the target light source brightness during projection can be reduced to decrease power consumption. Furthermore, when the maximum brightness of the source image is high, the required target light source brightness for projection should also be high to prevent image distortion and a decrease in overall brightness after projection.

[0085] Step S3: Update the brightness values ​​of each pixel in the source image based on the brightness parameters to obtain the target brightness matrix.

[0086] In one embodiment, based on the brightness parameters of the source image, spatial domain image enhancement technology is used to perform pixel compensation on the source image, thereby updating the brightness values ​​of each pixel in the source image, and obtaining the target brightness matrix to obtain the pixel-compensated source image.

[0087] In one embodiment, spatial domain image enhancement technology is a spatial domain-based image enhancement technology that can directly process each pixel of an image, thereby making the image image more uniform, expanding the dynamic range of the image, and increasing the contrast of the image.

[0088] In this embodiment, pixel compensation of the source image based on spatial domain enhancement technology can ensure that the overall brightness and color of the projected image after power consumption dimming remain basically unchanged from the source image.

[0089] In one embodiment, the brightness values ​​of each pixel in the source image are updated based on the brightness parameters of the source image to obtain the target brightness matrix, including, for example... Figure 5 Steps S31-S33 in the flowchart for obtaining the target brightness matrix shown.

[0090] Step S31: Determine the pixel compensation coefficient of the source image based on the brightness parameters of the source image.

[0091] In one embodiment, determining the pixel compensation coefficient of the source image based on the brightness parameter of the source image includes: determining the pixel compensation coefficient based on the first parameter and the second parameter.

[0092] Specifically, when L≠0, let the pixel compensation coefficient β=255 / L, where the brightness parameter L=Lave+(Ldiff+ L²diff / 255) / 2, Ldiff =Lmax–Lave; when L=0, let the pixel compensation coefficient β=0.

[0093] Step S32: Based on the preset mapping relationship, perform a mapping transformation on the first brightness matrix to obtain the second brightness matrix.

[0094] In one embodiment, updating the brightness values ​​in the brightness matrix to obtain the updated brightness matrix includes: finding a corresponding mapping value for each brightness value in the first brightness matrix based on a preset mapping relationship, updating the corresponding brightness value according to the mapping value, and obtaining the second brightness matrix.

[0095] Specifically, the preset mapping table stores the mapping relationships, which include the mapping value corresponding to each brightness value in the first brightness matrix. The mapping value can be specifically set according to the specific image quality performance and the desired effect, while ensuring that the trend of pixels in the image from dark to bright remains unchanged.

[0096] For example, for instance Figure 6 The example diagram of the mapping relationship provided in the embodiment of this application is shown. The S-shaped curve can be used to represent the mapping relationship of the S-shaped transformation trend. The second brightness matrix Lum' can be obtained by updating the first brightness matrix Lum based on the S-shaped curve.

[0097] Specifically, Figure 6 In the Cartesian coordinate system, both axes represent brightness values, where x represents the brightness value in the first brightness matrix Lum (as shown on the horizontal axis), and y represents the brightness value in the second brightness matrix Lum' (as shown on the vertical axis).

[0098] The straight line y=x intersects the S-curve at three points: the two vertices and the middle point A(x1, y1). When the brightness value (hereinafter referred to as the input value) in the first brightness matrix Lum before mapping lies at the intersection of the straight line y=x and the S-curve, the value mapped onto the y-axis remains unchanged, meaning the brightness value at the same position in the second brightness matrix Lum' (hereinafter referred to as the output value) remains unchanged. When the input value is between 0 and x1, the output value after S-curve mapping is less than the input value. When the input value is between x1 and 255, the output value after S-curve mapping is greater than the input value.

[0099] Based on the above embodiments, the increase or decrease of brightness value can be controlled by controlling the intersection of the S-curve and y=x. The magnitude of the decrease can be controlled by controlling y1, and the magnitude of the increase can be controlled by controlling y2. Here, y1 can be the point where the vertical coordinate of the point corresponding to y=x and the S-curve decreases the most, which can also be called the vertical coordinate of the point with the largest decrease. y2 can be the point where the vertical coordinate of the point corresponding to y=x and the S-curve increases the most, which can also be called the vertical coordinate of the point with the largest increase.

[0100] Furthermore, the S-curve in the above figure is a feasible embodiment of the mapping transformation relationship. It can also be represented by any curve, straight line, or broken line using this as a trend example. The final mapping result can be stored in the form of a mapping relationship table. By using a lookup table to find the corresponding mapping value for each brightness value in the brightness matrix, the hardware environment can be simplified, the computation time reduced, and dynamic control can be achieved.

[0101] Step S33: Obtain the target brightness matrix based on the pixel compensation coefficient and the second brightness matrix.

[0102] In one embodiment, obtaining the target brightness matrix based on the pixel compensation coefficients and the second brightness matrix includes:

[0103] Let the target brightness matrix P = β * Lum', where β represents the pixel compensation coefficient and Lum' represents the second brightness matrix.

[0104] In one embodiment, the source image after pixel compensation can be obtained by updating the brightness value of the corresponding pixel (representing the pixel at the same coordinate position) in the source image using the value in the target brightness matrix P.

[0105] Step S4: Modulate the source image based on the target light source brightness and the target brightness matrix to obtain the modulated source image, and then project and display the modulated source image using a projection device.

[0106] In one embodiment, based on the target light source brightness and the target brightness matrix, a preset display (e.g., Figure 3 The modulation display shown modulates the source image, enabling the projection device to project and display the modulated source image.

[0107] In one embodiment, for example Figure 7 The diagram shown is a flowchart of the image processing method provided according to the above embodiments of this application. Figure 2 .

[0108] The image processing method provided in this application embodiment can determine the corresponding pixel compensation coefficient and the target number of light source modules to be turned on based on the pixel information of each frame of the source image. In addition, the luminous power of the primary color lamps can be adjusted based on the real-time temperature of the primary color lamps of the light source modules, thereby adjusting the primary color lamps to the target brightness value. Each primary color lamp in the target number of light source modules outputs the target light source brightness according to the target brightness value, and the source image after pixel compensation based on the pixel compensation coefficient is illuminated and modulated to present the modulated image.

[0109] The beneficial effects of the image processing method provided in this application include: using multiple light source modules to achieve dynamic light control; achieving dynamic compensation for the temperature of the light source modules to ensure that the output light source does not have color deviation; dynamically adjusting and determining the required light source brightness for each frame of the source image based on the pixel information of each frame of the source image and the brightness parameters of the entire screen, reducing overall power consumption while ensuring that the projected image is not distorted; and performing corresponding pixel compensation for each frame of the source image in response to changes in the output light source brightness, thereby improving the dynamic contrast of the projected image.

[0110] It should be understood that, although Figure 2 , 4 The steps in flowcharts -5 and -7 are shown sequentially as indicated by the arrows; however, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order requirement for the execution of these steps, and they can be performed in other orders. Furthermore, Figure 2 , 4 At least some of the steps in -5 and 7 may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but may be executed at different times. The execution order of these steps or stages is not necessarily sequential, but may be executed in turn or alternately with other steps or at least some of the steps or stages in other steps.

[0111] In some embodiments, the image processing method described above can be implemented as a computer program, which can be implemented in the form of, for example, Figure 8 It runs on the projection device shown. The following is in conjunction with... Figure 8 The architecture of the hardware device for implementing the image processing method is introduced.

[0112] It should be understood that the embodiments are for illustrative purposes only and are not limited to this structure in the scope of the patent application.

[0113] See Figure 8 The diagram shown is a structural schematic of the projection device provided in an embodiment of this application.

[0114] The projection device 200 includes a projection unit 210 and a drive unit 220 for driving the projection unit 210. The projection unit 210 can form an optical image and project the optical image onto an imaging medium SC.

[0115] The projection unit 210 includes a light source unit 211, a light modulator 212, and an optical system 213. The driving unit 220 includes a light source driving unit 221 and a light modulator driving unit 222.

[0116] The light source unit 211 may include solid-state light sources such as light-emitting diodes (LEDs), lasers, and pump lamps. The light source unit 211 may include optical elements such as lenses and polarizers for improving the optical characteristics of the projected light, as well as dimming elements for adjusting the luminous flux.

[0117] The light source driving unit 221 can control the operation of the light source in the light source unit 211, including turning it on and off, according to the instructions of the control unit 250.

[0118] The light modulator 212 includes a display panel 215, which can be a transmissive liquid crystal display (LCD), a reflective liquid crystal on silicon (LCOS), or a digital micromirror device (DMD).

[0119] The optical modulator 212 is driven by the optical modulator driver unit 222, which is connected to the image processing unit 245.

[0120] The image processing unit 245 inputs image data to the light modulator driving unit 222. The light modulator driving unit 222 converts the input image data into a data signal suitable for the operation of the display panel 215. Based on the converted data signal, the light modulator driving unit 222 applies voltage to each pixel of each display panel 215 and draws an image on the display panel 215.

[0121] The optical system 213 includes a lens or mirror that causes the incident image light PLA to form an image on the imaging medium SC. The optical system 213 may also include a zoom mechanism that magnifies or reduces the image projected onto the imaging medium SC and a focus adjustment mechanism that performs focus adjustment.

[0122] The projection device 200 also includes an operation unit 231, a signal receiving unit 233, an input interface 235, a storage unit 237, a data interface 241, an interface unit 242, a frame memory 243, an image processing unit 245, and a control unit 250. The input interface 235, storage unit 237, data interface 241, interface unit 242, image processing unit 245, and control unit 250 can communicate with each other via an internal bus 207.

[0123] The operation unit 231 can generate corresponding operation signals based on the operation of various buttons and switches on the surface of the projection device 200 housing, and output them to the input interface 235. The input interface 235 includes circuitry that outputs the operation signals input from the operation unit 231 to the control unit 250.

[0124] After receiving signals (such as infrared signals or Bluetooth signals) sent from the control device 5 (such as a remote control), the signal receiving unit 233 can decode the received signals to generate corresponding operation signals. The signal receiving unit 233 outputs the generated operation signals to the input interface 235. The input interface 235 outputs the received operation signals to the control unit 250.

[0125] Storage unit 237 may be a magnetic recording device such as a hard disk drive (HDD), or a storage device using semiconductor storage elements such as flash memory. Storage unit 237 stores programs executed by control unit 250, data processed by control unit 250, image data, etc.

[0126] Data interface 241 includes a connector and interface circuitry, enabling wired connection with other electronic devices 100. Data interface 241 can also be a communication interface for communicating with other electronic devices 100. Data interface 241 receives image data, sound data, etc., from other electronic devices 100. In this embodiment, the image data can be content images.

[0127] Interface unit 242 is a communication interface for communicating with other electronic devices 100 according to the Ethernet standard. Interface unit 242 includes a connector and interface circuitry for processing signals transmitted by the connector. Interface unit 242 is an interface substrate including the connector and interface circuitry and is connected to the main substrate of control unit 250, which is a substrate on which processor 253 and other components are mounted. The connector and interface circuitry constituting interface unit 242 are mounted on the main substrate of control unit 250. Interface unit 242 can receive setting information or instruction information transmitted by other electronic devices 100.

[0128] The control unit 250 includes a memory 251 and a processor 253.

[0129] Memory 251 is a storage device that non-volatilely stores programs and data executed by processor 253. Memory 251 is composed of semiconductor storage elements such as magnetic storage devices, flash read-only memory (ROM), or other types of non-volatile storage devices. Memory 251 may also include random access memory (RAM) that constitutes the working area of ​​processor 253. Memory 251 stores data processed by control unit 250 and control programs executed by processor 253.

[0130] The processor 253 can be a single processor or a combination of multiple processor groups. The processor 253 executes control programs to control various parts of the projection device 200. For example, the processor 253 performs corresponding image processing based on operation signals generated by the operation unit 231, and outputs the parameters used in the image processing (such as parameters for keystone correction of the image) to the image processing unit 245. Furthermore, the processor 253 can control the light source in the light source unit 211 to turn on, off, or adjust its brightness by controlling the light source drive unit 221.

[0131] The image processing unit 245 and the frame memory 243 can be constructed from integrated circuits. Integrated circuits include large-scale integrated circuits (LSI), application-specific integrated circuits (ASIC), and programmable logic devices (PLD), where PLD may include field-programmable gate arrays (FPGA). Integrated circuits may also include a portion of analog circuitry, or a combination of a processor and integrated circuits. Combinations of processors and integrated circuits are referred to as microcontroller units (MCU), system-on-chips (SoC), system LSIs, chipsets, etc.

[0132] The image processing unit 245 can store the image data received from the data interface 241 in the frame memory 243. The frame memory 243 includes multiple memory banks, each containing storage capacity for writing one frame of image data. The frame memory 243 can be constructed from synchronous dynamic random access memory (SDRAM) or dynamic random access memory (DRAM).

[0133] The image processing unit 245 can perform image processing on the image data stored in the frame memory 243, including resolution conversion, size adjustment, distortion correction, shape correction, digital zoom, image tone adjustment, and image brightness adjustment.

[0134] The image processing unit 245 can also convert the input frame frequency of the vertical synchronization signal into a drawing frequency and generate a vertical synchronization signal with a drawing frequency. The generated vertical synchronization signal is called the output synchronization signal. The image processing unit 245 then outputs the above-mentioned output synchronization signal to the optical modulator driver unit 222.

[0135] In some embodiments of this application, a computer-readable storage medium is provided storing a computer program. The computer program is loaded by a processor, causing the processor to execute the steps of the data migration method described above. The steps of this data migration method may be steps from the image processing methods of the various embodiments described above.

[0136] The above description is merely a preferred embodiment of this application and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this application is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described application concept. For example, technical solutions formed by substituting the above-described features with (but not limited to) technical features with similar functions claimed in this application.

[0137] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. Multitasking and parallel processing may be advantageous in certain environments. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this application. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.

[0138] Although the subject matter has been described using language specific to the method's logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims. Regarding the apparatus in the above embodiments, the specific manner in which the various modules perform their operations has been described in detail in the embodiments relating to the method, and will not be elaborated upon here.

Claims

1. An image processing method applied to a projection device, characterized in that, The method includes: Acquiring a source image and determining its brightness parameters based on pixel information includes: taking the maximum value of a sub-pixel of each pixel in the source image as the brightness value of that pixel; wherein each pixel in the source image contains multiple sub-pixels; determining a first brightness matrix of the source image based on the brightness values ​​of each pixel; and determining the brightness parameters of the source image based on the first brightness matrix, wherein the brightness parameters include a first brightness parameter Lmax and a second brightness parameter Lave, wherein the first brightness parameter Lmax represents the maximum value of all brightness values ​​in the first brightness matrix, and the second brightness parameter Lave represents the average value of all brightness values ​​in the first brightness matrix. Based on the brightness parameters, determining the target light source brightness required to display the source image, and causing the light source module to emit light of the target light source brightness, includes: determining the light source adjustment coefficient of the source image based on the brightness parameters, wherein the light source adjustment coefficient = L / 255, where L = Lave + (Ldiff + ... L²diff / 255) / 2, Ldiff=Lmax–Lave, the value range of the light source adjustment coefficient is [0,1]; the target number of the light source modules to be turned on is determined based on the light source adjustment coefficient; wherein, when the target number of light source modules are turned on, they can emit light with the target light source brightness, and the target number is obtained by multiplying the light source adjustment coefficient by the total number of light source modules; The brightness values ​​of each pixel in the source image are updated based on the brightness parameters to obtain the target brightness matrix; The source image is modulated based on the target light source brightness and the target brightness matrix to obtain a modulated source image, and the projection device projects and displays the modulated source image.

2. The image processing method according to claim 1, characterized in that, The method further includes: The real-time temperature of each primary color lamp in the light source module is obtained, wherein each light source module contains multiple primary color lamps; Based on the real-time temperature confirmation of each primary color lamp and the temperature compensation coefficient corresponding to each primary color lamp; The brightness of each primary color lamp is adjusted according to the temperature compensation coefficient.

3. The image processing method according to claim 2, characterized in that, Each light source module contains red primary color lamps, green primary color lamps, and blue primary color lamps; The step of adjusting the brightness of each primary color lamp according to the temperature compensation coefficient includes: The brightness of the red, green, and blue primary light sources is adjusted respectively, so that the second brightness ratio among the adjusted red, green, and blue primary light sources is the same as the first brightness ratio; the first brightness ratio is the brightness ratio among the red, green, and blue light sources in the source image.

4. The image processing method according to claim 1, characterized in that, The step of updating the brightness values ​​of each pixel in the source image based on the brightness parameters to obtain the target brightness matrix includes: The pixel compensation coefficient of the source image is determined based on the brightness parameter; Based on a preset mapping relationship, the first brightness matrix is ​​transformed to obtain the second brightness matrix; The target brightness matrix is ​​obtained based on the pixel compensation coefficient and the second brightness matrix.

5. The image processing method according to claim 4, characterized in that, The process of mapping and transforming the first luminance matrix to obtain the second luminance matrix includes: Based on the mapping relationship, a corresponding mapping value is found for each brightness value in the first brightness matrix, and the corresponding brightness value is updated according to the mapping value to obtain the second brightness matrix.

6. The image processing method according to claim 4, characterized in that, The step of obtaining the target brightness matrix based on the pixel compensation coefficient and the second brightness matrix includes: Let the target brightness matrix P = β * Lum', where β represents the pixel compensation coefficient and Lum' represents the second brightness matrix.

7. A projection device, characterized in that, The projection device includes: One or more processors; The memory; and one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the image processing method of any one of claims 1 to 6.

8. A computer storage medium, characterized in that, It stores a computer program, which is loaded by a processor to execute the image processing method according to any one of claims 1 to 6.

Images