Display method and electronic equipment

Abstract

The invention provides a display method and electronic equipment. The method comprises the steps of obtaining current screen color information of a display screen; processing the pixel values corresponding to the plurality of pixel points in the current screen color information according to the attribute values corresponding to the plurality of pixel points in the current screen color information to obtain target screen color information; the target screen color information is obtained by enhancing visual perception of the current screen color information based on the attribute value; and sending the target screen color information to a light display device, so that the light display device displays the target screen color information.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of display, in particular to a display method and an electronic device. BACKGROUND

[0002] With the continuous development of display technology, light display devices are widely used in home decoration, entertainment scenes and human-computer interaction fields. These light display devices control the color and brightness of the lamp beads to achieve diversified light effects, so as to enhance the environment atmosphere or improve the user experience. However, the existing light display devices mostly rely on preset light modes, and the user experience is limited. SUMMARY

[0003] The embodiments of the present application provide a display method, device, electronic device, computer readable storage medium and computer program product, which can bring users immersive light experience.

[0004] The technical scheme of the embodiments of the present application is implemented as follows: In a first aspect, the embodiments of the present application provide a display method, which comprises: acquiring current screen color information of a display screen; processing pixel values corresponding to a plurality of pixel points in the current screen color information according to attribute values corresponding to the plurality of pixel points in the current screen color information, to obtain target screen color information; the target screen color information is obtained based on enhancing the visual perception of the current screen color information based on the attribute values; and sending the target screen color information to a light display device, so that the light display device displays the target screen color information.

[0005] In a second aspect, the embodiments of the present application provide a display device, which comprises: an acquisition module configured to acquire current screen color information of a display screen; a processing module configured to process pixel values corresponding to a plurality of pixel points in the current screen color information according to attribute values corresponding to the plurality of pixel points in the current screen color information, to obtain target screen color information; the target screen color information is obtained based on enhancing the visual perception of the current screen color information based on the attribute values; and a sending module configured to send the target screen color information to a light display device, so that the light display device displays the target screen color information.

[0006] In a third aspect, the embodiments of the present application provide an electronic device, which comprises a memory, a processor, a display screen and a light display device, wherein: The memory is used for storing a computer program capable of running on the processor; The processor is configured to execute the computer program in the memory, and perform the following operations: obtaining current screen color information of the display screen; processing pixel values corresponding to a plurality of pixel points in the current screen color information according to attribute values corresponding to the plurality of pixel points in the current screen color information, to obtain target screen color information; the target screen color information is obtained based on enhancing visual perception of the current screen color information based on the attribute values; and sending the target screen color information to a light display device; and the light display device is configured to display the target screen color information.

[0007] In a fourth aspect, an embodiment of the present application provides a computer readable storage medium storing a computer program or computer executable instructions for being executed by a processor to implement the display method provided by the embodiments of the present application.

[0008] In a fifth aspect, an embodiment of the present application provides a computer program product including a computer program or computer executable instructions, which, when executed by a processor, implement the display method provided by the embodiments of the present application. BRIEF DESCRIPTION OF DRAWINGS

[0009] The accompanying drawings, which are incorporated herein and constitute part of the specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative effort on the basis of these drawings.

[0010] The flowcharts shown in the drawings are only exemplary descriptions, and do not necessarily include all contents and operations / steps, nor do they necessarily be executed in the described order. For example, some operations / steps can be further decomposed, and some operations / steps can be combined or partially combined, so the actual execution order can be changed according to the actual situation.

[0011] Figure 1 Implementation process of the display method provided by the embodiments of the present application Figure One ; Figure 2 Implementation process of obtaining target screen color information provided by the embodiments of the present application Figure 3 Implementation process of the display method provided by the embodiments of the present application Figure Two ; Figure 4 Implementation process of the display method provided by the embodiments of the present application Figure Three ; Figure 5A structural schematic diagram of a display device provided in an embodiment of the present application is shown in the figure. Figure 6 A structural schematic diagram of an electronic device provided in an embodiment of the present application is shown in the figure. DETAILED DESCRIPTION

[0012] In order to make the purposes, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings, and the described embodiments should not be regarded as limiting the present application. All other embodiments obtained by those of ordinary skill in the art without creative labor fall within the scope of protection of the present application.

[0013] An embodiment of the present application provides a display method, Figure 1 An implementation flowchart of the display method provided in an embodiment of the present application is shown in the figure. Figure One As shown in the figure, Figure 1 The display method includes the following steps 101 to 103. Step 101: obtaining current screen color information of a display screen; Step 102: processing pixel values corresponding to a plurality of pixel points in the current screen color information according to attribute values respectively corresponding to the plurality of pixel points in the current screen color information, to obtain target screen color information; the target screen color information is obtained based on enhancing visual perception of the current screen color information; Step 103: sending the target screen color information to a light display device, so that the light display device displays the target screen color information.

[0014] It can be understood that in the embodiment of the present application, the current screen color information of the display screen is obtained, and the pixel values corresponding to a plurality of pixel points in the current screen color information are processed according to the attribute values of the plurality of pixel points in the current screen color information, so as to obtain target screen color information after enhancing visual perception of the current screen color information; and the target screen color information is sent to the light display device, so that the light display device displays the target screen color information. In this way, not only is it beneficial to make the content displayed by the light display device correspond to the color information displayed by the screen, but also the content displayed by the light display device is the content that is more focused on by visual perception of the user, thereby bringing the user an immersive light experience.

[0015] In some embodiments, the display method is applied to an electronic device, the electronic device including a display screen, or the electronic device including a display screen and a light display device. Further, in some embodiments, in the case where the electronic device includes a display screen, the electronic device is connected with the light display device through an external device to realize communication between the electronic device and the light display device.

[0016] Further optional embodiments of each of the above steps and related terms are described below.

[0017] In step 101, current screen color information of a display screen is acquired.

[0018] It should be understood that in the embodiments of the present application, the specific implementation of acquiring the current screen color information of the display screen is not limited. In some embodiments, the acquiring of the current screen color information of the display screen includes intercepting the current screen color information of the display screen. In other embodiments, the acquiring of the current screen color information of the display screen includes capturing the current screen color information of the display screen by calling an application program interface or a graphics library interface of the electronic device.

[0019] In the embodiments of the present application, the acquired current screen color information is not limited. In some embodiments, the acquired current screen color information includes the color composition of all pixel points on the current screen, which is represented in the form of red (Red), green (Green) and blue (Blue) three-channel values. In other embodiments, the acquired current screen color information includes color information represented in the form of hue (H), saturation (S) and value (V) three-channel values. In still other embodiments, the acquired current screen color information includes color information represented in the form of luminance, blue color difference and red color difference (i.e., YUV) three-channel values. In yet other embodiments, the acquired current screen color information includes color information represented in the form of lightness, red-green axis and yellow-blue axis (i.e., Lab) three-channel values.

[0020] In some embodiments, the method further includes segmenting the acquired current screen color information according to the number of the light display devices to determine sub-screen color information associated with the light display devices in the current screen color information.

[0021] It can be understood that in the embodiments of the present application, the acquired current screen color information is segmented according to the number of the light display devices to determine sub-screen color information associated with the light display devices in the current screen color information. In this way, each light display device is allocated a sub-region associated therewith, which not only avoids the high computational overhead and delay problem caused by processing the entire picture, improves processing efficiency and response speed, but also enables the content displayed by multiple light display devices to be in harmony with the corresponding sub-screen color information, thereby increasing the immersive experience effect of the user It should be understood that the light display device is not limited in the embodiments of the present application. The light display device refers to a light bar, a light strip or other similar devices for displaying dynamic color changes. For example, in a possible implementation, the light display device is an RGB light bar or a smart backlight strip, which is usually installed below, beside or around the display screen to enhance the visual experience and immersion of the user.

[0022] In the embodiments of the present application, the division refers to dividing the overall current screen color information into several independent sub-regions according to the number of light display devices, and each sub-region corresponds to one or a group of light display devices.

[0023] In other embodiments, the obtained current screen color information is divided according to the positional relationship between each light display device and the display screen and the number of light display devices. In some embodiments, the division of the obtained current screen color information includes adaptive calculation based on the ratio between the width of the display screen and the number of light display devices to ensure that each light display device can receive color information corresponding to its position. In yet other embodiments, the division of the obtained current screen color information includes adaptive calculation based on the ratio between the length of the display screen and the number of light display devices to ensure that each light display device can receive color information corresponding to its position.

[0024] For example, in a possible implementation, in the case where a plurality of light emitting diode (LED) lights are arranged horizontally around the display screen, the screen can be divided horizontally into a plurality of vertical strips, and each vertical strip corresponds to an LED light; in the case where a plurality of LED lights are arranged vertically around the display screen, the screen can be divided vertically into a plurality of horizontal strips, and each horizontal strip corresponds to an LED light.

[0025] It should be understood that in the embodiments of the present application, the sub-screen color information refers to the part of the screen color data corresponding to each light display device after division. The sub-screen color information retains the information of the original screen color. In some embodiments, there is a one-to-one correspondence between the light display device and the sub-screen color information. Each light display device only receives target sub-screen color information matching the physical position of the light display device, thereby realizing accurate spatial mapping. For example, in a possible implementation, the left LED light bar only receives target color data of the left area of the screen, and the right LED light bar receives target color data of the right area of the screen, thereby ensuring that the light color distribution is consistent with the screen content.

[0026] In the embodiments of the present application, the current screen color information is reasonably divided according to the number of light display devices, which can effectively match the display area of each light display device and avoid waste or repetition of color information.

[0027] In some embodiments, before the current screen color information is divided, the method further includes: extracting one pixel point every N-1 pixel points from the current screen color information according to a preset sampling step N to obtain sampled screen color information; the sampling step N is determined based on the resolution of the display screen, and the resolution of the display screen is an integer multiple of the sampling step N; and the sampled screen color information is taken as the current screen color information.

[0028] It can be understood that, in the embodiments of the present application, the sampling step N is determined based on the resolution of the display screen, and one pixel point is extracted every N-1 pixel points from the current screen color information according to the preset sampling step N to obtain the sampled screen color information. In this way, adaptive downsampling of the current screen color information can reduce the data processing amount without affecting the color information, thereby significantly reducing resource consumption and processing delay; and can be applied to display screens of various resolutions and hardware configurations, thereby improving the compatibility and practicality of the display method.

[0029] It should be understood that, in the embodiments of the present application, the sampling step N refers to extracting one pixel point every N-1 pixel points as a representative value in the image processing process, thereby reducing the data amount and speeding up the processing. The way of extracting one pixel point every N-1 pixel points from the current screen color information according to the preset sampling step N can significantly reduce the computational load while retaining the main color features of the picture. The setting of the sampling step N is closely related to the resolution of the display screen, which ensures that the sampled image still maintains sufficient accuracy and avoids picture distortion or detail loss caused by excessive downsampling.

[0030] In the embodiments of the present application, the resolution of the display screen refers to the number of pixel points in the horizontal and vertical directions on the screen. For example, in a possible implementation, a 1920x1080 resolution indicates that there are 1920 pixel points in the horizontal direction and 1080 pixel points in the vertical direction on the screen.

[0031] It should be understood that in the embodiments of the present application, the sampling step N is not limited. In some embodiments, the sampling step N is set as an integer factor of the resolution of the display screen, so as to ensure that the sampled color information can still uniformly cover the entire picture area, without missing the boundary pixel points or repeatedly calculating the pixel points, and to ensure that the sampled color information contains the main colors of the original color information. In this way, in the case of low resolution, the light display device can also better reflect the color trend of the screen content, thereby realizing a more natural and more coherent light effect.

[0032] Exemplarily, in a possible implementation, when N=4, it means that only the first pixel point in every 4x4 pixel points is taken for processing in the horizontal and vertical directions, and the rest is ignored.

[0033] Further, in some embodiments, the N can be fixed, that is, the current screen color information is processed by means of uniform sampling. In other embodiments, the N can be non-fixed, that is, the current screen color information is processed by means of non-uniform sampling.

[0034] In some embodiments, the sampling step N is positively correlated with the resolution of the display screen; the higher the resolution, the larger the step, and the lower the resolution, the smaller the step.

[0035] In some embodiments, the obtained current screen color information of the display screen is video stream information; before the current screen color information is segmented, the method further comprises: sampling the video stream to obtain the current screen color information of the display screen as frame screen color information, and taking the frame screen color information as the current screen color information of the display screen.

[0036] In step 102, according to the attribute values corresponding to the plurality of pixel points in the current screen color information, the pixel values corresponding to the plurality of pixel points in the current screen color information are processed to obtain target screen color information; the target screen color information is obtained based on enhancing the visual perception of the current screen color information based on the attribute values.

[0037] In some embodiments, the attribute values corresponding to the plurality of pixel points in the current screen color information are obtained according to a piecewise linear function. In this way, complex operations can be avoided, and the operation efficiency can be improved. Exemplarily, in a possible implementation, in the case of the attribute value being luminance, the piecewise linear function of the luminance brightness is as follows formula (1), and the minimum value of the luminance is set to 8.

[0038] (1) It should be understood that in the embodiments of the present application, the attribute values corresponding to the pixel points are not limited. The attribute values of the pixel points are used to reflect the characteristic values of the pixel points in different visual perception dimensions. In some embodiments, the attribute values of the pixel points include but are not limited to: brightness, saturation, wavelength, inter-frame dynamic difference, and pixel values of different color channels, etc.

[0039] In the embodiments of the present application, the attribute values corresponding to the pixel points can be used to evaluate whether the pixel points are visually attractive or important. For example, pixel points with high brightness are usually more eye-catching, pixel points with high saturation have more vivid colors, and pixel points with long wavelengths (such as red and orange) are more likely to attract the attention of users. In addition, pixel points with large inter-frame dynamic difference may represent moving objects, and the pixel points show a large change amplitude and are more likely to attract the attention of users.

[0040] In some embodiments, the processing of the pixel values corresponding to the plurality of pixel points in the current screen color information according to the attribute values corresponding to the plurality of pixel points in the current screen color information to obtain the target screen color information comprises: processing the pixel values corresponding to each pixel point in the current screen color information according to the attribute values corresponding to each pixel point in the current screen color information to obtain the target screen color information.

[0041] In other embodiments, the processing of the pixel values corresponding to the plurality of pixel points in the current screen color information according to the attribute values corresponding to the plurality of pixel points in the current screen color information to obtain the target screen color information further comprises: downsampling the current screen color information to obtain the sampled current screen color information, where the downsampling method can be the method in step 101 described above, and will not be repeated here; processing the pixel values corresponding to each pixel point in the sampled current screen color information according to the attribute values corresponding to each pixel point in the sampled current screen color information to obtain the target screen color information.

[0042] In yet other embodiments, the processing of the pixel values corresponding to the plurality of pixel points in the current screen color information according to the attribute values corresponding to the plurality of pixel points in the current screen color information to obtain the target screen color information further comprises: determining representative points of the pixel points of the current screen color information from the pixel points of the current screen color information; processing the pixel values corresponding to the representative points in the current screen color information according to the attribute values corresponding to the representative points in the current screen color information to obtain the target screen color information.

[0043] It should be understood that the representative point is not limited in the embodiments of this application. In some embodiments, the current screen color information is divided into multiple sub-regions, and the pixel with the highest average pixel value among multiple pixels in the sub-region is taken as the representative point of the sub-region; in other embodiments, the current screen color information is divided into multiple sub-regions, and the pixel corresponding to the median of the average pixel value among multiple pixels in the sub-region is taken as the representative point of the sub-region; in still other embodiments, the current screen color information is divided into multiple sub-regions, and the pixel with the most frequent pixel value among multiple pixels in the sub-region is taken as the representative point of the sub-region, etc.

[0044] In some embodiments, Figure 2 This application provides a schematic diagram of an implementation process for obtaining target screen color information, as shown in the embodiments of this application. Figure 2 As shown, the target screen color information can be obtained by processing the pixel values ​​corresponding to multiple pixels in the current screen color information according to the attribute values ​​corresponding to multiple pixels in the current screen color information through the following steps 201 to 203: Step 201: For each sub-screen color information in the current screen color information, determine the first weight corresponding to the pixel point according to the attribute value corresponding to each pixel point in the sub-screen color information. Step 202: Determine the sub-target color information corresponding to each sub-screen color information based on the first weight and the corresponding pixel value of each pixel. Step 203: Obtain the target screen color information corresponding to the current screen color information based on the sub-target color information corresponding to each sub-screen color information.

[0045] It is understood that, in this embodiment, for each sub-screen color information in the current screen color information, a first weight corresponding to each pixel is determined based on the attribute value corresponding to each pixel in the sub-screen color information; then, based on the first weight and the corresponding pixel value, the sub-target color information corresponding to the sub-screen color information is determined; and based on the sub-target color information corresponding to each sub-screen color information, the target screen color information corresponding to the current screen color information is obtained. In this way, by dividing the data into regions and combining the first weight of each pixel with its corresponding pixel value for weighted calculation, the overall processing complexity is reduced while maintaining the expressiveness of color features. This not only improves processing efficiency but also enhances the mapping accuracy of the lighting display device to the screen color information, thereby improving the user's immersive experience.

[0046] It should be understood that the first weight is not limited in the embodiments of the present application. The first weight represents the participation degree of the attribute value of the pixel point in the final color calculation. In this way, the more attractive part of the picture can be highlighted, thereby enhancing the linkage between the color displayed by the light display device and the screen content, and further improving the user's immersion and emotional value. In some embodiments, the first weight refers to the normalized first weight.

[0047] In the embodiments of the present application, the sub-target color information is obtained by weighting calculation based on the first weight of the pixel point and the pixel value of the pixel point, and is used to represent the overall color performance of a certain sub-screen area. For example, in a possible implementation, in a longitudinally cut sub-screen strip, the pixels in the longitudinally cut sub-screen strip are weighted according to the first weight of the pixel point, so as to obtain a representative color of the longitudinally cut sub-screen strip, and the representative color is taken as the basic data for controlling the LED light effect.

[0048] It should be understood that in the embodiments of the present application, the target screen color information includes the sub-target color information corresponding to each sub-screen color information. Accordingly, the sending of the target screen color information to the light display device to enable the light display device to display the target screen color information includes sending the sub-target color information to the corresponding light display device to enable the light display device to display the corresponding sub-target color information.

[0049] In some embodiments, the attribute value of the pixel point includes an attribute value for embodying the visual perception of the pixel point in different dimensions; and the determination of the first weight corresponding to each pixel point in the sub-screen color information according to the attribute value corresponding to the pixel point includes: obtaining, through a preset weight table, a second weight corresponding to the attribute value of each pixel point in different dimensions in the sub-screen color information; wherein the preset weight table is used to represent the corresponding relationship between the attribute value and the second weight; the second weight is positively correlated with the attribute value; and the first weight corresponding to each pixel point in the sub-screen color information is determined according to the second weight corresponding to the attribute value of each pixel point in different dimensions.

[0050] It can be understood that in the embodiments of the present application, the second weight corresponding to the attribute value of each pixel point in different dimensions in the sub-screen color information is obtained through a preset weight table. In this way, compared with complex real-time calculation, the operation delay is greatly reduced, and the stability of the processing process is ensured. Moreover, by using the positive correlation between the attribute value and the weight, the visual elements that the user pays more attention to can be emphasized first, further enhancing the correlation between the light display effect and the color information displayed by the display screen, thereby bringing the user an immersive light experience.

[0051] It should be understood that in the embodiments of the present application, visual perception is the cognitive process of color formed by human eyes receiving and processing light signals. In the embodiments of the present application, the attribute values of the pixel points are designed to reflect the perception characteristics of the human eye in different dimensions such as brightness, saturation, wavelength (i.e. color) and inter-frame dynamic difference. These attribute values not only describe the color information of the pixel points, but also reflect the importance of the attribute values of the pixel points in the picture.

[0052] In the embodiments of the present application, considering the attribute values in multiple dimensions can better identify which areas in the picture can attract the most attention. And designing the attribute values to be positively correlated with the second weight can make the light display effect closer to the actual viewing experience of the user, and improve the user's sense of immersion.

[0053] It should be understood that in the embodiments of the present application, the preset weight table is not limited. The preset weight table is a pre-calculated data structure that maps the attribute values (such as brightness, saturation, wavelength, etc.) of the pixel points to corresponding weight values. In some embodiments, the preset weight table is constructed based on the visual perception characteristics of the human eye and a large amount of experimental data, ensuring that each attribute value can be accurately converted into a suitable weight. For example, when the brightness value is high, the second weight corresponding to the brightness value is a high value; when the brightness value is low, the second weight corresponding to the brightness value is a low value.

[0054] In some embodiments, the preset weight table can be adjusted according to different application scenarios. For example, in the e-sports game scenario, more attention is paid to pixel points with larger inter-frame dynamic difference; and in the movie watching scenario, more attention may be paid to pixel points with higher brightness and saturation. By flexibly configuring the preset weight table, it can be adapted to various use environments and meet the individual needs of different users.

[0055] In some embodiments, in the preset weight table, the correspondence between the attribute values and the second weights can be a one-to-one correspondence or a many-to-one correspondence, which is not limited in the embodiments of the present application. The one-to-one correspondence means that each attribute value has a corresponding second weight; the many-to-one correspondence means that a range of attribute values corresponds to the same second weight. In the embodiments of the present application, the range is not limited.

[0056] Exemplarily, in a possible implementation, higher brightness is easier to attract visual attention. Therefore, dynamically assigning different weights for different brightness values is a key step to realize accurate perception control. If the brightness of pixel point 1 is 200 and the brightness of pixel point 2 is 180. If the corresponding relationship between the attribute value and the second weight in the preset weight table is a one-to-one correspondence, the second weight corresponding to the brightness of pixel point 1 is 78, and the second weight corresponding to the brightness of pixel point 2 is 71. If the corresponding relationship between the attribute value and the second weight in the preset weight table is a many-to-one relationship, and a certain range is 180-200, the second weight corresponding to the brightness of pixel point 1 and pixel point 2 is 75. The second weight is not normalized.

[0057] Saturation describes the degree of color vividness. Higher saturation can attract more visual attention, so higher saturation pixels are given higher weights to maintain or enhance their color impact. If the saturation of pixel point 1 is 90% and the saturation of pixel point 2 is 60%. If the corresponding relationship between the attribute value and the second weight in the preset weight table is a one-to-one correspondence, the second weight corresponding to the saturation of pixel point 1 is 88, and the second weight corresponding to the saturation of pixel point 2 is 65. If the corresponding relationship between the attribute value and the second weight in the preset weight table is a many-to-one relationship, and a certain range is 60%-90%, the second weight corresponding to the saturation of pixel point 1 and pixel point 2 is 80. The second weight is not normalized.

[0058] Wavelength directly determines the color perceived by the human eye. The visual sensitivity and emotional association of different colors (wavelengths) are different, so the short wavelength weight can be set low and the long wavelength weight can be set high. If the wavelength of pixel point 1 is 573 and the wavelength of pixel point 2 is 565. If the corresponding relationship between the attribute value and the second weight in the preset weight table is a one-to-one correspondence, the second weight corresponding to the wavelength of pixel point 1 is 52, and the second weight corresponding to the wavelength of pixel point 2 is 50. If the corresponding relationship between the attribute value and the second weight in the preset weight table is a many-to-one relationship, and a certain range is 564-574, the second weight corresponding to the wavelength of pixel point 1 and pixel point 2 is 51. The second weight is not normalized.

[0059] In some embodiments, the first weight corresponding to each pixel point in the sub-screen color information is determined according to the second weight corresponding to each attribute value of each pixel point in different dimensions, comprising: for each pixel point, determining a third weight based on the sum of the second weight corresponding to the pixel point and the second weight corresponding to each pixel point, for the second weight corresponding to the attribute value belonging to the same dimension; and determining the average of the third weight corresponding to each attribute value of each pixel point in different dimensions as the first weight corresponding to each pixel point in the sub-screen color information.

[0060] Further, the embodiments of the present application normalize the second weight without normalization. The normalization method is not limited in the present application. In some embodiments, the third weight is determined based on the quotient of the sum of the second weight corresponding to the pixel point and the second weight corresponding to each pixel point as the third weight.

[0061] For example, in a possible implementation, if a strip has three pixel points, the pixel values and the second weights of the three pixel points are as follows: Pixel point 1: (R1, G1, B1); the weight corresponding to the brightness is B1; the weight corresponding to the saturation is S1; and the weight corresponding to the wavelength is L1; Pixel point 2: (R2, G2, B2), the weight corresponding to the brightness is B2; the weight corresponding to the saturation is S2; and the weight corresponding to the wavelength is L2; Pixel point 3: (R3, G3, B3), the weight corresponding to the brightness is B3; the weight corresponding to the saturation is S3; and the weight corresponding to the wavelength is L3; wherein the second weight is a weight without normalization.

[0062] Then, the third weight corresponding to the brightness of the pixel point 1 is B1 / (B1+B2+B3); the third weight corresponding to the brightness of the pixel point 2 is B2 / (B1+B2+B3); and the third weight corresponding to the brightness of the pixel point 3 is B3 / (B1+B2+B3). The third weight corresponding to the saturation of the pixel point 1 is S1 / (S1+S2+S3); the third weight corresponding to the saturation of the pixel point 2 is S2 / (S1+S2+S3); and the third weight corresponding to the saturation of the pixel point 3 is S3 / (S1+S2+S3). The third weight corresponding to the wavelength of the pixel point 1 is L1 / (L1+L2+L3); the third weight corresponding to the wavelength of the pixel point 2 is L2 / (L1+L2+L3); and the third weight corresponding to the wavelength of the pixel point 3 is L3 / (L1+L2+L3).

[0063] The first weight of pixel 1 is w1 = (B1 / (B1+B2+B3)+S1 / (S1+S2+S3)+L1 / (L1+L2+L3)) / 3; the first weight of pixel 2 is w2 = (B2 / (B1+B2+B3)+S2 / (S1+S2+S3)+L2 / (L1+L2+L3)); the first weight of pixel 3 is w3 = (B3 / (B1+B2+B3)+S3 / (S1+S2+S3)+L3 / (L1+L2+L3)).

[0064] In some embodiments, the second weight is greater than 0. This means that for pixel values ​​with smaller attribute values, the corresponding second weight is lower, rather than zero. This helps to prevent the second weight from affecting the representation of other colors in the weighted average.

[0065] In other embodiments, determining the first weight corresponding to each pixel in the sub-screen color information based on the second weight corresponding to the attribute values ​​of each pixel in different dimensions includes: for each pixel, determining the sum of the corresponding second weights to obtain a first sum value; dividing the first sum value by the sum of the first sum values ​​corresponding to each pixel to obtain the first weight; wherein the second weight is a normalized weight.

[0066] It should be understood that, in the embodiments of this application, the first weight is the parameter ultimately used to calculate the weighted average RGB value. The first weight is the result of combining the second weights of each dimension, reflecting the relative importance of the pixel in the entire sub-screen color information. For example, if a pixel has a high weight in all three dimensions of brightness, saturation, and wavelength, then the first weight of this pixel will also be increased accordingly, indicating that this pixel occupies a more important position in the entire sub-screen color information.

[0067] For example, in one possible implementation, if a stripe has 3 pixels, the pixel values ​​and second weights of the 3 pixels are as follows: Pixel 1: (R1, G1, B1); the weight corresponding to brightness is B1; the weight corresponding to saturation is S1; the weight corresponding to wavelength is L1. Pixel 2: (R2, G2, B2), with B2 as the weight for brightness, S2 as the weight for saturation, and L2 as the weight for wavelength; Pixel 3: (R3, G3, B3), with B3 as the weight for brightness, S3 as the weight for saturation, and L3 as the weight for wavelength; Therefore, the first weight of pixel 1 is w1 = (B1 + S1 + L1) / 3, the first weight of pixel 2 is w2 = (B2 + S2 + L2) / 3, and the first weight of pixel 3 is w3 = (B3 + S3 + L3) / 3.

[0068] If the sub-screen color information has 3 pixels, the pixel colors and weights from top to bottom are as follows: Pixel 1 (top): Red (255, 0, 0); weight for brightness is 1; weight for saturation is 0.5; weight for wavelength is 0.6. Pixel 2 (center): Green (0, 255, 0); Brightness weight is 1; Saturation weight is 0.5; Wavelength weight is 0.5. Pixel 3 (bottom): Blue (0, 0, 255); weight for brightness is 1; weight for saturation is 0.5; weight for wavelength is 0.4. Therefore, w1 = (1 + 0.5 + 0.6) / 3 = 0.7; w2 = (1 + 0.5 + 0.5) / 3 = 0.67; w1 = (1 + 0.5 + 0.4) / 3 = 0.63.

[0069] In some embodiments, determining the first weight corresponding to each pixel in the sub-screen color information based on the second weight corresponding to the attribute values ​​of each pixel in different dimensions further includes: for each pixel, in response to the existence of a corresponding dynamic weight, determining the first weight corresponding to each pixel in the sub-screen color information based on the dynamic weight and the second weight; wherein the dynamic weight is determined based on the current screen color information and the screen color information of the corresponding previous frame.

[0070] It is understood that, in this embodiment, in response to obtaining the dynamic weight determined based on the current screen color information and the screen color information of the previous frame, the first weight corresponding to each pixel in the sub-screen color information is determined based on the dynamic weight and the second weight. This approach, taking into account both temporal and spatial characteristics, can capture the changing trends of moving objects in the image, making the lighting display device more sensitive to dynamic content, thereby enhancing the user's immersion and realism.

[0071] It should be understood that, in the embodiments of this application, dynamic weight refers to, when processing the current screen color information, calculating the degree of change of each pixel in the current screen color information in the time dimension by comparing the color changes between the current frame and the previous frame, and quantifying the degree of change of dynamic weight into a numerical value, which is used to adjust the importance of the pixels in the current screen color information in the final weighted calculation.

[0072] In this application embodiment, the specific implementation method for determining dynamic weights is not limited. In some embodiments, dynamic weights can be determined by differential methods, inter-frame correlation analysis, gradient change detection, etc. For example, in one possible implementation, if the RGB value of a pixel in the current screen color information changes significantly between two adjacent frames, it is determined that the pixel in the current screen color information is in a moving area. Compared to the background in the image, these moving objects are more likely to attract the user's attention, and the dynamic weight of the pixel in the moving area is higher; conversely, if the change in the RGB value of a pixel in the current screen color information is small, the dynamic weight of the pixel in the current screen color information is lower. By adopting the above method, the expressiveness of dynamic content in lighting display can be improved without increasing additional computational complexity.

[0073] In this embodiment, the dynamic weight and the second weight (i.e., the static attribute weight) are complementary. The dynamic weight reflects the changing trend of pixels in the time dimension, while the second weight (i.e., the static attribute weight) reflects the static attribute characteristics of pixels in the spatial dimension. By combining the dynamic weight and the second weight, the importance of pixels in multi-dimensional space can be comprehensively evaluated, and the accuracy and expressiveness of light output can be further optimized.

[0074] In this embodiment, by introducing dynamic weights and combining them with static attribute weights, the importance of each pixel on the screen can be reflected more comprehensively. Furthermore, it can dynamically highlight areas of dramatic color change in the screen, making the lighting display effect more closely match the screen content, thereby enhancing the user's immersion and visual experience.

[0075] In some embodiments, determining the first weight corresponding to each pixel in the sub-screen color information based on the dynamic weight and the second weight includes: for each pixel, for the second weight corresponding to the attribute value belonging to the same dimension, determining a third weight based on the sum of the second weight corresponding to the pixel and the second weight corresponding to each pixel; determining a fourth weight based on the sum of the dynamic weight corresponding to the pixel and the dynamic weight corresponding to each pixel; and determining the average of the multiple third weights and the fourth weight corresponding to each pixel as the first weight corresponding to each pixel in the sub-screen color information.

[0076] Further, in some embodiments, determining the third weight based on the second weight corresponding to the pixel and the sum of the second weights corresponding to each pixel includes: taking the quotient of the second weight corresponding to the pixel and the sum of the second weights corresponding to each pixel as the third weight; determining the fourth weight based on the dynamic weight corresponding to the pixel and the sum of the dynamic weights corresponding to each pixel includes: taking the quotient of the dynamic weight corresponding to the pixel and the sum of the dynamic weights corresponding to each pixel as the fourth weight.

[0077] In some embodiments, determining the first weight corresponding to each pixel in the sub-screen color information based on the dynamic weight and the second weight includes: for each pixel, determining the sum of the corresponding second weight and the dynamic weight to obtain the first weight; wherein the second weight and the dynamic weight are normalized weights.

[0078] For example, if the sub-screen color information has 3 pixels, the pixel colors and weights from top to bottom are as follows: Pixel 1 (top): Red (255, 0, 0); weight for brightness is 1; weight for saturation is 0.5; weight for wavelength is 0.6; weight for dynamics is 0.3. Pixel 2 (center): Green (0, 255, 0); weight for brightness is 1; weight for saturation is 0.5; weight for wavelength is 0.5; weight for dynamics is 0.5. Pixel 3 (bottom): Blue (0, 0, 255); weight for brightness is 1; weight for saturation is 0.5; weight for wavelength is 0.4; weight for dynamics is 0.2. Therefore, w1 = (1 + 0.5 + 0.6 + 0.3) / 4 = 0.6; w2 = (1 + 0.5 + 0.5 + 0.5) / 4 = 0.625; w3 = (1 + 0.5 + 0.4 + 0.2) / 4 = 0.525.

[0079] In some embodiments, determining the sub-target color information corresponding to each sub-screen color information based on the first weight and the corresponding pixel value of each pixel includes: for each pixel, determining a target pixel value based on the pixel value corresponding to each color channel in the pixel and the first weight; and determining the sub-target color information corresponding to each sub-screen color information based on the target pixel value corresponding to each pixel.

[0080] It is understood that, in this embodiment, for each pixel, a target pixel value is determined based on the pixel value corresponding to each color channel and a first weight; and sub-target color information corresponding to each sub-screen color information is determined based on the target pixel value corresponding to each pixel. In this way, by performing pixel-by-pixel weighted calculation, color distortion or loss of detail can be avoided, further enhancing the user's immersive experience.

[0081] It should be understood that in the embodiments of this application, a pixel refers to the smallest display unit in an image. Each pixel contains values ​​for three color channels: red, green, and blue, typically ranging from 0 to 255. The first weight is used to adjust the importance of different pixels or different color channels. By multiplying the R, G, and B values ​​of each pixel by the first weight, the target pixel value of the corresponding pixel can be calculated, thereby highlighting certain areas or color features.

[0082] For example, in one possible implementation, the color of each pixel is multiplied by a weight (a first weight, determined based on a normalized second weight), then summed, and then divided by the sum of the first weights corresponding to all pixels.

[0083] If a stripe has 3 pixels, the pixel values ​​and weights of the 3 pixels are as follows: Pixel 1: (R1, G1, B1), weight w1; Pixel 2: (R2, G2, B2), weight w2; Pixel 3: (R3, G3, B3), weight w3; Then the weighted average color = ((R1×w1+R2×w2+R3×w3) / (w1+w2+w3), (G1×w1+G2×w2+G3×w3) / (w1+w2+w3), (B1×w1+B2×w2+B3×w3) / (w1+w2+w3)).

[0084] If the sub-screen color information has 3 pixels, the pixel colors and weights from top to bottom are as follows: Pixel 1 (top): Red (255, 0, 0), weight 0.5; Pixel 2 (center): Green (0, 255, 0), weight 1.0; Pixel 3 (bottom): Blue (0, 0, 255), weight 0.5; Calculate the weighted average: R=(255×0.5+0×1.0+0×0.5) / (0.5+1.0+0.5)=(127.5) / (2.0)=63.75; G=(0×0.5+255×1.0+0×0.5) / (2.0)=255 / 2=127.5; B=(0×0.5+0×1.0+255×0.5) / (2.0)=127.5 / 2=63.75; Therefore, the weighted average color of this band is (63.75, 127.5, 63.75).

[0085] In step 103, the target screen color information is sent to the lighting display device so that the lighting display device displays the target screen color information.

[0086] It should be understood that, in the embodiments of this application, the lighting display device can be a display device with multiple color output capabilities, such as LED strips, light bars, or RGB light strings. In some embodiments, the target screen color information is sent to the lighting display device via a communication protocol; wherein, the communication protocol includes, but is not limited to, the following: Universal Serial Bus (USB), Serial Peripheral Interface (SPI), Inter-Integrated Circuit (I2C), and Universal Asynchronous Receiver / Transmitter (UART). Further, in some embodiments, the processed target screen color information is converted into corresponding RGB signals and sent to the lighting display device.

[0087] In some embodiments, Figure 3 Schematic diagram of the implementation process of the display method provided in the embodiments of this application Figure Two ,like Figure 3 As shown, the method further includes the following steps 301 to 304: Step 301: Determine the difference between the pixel value corresponding to the pixel in the screen color information currently displayed by the light display device and the target pixel value corresponding to the associated pixel in the target screen color information; Step 302: Based on the difference and the exponential factor, determine the change in the pixel corresponding to the current screen color information displayed by the light display device; the exponential factor decreases as time increases; the time refers to the time elapsed since the target screen color information was received. Step 303: Based on the amount of change of the pixels in the screen color information currently displayed by the light display device, smooth the currently displayed screen color information to determine the screen color information to be displayed by the light display device. Step 304: Send the screen color information to be displayed to the lighting display device.

[0088] As can be understood, in this embodiment, the difference between the color information of the screen currently displayed by the lighting display device and the color information of the target screen is obtained by calculating the pixel value difference. An exponential factor is then used to control the rate of color information change. A smoothing process is then used to generate transition colors, and finally, the result is sent to the lighting display device for display. This approach helps to make the colors appear more natural, avoiding abrupt color changes and stuttering, thereby significantly enhancing the user's immersive experience.

[0089] It should be understood that in the embodiments of this application, pixel value refers to the color information of each pixel in the image, typically composed of three channels: red, green, and blue, ranging from 0 to 255. Target pixel value is the desired color value obtained by extracting and weighted averaging the current screen color information. By comparing the difference between the current pixel value and the target pixel value, the degree of deviation of the pixel in the color space can be determined.

[0090] In this embodiment, the exponential factor is not limited. The exponential factor is a coefficient that decays over time and is used to control the rate of color change. Upon receiving new target screen color information, the exponential factor gradually decreases over time, thereby reducing the magnitude of color change and eventually stabilizing. This design simulates a natural color transition effect and avoids abrupt changes in lighting.

[0091] It should be understood that, in this embodiment, the currently displayed screen color information is smoothed based on the change in pixel values ​​in the currently displayed screen color information to determine the screen color information to be displayed by the light display device. This reduces the abruptness and graininess during light switching, enhancing the overall immersion and user experience, allowing users to perceive a more natural light response.

[0092] In this embodiment of the application, "downloading" refers to transmitting the smoothed color data to the LED light strip or other lighting display device through a communication interface, and causing the LED light strip or other lighting display device to light up in a specified manner.

[0093] In some embodiments, the method further includes stopping the acquisition of the target screen color information in response to disabling the screen-following rhythm function; wherein the screen-following rhythm function refers to the light display device displaying the target screen color information.

[0094] For example, in one possible implementation, the update strategy for the RGB values ​​to be displayed by the light display device is shown in the following formula (2): (2) in, This indicates the RGB values ​​to be displayed by the lighting display device. This represents the RGB value currently displayed by the lighting display device; target represents the target RGB value corresponding to the associated pixel in the target screen color information; t is a timer (i.e., duration), which increases over time and is set to 0 when target is updated. The update coefficients (i.e., exponential factors) are specifically defined as follows: The update strategy for factor is shown in formula (3) below: (3) in, This is the minimum value of the factor to avoid underflow of the factor value; t0 is the amplitude of factor; t0 is the time constant, which is a fixed value.

[0095] In some embodiments, the method further includes: creating a main thread and a sub-thread of the main thread; the sub-thread acquiring current screen color information of the display screen based on a first frequency; and processing pixel values ​​corresponding to multiple pixels in the current screen color information according to attribute values ​​corresponding to multiple pixels in the current screen color information to obtain target screen color information; the main thread performing smoothing processing on the target screen color information based on a second frequency to determine screen color information to be displayed by the lighting display device; and sending the screen color information to be displayed to the lighting display device so that the lighting display device displays the screen color information to be displayed; the second frequency is greater than the first frequency.

[0096] It is understood that in this embodiment, a main thread and a sub-thread are created and set to different running frequencies. The sub-thread is responsible for low-frequency but computationally intensive screen color analysis, while the main thread is responsible for high-frequency data updates and distribution. This helps to reduce computational load while ensuring smoother color information displayed by the lighting display device. This enables smooth transitions and rapid updates in the lighting display, enhancing user immersion and visual comfort, and further improving the overall user experience.

[0097] It should be understood that, in this embodiment, the main thread is used to update and send the data to be displayed by the lighting display device. The main task of the main thread is to be responsible for the real-time rendering and output of the lighting effects of the lighting display device, ensuring smooth and seamless lighting changes. In this embodiment, the sub-threads are auxiliary threads derived from the main thread, used to perform low-frequency but computationally intensive tasks, such as capturing screen content and analyzing color distribution.

[0098] In some embodiments, the main thread and child threads communicate via shared memory or message queues. After completing a screen color analysis, the child thread passes the processing result to the main thread, which then receives the result and schedules subsequent lighting display operations. By having the main thread and child threads execute different tasks, response speed can be improved and multitasking capabilities enhanced.

[0099] It should be understood that in this embodiment, the main thread and the sub-thread run concurrently. That is, the steps "obtaining the current screen color information of the display screen; and processing the pixel values ​​corresponding to multiple pixels in the current screen color information according to the attribute values ​​corresponding to multiple pixels in the current screen color information to obtain the target screen color information" and "smoothing the target screen color information to determine the screen color information to be displayed by the lighting display device; and sending the screen color information to be displayed to the lighting display device so that the lighting display device displays the screen color information to be displayed" are executed in parallel. This helps alleviate the latency caused by large-scale computation, thereby ensuring that the color information displayed by the lighting display device and the screen changes synchronously, thus improving the user's immersion.

[0100] In this embodiment, the first frequency and the second frequency are not limited. The first frequency refers to the periodic frequency at which the sub-thread performs screen color acquisition and analysis tasks. For example, in one possible implementation, the first frequency is set to 20Hz. Compared to the high-frequency operation of the main thread, the lower frequency of the sub-thread helps reduce the load while still meeting the basic perceptual requirements of screen color changes.

[0101] In this embodiment, the second frequency refers to the frequency at which the main thread executes light data updates and issues tasks. For example, in one possible implementation, the second frequency is set to 200Hz, a value significantly higher than the first frequency set for the child thread. This helps ensure that the light changes are sufficiently rapid, thereby achieving a smooth, stutter-free display effect.

[0102] In some embodiments, the smoothing process refers to the steps performed in steps 301 to 304. In other embodiments, the smoothing process refers to interpolating color values ​​during the transition between two consecutive frames to make the change in light more gradual. For example, using linear interpolation, multiple intermediate states can be generated between the previous and current frames, making the transition of light color more natural and avoiding abrupt changes.

[0103] It should be understood that, in the embodiments of this application, the screen color information to be displayed is the final color data after smoothing by the main thread. In some embodiments, the screen color information to be displayed includes all the specific color values ​​that the lighting display devices should display, and is organized in a certain format so as to be quickly transmitted to the lighting display devices.

[0104] The following examples illustrate possible implementation schemes of the display method described in one or more of the above embodiments.

[0105] Lighting display devices such as light strips and light belts are widely used.

[0106] However, the inventors of this application discovered that the display modes of lighting are relatively limited, typically only offering fixed patterns such as breathing, rainbow, snow, and waves. These modes fail to resonate with the content displayed on the screen, providing only limited immersion and emotional value to users in specific situations. Furthermore, most light strips and light bars have a slow light update frequency, resulting in a noticeable abruptness and graininess in the display, impacting user immersion and leading to a poor user experience. In addition, the color changes of most light strips and light bars are abrupt and drastic. This is especially problematic in scenarios like e-sports games, affecting user immersion and increasing visual fatigue during prolonged use, resulting in a poor user experience.

[0107] Therefore, the relevant technologies have the following problems: (1) The lack of linkage between screen color and LED device results in a lack of immersive lighting display; (2) The product has a severe sense of unease and abrupt color changes, which cannot provide good emotional value. It not only fails to provide users with an immersive user experience, but also lowers the overall positioning of the product.

[0108] This application provides a method for displaying light that follows screen content (i.e., an example of a display method), including: (1) Create the main thread, which is responsible for updating RGB data and sending it to the LED display device.

[0109] (2) Create a child thread of the main thread to capture and analyze the screen color content; in this way, the RGB data calculation and LED command issuance are processed asynchronously by multiple threads, avoiding the delay in command issuance caused by calculation delay.

[0110] (3) Use linear interpolation to smooth the RGB data between frames, or use exponential smoothing algorithm to smooth the color information of the target screen; in this way, the LED lighting effect is smoother and the user experience is improved.

[0111] (4) Adaptive downsampling is performed on the captured screen content; this ensures that sufficient pixel information is collected while minimizing subsequent RGB calculations, and also ensures that the pixel coordinates assigned to each LED bead are not deviated. Adaptive downsampling involves determining the corresponding parameters (i.e., step size) based on the display screen resolution. The step size is divisible by the display screen resolution, ensuring no redundant color information and that each pixel can be mapped to an LED bead. In some embodiments, the step size is positively correlated with the resolution; the higher the resolution, the larger the step size; the lower the resolution, the smaller the step size.

[0112] (5) Perform a multi-dimensional weighted average of the RGB values ​​of the pixels, including brightness, saturation, wavelength, and inter-frame dynamic differences; this is beneficial for highlighting dynamically changing targets, bright parts of the image, and parts with high saturation and long wavelength, which are often more attractive to the eye, thereby optimizing the lighting effect display and improving the user experience.

[0113] (6) Avoid a lot of calculations and reduce latency by using table lookup and approximate calculation methods; in this way, the calculation process can be simplified and the calculation latency of RGB data can be reduced.

[0114] In some embodiments, steps 11 to 14 are performed in the main thread: Step 11: Initialize the color weight table corresponding to brightness, saturation, and wavelength; Step 12: Create a thread, hereinafter referred to as thread A, to capture the screen and process its colors; Step 13: Establish communication with the LED hardware device; Step 14: Start the loop at a frequency of 200Hz.

[0115] Step 141: Check if there is new LED data. If so, update the target LED data: target LED; otherwise, keep the existing target LED.

[0116] Step 142: Calculate the current LED data using the exponential moving average algorithm: that is, the data to be displayed by the light display device.

[0117] The update strategy for the RGB values ​​to be displayed by the lighting display device is shown in the following formula (4): (4) in, This indicates the RGB values ​​to be displayed by the lighting display device. This represents the RGB value currently displayed by the lighting display device; target represents the target RGB value corresponding to the associated pixel in the target screen color information; t is a timer (i.e., duration), which increases over time and is set to 0 when target is updated. The update coefficients (i.e., exponential factors) are specifically defined as follows: The update strategy for factor is shown in formula (5) below: (5) in, This is the minimum value of the factor to avoid underflow of the factor value; t0 is the amplitude of factor; t0 is the time constant, which is a fixed value.

[0118] Step 143, will Distribute to LED hardware devices, and based on renew .

[0119] In some embodiments, steps 21 to 25 are performed in thread A: Step 21: Capture the video stream from the user's display at a frequency of 20Hz; Step 22: Downsample the frame sequence; Step 23: Cut the sampling frame into several vertical strips, with each strip corresponding to an LED light; Step 24, calculate the strip-weighted average RGB value: Step 241, cache the current stripe; Step 242: Try to obtain the stripe at the same position in the previous frame and submit the asynchronous dynamic differential weight calculation (if there is data from the previous frame). Step 243, attempt to obtain dynamic weights in a non-blocking manner; Step 244: Use the approximate method to quickly calculate brightness and saturation; Step 245: Look up the table to obtain the weights corresponding to the pixel brightness, saturation, and wavelength; Step 246: If the dynamic difference weights are obtained, they are added to the weights from the previous step. Step 247: Accumulate the weights of the R, G, and B channels to obtain the final weight of the pixel; Step 248: Calculate the weighted average of the band colors; Step 25: Update the global LED data, i.e., the target LED.

[0120] The display method provided in this application embodiment can achieve the following technical effects: (1) Mapping the screen content onto LED lights can provide users with a more immersive experience in multiple scenarios such as office work, movie watching, and games. (2) Using two threads to process sending data to LED hardware devices and analyzing screen colors respectively. Using a lower frequency to capture screen colors for analysis alleviates the latency caused by large-scale calculations. Using a higher frequency to perform linear interpolation or exponential smoothing calculations on RGB data and sending data to LED hardware devices makes the LED light effect display very smooth without any stuttering, enhancing the immersive experience and improving the user experience. (3) Avoiding complex calculations as much as possible: By pre-calculating the correspondence between brightness / saturation / wavelength and weights, a weight table is obtained, and the table lookup method is used to replace the calculation; the piecewise linear function approximation method is used to replace the complex calculations of brightness, saturation, and wavelength. (4) Calculating an adaptive downsampling ratio for the captured screen size and the number of RGB lights to adapt to devices with different resolutions and numbers of lights. By downsampling, the computational overhead is greatly reduced without losing key screen color information, further reducing latency and improving the user experience. (5) Apply multi-dimensional weighted averaging to screen colors: For pixels with R, G, and B values ​​all less than a specific value (e.g., 5), set the weight to low to avoid affecting the brightness and saturation of other colors in the weighted averaging; Based on the pixel brightness and saturation values, consult the weight table to adjust the weights so that pixels with high brightness and saturation receive higher weights. Areas with higher brightness and saturation are usually more attractive to users. By weighting them, the performance of these color content points on the LED light is improved; Increase the weight value of long-wavelength pixels. Generally, long-wavelength (e.g., warm light areas with orange-red hues) color content is more attractive to users, such as sunrise and flowers. By weighting them, the performance of these color content points on the LED light is improved; By comparing the pixel differences between frames, increase the weight value of pixels with large differences (dynamic weight). These pixels often represent moving objects in the picture. Compared to the background, these moving objects are more attractive to users. By weighting them, the performance of these color content points on the LED light is improved.

[0121] In some embodiments, Figure 4 Schematic diagram of the implementation process of the display method provided in the embodiments of this application Figure Three ,like Figure 4 As shown, the method includes the following steps 401 to 420: Step 401, initialize the weight table; Step 402, create child thread A; Step 403: Establish communication with the LED device; Step 404: Determine if there is new RGB data; if yes, proceed to step 405; otherwise, proceed to step 406. Step 405: Update the current LED value using an exponential function; Step 406, update the target LED value; Step 407: Send the current LED value to the LED device; Step 408: Determine whether the screen-synchronized rhythm function is enabled; if yes, proceed to step 404; otherwise, proceed to step 409. Step 409, terminate child thread A; Sub-thread A executes steps 410 to 420; Step 410, capture the display content; Step 411: Adaptive downsampling of the frame; Step 412: Cut the frame into several strips; Step 413, cache the current stripe; Step 414: Calculate attribute values ​​using the approximate method; Step 415: Look up the table to obtain the weight corresponding to the attribute value (i.e., an example of the second weight). Step 416: Asynchronously calculate inter-frame differential weights (i.e., an example of dynamic weights). Step 417, calculate the total pixel weight (i.e., an example of the first weight); Step 418, calculate the weighted average; Step 419: Determine if the stripe processing is complete; if yes, proceed to step 414; otherwise, proceed to step 420. Step 420, update global RGB data (i.e., update global RGB data, which is also an example of target screen color information).

[0122] Based on the same inventive concept as the foregoing embodiments, this application provides a display device.

[0123] Figure 5 This is a schematic diagram of the structure of a display device provided in an embodiment of this application; as shown below. Figure 5 As shown, the display device 50 includes: The acquisition module 501 is configured to acquire the current screen color information of the display screen; The processing module 502 is configured to process the pixel values ​​corresponding to the multiple pixels in the current screen color information according to the attribute values ​​corresponding to the multiple pixels in the current screen color information to obtain target screen color information; the target screen color information is obtained by enhancing the visual perception of the current screen color information based on the attribute values. The sending module 503 is configured to send the target screen color information to the lighting display device, so that the lighting display device displays the target screen color information. In some embodiments, the display device 50 further includes a segmentation module; the segmentation module is configured to segment the acquired current screen color information according to the number of the light display devices, and determine the sub-screen color information associated with the light display devices in the current screen color information.

[0124] In some embodiments, the processing module 502 is further configured to, for each sub-screen color information in the current screen color information, determine a first weight corresponding to the pixel based on the attribute value corresponding to each pixel in the sub-screen color information; determine sub-target color information corresponding to each sub-screen color information based on the first weight and the corresponding pixel value; and obtain the target screen color information corresponding to the current screen color information based on the sub-target color information corresponding to each sub-screen color information.

[0125] In some embodiments, the attribute values ​​of the pixels include attribute values ​​that reflect the visual perception of the pixels in different dimensions; the processing module 502 is further configured to obtain a second weight corresponding to the attribute values ​​of each pixel in the sub-screen color information in different dimensions through a preset weight table; wherein, the preset weight table is used to characterize the correspondence between the attribute values ​​and the second weight; the second weight is positively correlated with the attribute values; and a first weight corresponding to each pixel in the sub-screen color information is determined according to the second weight corresponding to the attribute values ​​of each pixel in different dimensions. In some embodiments, the processing module 502 is further configured to, for each pixel, in response to the existence of a corresponding dynamic weight, determine a first weight corresponding to each pixel in the sub-screen color information based on the dynamic weight and the second weight; wherein the dynamic weight is determined based on the current screen color information and the screen color information of the corresponding previous frame.

[0126] In some embodiments, the processing module 502 is further configured to, for each pixel, determine a target pixel value based on the pixel value corresponding to each color channel in the pixel and the first weight; and determine sub-target color information corresponding to each sub-screen color information based on the target pixel value corresponding to each pixel.

[0127] In some embodiments, the display device 50 further includes a first determining module, a second determining module, and a smoothing processing module; the first determining module is configured to determine the difference between the pixel value corresponding to a pixel in the screen color information currently displayed by the light display device and the target pixel value corresponding to an associated pixel in the target screen color information; the second determining module is configured to determine the amount of change corresponding to a pixel in the screen color information currently displayed by the light display device based on the difference and an exponential factor; the exponential factor decreases as time increases; the time refers to the time elapsed since the target screen color information was received; the smoothing processing module is configured to smooth the currently displayed screen color information based on the amount of change corresponding to a pixel in the currently displayed screen color information to determine the screen color information to be displayed by the light display device; the sending module 503 is further configured to send the screen color information to be displayed to the light display device.

[0128] In some embodiments, the display device 50 further includes a creation module; the creation module is configured to create a main thread and a sub-thread of the main thread; the processing module 502 is further configured to have the sub-thread acquire the current screen color information of the display screen based on a first frequency; and process the pixel values ​​corresponding to the multiple pixels in the current screen color information according to the attribute values ​​corresponding to the multiple pixels in the current screen color information to obtain the target screen color information; the sending module 503 is further configured to have the main thread perform smoothing processing on the target screen color information based on a second frequency to determine the screen color information to be displayed by the lighting display device; and send the screen color information to be displayed to the lighting display device so that the lighting display device displays the screen color information to be displayed; the second frequency is greater than the first frequency.

[0129] In some embodiments, the display device 50 further includes a sampling module; the sampling module is configured to, before segmenting the acquired current screen color information, extract one pixel from the current screen color information every N-1 pixels according to a preset sampling step size N, to obtain sampled screen color information; the sampling step size N is determined based on the resolution of the display screen, and the resolution of the display screen is an integer multiple of the sampling step size N; the sampled screen color information is used as the current screen color information.

[0130] The descriptions of the above device embodiments are similar to those of the above method embodiments, and have similar beneficial effects. For technical details not disclosed in the device embodiments of this application, please refer to the descriptions of the method embodiments of this application for understanding.

[0131] It should be noted that the module division in the embodiments of this application is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods. Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, exist as separate physical units, or have two or more units integrated into one unit. The integrated units can be implemented in hardware, as software functional units, or a combination of software and hardware.

[0132] It should be noted that, in the embodiments of this application, if the above-described methods are implemented as software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, or the parts that contribute to related technologies, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause an electronic device to execute all or part of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), magnetic disks, or optical disks. Thus, the embodiments of this application are not limited to any specific hardware and software combination.

[0133] This application provides an electronic device. Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application, such as... Figure 6 As shown, the electronic device 60 includes a memory 601, a processor 602, a display screen 603, and a light display device 604. The memory 601 stores a computer program that can run on the processor 602. When the processor 602 executes the program, it performs the following: Obtain the current screen color information of display screen 603; Based on the attribute values ​​corresponding to multiple pixels in the current screen color information, the pixel values ​​corresponding to multiple pixels in the current screen color information are processed to obtain target screen color information; the target screen color information is obtained by enhancing the visual perception of the current screen color information based on the attribute values. The target screen color information is sent to the lighting display device; The light display device 604 is used to display the color information of the target screen.

[0134] It should be noted that the memory 601 is configured to store instructions and applications that can be executed by the processor 602, and can also cache data to be processed or already processed in the various modules of the processor 602 and the electronic device 60. It can be implemented by flash memory or random access memory (RAM).

[0135] This application provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the steps of the methods provided in the above embodiments. This application also provides a computer program product containing instructions that, when run on a computer, cause the computer to perform the steps of the methods provided in the above method embodiments.

[0136] It should be noted that the descriptions of the storage medium and device embodiments above are similar to the descriptions of the method embodiments above, and have similar beneficial effects. For technical details not disclosed in the storage medium, storage medium, and device embodiments of this application, please refer to the descriptions of the method embodiments of this application for understanding.

[0137] It should be understood that phrases such as "an embodiment," "one embodiment," "some embodiments," "in one possible implementation," or "example" throughout the specification mean that a specific feature, structure, or characteristic related to an embodiment is included in at least one embodiment of this application. Therefore, phrases such as "in one embodiment," "in one embodiment," "in some embodiments," "in one possible implementation," or "example" appearing throughout the specification do not necessarily refer to the same embodiment.

[0138] Furthermore, these specific features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. It should be understood that in the various embodiments of this application, the sequence numbers of the above processes do not imply a specific order of execution; the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0139] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments. The descriptions of the various embodiments above tend to emphasize the differences between the various embodiments, and their similarities or commonalities can be referred to each other. For the sake of brevity, they will not be repeated here.

[0140] In this article, the term "and / or" is merely a description of the relationship between related objects, indicating that there can be three kinds of relationships. For example, object A and / or object B can represent three situations: object A exists alone, object A and object B exist simultaneously, and object B exists alone.

[0141] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0142] The above description is merely an embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A display method, the method comprising: Obtain the current screen color information of the display screen; Based on the attribute values ​​corresponding to multiple pixels in the current screen color information, the pixel values ​​corresponding to multiple pixels in the current screen color information are processed to obtain the target screen color information; The target screen color information is obtained by enhancing the visual perception of the current screen color information based on the attribute values. The target screen color information is sent to the lighting display device so that the lighting display device displays the target screen color information.

2. The display method according to claim 1, further comprising: Based on the number of lighting display devices, the acquired current screen color information is segmented to determine the sub-screen color information associated with the lighting display devices within the current screen color information.

3. The display method according to claim 2, wherein processing the pixel values ​​corresponding to the multiple pixels in the current screen color information according to the attribute values ​​corresponding to the multiple pixels in the current screen color information to obtain the target screen color information includes: For each sub-screen color information in the current screen color information, a first weight corresponding to the pixel is determined based on the attribute value corresponding to each pixel in the sub-screen color information. Based on the first weight and the corresponding pixel value of each pixel, the sub-target color information corresponding to each sub-screen color information is determined; Based on the sub-target color information corresponding to each sub-screen color information, the target screen color information corresponding to the current screen color information is obtained.

4. The display method according to claim 3, wherein the attribute values ​​of the pixel include attribute values ​​used to reflect the visual perception of the pixel in different dimensions; The step of determining the first weight corresponding to each pixel based on the attribute value corresponding to each pixel in the sub-screen color information includes: Using a preset weight table, the second weight corresponding to the attribute values ​​of each pixel in the sub-screen color information in different dimensions is obtained; wherein, the preset weight table is used to characterize the correspondence between the attribute values ​​and the second weight; the second weight is positively correlated with the attribute values; Based on the second weight corresponding to the attribute values ​​of each pixel in different dimensions, the first weight corresponding to each pixel in the sub-screen color information is determined.

5. The display method according to claim 4, wherein determining the first weight corresponding to each pixel in the sub-screen color information based on the second weight corresponding to the attribute values ​​of each pixel in different dimensions further comprises: For each pixel, in response to the existence of a corresponding dynamic weight, a first weight corresponding to each pixel in the sub-screen color information is determined based on the dynamic weight and the second weight; wherein, the dynamic weight is determined based on the current screen color information and the screen color information of the previous frame.

6. The display method according to any one of claims 3 to 5, wherein determining the sub-target color information corresponding to each sub-screen color information based on the first weight and the corresponding pixel value of each pixel includes: For each pixel, the target pixel value is determined based on the pixel value corresponding to each color channel in the pixel and the first weight; Based on the target pixel value corresponding to each pixel, the sub-target color information corresponding to each sub-screen color information is determined.

7. The display method according to claim 6, further comprising: Determine the difference between the pixel value corresponding to the pixel in the screen color information currently displayed by the light display device and the target pixel value corresponding to the associated pixel in the target screen color information; Based on the difference and the exponential factor, the change in the pixel corresponding to the screen color information currently displayed by the light display device is determined; The exponential factor decreases as time increases; the time refers to the time elapsed since the target screen color information was received. Based on the change in the pixel values ​​in the currently displayed screen color information of the light display device, the currently displayed screen color information is smoothed to determine the screen color information to be displayed by the light display device. The screen color information to be displayed is sent to the lighting display device.

8. The display method according to claim 7, further comprising: Create the main thread and its child threads; The sub-thread obtains the current screen color information of the display screen based on the first frequency; Based on the attribute values ​​corresponding to multiple pixels in the current screen color information, the pixel values ​​corresponding to multiple pixels in the current screen color information are processed to obtain the target screen color information; The main thread performs smoothing processing on the target screen color information based on the second frequency to determine the screen color information to be displayed by the lighting display device; and sends the screen color information to be displayed to the lighting display device so that the lighting display device displays the screen color information to be displayed. The second frequency is greater than the first frequency.

9. The display method according to claim 2, wherein before segmenting the acquired current screen color information, the method further comprises: According to the preset sampling step size N, one pixel is extracted from the current screen color information every N-1 pixels to obtain the sampled screen color information. The sampling step size N is determined based on the resolution of the display screen, and the resolution of the display screen is an integer multiple of the sampling step size N; The sampled screen color information is used as the current screen color information.

10. An electronic device, comprising a memory, a processor, a display screen, and a light display device, wherein: The memory is used to store computer programs that can run on the processor; The processor is configured to execute the computer program in the memory, performing the following: Obtain the current screen color information of the display screen; Based on the attribute values ​​corresponding to multiple pixels in the current screen color information, the pixel values ​​corresponding to multiple pixels in the current screen color information are processed to obtain the target screen color information; The target screen color information is obtained by enhancing the visual perception of the current screen color information based on the attribute values. The target screen color information is sent to the lighting display device; The light display device is used to display the color information of the target screen.

Images