Display method and device

Abstract

The invention discloses a display method and equipment. The display method comprises the following steps: acquiring pixel matrix data of a first color component of an original display picture in a target color space; performing fuzzy processing on color components of at least part of pixels in the pixel matrix data of the first color component to obtain a first fuzzy component; and generating and displaying a target display picture based on the first fuzzy component. Through the implementation scheme, fuzzy processing is carried out on part of color components in the display picture, and the effect that the focus moves forwards in the eye axis direction after the part of color components are focused in the human eyes is simulated, so that myopia defocus signals are generated on the retina, myopia formation and development are slowed down, and the eye protection effect is achieved. Meanwhile, part of color components are blurred, the color proportion cannot be obviously reduced, the influence on the picture hue can be reduced, and the user experience is better.

Description

Technical Field

[0001] The present invention relates to the field of terminal technology, and in particular to a display method and device. Background Art

[0002] In order to reduce the stimulation of screen display content to the eyes and improve eye comfort, it is necessary to optimize the display content of electronic devices. The current technical solution is to achieve the purpose of eye protection by reducing the proportion of blue light in the display light. However, this solution will cause obvious changes in the display color tone, affecting the display effect. Summary of the invention

[0003] The object of the present invention is to provide a display method and device to reduce the stimulation of screen display content to human eyes, while preventing the color tone of the display content from being changed to ensure the display effect.

[0004] In a first aspect, the present invention provides a display method, comprising: obtaining pixel matrix data of a first color component of an original display picture in a target color space; blurring the color components of at least some pixels in the pixel matrix data of the first color component to obtain a first blurred component; generating a target display picture based on the first blurred component and displaying it.

[0005] In the above implementation scheme, by blurring some color components in the display image, the blurred color components are imaged in a blurred state in the human eye, which can be used to simulate the imaging effect in the state of myopia defocus, and provide the eye with myopia defocus guidance information, thereby inhibiting the axial growth of the eye, slowing down the formation of myopia, and achieving the purpose of eye protection. At the same time, blurring does not significantly reduce the color ratio, which can reduce the impact on the color tone of the display image, and provide a better user experience.

[0006] In some implementations of the first aspect of a display method as described above, obtaining pixel matrix data of a first color component of an original display image in a target color space includes: obtaining a pixel matrix of at least one color component of the original display image in an RGB color space including a blue component.

[0007] In this implementation, the RGB color space can be selected to perform blur processing on the B component of the display image in the RGB color space. Since the RGB color space is the color space used by the display device to display the image, the conversion of the color space can be avoided, thereby improving the calculation efficiency.

[0008] A display method as described above, in certain implementations of the first aspect, obtains pixel matrix data of a first color component of an original display picture in a target color space, including: converting the original display picture from an RGB color space to an LMS color space; and obtaining pixel matrix data of at least one color component of the original display picture in the LMS color space including an S component.

[0009] In this implementation, since the LMS color space can characterize the perceived intensity response of different cone cells on the human eye's retina to light stimuli of different wavelengths, by converting the color space of the display image to the LMS space and then extracting and blurring the color components, the extracted color components can be adapted to the actual perception of the human eye, which is beneficial to improving the eye protection effect of the optimized display image.

[0010] In some implementations of the first aspect of the display method as described above, the color components of at least part of the pixels in the pixel matrix data of the first color component include: the color components of all the pixels in the pixel matrix data of the first color component.

[0011] In some implementations of the first aspect of the display method as described above, the color components of at least part of the pixels in the pixel matrix data of the first color component include: the color components of a preset proportion of pixels in the pixel matrix data of the first color component.

[0012] In this implementation, blurring is performed on a preset proportion of the extracted color components, so that the influence of blurring on the overall display effect can be reduced.

[0013] In a display method as described above, in certain implementations of the first aspect, the color components of at least some pixels in the pixel matrix data of the first color component include: the color components of pixels whose component values ​​are greater than a first threshold in the pixel matrix data of the first color component.

[0014] In this implementation, by selecting an appropriate filter to filter the extracted color component, the pixels in the color component whose brightness is greater than the set threshold can be screened out, and only such pixels are blurred. On the one hand, the amount of calculation during blurring can be reduced, and on the other hand, only the high-brightness part of the overall color component is blurred, which can effectively achieve the eye protection effect while reducing the impact on the image display effect.

[0015] In a display method as described above, in certain implementations of the first aspect, the color components of at least part of the pixels in the pixel matrix of the first color component include: the color components of the pixels whose frequency domain component values ​​are greater than the second threshold in the pixel matrix data of the first color component.

[0016] In this implementation, the color component is first transformed into the frequency domain through Fourier transform, and the pixels whose frequency domain values ​​in the color component are greater than the set threshold are screened out, and then only such pixels are blurred. On the one hand, the amount of calculation during blurring can be reduced, and on the other hand, only the part of the overall color component containing more details is blurred to prevent the image display effect from being affected.

[0017] A display method as described above, in certain implementations of the first aspect, generates and displays a target display screen based on a first fuzzy component, including: reconstructing pixel matrix data of the first fuzzy component and a second color component to obtain and display the target display screen, wherein the second color component is the remaining color components in the target color space except the first color component.

[0018] A display method as described above, in certain implementations of the first aspect, generates and displays a target display screen based on a first fuzzy component, including: generating a second fuzzy component based on the first fuzzy component and the color component of the unblurred pixels in the pixel matrix data of the first color component; reconstructing the second fuzzy component and the pixel matrix data of the second color component to obtain and display the target display screen, wherein the second color component is the remaining color components in the target color space except the first color component.

[0019] A display method as described above, in certain implementations of the first aspect, blurring the color components of at least some pixels in the pixel matrix data of the first color component to obtain a first blurred component, including: determining blurred matrix data; using the blurred matrix data to blur the color components of at least some pixels in the pixel matrix data of the first color component to obtain the first blurred component.

[0020] In certain implementations of the first aspect of a display method as described above, determining fuzzy matrix data includes: acquiring at least one first parameter associated with a current display scene; and determining a size and / or weight of the fuzzy matrix data based on the at least one first parameter.

[0021] In a display method as described above, in certain implementations of the first aspect, the first parameter includes any one or more of longitudinal chromatic aberration of the human eye, viewing distance of the human eye, pupil diameter of the human eye, user age, user vision data, and user eye axis length.

[0022] In this implementation, by utilizing parameters related to the display scene to determine the size and / or weight of the fuzzy matrix, the optimization intensity of the display image can be adaptively changed as the actual display scene changes, which is more in line with the user's actual usage scenario and improves the optimization effect.

[0023] In some implementations of the first aspect of the display method described above, the size of the fuzzy matrix data is the number of rows and columns of the fuzzy matrix data; and determining the size of the fuzzy matrix data according to at least one first parameter includes: determining the size of the fuzzy matrix data according to the following formula:

[0024] D=Pupil*(SG) / G

[0025]

[0026]

[0027] Wherein, D is the size of the fuzzy matrix data, Pupil is the pupil diameter of the human eye, S is the viewing distance of the human eye, G is the target parameter calculated based on the viewing distance of the human eye and the longitudinal chromatic aberration, LCA is the longitudinal chromatic aberration, λ is the wavelength of the first color component, and p, q and c are constants.

[0028] In a display method as described above, in certain implementations of the first aspect, the weight of the fuzzy matrix data is the coefficient of each element in the fuzzy matrix data; the larger the coefficient of the target element in the fuzzy matrix data, the greater the weight of the color component of the target pixel in the fuzzy component corresponding to the target pixel; the smaller the coefficient of the target element in the fuzzy matrix data, the greater the weight of the color component of the pixels around the target pixel in the fuzzy component corresponding to the target pixel; the target element is the element at the center point of the fuzzy matrix data, and the target pixel is any one of at least some of the pixels.

[0029] In a second aspect, the present invention further provides an electronic device, comprising: an acquisition unit, configured to acquire a pixel matrix of a first color component of an original display image in a target color space; an execution unit, configured to use a fuzzy matrix to perform fuzzy processing on the color components of at least some pixels in the pixel matrix of the first color component to obtain a first fuzzy component; and a generation unit, configured to generate a target display image based on the first fuzzy component and display the image.

[0030] In a third aspect, the present technical solution provides a display device, comprising: one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, which, when executed by the device, enable the device to execute the method in the first aspect or any possible implementation of the first aspect.

[0031] In a fourth aspect, the present invention further provides a chip, comprising a processor and a data interface, wherein the processor reads instructions stored in a memory through the data interface to execute the method in the first aspect or any possible implementation of the first aspect.

[0032] Optionally, as an implementation method, the chip may also include a memory, in which instructions are stored, and the processor is used to execute the instructions stored in the memory. When the instructions are executed, the processor is used to execute the method in the first aspect or any possible implementation method of the first aspect.

[0033] In a fifth aspect, the present invention further provides a computer-readable storage medium, wherein the computer-readable medium stores a program code for execution by a device, wherein the program code includes instructions for executing the method in the first aspect or any possible implementation of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 This is a schematic diagram of the eyeball development process provided by an embodiment of the present application;

[0035] Figure 2 This is a schematic diagram of the principle of longitudinal chromatic aberration provided by an embodiment of the present application;

[0036] Figure 3 is a schematic flow chart of a display method provided in an embodiment of the present application;

[0037] Figure 4 is a structural schematic diagram of an electronic device provided in an embodiment of the present application;

[0038] Figure 5 is another schematic flow chart of the display method provided in an embodiment of the present application;

[0039] Figure 6 It is a scene flow chart of the display method provided in an embodiment of the present application;

[0040] Figure 7 is another scenario flow chart of the display method provided in an embodiment of the present application;

[0041] Figure 8 is another schematic flow chart of the display method provided in an embodiment of the present application;

[0042] Fig. 9 is another schematic flow chart of the display method provided in an embodiment of the present application;

[0043] Fig.10 This is another structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0044] Nowadays, people's daily lives are increasingly closely connected with various electronic devices, and screen usage time is getting longer and longer. Against this background, it is necessary to adjust the light stimulation emitted by display screens, reduce the stimulation of blue light to the human eye, and slow down the formation of myopia.

[0045] In the related technical solution, the amount of blue light incident on the human eye is reduced by reducing the proportion of blue light in the light stimulation of the display screen, thereby achieving the purpose of eye protection. Specifically, for example, the value of the blue light component in the white field point of the display screen is reduced. The white field point is the brightest point in the image, and the RGB value of the white field point can be preset. When the screen displays an image, the RGB value of each pixel in the image is determined based on the RGB value of the white field point. Then, when the blue light component of the white field point is reduced, when the screen displays an image, the blue light component of each pixel in the image is reduced.

[0046] However, when the proportion of blue light is reduced, the color tone of the original display will change significantly, and the overall color tone will appear yellowish, affecting the display effect. Especially in color-sensitive usage scenarios, such as making animations, posters, and photo editing, it is not conducive to users to accurately identify the color of the image, which will greatly affect the user experience.

[0047] In view of the above problems, a display method is proposed, which is used to adjust the light stimulation emitted by the display screen to achieve eye protection effect, while reducing the impact on the color tone of the display picture and improving the display effect of the adjusted display picture.

[0048] Before explaining the display method provided in the present application, for ease of understanding, the relevant theories of human eye development are first introduced.

[0049] 1. Defocus theory

[0050] The defocus theory explains the formation process of myopia. The theory suggests that the retina can recognize defocus signals and control the growth of the eye axis based on the defocus information. Figure 1 A schematic diagram of the eyeball development process provided in the embodiment of the present application. Figure 1 During the growth of the eyeball, the retina can actively control the axial growth of the eyeball according to visual cues, so that the light entering the human eye is focused on the retina to form a clear image, achieving Figure 1 The state shown in 1B in the figure, at this time, the focus O formed by the focused light is located on the retina, and this process is called emmetropization. In this process, if the focus O formed by the light entering the human eye is located behind the retina, it is hyperopic defocus, such as Figure 1 As shown in 1A in the figure, at this time, the image on the retina is in a blurred state. In order to obtain a clearer image, the eyeball will continue to grow toward its own axis so that the focus O of the light is focused on the retina. If the eyes are kept in a hyperopic defocus state for a long time due to improper use of the eyes, the eye axis will continue to lengthen, causing myopia to occur and deepen. On the contrary, if the focus O formed by the visual clues entering the human eye is located in front of the retina, that is, myopic defocus, as shown in Figure 1 As shown in Figure 1C, the growth rate of the eye axis will slow down, thereby inhibiting the occurrence and development of myopia.

[0051] According to the above description, it can be understood that when the human eye is in a hyperopic defocus state, it will promote the eyeball to grow along its own axis and promote the formation and development of myopia. When the human eye is in a myopic defocus state, it will inhibit the eyeball from growing along its own axis and slow down the formation and development of myopia.

[0052] 2. Longitudinal chromatic aberration theory

[0053] Longitudinal chromatic aberration, also known as axial chromatic aberration, refers to the phenomenon that due to the different refractive indices of the lens for different colors of light, the focus of each color of light is arranged in front and behind the main axis of the lens, thus causing a dispersion circle on an imaging surface. Its size is usually expressed by the distance between the blue light focus and the red light focus. For the human eye, Figure 2 As shown, based on the theory of longitudinal chromatic aberration, the various colors of light from the display of an electronic device will be focused on different positions of the eye axis after passing through the human eye. Among them, blue light has the shortest wavelength and red light has the longest wavelength. Therefore, the focus of blue light on the eye axis is before red light, and green light is focused between blue and red light.

[0054] Based on the above theory, during the development of the eyeball, after visual information enters the human eye, if the focus of some color components on the eye axis is above the retina and the focus of other color components on the eye axis is behind the retina, or the focus of all color components on the eye axis is behind the retina, the eyeball will be guided by the hyperopic defocus signal and will continue to grow toward its own axis, promoting the formation and development of myopia; on the contrary, if the focus of at least some color components on the eye axis is in front of the retina, the eyeball will be guided by the myopic defocus signal, which can inhibit the eyeball from growing toward its own axis and slow down the formation and development of myopia.

[0055] Based on the above theory, in the embodiments of the present application, Figure 3 As shown, some color components in the original display picture, such as the blue light component, can be extracted, and the blue light component can be blurred using a blur matrix, such as Gaussian blur, to obtain the blurred blue light component. Then, the blurred blue light component can be reconstructed with the other color components of the original display picture to obtain a new display picture for display.

[0056] Since the blue light component is in a blurred state in the new display image, it can be used to simulate the imaging effect of the blue light component in the human eye in a myopic defocus state, giving the eyeball myopic defocus guidance information, thereby inhibiting the axial growth of the eyeball, slowing down the formation of myopia, and achieving the purpose of eye protection. At the same time, since the blurring of blue light in the embodiment of the present application does not cause a significant change in the proportion of blue light, the impact on the color tone of the display image can be weakened, and blurring some of the color components can prevent significant changes in image clarity and ensure the display effect.

[0057] For example, Figure 4 A schematic diagram of the structure of an electronic device 100 provided in an embodiment of the present application is shown. The electronic device 100 may include a display screen 194, a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a motor 191, an indicator 192, a camera 193, and a subscriber identification module (SIM) card interface 195, etc.

[0058] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0059] The display screen 194 can display images by forming pixels using three primary colors: red, green, and blue (RGB).

[0060] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0061] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0062] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0063] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0064] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0065] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a display control function, etc.), etc. The data storage area may store data created during the use of the electronic device 100, etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0066] The distance sensor 180F can be used to measure the distance, and specifically can measure the distance through infrared or laser. In some embodiments, when a user uses the electronic device, the distance sensor 180F can be used to detect the viewing distance of the user using an infrared signal.

[0067] The ambient light sensor 108L is used to detect the brightness of the ambient light. In some embodiments, when a user uses the electronic device, the ambient light sensor 108L can be used to detect the brightness of the ambient light, so that the electronic device 100 can calculate the pupil diameter of the human eye based on parameters such as the ambient light brightness and the screen display brightness.

[0068] For ease of understanding, the following embodiments of the present application will be described in detail with Figure 4 Taking the electronic device with the structure shown as an example, the display method provided in the embodiment of the present application is specifically explained.

[0069] Figure 5 is a schematic flow chart of a display method provided in an embodiment of the present application, such as Figure 5 As shown, the display method provided in the embodiment of the present application includes:

[0070] 101. Obtain pixel matrix data of a first color component of an original display picture in a target color space.

[0071] 102 , perform fuzzy processing on color components of at least some pixels in the pixel matrix data of the first color component to obtain a first fuzzy component.

[0072] 103 , generating a target display picture based on the first fuzzy component and displaying the picture.

[0073] In an embodiment of the present application, the electronic device may be configured with a display mode adjustment function for the user to adjust the display mode of the device.

[0074] For example, Figure 6 As shown, the setting interface 61 of the electronic device may include, for example, a display mode setting button 611. In response to the triggering operation of the display mode setting button 611, the electronic device may display a display mode selection interface 62, and the display mode selection interface 62 may include, for example, option buttons for multiple display modes such as an eye protection mode and a standard mode.

[0075] In response to the triggering operation of any option button in the display mode selection interface, the electronic device can switch to the corresponding display mode. Specifically, in response to the triggering operation of the eye protection mode option button, the electronic device can switch to the eye protection mode and trigger the execution of the display method provided in the embodiment of the present application to adjust the screen display light and achieve the eye protection goal.

[0076] The specific execution process of the display method provided in the embodiment of the present application is described below.

[0077] First, the electronic device may obtain pixel matrix data of at least one color component of the original display image in the target color space.

[0078] In one possible implementation, the target color space is an RGB color space. The electronic device can obtain the color component of the B channel in the RGB color space of the original display image, that is, the blue component. Since the image display format of the electronic device is the RGB format, this implementation is conducive to reducing the amount of calculation and facilitating the extraction of color components.

[0079] In another possible implementation, the target color space is the (long-, middle-and short-wavelength-sensitive cones, LMS) color space. It should be noted that when the human eye receives color-related visual information, it is mainly perceived and responded by the short, medium and long cones on the retina. Among them, short cones mainly perceive S short-wavelength light, medium cones mainly perceive M medium-wavelength light, and long cones mainly perceive L long-wavelength light. The LMS color space is a color space represented by the responses of the above three types of cones of the human eye, and is named after its response peaks at long wavelengths, medium wavelengths and short wavelengths. Based on the above description, the electronic device can first convert the original display image from the RGB color space to the LMS color space according to a preset conversion function, and then obtain the color component of the original display image in the S channel, that is, the short-wavelength component. Through this implementation, it is possible to extract the color components perceived by the short cones based on the perception ability of the cones of the human eye to light, so that the extracted color components are more in line with the actual perception of the human eye.

[0080] It should be understood that, alternatively, the color components extracted by the embodiment of the present application may also be other color components in the corresponding color space, such as green light component and medium wavelength component, in addition to the above-mentioned blue component and short wavelength component; or, it may also be at least one color component including the above-mentioned blue component or short wavelength component in the corresponding color space, such as blue light component and green light component, or short wavelength component and medium wavelength component. The embodiment of the present application is not limited to this.

[0081] Then, the electronic device may perform blur processing on the extracted color components to obtain blurred color components. The specific blur processing method may be Gaussian blur.

[0082] The following takes the case where the extracted color component is a blue component as an example to illustrate the fuzzy processing process. It should be understood that when the color component is other color components in the RGB color space or other color components in other color spaces, the following method flow is still applicable.

[0083] In a possible implementation, the fuzzy matrix data can be directly convolved with the pixel matrix data of the blue component extracted above to implement fuzzy processing of the blue component. The value of the fuzzy matrix data can be a preset fixed value. Through this implementation, fuzzy processing of all blue components in the entire image can be implemented, which is beneficial to improving the eye protection effect.

[0084] Taking into account that blurring the blue component in the image will reduce the overall clarity of the image to a certain extent, in another possible implementation method, the blue component of some pixels in the extracted pixel matrix data of the blue component can be blurred, thereby reducing the total amount of blurred blue components and reducing the impact of the blurring on the overall clarity of the image.

[0085] For example, the blue component of any part of the pixels can be selected from the pixel matrix data of the extracted blue component according to a preset ratio. Then, the selected part of the blue component is fuzzy processed using the fuzzy matrix data. Through this implementation, the fuzzy processing of part of the blue component in the whole image can be achieved, which is conducive to achieving eye protection effect to a certain extent, while reducing the influence of the fuzzy processing on the image display effect.

[0086] The preset ratio may be a fixed value, or the preset ratio may be flexibly adjusted by the user according to needs. Figure 6 In the mode selection interface 62 shown, in response to the user triggering the eye protection mode option button, a first adjustment control can also be displayed for adjusting the size of the preset ratio. The first adjustment control can be, for example, a sliding bar.

[0087] Alternatively, blurring of part of the blue component may also be performed by determining the blue component of part of the pixels from the pixel matrix data of the extracted blue component according to a preset screening principle. Specifically, the pixel matrix data of the extracted blue component may be filtered based on a pre-selected filter to obtain the blue component of part of the pixels whose component values ​​are greater than a preset threshold. Furthermore, the above-mentioned blur matrix data may be convolved with the filtered blue component to achieve blurring of the filtered blue component. Through this implementation, only the pixels whose brightness is greater than the set threshold in the blue component of the entire image are blurred, which is beneficial to reduce the impact on the display effect while achieving the eye protection effect.

[0088] Alternatively, blurring of part of the blue component can also be performed by first performing a fast Fourier transform on the extracted blue component to obtain frequency domain data corresponding to the blue component in the frequency domain space. Furthermore, the obtained frequency domain data can be filtered based on a preset filter to obtain each frequency domain data whose frequency domain value is greater than a preset threshold. Among them, the larger the frequency domain value, the higher the rate of change of brightness and the more image details contained. Furthermore, the above-mentioned fuzzy matrix data can be convolved with the filtered frequency domain data to achieve blurring. Through this implementation method, only the pixels whose rate of change in the blue component of the entire image is higher than the threshold are blurred, which is also conducive to improving the display effect of the processed picture.

[0089] For ease of understanding, the following Figure 7 , the implementation method of fuzzy processing is explained.

[0090] refer to Figure 7 Assuming that the original display screen contains N*M pixels, the extracted color component is the N*M pixel matrix data 71. The fuzzy matrix data 72 can be used to sequentially fuzzy each pixel contained in the N*M pixel matrix data 71 to obtain the blurred component value.

[0091] Specifically, assuming that the size of the fuzzy matrix data 72 is K*K, then for any pixel 711 to be processed in the N*M pixel matrix data 71, first, K*K-1 pixels around the pixel 711 to be processed can be selected to form a K*K matrix 712 with the pixel to be processed.

[0092] Furthermore, the fuzzy matrix data 72 can be used to perform convolution calculation with the obtained K*K matrix 712, and the calculated value obtained is the component value of the current pixel to be processed after blurring. The component value of the pixel to be processed after blurring is related to the component value of each surrounding pixel, and at the same time, it is also related to the value of each element in the fuzzy matrix data 72. Based on the different component values ​​of each surrounding pixel and the values ​​of each element in the fuzzy matrix data 72, the component value of the pixel to be processed after blurring may be larger or smaller than the original component value, or it may be the same as the original component value. Moreover, after blurring the pixel to be processed based on different fuzzy functions, the component value obtained after blurring is also different. The specific fuzzy function can be selected according to the needs, for example, it can be a Gaussian fuzzy function, a mean fuzzy function, etc.

[0093] According to the above description of the implementation method of blur processing, it can be understood that the component value of any pixel in the extracted blue component after blurring is related to the component values ​​of the surrounding pixels, which makes the difference between the blurred component value and the component values ​​of the surrounding pixels small and will not cause obvious changes in color tone. Therefore, compared with the method of reducing the proportion of blue components as a whole in the related art, the implementation method of the embodiment of the present application can effectively reduce the impact on the overall color tone of the picture, and the user viewing experience is better.

[0094] Finally, a processed display image may be generated based on the blurred color components and displayed.

[0095] In the embodiment of the present application, the color components before blurring can be replaced by the color components after blurring, and reconstructed with the remaining unblurred color components of the corresponding color space to generate a processed display image.

[0096] Still refer to Figure 7 , assuming that the original display screen contains N*M pixels, then the extracted color component is N*M pixel matrix data. In the case of blurring all the extracted components, the blurred color component is also N*M pixel matrix data. The blurred color component N*M pixel matrix data can be reconstructed with the N*M pixel matrix data of the remaining color components in the original display screen to obtain the processed display screen.

[0097] When blurring some of the extracted components, the unblurred color components and the blurred color components among the extracted color components can be combined into N*M pixel matrix data, and reconstructed with the N*M pixel matrix data of the remaining color components of the original display image in the corresponding color space to obtain the processed display image.

[0098] like Figure 8As shown, for the RGB color space, the original display image includes a red component R, a green component G, and a blue component B. If the extracted color component is the blue component B, after blurring at least part of the blue component B to obtain the blue component B', the blue component B' can be used to replace the blue component B, and reconstructed with the red component R and the green component G of the original display image to obtain a processed display image and display it.

[0099] like Fig. 9 As shown, for the LMS color space, the original display image includes a long wavelength component L, a medium wavelength component M, and a short wavelength component S. If the extracted color component is the short wavelength component S, after blurring at least part of the short wavelength component S to obtain the short wavelength component S', the short wavelength component S' can be used to replace the short wavelength component S, and reconstructed with the long wavelength component L and the medium wavelength component M of the original display image to obtain a processed display image. Furthermore, the processed display image can be converted into a color space to obtain a display image in RGB format for display.

[0100] Since the color components with shorter wavelengths in the processed display image are in a blurred state, they can be used to simulate the imaging effect of the color components with shorter wavelengths in the human eye in a myopic defocus state, giving the eyeball myopic defocus guidance information, thereby inhibiting the axial growth of the eyeball, slowing down or even preventing the formation and aggravation of myopia. At the same time, since the above solution does not significantly reduce the proportion of color components in the display image, it can greatly reduce the impact on the color tone of the display image and improve the user viewing experience.

[0101] In the above embodiment, when the extracted color component is fuzzy processed, the value of the fuzzy matrix data applied is a preset fixed value. In the embodiment of the present application, the value of the fuzzy matrix data applied is a variable value. The value of the fuzzy matrix data includes the size of the fuzzy matrix data. Among them, the size refers to the number of rows and columns of the fuzzy matrix data. The larger the size of the fuzzy matrix data, the greater the degree of fuzziness that can be achieved, and vice versa, the smaller the degree of fuzziness that can be achieved.

[0102] In one possible implementation, the size of the applied fuzzy matrix data can be adjusted in response to user operation. Figure 6 In the mode selection interface 62 shown, in response to the user triggering the eye protection mode option button, a second adjustment control may also be displayed for adjusting the size of the fuzzy matrix data. The second adjustment control may be, for example, a sliding bar.

[0103] Through this implementation, the blur intensity of the color components in the picture can be flexibly adjusted based on changes in user needs, thereby better adapting to user needs.

[0104] In another possible implementation, in order to further improve the scene adaptability of the blur intensity, the size of the blur matrix data can be automatically determined based on the change of the display scene and at least one parameter information related to the display scene, so that the blur intensity of the extracted color component changes automatically in real time with the change of the display scene. Among them, the at least one parameter information related to the display scene can include, for example, the spectral characteristics of the display device, the user's viewing distance, the user's age, the user's vision data, the user's eye axis length, the user's pupil diameter, etc. Among them, the user's pupil diameter is related to factors such as screen size, display brightness, display content, ambient light, and viewing distance.

[0105] The following is a detailed description of a method for determining the size of fuzzy matrix data according to at least one parameter information related to a display scene.

[0106] In a possible implementation, the size of the fuzzy matrix data can be determined according to the spectral characteristics of the display device. Based on the differences in the spectral characteristics of the display devices, the wavelengths of the three primary colors of red, green and blue in different display devices are not the same. In the embodiment of the present application, the longitudinal chromatic aberration of the display light after entering the human eye can be calculated according to the wavelength of each color component in the current display device. Furthermore, the size of the fuzzy matrix data can be determined based on the longitudinal chromatic aberration. Among them, the smaller the longitudinal chromatic aberration, the smaller the size of the fuzzy matrix data.

[0107] In another possible implementation, the user's viewing distance can be detected in real time, and the size of the fuzzy matrix data can be determined based on the user's viewing distance. The closer the user's viewing distance is, the larger the size of the fuzzy matrix data is. The user's viewing distance can be detected by emitting infrared light or laser based on a distance sensor configured in the electronic device to detect the distance between the electronic device display and the user.

[0108] In another possible implementation, the pupil diameter of the user during use of the device can be detected, and the size of the fuzzy matrix data can be determined based on the pupil diameter. The larger the pupil diameter, the larger the size of the fuzzy matrix data. Among them, the user's pupil diameter is related to factors such as ambient light, viewing distance, display size, and display content, and can be calculated based on the above factors. For details, please refer to the relevant technology.

[0109] In another possible implementation, the age data and / or vision data and / or axial length input by the user may be obtained in advance. Then, according to the pre-stored mapping table, the fuzzy matrix data size corresponding to the current user's age data and / or vision data and / or axial length is searched. Among them, the pre-stored mapping table may be configured before the electronic device leaves the factory, and the pre-stored mapping table may include a mapping relationship between different ages and / or different vision and / or different axial lengths and fuzzy matrix data sizes. The specific mapping relationship may be determined based on experimental research. For example, the axial development status of people of different age groups and / or people with different vision may be collected, and based on the different axial development status, the fuzzy matrix data size required by people of different age groups and / or people with different vision may be matched.

[0110] In a specific implementation, alternatively, the size of the fuzzy matrix data may be jointly determined based on a combination of any two or more of the above-mentioned parameter information.

[0111] For example, the size of the fuzzy matrix data can be determined based on the spectral characteristics of the display device, the user's viewing distance, and the user's pupil diameter. The specific calculation method can refer to the following formula:

[0112] D=Pupil*(SG) / G

[0113] Where D is the size of the fuzzy matrix data, Pupil is the pupil diameter, S is the user's viewing distance, and G is a parameter calculated based on the viewing distance and longitudinal color difference, which is calculated as follows:

[0114]

[0115] Among them, LCA is the longitudinal chromatic aberration, which is calculated as follows:

[0116]

[0117] Wherein, λ is the wavelength of the extracted color component, p, q, and c are all constants, and their values ​​are 1.68524, 0.63346, and 0.21410, respectively.

[0118] Through the above technical solution, the size of the fuzzy matrix data can change in real time with the changes of factors such as the spectral characteristics of the display device in the actual display scene, the user's viewing distance, the user's age, the user's vision data, the user's axial length, the user's pupil diameter, etc., so that the blur intensity of the color component in the device display screen can be adaptively adjusted with the changes in the display scene, which is conducive to improving viewing comfort, and the implementation method is more intelligent and the user experience is better.

[0119] In another embodiment, the value of the fuzzy matrix data also includes the weight of the fuzzy matrix data. The fuzzy weight refers to the coefficient corresponding to each element in the fuzzy matrix, and the sum of the coefficients of each element is 1. The higher the coefficient corresponding to the element at the center point of the fuzzy matrix, the more likely it is to be used when blurring the pixel to be processed. Figure 7 , the weight of the pixel to be blurred is greater, otherwise, the weight of the pixels around the pixel to be blurred is greater.

[0120] Similar to the above-mentioned blur size, the blur weight may also be determined based on at least one parameter information related to the display scene.

[0121] In a possible implementation, the fuzzy weight may be determined, for example, based on the longitudinal chromatic aberration. Specifically, the coefficient corresponding to the element at the center point of the fuzzy matrix may be positively correlated with the value of the longitudinal chromatic aberration.

[0122] In another possible implementation, the viewing distance and / or pupil diameter of the user may be detected in real time, and the blur weight may be determined based on the viewing distance and / or pupil diameter of the user.

[0123] In another possible implementation, the age data and / or vision data and / or axial length of the eye input by the user may be obtained in advance. Then, according to the pre-stored mapping table, the fuzzy weight corresponding to the current user's age data and / or vision data and / or axial length of the eye is searched. The pre-stored mapping table may be configured before the electronic device leaves the factory, and the pre-stored mapping table may include a mapping relationship between different ages and / or different visions and / or different axial lengths of the eye and the fuzzy weights.

[0124] In a specific implementation, alternatively, the fuzzy weight may be determined based on a combination of any two or more of the above-mentioned parameter information.

[0125] Through this implementation method, when blurring the color components of the display image, the degree of blur can change in real time with factors such as the spectral characteristics of the display device in the specific display scene, the user's viewing distance, the user's age, the user's vision data, the user's axial length, the user's pupil diameter, etc., thereby further improving the scene adaptability of this solution.

[0126] It is understandable that, in order to implement the above functions, the electronic device includes hardware and / or software modules corresponding to the execution of each function. In combination with the steps of each example described in the embodiments disclosed herein, the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments.

[0127] In this embodiment, the electronic device can be divided into functional modules according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0128] In the case of dividing each functional module into corresponding functional modules, Fig.10 A possible schematic diagram of the composition of the electronic device involved in the above embodiment is shown. Fig.10 As shown, the electronic device 600 may include: an acquisition unit 601, an execution unit 602 and a generation unit 603, wherein:

[0129] The acquisition unit 601 is used to acquire pixel matrix data of a first color component of an original display picture in a target color space.

[0130] The execution unit 602 is configured to perform fuzzy processing on the color components of at least some pixels in the pixel matrix data of the first color component to obtain a first fuzzy component.

[0131] The generating unit 603 is used to generate a target display picture based on the first fuzzy component and display it.

[0132] In a possible implementation, the acquisition unit 601 is specifically configured to: acquire pixel matrix data of at least one color component of the original display picture in the RGB color space, wherein the at least one color component includes a blue component.

[0133] In a possible implementation, the acquisition unit 601 is specifically used to: convert the original display image from the RGB color space to the LMS color space; obtain pixel matrix data of at least one color component of the original display image in the LMS color space, and at least one color component includes a short wavelength component.

[0134] In a possible implementation manner, at least part of the color components in the first color component include: color components of all pixels in the pixel matrix data of the first color component.

[0135] In a possible implementation manner, at least part of the color components in the first color component includes: part of the color components of pixels in a preset proportion in the pixel matrix data of the first color component.

[0136] In a possible implementation manner, at least part of the color components in the first color component include: color components of pixels whose component values ​​are greater than a first threshold in the pixel matrix data of the first color component.

[0137] In a possible implementation manner, at least part of the color components in the first color component include: color components of pixels whose frequency domain values ​​are greater than a second threshold in the pixel matrix data of the first color component.

[0138] In a possible implementation, the generation unit 603 is specifically used to reconstruct the pixel matrix data of the first fuzzy component and the second color component to obtain and display the target display screen, and the second color component is the remaining color components in the target color space except the first color component.

[0139] In one possible implementation, the generation unit 603 is specifically used to generate a second fuzzy component based on the first fuzzy component and the color component of the unblurred pixels in the pixel matrix data of the first color component; reconstruct the second fuzzy component and the pixel matrix data of the second color component to obtain the target display screen and display it, and the second color component is the remaining color components in the target color space except the first color component.

[0140] In a possible implementation, the execution unit 602 is specifically configured to determine fuzzy matrix data; and use the fuzzy matrix data to fuzzy the color components of at least some pixels in the pixel matrix data of the first color component to obtain a first fuzzy component.

[0141] In one possible implementation, the execution unit 602 is specifically used to obtain a first parameter associated with the current display scene, where the first parameter includes any one or more of longitudinal chromatic aberration of the human eye, viewing distance of the human eye, pupil diameter of the human eye, user age, user vision data, and user eye axis length; and determine the size and / or weight of the fuzzy matrix data based on at least one first parameter.

[0142] In a possible implementation, the execution unit 602 is specifically configured to determine the size of the fuzzy matrix data according to the following formula:

[0143] D=Pupil*(SG) / G

[0144]

[0145]

[0146] Among them, D is the size of the fuzzy matrix data, Pupil is the pupil diameter of the human eye, S is the viewing distance of the human eye, G is the target parameter calculated based on the viewing distance of the human eye and the longitudinal chromatic aberration, LCA is the longitudinal chromatic aberration, λ is the wavelength of the first color component, and p, q and c are constants.

[0147] In one possible implementation, the weight of the fuzzy matrix data is the coefficient of each element in the fuzzy matrix data; the larger the coefficient of the target element in the fuzzy matrix data, the greater the weight of the color component of the target pixel in the fuzzy component corresponding to the target pixel; the smaller the coefficient of the target element in the fuzzy matrix data, the greater the weight of the color component of the pixels around the target pixel in the fuzzy component corresponding to the target pixel; the target element is the element at the center point of the fuzzy matrix, and the target pixel is any one of at least some of the pixels.

[0148] Through the above technical solution, some color components in the display image are blurred to simulate the myopic defocus state of some color components in the human eye, thereby inhibiting the axial growth of the eyeball, slowing down the formation and development of myopia, and achieving eye protection. At the same time, blurring does not reduce the color ratio, which can prevent the change of the picture color tone and provide a better user experience.

[0149] It should be understood that the electronic device here is embodied in the form of a functional unit. The term "unit" here can be implemented in the form of software and / or hardware, and is not specifically limited to this. For example, a "unit" can be a software program, a hardware circuit, or a combination of the two that implements the above functions. The hardware circuit may include an application specific integrated circuit (ASIC), an electronic circuit, a processor (such as a shared processor, a proprietary processor, or a group processor, etc.) and a memory for executing one or more software or firmware programs, a merged logic circuit, and / or other suitable components that support the described functions.

[0150] An embodiment of the present application also provides a display device, which includes a storage medium and a central processing unit. The storage medium may be a non-volatile storage medium, in which a computer executable program is stored. The central processing unit is connected to the non-volatile storage medium and executes the computer executable program to implement the above-mentioned display method.

[0151] The embodiment of the present application also provides a computer-readable storage medium, in which instructions are stored. When the instructions are executed on a computer, the computer executes each step of the display method of the embodiment of the present application.

[0152] The embodiment of the present application also provides a computer program product comprising instructions, and when the computer program product is run on a computer or any at least one processor, the computer executes each step of the display method of the embodiment of the present application.

[0153] An embodiment of the present application also provides a chip, including a processor and a data interface, wherein the processor reads instructions stored in a memory through the data interface to execute corresponding operations and / or processes performed by the display method provided in the present application.

[0154] Optionally, the chip also includes a memory, which is connected to the processor via a circuit or wire, and the processor is used to read and execute the computer program in the memory. Further optionally, the chip also includes a communication interface, and the processor is connected to the communication interface. The communication interface is used to receive data and / or information to be processed, and the processor obtains the data and / or information from the communication interface and processes the data and / or information. The communication interface can be an input and output interface.

[0155] The memory can be a read-only memory (ROM), other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), a magnetic disk storage medium or other magnetic storage device, or it can also be any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer.

[0156] In the embodiments of the present application, "and / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B may represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. Among them, A and B can be singular or plural. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can be represented by: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.

[0157] Those of ordinary skill in the art will appreciate that the various units and algorithm steps described in the embodiments disclosed herein can be implemented in a combination of electronic hardware, computer software, and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0158] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0159] In several embodiments provided in the present application, any function can be stored in a computer-readable storage medium if it is implemented in the form of a software functional unit and sold or used as an independent product. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence or in other words, the part that contributes to the prior art or the part of the technical solution. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0160] The above is only a specific implementation of the present application. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. The protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A display method, characterized in that: include: Acquire pixel matrix data of a first color component of an original display image in a target color space; Performing fuzzy processing on color components of at least some pixels in the pixel matrix data of the first color component to obtain a first fuzzy component; A target display picture is generated based on the first blur component and displayed.

2. The method according to claim 1, characterized in that Obtaining pixel matrix data of the first color component of the original display image in the target color space, including: Pixel matrix data of at least one color component of an original display picture in an RGB color space is obtained, wherein the at least one color component includes a blue component.

3. The method according to claim 1, characterized in that Obtaining pixel matrix data of the first color component of the original display image in the target color space, including: Convert the original display image from the RGB color space to the LMS color space; Pixel matrix data of at least one color component of the original display image in the LMS color space is obtained, and the at least one color component includes an S short wavelength component.

4. The method according to any one of claim 1, characterized in that: The color components of at least some pixels in the pixel matrix data of the first color component include: The color components of all pixels in the pixel matrix data of the first color component.

5. The method according to any one of claim 1, characterized in that: The color components of at least some pixels in the pixel matrix data of the first color component include: In the pixel matrix data of the first color component, color components of pixels of a preset ratio are included.

6. The method according to any one of claim 1, characterized in that: The color components of at least some pixels in the pixel matrix data of the first color component include: The color components of pixels whose component values ​​are greater than the first threshold value in the pixel matrix data of the first color component.

7. The method according to any one of claim 1, characterized in that: The color components of at least some pixels in the pixel matrix data of the first color component include: The color component of the pixel whose frequency domain component value is greater than the second threshold in the pixel matrix data of the first color component.

8. The method according to claim 4, characterized in that Generating a target display picture based on the first fuzzy component and displaying the picture includes: The pixel matrix data of the first fuzzy component and the second color component are reconstructed to obtain a target display screen and display it, wherein the second color component is the remaining color components in the target color space except the first color component.

9. The method according to any one of claims 5 to 7, characterized in that: Generating a target display picture based on the first fuzzy component and displaying the picture includes: Generate a second blurred component based on the first blurred component and the color component of the pixel that has not been blurred in the pixel matrix data of the first color component; The pixel matrix data of the second fuzzy component and the second color component are reconstructed to obtain a target display screen and display it. The second color component is the remaining color components in the target color space except the first color component.

10. The method according to claim 1, characterized in that The method of performing blurring processing on the color components of at least some pixels in the pixel matrix data of the first color component to obtain a first blurred component includes: Determine fuzzy matrix data; The fuzzy matrix data is used to perform fuzzy processing on the color components of at least part of the pixels in the pixel matrix data of the first color component to obtain a first fuzzy component.

11. The method according to claim 10, characterized in that Determine the fuzzy matrix data, including: Acquire a first parameter associated with the current display scene, the first parameter including any one or more of longitudinal chromatic aberration of human eyes, viewing distance of human eyes, pupil diameter of human eyes, user age, user vision data, and axial length of user eyes; Based on the at least one first parameter, the size and / or weight of the fuzzy matrix data are determined.

12. The method according to claim 11, characterized in that The size of the fuzzy matrix data is the number of rows and columns of the fuzzy matrix data; determining the size of the fuzzy matrix data according to the at least one first parameter comprises: The size of the fuzzy matrix data is determined according to the following formula: D=pupil*(SG) / G Among them, D is the size of the fuzzy matrix data, Pupil is the pupil diameter of the human eye, S is the viewing distance of the human eye, G is the target parameter calculated based on the viewing distance of the human eye and the longitudinal chromatic aberration, LCA is the longitudinal chromatic aberration, λ is the wavelength of the first color component, and p, q and c are constants.

13. The method according to claim 11, characterized in that The weight of the fuzzy matrix data is the coefficient of each element in the fuzzy matrix data; The larger the coefficient of the target element in the fuzzy matrix data, the larger the weight of the color component of the target pixel in the fuzzy component corresponding to the target pixel; The smaller the coefficient of the target element in the fuzzy matrix data is, the greater the weight of the color components of the pixels around the target pixel in the fuzzy component corresponding to the target pixel is; The target element is an element at the center point of the fuzzy matrix data, and the target pixel is any one of the at least some pixels.

14. An electronic device, characterized in that: include: one or more processors; Memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, and when the instructions are executed by the device, the device performs the method according to any one of claims 1 to 13.

15. A chip, characterized in that: The chip includes a processor and a data interface, and the processor reads instructions stored in a memory through the data interface to execute the method as described in any one of claims 1 to 13.

16. A storage medium, characterized in that: The storage medium stores program instructions, which, when executed on an electronic device, enable the electronic device to execute the method as claimed in any one of claims 1 to 13.

Images