Image display method, image display apparatus, electronic device and storage medium

Abstract

Disclosed in the embodiments of the present application are an image display method, an image display apparatus, an electronic device and a storage medium. The image display method comprises: acquiring an image to be processed; performing blurring processing on at least part of said image to obtain a defocused image, wherein the defocused image is configured to be imaged on the retinas of a user when the eyesight of the user is normal; and displaying the defocused image. In the embodiments of the present application, by means of a blurred image, image content seen on the retinas of a user when myopic defocusing occurs is restored, such that a myopic defocused picture is seen when the human eyes focus normally, thereby achieving the protection effect of defocusing on eyesight protection.

Description

Image display method, image display device, electronic device, and storage medium

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on December 12, 2023, with application number 202311704127.7 and application name “Image display method, image display device, electronic device and storage medium”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of image processing technology, and in particular to an image display method, an image display device, an electronic device, and a storage medium. Background Art

[0003] In recent years, myopia has become increasingly serious among adolescents, with the average prevalence exceeding half of Chinese adolescents. The use of electronic products, coupled with close eye contact, is considered a key contributing factor. Meanwhile, adults are increasingly using electronic devices, with average daily mobile phone usage exceeding five hours. This continuous use can lead to long-term eye fatigue and, consequently, myopia. Therefore, addressing myopia is a pressing issue.

[0004] In the prior art, one common solution for suppressing myopia is to use defocus glasses for vision protection. This optical solution creates myopic defocus: that is, focusing part of the content in front of the retina, which will tend to focus forward to achieve clear imaging, thereby thickening the choroid of the eye, increasing blood flow density, and inhibiting axial length growth. In reality, the so-called myopic defocus and the display image focused in front of the retina, and then the light projected onto the retina is actually an unfocused virtual image. For people with normal vision, including those who wear myopia correction glasses, the displayed content can be accurately focused on the retina within a certain range. Therefore, myopic defocus is usually not achieved, and vision cannot be protected.

[0005] Summary of the Invention

[0006] The purpose of this application is to provide an image display method, an image display device, an electronic device and a storage medium to simulate the defocused equivalent image seen by the human eye through an optical solution, thereby achieving equivalent prevention and control of myopia, improvement of visual fatigue, etc. through image defocusing.

[0007] In a first aspect, an image display method is provided, the method comprising:

[0008] Get the image to be processed;

[0009] performing blur processing on at least a portion of the image to be processed to obtain a defocused image, wherein the defocused image is used to form an image on the retina of the user when the user has normal vision;

[0010] The out-of-focus image is displayed.

[0011] In an embodiment of the present application, by blurring part of the image, the image on the retina during myopic defocus is simulated, so that the myopic defocused image can be seen when the human eye is focused normally, thereby achieving the protective effect of defocus on vision.

[0012] In some possible implementations, blurring at least a portion of the image to be processed to obtain a defocused image includes:

[0013] Get the user's gaze point on the screen;

[0014] Blurring is performed on at least a portion of the image to be processed with the gaze point as the center to obtain a defocused image, wherein the farther the area of ​​the defocused image is from the gaze point, the higher the blurriness.

[0015] In the embodiment of the present application, after the human eye wears a defocus lens, the image presented on the retina is an image with a clear center and a blurred periphery, and the image is more blurred the farther away from the center. Therefore, when displaying a simulated image on the screen, the defocus area can be determined by identifying the gaze point, and the farther away from the gaze point, the higher the blurriness, so that the simulated myopic defocus image is more consistent with the actual myopic defocus image.

[0016] In some possible implementations, blurring at least a portion of the image to be processed with the gaze point as the center to obtain a defocused image includes:

[0017] Taking the gaze point as the center and the non-defocus radius as the radius, determining the non-defocus area of ​​the image to be processed, wherein the non-defocus area is a circular area;

[0018] Blurring the out-of-focus area of ​​the image to be processed with the gaze point as the center to obtain a out-of-focus image;

[0019] The area other than the non-defocused area in the image to be processed is the defocused area.

[0020] In an embodiment of the present application, the non-defocus radius can be determined according to the type of electronic device or according to the eye distance. After the non-defocus radius is determined, the image to be processed is divided into a defocus area and a non-defocus area with the gaze point as the center. The defocus area is the blurred area in the myopic defocus image, and the non-defocus area is the clear area in the myopic defocus image.

[0021] In some possible implementations, before determining the non-defocus area of ​​the image to be processed with the gaze point as the center and the non-defocus radius as the radius, the method further includes:

[0022] Obtaining the user's eye distance, where the eye distance is the distance between the user's eyeballs and the screen;

[0023] A non-defocus radius is determined according to the eye distance, wherein the eye distance is positively correlated with the non-defocus radius.

[0024] In an embodiment of the present application, the non-defocus radius is determined by obtaining the current user's eye distance. Compared with determining the defocus area using the default non-defocus radius based on the type of electronic device, the result is more accurate and more conducive to protecting eyesight.

[0025] In some possible implementations, determining the non-defocus radius according to the eye distance includes:

[0026] A non-defocus radius is determined according to the eye distance and a central visual field angle corresponding to the eye distance, wherein the non-defocus radius is positively correlated with the central visual field angle.

[0027] In the embodiment of the present application, corresponding central field of view angles are pre-set for different eye distances. Therefore, after obtaining the eye distance, the corresponding central field of view angle can be obtained, and then the non-defocus radius can be obtained.

[0028] In some possible implementations, determining the non-defocus radius according to the eye distance and the central visual angle corresponding to the eye distance includes:

[0029] According to the formula: R = L Y ×tanθ to determine the non-defocus radius, where R is the non-defocus radius, L Y is the eye distance, and θ is the central visual angle.

[0030] In the embodiment of the present application, the non-defocus radius is obtained by calculation, which is simpler and more convenient than looking up a table.

[0031] In some possible implementations, blurring the defocused area of ​​the image to be processed with the gaze point as the center to obtain the defocused image includes:

[0032] Calculating a first distance between each pixel in the defocused area and the pixel corresponding to the gaze point;

[0033] determining a first blur intensity for each pixel in the defocused area according to a first distance corresponding to each pixel in the defocused area, wherein the first blur intensity is positively correlated with the first distance;

[0034] Taking each pixel in the defocused area as a first central pixel, calculating a first influence intensity of each pixel within a preset range on the first central pixel, wherein the first influence intensity is positively correlated with a first blur intensity of each pixel within the preset range;

[0035] According to the initial pixel value corresponding to each pixel in the preset range and the first influence intensity, a first updated pixel value corresponding to each pixel in the defocused area is determined to obtain a defocused image.

[0036] In an embodiment of the present application, when blurring each pixel in the defocused area, not only the distance between each pixel in the defocused area and the pixel corresponding to the gaze point is taken into account, but also the blurring effect of the pixels around each pixel on each pixel is taken into account, so that the final blurred defocused image is closer to the actual myopic defocused image.

[0037] In some possible implementations, calculating a first distance between each pixel in the defocused area and a pixel corresponding to the gaze point includes:

[0038] According to the formula: Calculating a first distance between each pixel in the defocused area and the pixel corresponding to the gaze point;

[0039] Wherein, (n,m) is the coordinate of the (n,m)th pixel, (n0,m0) is the coordinate of the pixel corresponding to the gaze point, ppi is the pixel density, and L(n,m;n0,m0) is the first distance between the (n,m)th pixel and the pixel corresponding to the gaze point.

[0040] In an embodiment of the present application, the image to be processed can be placed in a coordinate system so that each pixel in the image to be processed has coordinates, and the distance between pixels is calculated based on the coordinates of the pixels. The overall calculation is simple and easy to implement.

[0041] In some possible implementations, determining a first blur intensity for each pixel in the defocused area according to a first distance corresponding to each pixel in the defocused area includes:

[0042] According to the formula: Calculating a first blur intensity for each pixel in the defocused area;

[0043] Where L is the first distance, R is the non-defocus radius, C 1模糊 is the first blur strength.

[0044] In an embodiment of the present application, for each pixel in the defocused area, the farther it is from the pixel corresponding to the gaze point, the greater the first blur intensity. Therefore, the first blur intensity of each pixel can be calculated based on the distance between each pixel and the pixel corresponding to the gaze point.

[0045] In some possible implementations, taking each pixel in the defocused area as a first central pixel and calculating a first influence intensity of each pixel within a preset range on the first central pixel includes:

[0046] Taking each pixel in the defocused area as a first central pixel, calculating a second distance between each pixel in a preset range and the first central pixel;

[0047] According to the second distance and the first blur intensity of each pixel within the preset range, the first influence intensity of each pixel within the preset range on the first central pixel is calculated, and the first influence intensity is negatively correlated with the second distance and positively correlated with the first blur intensity of each pixel within the preset range.

[0048] In an embodiment of the present application, when calculating the first influence intensity of each pixel within a preset range on the first central pixel, the second distance between each pixel within the preset range and the first central pixel and the first blur intensity of each pixel within the preset range are taken into account, so that the first influence intensity finally calculated is more accurate.

[0049] In some possible implementations, taking each pixel in the defocused area as a first central pixel and calculating a second distance between each pixel within a preset range and the first central pixel includes:

[0050] According to the formula: Calculate a second distance between each pixel in a preset range and the first central pixel;

[0051] Wherein, (n,m) is the coordinate of the (n,m)th pixel, (i,j) is the coordinate of the first central pixel, ppi is the pixel density, and L(n,m;i,j) is the second distance between the (n,m)th pixel and the first central pixel.

[0052] In an embodiment of the present application, the image to be processed can be placed in a coordinate system so that each pixel in the image to be processed has coordinates, and the distance between pixels is calculated based on the coordinates of the pixels. The overall calculation is simple and easy to implement.

[0053] In some possible implementations, calculating the first influence intensity of each pixel within the preset range on the first central pixel based on the second distance and the first blur intensity of each pixel within the preset range includes:

[0054] According to the formula: Calculate a first influence intensity of each pixel within a preset range on the first central pixel;

[0055] Where a is a constant, x = L(n, m; i, j), and y = C1模糊 (n,m), C 1模糊 (n, m) is the first blur intensity of the (n, m)th pixel within the preset range, and t(n, m; i, j) is the first influence intensity of the (n, m)th pixel on the first central pixel.

[0056] In the embodiment of the present application, since the farther each pixel in the defocused area is from the pixel corresponding to the gaze point, the higher the blurriness, the farther each pixel in the defocused area is from the pixel corresponding to the gaze point, the smaller its a value.

[0057] In some possible implementations, determining a first updated pixel value corresponding to each pixel in the defocused area according to the initial pixel value corresponding to each pixel within the preset range and the first influence intensity to obtain a defocused image includes:

[0058] According to the formula: Determine a first updated pixel value corresponding to each pixel in the defocused area;

[0059] Among them, N 计算 is the number of pixels within the preset range, K0(n,m) is the initial pixel value of the (n,m)th pixel within the preset range, and K(i,j) is the first updated pixel value corresponding to each pixel in the defocused area;

[0060] The initial pixel value of each pixel in the defocused area is updated using the first updated pixel value corresponding to each pixel in the defocused area to obtain a defocused image.

[0061] In some possible implementations, blurring at least a portion of the image to be processed to obtain a defocused image includes:

[0062] Obtaining the hue value of each pixel in the image to be processed;

[0063] determining a second blur intensity for each pixel in the image to be processed according to the hue value of each pixel in the image to be processed, wherein the second blur intensity is negatively correlated with the hue value;

[0064] Taking each pixel in the image to be processed as a second central pixel, calculating a second influence strength of pixels within a preset range on the second central pixel, wherein the second influence strength is positively correlated with a second blur strength of each pixel within the preset range;

[0065] According to the initial pixel value corresponding to each pixel within the preset range and the second influence intensity, a second updated pixel value corresponding to each pixel in the image to be processed is determined to obtain a defocused image.

[0066] In the embodiment of the present application, the blur intensity is set based on the hue value of each pixel in the image to be processed, simulating the display effect of light of different wavelengths focusing on different positions of the retina and enhancing the effect. Compared with the partial defocus solution where the center of the gaze point is clear and the periphery is blurred, the embodiment of the present application is full-surface defocus, and the embodiment of the present application does not require gaze point tracking, so the calculation process is simpler.

[0067] In some possible implementations, determining the second blur intensity of each pixel in the image to be processed according to the hue value of each pixel in the image to be processed includes:

[0068] According to the formula: C 2模糊 =1 / (h-240° / 180°×pi) 2 Calculating a second blur intensity for each pixel in the image to be processed;

[0069] Among them, h is the hue value, the value range is (0,2pi], C 2模糊 is the second blur strength.

[0070] In the embodiment of the present application, for each pixel in the image to be processed, the larger the hue value, the smaller the second blur strength. Therefore, the second blur strength of each pixel can be obtained according to the hue value of each pixel.

[0071] In some possible implementations, taking each pixel in the to-be-processed image as a second central pixel and calculating a second influence intensity of pixels within a preset range on the second central pixel includes:

[0072] Taking each pixel in the image to be processed as a second central pixel, calculating a third distance between each pixel in a preset range and the second central pixel;

[0073] According to the third distance and the second blur intensity of each pixel within the preset range, the second influence intensity of each pixel within the preset range on the second central pixel is calculated, and the second influence intensity is negatively correlated with the third distance and positively correlated with the second blur intensity of each pixel within the preset range.

[0074] In an embodiment of the present application, when calculating the second influence intensity of each pixel within a preset range on the second central pixel, the third distance between each pixel within the preset range and the second central pixel and the second blur intensity of each pixel within the preset range are taken into account, so that the second influence intensity finally calculated is more accurate.

[0075] In some possible implementations, taking each pixel in the to-be-processed image as a second central pixel and calculating a third distance between each pixel within a preset range and the second central pixel includes:

[0076] According to the formula: Calculate a third distance between each pixel in a preset range and the second central pixel;

[0077] Wherein, (a, b) is the coordinate of the (a, b)th pixel, (u, v) is the coordinate of the second center pixel, ppi is the pixel density, and L(a, b; u, v) is the third distance between the (a, b)th pixel and the second center pixel.

[0078] In an embodiment of the present application, the image to be processed can be placed in a coordinate system so that each pixel in the image to be processed has coordinates, and the distance between pixels is calculated based on the coordinates of the pixels. The overall calculation is simple and easy to implement.

[0079] In some possible implementations, calculating the second influence intensity of each pixel within the preset range on the second central pixel based on the third distance and the second blur intensity of each pixel within the preset range includes:

[0080] According to the formula: Calculate a second influence intensity of each pixel within a preset range on the second central pixel;

[0081] Where a is a constant, x = L(a, b; u, v), and y = C 2模糊 (a,b), C 2模糊 (a, b) is the second blur intensity of the (a, b)th pixel within the preset range, and t(a, b; u, v) is the second influence intensity of the (a, b)th pixel on the second central pixel.

[0082] In the embodiment of the present application, since the farther each pixel in the defocused area is from the pixel corresponding to the gaze point, the higher the blurriness, the farther each pixel in the defocused area is from the pixel corresponding to the gaze point, the smaller its a value.

[0083] In some possible implementations, determining the second updated pixel value corresponding to each pixel in the to-be-processed image based on the initial pixel value corresponding to each pixel within the preset range and the second influence intensity to obtain the defocused image includes:

[0084] According to the formula: Determining a second updated pixel value corresponding to each pixel in the image to be processed;

[0085] Among them, N 计算 is the number of pixels within the preset range, K0(a,b) is the initial pixel value of the (a,b)th pixel within the preset range, and K(u,v) is the second updated pixel value corresponding to each pixel in the image to be processed;

[0086] The initial pixel value of each pixel in the image to be processed is updated using the second updated pixel value corresponding to each pixel in the image to be processed to obtain a defocused image.

[0087] In a second aspect, the present application further provides an image display device, comprising:

[0088] An acquisition unit, configured to acquire an image to be processed;

[0089] a blurring unit, configured to blur at least a portion of the image to be processed to obtain a defocused image, wherein the defocused image is an image presented when the image is out of focus;

[0090] A display unit is used to display the defocused image.

[0091] In a third aspect, the present application also provides an electronic device comprising: a memory for storing computer program instructions and a processor for executing program instructions, wherein, when the computer program instructions are executed by the processor, the electronic device is triggered to execute the method in a possible implementation of the first aspect.

[0092] In a fourth aspect, the present application further provides a computer-readable storage medium, wherein the computer-readable medium stores program code for execution by a device, wherein the program code includes instructions for executing the method in a possible implementation manner of the first aspect.

[0093] The embodiment of the present application restores the image content seen on the user's retina during myopic defocus by blurring the image, so that what the human eye sees when focusing normally is the myopic defocused picture, thereby achieving the effect of defocusing on vision protection. BRIEF DESCRIPTION OF THE DRAWINGS

[0094] FIG1a is a schematic diagram of focusing of a general optical lens in the related art;

[0095] FIG1b is a focusing schematic diagram of a defocus lens in the related art;

[0096] FIG2a is a schematic diagram of focusing of various wavelengths when the eyeball is normally focused in the related art;

[0097] FIG2 b is a schematic diagram of focusing of various wavelengths when an eyeball is hyperopic and defocused in the related art;

[0098] FIG2c is a schematic diagram of focusing of various wavelengths when an eyeball is myopically defocused in the related art;

[0099] FIG3 a is a schematic diagram of a retinal display image under myopia defocus provided by an embodiment of the present application;

[0100] FIG3 b is a schematic diagram of a retinal display image at focus provided by an embodiment of the present application;

[0101] FIG3 c is a schematic diagram of displaying a defocused image when in focus to simulate myopic defocus, provided by an embodiment of the present application;

[0102] FIG4 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

[0103] FIG5 is a software structure block diagram of an electronic device provided in an embodiment of the present application;

[0104] FIG6 is a schematic flow chart of an image display method provided in an embodiment of the present application;

[0105] FIG7 is a flow chart of a scenario of an image display method provided by an embodiment of the present application;

[0106] FIG8 is a schematic diagram of a process for blurring a defocused area according to an embodiment of the present application;

[0107] FIG9 is a schematic diagram of a process for blurring an image to be processed according to an embodiment of the present application.

[0108] FIG10 is a schematic structural diagram of an image display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0109] In order to better understand the technical solution of the present application, the embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0110] It should be clear that the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0111] The terms used in the embodiments of the present application are for the purpose of describing specific embodiments only and are not intended to limit the present application. The singular forms "a", "an", "the" and "the" used in the embodiments of the present application and the appended claims are also intended to include plural forms unless the context clearly indicates otherwise.

[0112] It should be understood that the term "and / or" as used herein simply describes a relationship between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can represent: A alone, A and B together, or B alone. Furthermore, the character " / " in this document generally indicates an "or" relationship between the associated objects.

[0113] In recent years, myopia has become increasingly serious among adolescents, with the average prevalence exceeding half of Chinese adolescents. The use of electronic products, coupled with close eye contact, is considered a key contributing factor. Meanwhile, adults are increasingly using electronic devices, with average daily mobile phone usage exceeding five hours. This continuous use can lead to long-term eye fatigue and, consequently, myopia. Therefore, addressing myopia is a pressing issue.

[0114] In the existing technology, one of the common solutions to suppress myopia is to use defocus glasses for vision protection. Myopia defocus is achieved through optical solutions: that is, part of the content is focused in front of the retina, and the retina tends to move forward to achieve clear imaging, thereby causing the choroid of the eye to thicken, increase blood flow density, and inhibit the growth of the eye axis. Currently, common ways to use defocus glasses for vision protection include:

[0115] 1. Achieve central focus through lenses, with the peripheral vision focused in front of the retina. As shown in Figure 1a, with conventional optical lenses, the central image is focused on the macula of the retina, while the peripheral image is formed behind the retina, thereby stimulating the lengthening of the eye axis and deepening myopia. However, with defocused glasses, as shown in Figure 1b, the central image is focused on the macula of the retina, while the peripheral image is formed in front of the retina, thereby suppressing the length of the eye axis and controlling myopia.

[0116] 2. Myopic defocusing of short-wavelength light is achieved by controlling the wavelength content of the lens, that is, by using the difference in refractive index of different wavelengths. As shown in Figure 2a, during normal focusing, blue light has the shortest wavelength and is focused in front of the retina, red light has the longest wavelength and is focused behind the retina, and green light is focused on the retina. As shown in Figure 2b, during hyperopic focusing, blue light is focused in front of the retina, while red and green light are both focused behind the retina. By adjusting the refraction of each wavelength through defocus glasses, blue and green light can be focused in front of the retina, while red light is focused on the retina, as shown in Figure 2c, thus forming myopic focusing and suppressing the length of the eye's axial length.

[0117] In fact, the so-called myopic defocus and the displayed image are focused in front of the retina, and then the light projected onto the retina is actually an unfocused virtual image. People with normal vision, including those who wear corrective glasses for myopia, can accurately focus the displayed content on the retina within a certain range. Therefore, myopic defocus usually does not occur, and vision cannot be protected.

[0118] In response to the above problems, an embodiment of the present application proposes an image display method, which blurs the image to restore the image content seen on the user's retina during myopic defocus, so that when the human eye is focused normally, what is seen is the myopic defocused picture, thereby achieving the effect of defocusing on vision protection.

[0119] The following is an introduction to the defocusing principle of the embodiment of the present application.

[0120] See Figure 3a, which is a schematic diagram of a retinal display image during myopic defocus provided by an embodiment of the present application. As shown in Figure 3a, when the human eye is myopic, the image is formed in front of the retina, so that the image on the retina appears in a blurred state. Under normal vision, as shown in Figure 3b, the image is formed on the retina after passing through the human eye focusing system, that is, the retina is a clear image. In order to enable the human eye to see the picture during myopic defocus under normal vision, the embodiment of the present application calculates the image seen on the retina during myopic defocus, and then restores the image content seen by the user during myopic defocus on the display screen through graphic calculation. In this way, what the human eye sees when focusing normally is the myopic defocus picture, as shown in Figure 3c, thereby achieving the effect of protecting eyesight.

[0121] The embodiments of the present application simulate the defocused image when the line of sight is clearly focused on the screen of an electronic device such as a mobile phone or tablet, thereby achieving an equivalent myopic defocus effect without changing the optical structure of the product or wearing lenses.

[0122] In some embodiments, in addition to the above-mentioned mobile phones, tablets and other electronic devices, the electronic devices may also be personal computers (PCs), personal digital assistants (PDAs), smart watches, netbooks, wearable electronic devices, augmented reality (AR) devices, virtual reality (VR) devices, vehicle-mounted devices, smart cars, smart speakers, robots, smart glasses, smart TVs and other devices that can display images.

[0123] For example, FIG4 shows a schematic diagram of the structure of an electronic device. As shown in FIG4, the electronic device 100 may include a display screen 194, a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a motor 191, an indicator 192, a camera 193, and a subscriber identification module (SIM) card interface 195.

[0124] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0125] The display screen 194 can display images by forming pixels using the three primary colors of red, green, and blue (RGB).

[0126] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0127] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0128] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0129] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0130] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0131] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a screen display control function, etc.), etc. The data storage area may store data created during the use of the electronic device 100, etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0132] The distance sensor 180F can be used to measure distance, specifically by infrared or laser. In some embodiments, when a user uses an electronic device, the distance sensor 180F can be used to detect the user's eye distance using infrared signals.

[0133] Camera 193 is used to capture static images or videos. In some embodiments, camera 193 can also be set to a binocular camera so that the user's eye distance can also be measured during use.

[0134] See Figure 5, which shows a block diagram of the software structure of an electronic device provided in an embodiment of the present application. A layered architecture divides software into several layers, each with distinct roles and divisions of labor. Layers communicate with each other via software interfaces. In some embodiments, the electronic device is divided into four layers: application layer, framework layer, hardware abstraction layer, and hardware layer, from top to bottom.

[0135] The application layer (Application, App) can include a series of application packages. For example, the application package may include a gallery application, a video application, etc. In the embodiment of the present application, the application layer is mainly used to send the content to be displayed based on the gallery application, video application, etc., or blur the content to be displayed through pre-processing or cloud processing using its own image processing technology. Performing image processing at the application layer can reduce the impact of local processing on operating performance and power consumption, but this processing method is not suitable for gaze-based image blurring processing.

[0136] The framework layer (Framework, FWK) provides an application programming interface (API) and a programming framework for the application layer's applications, including some predefined functions. In Figure 5, the framework layer may include a resource manager and a window manager. The resource manager provides various resources to the application, such as a GPU and a display chip, and the window manager manages the display window of the application. In an embodiment of the present application, the content to be displayed sent by the application layer can be analyzed and synthesized by the framework layer in terms of layers and windows, specifically including: for the content to be displayed, identifying the layers of the application, such as the video display layer in the video scene, and then using the GPU or display chip to blur each layer, and then synthesizing each layer, or performing overall blurring on the entire visible window through the window manager. Using a GPU or display chip to process the content to be displayed can perform real-time processing of the display screen, wherein the use of a GPU solution is more flexible, and the use of a display chip solution to harden the blur algorithm and range to the display IP can effectively reduce power consumption.

[0137] The Hardware Abstraction Layer (HAL) is an interface layer located between the operating system kernel and the hardware circuit, and its purpose is to abstract the hardware. It hides the hardware interface details of a specific platform and provides a virtual hardware platform for the operating system, making it hardware-independent and portable on multiple platforms. For example, the HAL includes a display engine and a camera hardware abstraction layer (Camera HAL). The display engine is used to further process the received content to be displayed, and the Camera HAL includes a camera. It can be understood that the camera is an abstract device. In the embodiment of the present application, the hardware abstraction layer mainly uses the display engine to process the blurred content to be displayed, such as image brightness and image grayscale, while the Camera HAL mainly prepares for user access to the camera.

[0138] The hardware layer (HW) is the hardware at the bottom layer of the operating system. For example, HW includes displays, cameras, and sensors. The display can display myopic, out-of-focus images, while the camera and sensors can detect the user's eye distance.

[0139] For ease of understanding, the following embodiments of the present application will take an electronic device having the structure shown in FIG. 4 and FIG. 5 as an example to specifically illustrate the image display method provided in the embodiments of the present application.

[0140] See Figure 6, which is a flow chart of an image display method provided in an embodiment of the present application. As shown in Figure 6, the main steps of the image display method provided in an embodiment of the present application include:

[0141] S601: The electronic device obtains an image to be processed.

[0142] S602: The electronic device blurs at least a portion of the image to be processed to obtain a defocused image, where the defocused image is used to form an image on the user's retina when the user has normal vision.

[0143] S603: The electronic device displays a defocused image.

[0144] In an embodiment of the present application, the electronic device may be configured with a display mode adjustment function for the user to adjust the display mode of the device.

[0145] For example, as shown in FIG7 , the electronic device's settings interface 71 may include a display mode setting button 711. In response to a triggering operation on the display mode setting button 711, the electronic device may display a display mode selection interface 72. The display mode selection interface 72 may include option buttons for multiple display modes, such as a myopia prevention mode and a standard mode.

[0146] In response to triggering any option button in the display mode selection interface, the electronic device can switch to the corresponding display mode. Specifically, in response to triggering the myopia prevention mode option button, the electronic device can switch to the myopia prevention mode and trigger the execution of the image display method provided in the embodiment of the present application to achieve defocused image display and achieve myopia prevention.

[0147] The following describes in detail the various steps of the image display method provided in the embodiment of the present application.

[0148] S601: The electronic device obtains an image to be processed.

[0149] In an embodiment of the present application, the image to be processed is the content to be displayed on the display interface. Specifically, according to the user's choice, the image to be processed can be a certain image to be displayed on the display interface, or all images to be displayed on the display interface. If the image to be processed is a certain image to be displayed on the display interface, the electronic device can obtain it directly from the relevant application of the application layer according to the user's choice. For example, if the user chooses to blur only the video to be displayed on the display interface, the electronic device can obtain the image to be processed from the video application; if the image to be processed includes all images to be displayed on the display interface, the electronic device obtains a certain image to be displayed on the display interface from the relevant application of the application layer, and then combines it with the window manager of the framework layer to obtain all images to be displayed on the display interface. For example, after the electronic device obtains the video image to be displayed from the video application, it sends the video image to be displayed to the framework layer. After the window manager of the framework combines the video image to be displayed with the existing display interface image for analysis, all images to be displayed on the display interface can be obtained.

[0150] S602: The electronic device blurs at least a portion of the image to be processed to obtain a defocused image, where the defocused image is used to form an image on the user's retina when the user has normal vision.

[0151] The methods for protecting vision through defocusing in the prior art mainly include: 1. Using lenses to focus the center of the line of sight on the retina, and focusing the peripheral line of sight in front of the retina, that is, the image presented on the retina is an image with a clear center part and a blurred peripheral part; 2. Using lenses to adjust the refraction of each wavelength so that blue light and green light are focused in front of the retina, and red light is focused on the retina, that is, the image presented on the retina is an overall blurred image. However, the embodiment of the present application presents the image presented on the retina on the screen in a simulated manner, so that people with normal vision (including those wearing corrective glasses) can also see the myopic defocused picture when focusing. Therefore, the embodiment of the present application also includes two types of blurring processing for the screen display image, namely partial defocusing based on the focus of the center of the line of sight and full defocusing based on the image color.

[0152] The following is an introduction to the partial defocus method.

[0153] In the partial defocus method, before blurring the image to be processed, it is necessary to determine the defocused area on the image to be processed, and then blur the defocused area to obtain a defocused image.

[0154] In one possible implementation, the defocused area can be identified by the user's gaze point on the display screen. Specifically, the gaze point of the current user on the screen is obtained; with the gaze point as the center, at least part of the area of ​​the image to be processed is blurred to obtain a defocused image, wherein the area farther from the gaze point in the defocused image is, the higher the blurriness. In an embodiment of the present application, the gaze point is the focus of the user's line of sight on the screen. In some ways, the gaze point of the current user can be obtained by tracking the eyeball by the camera of the electronic device. After obtaining the gaze point, the defocused area of ​​the image to be processed can be obtained by a pre-set corresponding chart or calculation formula, and the defocused image can be obtained based on the blurring of the defocused area of ​​the image to be processed. In actual applications, due to the curvature of the eyeball, the image presented on the retina is blurrier the farther away from the center point. Correspondingly, in an embodiment of the present application, the image displayed on the screen is blurred to a higher degree as the area is farther away from the gaze point.

[0155] It can be understood that in an embodiment of the present application, when the image to be processed is an image on the display interface, the user's gaze point on the screen may be on the image to be processed or not on the image to be processed. Accordingly, when the user's gaze point on the screen is on the image to be processed, the defocus area of ​​the image to be processed only includes a part of the image to be processed; when the user's gaze point is not on the image to be processed, the defocus area of ​​the image to be processed may include only a part of the image to be processed or the entire area of ​​the image to be processed.

[0156] In one possible implementation, after obtaining the gaze point, the non-defocus area of ​​the image to be processed is determined with the gaze point as the center and the non-defocus radius as the radius, and the defocus area of ​​the image to be processed is determined based on the non-defocus area of ​​the image to be processed. Specifically, all areas in the image to be processed except the defocus area are defocus areas, and the non-defocus area is a circular area with the gaze point as the center and the non-defocus radius as the radius.

[0157] In one possible implementation, the non-defocus radius can be obtained through a pre-set corresponding chart according to the type of electronic device used. Specifically, for different types of electronic devices, the default eye distance table can be used to obtain the non-defocus radius. For example, the default eye distance of a mobile phone is 25cm, and the non-defocus radius obtained by looking up the table is about 2cm. The default eye distance of a tablet is 35cm, and the non-defocus radius obtained by looking up the table is about 3cm. The non-defocus radius can also be obtained by looking up the table according to the measured eye distance of the current user. For example, the eye distance of the current user of a desktop computer is 50cm, and the non-defocus radius obtained by looking up the table is about 28cm. In a specific implementation, the actual eye distance of the electronic device can be obtained by measuring using TOF (Time of flight) or a binocular camera.

[0158] In another possible implementation, the non-defocus radius can also be obtained according to the calculation formula of the non-defocus radius. Specifically, when obtaining the current user's gaze point, the current user's eye distance is also obtained, and the non-defocus radius is determined according to the current user's eye distance and the preset central field of view angle, wherein the non-defocus radius is positively correlated with the eye distance and the central field of view angle. Specifically, the calculation formula of the non-defocus radius is: R = L Y × tanθ,

[0159] Where R is the non-defocus radius, L Y is the eye distance, and θ is the central visual angle.

[0160] In one possible implementation, the preset center field of view angle range includes ±5°-±30°. In a specific implementation, the preset center field of view angle range is related to the eye distance. For example, the eye distance of a mobile phone is generally shorter, so the preset center field of view angle of a mobile phone is generally around ±5°, while the eye distance of a television is generally longer, so the preset center field of view angle of a television is generally ±30°.

[0161] In an embodiment of the present application, after the defocused area of ​​the image to be processed is determined, blur processing is performed on the defocused area of ​​the image to be processed to obtain a defocused image.

[0162] 8, which is a schematic diagram of a process for blurring a defocused area according to an embodiment of the present application. As shown in FIG8, blurring a defocused area mainly includes the following steps.

[0163] S801: Calculate a first distance between each pixel in the defocused area and the pixel corresponding to the gaze point.

[0164] In the embodiment of the present application, the first distance between each pixel in the defocus area and the pixel corresponding to the gaze point can be calculated according to the distance formula between two pixels. Specifically, the distance formula between two pixels is:

[0165] Where (n,m) is the coordinate of the (n,m)th pixel, (n0,m0) is the coordinate of the pixel corresponding to the gaze point, ppi is the pixel density, and L(n,m;n0,m0) is the first distance between the (n,m)th pixel and the pixel corresponding to the gaze point.

[0166] S802: Determine a first blur intensity for each pixel in the defocused area according to a first distance corresponding to each pixel in the defocused area.

[0167] In the embodiment of the present application, the first blur intensity of each pixel in the defocused area is positively correlated with the first distance between each pixel and the pixel corresponding to the gaze point, that is, the farther the pixel is from the pixel corresponding to the gaze point, the greater the first blur intensity. Specifically, the first blur intensity of each pixel in the defocused area is calculated as follows:

[0168] Where L is the first distance, R is the non-defocus radius, C 1模糊 is the first blur strength.

[0169] S803: Taking each pixel in the defocused area as a first central pixel, calculating a first influence intensity of pixels within a preset range on the first central pixel.

[0170] In an embodiment of the present application, the final display intensity of each pixel in the defocused area is not only affected by the distance from the gaze point, but also by the pixels within a preset range centered on each pixel, wherein the first influence intensity of the pixels within the preset range on the central pixel is related to the distance between each pixel and the central pixel within the preset range, and the first blur intensity of each pixel within the preset range.

[0171] Specifically, taking each pixel in the defocus area as the first central pixel, the second distance between each pixel in the preset range and the first central pixel is calculated; based on the second distance and the first blur intensity of each pixel in the preset range, the first influence intensity of each pixel in the preset range on the first central pixel is calculated, wherein the first influence intensity is negatively correlated with the second distance and positively correlated with the first blur intensity of each pixel in the preset range.

[0172] In a possible implementation, the formula:

[0173] Calculate the second distance between each pixel and the first center pixel within a preset range; where (n,m) is the coordinate of the (n,m)th pixel, (i,j) is the coordinate of the first center pixel, ppi is the pixel density, and L(n,m;i,j) is the second distance between the (n,m)th pixel and the first center pixel in the image defocus area.

[0174] In a possible implementation, the first influence intensity of each pixel in the defocused area on the first central pixel is t(n, m; i, j). Specifically, the calculation formula of t(n, m; i, j) is:

[0175] Where a is a constant, x = L(n, m; i, j), and y = C 1模糊 (n,m), C 1模糊 (n,m) is the first blur intensity of the (n,m)th pixel in the preset range.

[0176] In the embodiment of the present application, the sum of the dispersion of the display intensity of each pixel in the defocused area due to blurring is equivalent to the initial display intensity before blurring, so the value a can be obtained based on the following calculation formula: ∑ i,jt (n,m;i,j)=1

[0177] Among them, the summation range of (i, j) is L(n, m; i, j) < <N 计算 / ppi,N 计算 is the number of pixels within the preset range. For mobile phones, considering the computing power of the mobile phone N 计算 The value is generally not greater than 50. In specific implementation, the N 计算 Generally, it is around 10.

[0178] It can be understood that in the embodiment of the present application, since the farther the pixel is from the pixel corresponding to the gaze point, the greater the blur intensity, the farther the pixel is from the pixel corresponding to the gaze point, the smaller the a value.

[0179] S804: Determine a first updated pixel value corresponding to each pixel in the defocused area according to the initial pixel value corresponding to each pixel in the preset range and the first influence intensity, and obtain a defocused image.

[0180] In an embodiment of the present application, the influence of each pixel within the preset range on the first central pixel includes the first influence intensity of each pixel within the preset range on the first central pixel and the initial display intensity of each pixel, wherein the initial display intensity of each pixel can be the initial pixel value of each pixel before being blurred, that is, the initial RGB value of each pixel. Therefore, the first updated pixel value component of each pixel within the preset range to the first central pixel can be determined based on the initial pixel value and the first influence intensity corresponding to each pixel within the preset range. The first updated pixel value corresponding to each pixel in the defocused area is obtained based on the first updated pixel value component of each pixel within the preset range to the first central pixel. The initial pixel value of each pixel in the defocused area is updated using the first updated pixel value corresponding to each pixel in the defocused area to obtain a defocused image. It should be noted that, in an embodiment of the present application, each pixel within the preset range includes the first central pixel.

[0181] In a possible implementation, determining, based on the initial pixel value corresponding to each pixel within the preset range and the first influence intensity, the first updated pixel value component of each pixel within the preset range with respect to the first central pixel specifically includes:

[0182] Multiplying the initial pixel value corresponding to each pixel within the preset range by the first influence intensity to obtain a first updated pixel value component of each pixel within the preset range with respect to the first central pixel;

[0183] Obtaining a first updated pixel value corresponding to each pixel in the defocused area according to the first updated pixel value component of each pixel in the preset range with respect to the first central pixel specifically includes:

[0184] The first updated pixel value components of the first central pixel are summed for each pixel within the preset range to obtain the first updated pixel value corresponding to each pixel in the defocused area, that is, the calculation formula for the first updated pixel value is:

[0185] Wherein, K0(n,m) is the initial pixel value of the (n,m)th pixel within the preset range, t(n,m;i,j)×K0(n,m) is the first updated pixel value component of the (n,m)th pixel in the preset range for the first center pixel, and K(i,j) is the first updated pixel value corresponding to each pixel in the defocused area. This formula adds up all intensities that may affect the (i,j) pixel and finally calculates the first updated pixel value of (i,j).

[0186] In one possible implementation, updating the initial pixel value of each pixel in the defocused area using the first updated pixel value corresponding to each pixel in the defocused area to obtain a defocused image specifically includes:

[0187] The initial pixel value of each pixel in the defocused area is replaced by the first updated pixel value corresponding to each pixel in the defocused area to obtain a defocused image.

[0188] In an embodiment of the present application, the defocused image is used to be presented on the user's retina when the user has normal vision, so that the user can see the myopic defocused image even when the user has normal vision.

[0189] In an embodiment of the present application, a defocused area is obtained by obtaining a gaze point, and the image in the defocused area is blurred to obtain a defocused image, thereby achieving a simulation of a myopic defocused image on the retina, so that people with normal vision (including those wearing corrective glasses) can also see the myopic defocused image when focusing, thereby achieving the effect of protecting eyesight.

[0190] In addition to defocusing the pixels around the center, the embodiment of the present application also proposes a method for defocus blur based on image hue. This method obtains the hue value of each pixel by performing HSV conversion on each pixel of the entire image, and confirms the second blur intensity of each pixel based on the hue value of each pixel. Based on the second blur intensity of each pixel, the second updated pixel value of each pixel is obtained, and finally the desired image effect is obtained.

[0191] Refer to FIG9 , which is a schematic diagram of a process of blurring an image to be processed provided in an embodiment of the present application.

[0192] As shown in Figure 9, the main steps of blurring the image to be processed include:

[0193] S901: Obtain the hue value of each pixel in the image to be processed.

[0194] In the embodiment of the present application, obtaining the hue value of each pixel in the image to be processed specifically includes:

[0195] Obtain the [R, G, B] value of each pixel in the image to be processed; convert the [R, G, B] value of each pixel in the image to be processed into a [H, S, V] value; and obtain the hue value of each pixel according to the [H, S, V] value of each pixel in the image to be processed.

[0196] In an embodiment of the present application, the [R, G, B] value of each pixel in the image to be processed can be obtained from the image information, and the conversion of the [R, G, B] value into the [H, S, V] value can refer to the relevant existing technology. For the sake of brevity, this application will not elaborate on it here.

[0197] S902: Determine a second blur strength for each pixel in the image to be processed according to the hue value of each pixel in the image to be processed, where the second blur strength is negatively correlated with the hue value.

[0198] In the embodiment of the present application, the second blur intensity of each pixel in the image to be processed is negatively correlated with the hue value of each pixel, that is, the larger the hue value of each pixel, the smaller the second blur intensity of each pixel. Specifically, the calculation formula of the second blur intensity is: C 2模糊 =1 / (h-240° / 180°×pi) 2

[0199] Among them, h is the hue value, the value range is (0,2pi], C 2模糊 is the second blur strength.

[0200] S903: Taking each pixel in the image to be processed as a second central pixel, calculating a second influence strength of pixels within a preset range on the second central pixel, where the second influence strength is positively correlated with a second blur strength of each pixel within the preset range.

[0201] In an embodiment of the present application, the final display intensity of each pixel in the image to be processed is not only affected by the distance from the gaze point, but also by the pixels within a preset range centered on each pixel, wherein the second influence intensity of the pixels within the preset range on the center pixel is related to the distance between each pixel and the center pixel within the preset range, and the second blur intensity of each pixel within the preset range.

[0202] Specifically, taking each pixel in the image to be processed as the second center pixel, the third distance between each pixel and the second center pixel within the preset range is calculated; based on the third distance and the second blur intensity of each pixel within the preset range, the second influence intensity of each pixel within the preset range on the second center pixel is calculated, wherein the second influence intensity is negatively correlated with the third distance and positively correlated with the second blur intensity of each pixel within the preset range.

[0203] In a possible implementation, the formula:

[0204] Calculate the third distance between each pixel in the preset range and the second center pixel; where (a, b) are the coordinates of the (a, b)th pixel in the preset range, (u, v) are the coordinates of the second center pixel, ppi is the pixel density, and L(a, b; u, v) is the third distance between the (a, b)th pixel and the second center pixel.

[0205] In a possible implementation, the second influence intensity of each pixel in the image to be processed on the second central pixel is t(a, b; u, v). Specifically, the calculation formula of t(a, b; u, v) is:

[0206] Where a is a constant, x = L(a, b; u, v), and y = C 2模糊 (a,b), C2模糊 (a, b) is the second blur intensity of the (a, b)th pixel within the preset range, and t(a, b; u, v) is the second influence intensity of the (a, b)th pixel on the second central pixel.

[0207] In the embodiment of the present application, the sum of the dispersion of the display intensity of each pixel in the image to be processed due to blurring is equivalent to the initial display intensity before blurring, so the value a can be obtained based on the following calculation formula: ∑ u,v t(a,b;u,v)=1

[0208] Among them, the sum range of (u, v) is L(a, b; u, v)<<N 计算 / ppi,N 计算 is the number of pixels within the preset range. For mobile phones, considering the computing power of the mobile phone N 计算 The value is generally not greater than 50. In specific implementation, the N 计算 Generally, it is around 10.

[0209] It can be understood that in the embodiment of the present application, since the farther the pixel is from the pixel corresponding to the gaze point, the greater the blur intensity, the farther the pixel is from the pixel corresponding to the gaze point, the smaller the a value.

[0210] S904: Determine a second updated pixel value corresponding to each pixel in the image to be processed according to the initial pixel value corresponding to each pixel within a preset range and the second influence intensity, to obtain a defocused image.

[0211] In an embodiment of the present application, the influence of each pixel within the preset range on the second central pixel includes the second influence intensity of each pixel within the preset range on the second central pixel and the initial display intensity of each pixel, wherein the initial display intensity of each pixel can be the initial pixel value of each pixel before being blurred, that is, the initial RGB value of each pixel. Therefore, the second updated pixel value component of each pixel within the preset range on the second central pixel can be determined based on the initial pixel value and the second influence intensity corresponding to each pixel within the preset range. The second updated pixel value corresponding to each pixel within the defocused area is obtained based on the second updated pixel value component of each pixel within the preset range on the second central pixel. The initial pixel value of each pixel within the defocused area is updated using the second updated pixel value corresponding to each pixel within the defocused area to obtain a defocused image. It should be noted that, in an embodiment of the present application, each pixel within the preset range includes the second central pixel.

[0212] In a possible implementation, determining the second updated pixel value component of each pixel within the preset range with respect to the second central pixel based on the initial pixel value and the second influence strength corresponding to each pixel within the preset range specifically includes:

[0213] Multiplying the initial pixel value corresponding to each pixel within the preset range by the second influence intensity to obtain a second updated pixel value component of each pixel within the preset range with respect to the second central pixel;

[0214] Obtaining the second updated pixel value corresponding to each pixel in the defocused area according to the second updated pixel value component of each pixel in the preset range with respect to the second central pixel specifically includes:

[0215] The second updated pixel value components of the second central pixel are summed for each pixel within the preset range to obtain the second updated pixel value corresponding to each pixel in the defocused area, that is, the calculation formula of the second updated pixel value is:

[0216] Among them, N 计算 is the number of pixels within the preset range, K0(a,b) is the initial pixel value of the (a,b)th pixel within the preset range, and K(u,v) is the second updated pixel value corresponding to each pixel in the image to be processed;

[0217] In one possible implementation, updating the initial pixel value of each pixel in the image to be processed by using the second updated pixel value corresponding to each pixel in the image to be processed to obtain a defocused image specifically includes:

[0218] The initial pixel value of each pixel in the image to be processed is replaced by the second updated pixel value corresponding to each pixel in the image to be processed to obtain a defocused image.

[0219] This embodiment sets the blur intensity based on the hue of the image content, simulating the effect of light of different wavelengths focused on different locations on the retina and enhancing that effect. Compared to partial defocus solutions, this embodiment defocuses the entire image and does not require gaze tracking, making the calculation process simpler.

[0220] S603: The electronic device displays a defocused image.

[0221] In an embodiment of the present application, after image blurring is completed on the image to be processed, the electronic device displays a defocused image so that the human eye can directly obtain the defocused image for preventing myopia from the screen.

[0222] It should be understood that the above examples are intended to help those skilled in the art understand the embodiments of the present application, and are not intended to limit the embodiments of the present application to the specific numerical values ​​or specific scenarios illustrated. Those skilled in the art can obviously make various equivalent modifications or variations based on the above examples, and such modifications or variations also fall within the scope of the embodiments of the present application.

[0223] The image display method provided by the embodiment of the present application is described in detail above with reference to Figures 1 to 9 . The device embodiment of the present application will be described in detail below with reference to Figure 10 . It should be understood that the image display device in the embodiment of the present application can perform the various methods of the aforementioned embodiments of the present application. For the specific working processes of the various products below, reference can be made to the corresponding processes in the aforementioned method embodiments.

[0224] Referring to Figure 10 , which is a schematic diagram of the structure of an image display device provided in an embodiment of the present application, the image forming device 1000 includes: an acquisition unit 1001 for acquiring an image to be processed; a blurring unit 1002 for blurring at least a portion of the image to be processed to obtain a defocused image, where the image is out of focus; and a display unit 1003 for displaying the defocused image.

[0225] It should be understood that the image display device 1000 here is embodied in the form of a functional unit. The term "unit" here can be implemented in the form of software and / or hardware, and is not specifically limited to this. For example, a "unit" can be a software program, a hardware circuit, or a combination of the two that implements the above functions. The hardware circuit may include an application specific integrated circuit (ASIC), an electronic circuit, a processor (such as a shared processor, a dedicated processor, or a group processor, etc.) and memory for executing one or more software or firmware programs, a combined logic circuit, and / or other suitable components that support the described functions.

[0226] Therefore, the units of each example described in the embodiments of this application can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0227] The embodiment of the present application also provides a computer-readable storage medium, which stores instructions. When the instructions are executed on a computer, the computer executes the various steps of the screen display method of the embodiment of the present application.

[0228] The embodiment of the present application also provides a computer program product containing instructions. When the computer program product is run on a computer or any at least one processor, it enables the computer to execute the various steps of the screen display method of the embodiment of the present application.

[0229] An embodiment of the present application also provides a chip, including a processor and a data interface, wherein the processor reads instructions stored in a memory through the data interface to execute corresponding operations and / or processes performed by the screen display method provided in the present application.

[0230] Optionally, the chip further includes a memory, which is connected to the processor via a circuit or wire, and the processor is configured to read and execute a computer program in the memory. Further optionally, the chip further includes a communication interface, to which the processor is connected. The communication interface is configured to receive data and / or information to be processed, and the processor obtains the data and / or information from the communication interface and processes the data and / or information. The communication interface may be an input / output interface.

[0231] The memory may be a read-only memory (ROM), other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer.

[0232] In the embodiments of the present application, "and / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B may represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. A and B may be singular or plural. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can be represented by: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.

[0233] Those skilled in the art will appreciate that the various units and algorithm steps described in the embodiments disclosed herein can be implemented using a combination of electronic hardware, computer software, and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0234] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0235] In the several embodiments provided in this application, if any function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of this application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0236] The above description is merely a specific embodiment of the present application. Any person skilled in the art may easily conceive of variations or substitutions within the technical scope disclosed in this application, and such variations or substitutions shall be within the scope of protection of this application. The scope of protection of this application shall be subject to the scope of protection of the claims.

Claims

1. An image display method, characterized in that: The method comprises: Get the image to be processed; Performing blur processing on at least a partial area of ​​the image to be processed to obtain a defocused image, wherein the defocused image is used to form an image on the retina of the user when the user has normal vision; The out-of-focus image is displayed.

2. The method according to claim 1, characterized in that The blurring of at least a part of the image to be processed to obtain a defocused image comprises: Get the user's gaze point on the screen; Taking the gaze point as the center, blurring is performed on at least a portion of the image to be processed to obtain a defocused image, wherein the farther the area in the defocused image is from the gaze point, the higher the blurriness.

3. The method according to claim 2, characterized in that The blurring of at least a part of the image to be processed with the gaze point as the center to obtain a defocused image includes: Taking the gaze point as the center and the non-defocus radius as the radius, determining the non-defocus area of ​​the image to be processed, wherein the non-defocus area is a circular area; Taking the gaze point as the center, blurring the defocused area of ​​the image to be processed to obtain a defocused image; Wherein, the area other than the non-defocused area in the image to be processed is the defocused area.

4. The method according to claim 3, characterized in that Before determining the non-defocus area of ​​the image to be processed with the gaze point as the center and the non-defocus radius as the radius, the method further includes: Acquire the user's eye distance, where the eye distance is the distance between the user's eyeball and the screen; A non-defocus radius is determined according to the eye distance, wherein the eye distance is positively correlated with the non-defocus radius.

5. The method according to claim 4, characterized in that The determining of the non-defocus radius according to the eye distance includes: A non-defocus radius is determined according to the eye distance and a central visual angle corresponding to the eye distance, wherein the non-defocus radius is positively correlated with the central visual angle.

6. The method according to claim 5, characterized in that The determining of the non-defocus radius according to the eye distance and the central visual angle corresponding to the eye distance includes: According to the formula: R = L Y ×tanθ determines the non-defocus radius, where R is the non-defocus radius, L Y is the eye distance, and θ is the central visual angle.

7. The method according to claim 3, characterized in that The blurring of the defocused area of ​​the image to be processed with the gaze point as the center to obtain the defocused image includes: Calculate a first distance between each pixel in the defocused area and a pixel corresponding to the gaze point; determining a first blur intensity of each pixel in the defocused area according to a first distance corresponding to each pixel in the defocused area, wherein the first blur intensity is positively correlated with the first distance; Taking each pixel in the defocused area as a first central pixel, calculating a first influence strength of each pixel in a preset range on the first central pixel, wherein the first influence strength is positively correlated with a first blur strength of each pixel in the preset range; According to the initial pixel value corresponding to each pixel in the preset range and the first influence intensity, the first updated pixel value corresponding to each pixel in the defocused area is determined to obtain a defocused image.

8. The method according to claim 7, characterized in that The calculating a first distance between each pixel in the defocused area and a pixel corresponding to the gaze point comprises: According to the formula: Calculate a first distance between each pixel in the defocused area and a pixel corresponding to the gaze point; Among them, (n,m) is the coordinate of the (n,m)th pixel, (n0,m0) is the coordinate of the pixel corresponding to the gaze point, ppi is the pixel density, and L(n,m; n0,m0) is the first distance between the (n,m)th pixel and the pixel corresponding to the gaze point.

9. The method according to claim 7, characterized in that: The determining, according to the first distance corresponding to each pixel in the defocused area, a first blur intensity of each pixel in the defocused area comprises: According to the formula: Calculate a first blur intensity of each pixel in the defocused area; Where L is the first distance, R is the non-defocus radius, C 1模糊 is the first blur strength.

10. The method according to claim 7, characterized in that The step of taking each pixel in the defocused area as a first central pixel and calculating a first influence intensity of each pixel in a preset range on the first central pixel comprises: Taking each pixel in the defocused area as a first central pixel, calculating a second distance between each pixel in a preset range and the first central pixel; According to the second distance and the first blur intensity of each pixel within the preset range, the first influence intensity of each pixel within the preset range on the first central pixel is calculated, and the first influence intensity is negatively correlated with the second distance and positively correlated with the first blur intensity of each pixel within the preset range.

11. The method according to claim 10, characterized in that The method of taking each pixel in the defocused area as a first central pixel and calculating a second distance between each pixel in a preset range and the first central pixel comprises: According to the formula: Calculate a second distance between each pixel within a preset range and the first central pixel; Among them, (n,m) is the coordinate of the (n,m)th pixel, (i,j) is the coordinate of the first central pixel, ppi is the pixel density, and L(n,m;i,j) is the second distance between the (n,m)th pixel and the first central pixel.

12. The method according to claim 11, characterized in that The calculating, according to the second distance and the first blur strength of each pixel within the preset range, a first influence strength of each pixel within the preset range on the first central pixel comprises: According to the formula: Calculate a first influence intensity of each pixel within a preset range on the first central pixel; Where a is a constant, x = L(n,m;i,j), y = C 1模糊 (n,m),C 1模糊 (n,m) is the first blur intensity of the (n,m)th pixel within the preset range, and t(n,m;i,j) is the first influence intensity of the (n,m)th pixel on the first central pixel.

13. The method according to claim 12, characterized in that The step of determining a first updated pixel value corresponding to each pixel in the defocused area according to the initial pixel value corresponding to each pixel in the preset range and the first influence intensity to obtain a defocused image comprises: According to the formula: Determine a first updated pixel value corresponding to each pixel in the out-of-focus area; Among them, N 计算 is the number of pixels within the preset range, K0(n,m) is the initial pixel value of the (n,m)th pixel within the preset range, and K(i,j) is the first updated pixel value corresponding to each pixel in the defocused area; The initial pixel value of each pixel in the defocused area is updated using the first updated pixel value corresponding to each pixel in the defocused area to obtain a defocused image.

14. The method according to claim 1, characterized in that The blurring of at least a part of the image to be processed to obtain a defocused image comprises: Obtaining the hue value of each pixel in the image to be processed; Determining a second blur intensity of each pixel in the image to be processed according to the hue value of each pixel in the image to be processed, wherein the second blur intensity is negatively correlated with the hue value; Taking each pixel in the image to be processed as a second central pixel, calculating a second influence strength of pixels within a preset range on the second central pixel, wherein the second influence strength is positively correlated with a second blur strength of each pixel within the preset range; According to the initial pixel value corresponding to each pixel within the preset range and the second influence intensity, the second updated pixel value corresponding to each pixel in the image to be processed is determined to obtain a defocused image.

15. The method according to claim 14, characterized in that Determining the second blur intensity of each pixel in the image to be processed according to the hue value of each pixel in the image to be processed includes: According to the formula: C 2模糊 =1 / (h-240° / 180°×pi) 2 Calculating a second blur intensity of each pixel in the image to be processed; Among them, h is the hue value, the value range is (0,2pi], C 2模糊 is the second blur strength.

16. The method according to claim 14, characterized in that The step of taking each pixel in the image to be processed as a second central pixel and calculating a second influence strength of pixels within a preset range on the second central pixel comprises: Taking each pixel in the image to be processed as a second central pixel, calculating a third distance between each pixel in a preset range and the second central pixel; According to the third distance and the second blur intensity of each pixel within the preset range, the second influence intensity of each pixel within the preset range on the second central pixel is calculated, and the second influence intensity is negatively correlated with the third distance and positively correlated with the second blur intensity of each pixel within the preset range.

17. The method according to claim 16, characterized in that The method of taking each pixel in the image to be processed as a second central pixel and calculating a third distance between each pixel in a preset range and the second central pixel comprises: According to the formula: Calculate a third distance between each pixel within a preset range and the second central pixel; Among them, (a, b) is the coordinate of the (a, b)th pixel, (u, v) is the coordinate of the second center pixel, ppi is the pixel density, and L(a, b; u, v) is the third distance between the (a, b)th pixel and the second center pixel.

18. The method according to claim 17, characterized in that Calculating the second influence intensity of each pixel within the preset range on the second central pixel according to the third distance and the second blur intensity of each pixel within the preset range includes: According to the formula: Calculate a second influence strength of each pixel within a preset range on the second central pixel; Where a is a constant, x = L(a, b; u, v), y = C 2模糊 (a,b), C 2模糊 (a, b) is the second blur intensity of the (a, b)th pixel in the preset range, and t(a, b; u, v) is the second influence intensity of the (a, b)th pixel on the second central pixel.

19. The method according to claim 18, characterized in that Determining the second updated pixel value corresponding to each pixel in the image to be processed according to the initial pixel value corresponding to each pixel in the preset range and the second influence strength to obtain the defocused image includes: According to the formula: Determine a second updated pixel value corresponding to each pixel in the image to be processed; Among them, N 计算 is the number of pixels within the preset range, K0(a,b) is the initial pixel value of the (a,b)th pixel within the preset range, and K(u,v) is the second updated pixel value corresponding to each pixel in the image to be processed; The initial pixel value of each pixel in the image to be processed is updated using the second updated pixel value corresponding to each pixel in the image to be processed to obtain a defocused image.

20. An image display device, characterized in that: include: An acquisition unit, used for acquiring an image to be processed; A blurring unit, which performs blurring processing on at least a part of the image to be processed to obtain a defocused image, wherein the defocused image is an image presented when the image is out of focus; A display unit is used to display the defocused image.

21. An electronic device, characterized in that: It comprises a memory for storing computer program instructions and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to execute the method according to any one of claims 1 to 19.

22. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein when the program is executed, the device where the computer-readable storage medium is located is controlled to execute the method according to any one of claims 1 to 19.

Images