Display method, device, system and equipment, storage medium and program product

Abstract

The invention provides a display method, device and system for preventing and / or delaying myopia occurrence and / or development of a user in need, electronic equipment, a storage medium and a computer program product, and relates to the technical field of optics. The system provided by the invention combines an eye movement tracker, a display device, a controller and a dynamic fuzzy filter, and prevents or slows down the occurrence and development of myopia by accurately tracking the fixation point of a user, utilizing a camera module as an optical sensor and selectively blurring the peripheral visual content. The system is intended to eliminate optical signals that stimulate the increase in myopia degree, thereby promoting a healthier viewing habit.

Description

Technical Field

[0001] The present disclosure relates to the field of optical technology, and in particular, to a display method, a display device, a display system, an electronic device, a computer-readable storage medium, and a computer program product. Background Art

[0002] Myopia is characterized by excessive elongation of the eye, which makes it difficult to focus on distant objects, resulting in blurred vision and inconvenience. As myopia progresses, it is often necessary to periodically re-fit corrective glasses or contact lenses with higher diction. Wearing corrective glasses or contact lenses can provide clear vision for myopic patients, but it does not slow the progression of myopia. As myopia increases, the risk of developing eye complications caused by high myopia also increases. Therefore, there is an urgent need to provide methods that can effectively prevent myopia and / or delay the progression of myopia, especially as the prevalence of myopia continues to increase. Researchers and medical practitioners are actively seeking to better understand this disease and methods to prevent, delay or reverse its progression.

[0003] There is evidence that modifiable environmental factors such as long hours of study, close work and insufficient time outdoors can contribute to myopia. Recent studies have also shown that excessive use of electronic display devices (e.g. televisions, monitors, tablets, smartphones) is a significant risk factor for myopia, similar to traditional close work. This highlights the need for new technologies that can mitigate the risk of myopia when using such devices.

[0004] The above information disclosed in this Background section is only for enhancement of understanding of the background of the present disclosure and therefore it may contain information that does not constitute the prior art that is already known to one of ordinary skill in the art. Summary of the invention

[0005] The purpose of the present disclosure is to provide a display method, a display device, a display system, an electronic device, a computer-readable storage medium and a computer program product, which can prevent and / or delay the occurrence and / or development of myopia in users of the display device at least to a certain extent.

[0006] Other features and advantages of the present disclosure will become apparent from the following detailed description, or may be learned in part by the practice of the present disclosure.

[0007] According to one aspect of the present disclosure, a display method is provided, comprising: obtaining content to be displayed of a display device; obtaining a dynamic blur filter, wherein the dynamic blur filter is obtained based on a gaze point of a user of the display device on the display device; and displaying at least partially blurred content to be displayed on the display device based on the dynamic blur filter.

[0008] According to an embodiment of the present disclosure, the dynamic blur filter is configured to increase the blur degree of the content to be displayed as the distance between the gaze point and the display position increases.

[0009] According to an embodiment of the present disclosure, the blur degree is represented by defocus, the distance between the gaze points at the display position is represented by eccentricity, and the dynamic blur filter is configured so that the defocus corresponding to the eccentricity is in a predetermined proportional relationship with the Nyquist frequency.

[0010] According to an embodiment of the present disclosure, the motion blur filter includes a first area and a second area, and the motion blur filter is configured so that the first area is centered on the gaze point, and the distance between the second area and the gaze point is greater than the distance between the first area and the gaze point.

[0011] According to an embodiment of the present disclosure, the dynamic blur filter is configured not to blur the content to be displayed in the first area.

[0012] According to an embodiment of the present disclosure, the method further includes: obtaining an eye tracking signal of the user; determining an area of ​​interest in the content to be displayed based on the eye tracking signal, wherein the dynamic blur filter is configured such that after being applied to the content to be displayed, the area of ​​interest includes the first area and the second area.

[0013] According to an embodiment of the present disclosure, the motion blur filter is configured to eliminate image spatial frequencies higher than the Nyquist frequency in the content to be displayed.

[0014] According to an embodiment of the present disclosure, the dynamic blur filter is configured to enable the at least partially blurred content to be displayed to prevent the occurrence of myopia in the user and / or delay the development of myopia in the user.

[0015] According to an embodiment of the present disclosure, the dynamic blur filter is configured to change in real time according to changes in the gaze point position.

[0016] According to an embodiment of the present disclosure, the method further includes: acquiring a change amplitude of the gaze point position; in response to determining that the change amplitude is greater than a preset amplitude threshold, reacquiring a dynamic blur filter according to the current gaze point position.

[0017] According to an embodiment of the present disclosure, the target parameters of the dynamic blur filter are adjustable, and the target parameters include one or more of the following parameters: blur intensity, transition slope, and clear area size.

[0018] According to an embodiment of the present disclosure, the method further includes: acquiring the input value of the target parameter; and obtaining the dynamic blur filter according to the input value of the target parameter.

[0019] According to another aspect of the present disclosure, a display device is provided, including: a first acquisition module, used to acquire content to be displayed of the display device; a second acquisition module, used to acquire a dynamic blur filter, wherein the dynamic blur filter is obtained according to a gaze point of a user of the display device on the display device; and a display module, used to display at least partially blurred content to be displayed on the display device based on the dynamic blur filter.

[0020] According to an embodiment of the present disclosure, the dynamic blur filter includes a first area and a second area, and the dynamic blur filter is configured so that the first area is centered on the gaze point, and the distance between the second area and the gaze point is greater than the distance between the first area and the gaze point; the device also includes: a third acquisition module, used to obtain an eye tracking signal of the user; a determination module, used to determine an area of ​​interest in the content to be displayed based on the eye tracking signal, wherein the dynamic blur filter is configured so that after being applied to the content to be displayed, the area of ​​interest includes the first area and the second area.

[0021] According to one embodiment of the present disclosure, the dynamic blur filter is configured to change in real time according to changes in the gaze point position; the device also includes: a fourth acquisition module, used to obtain the change amplitude of the gaze point position; the second acquisition module is also used to re-acquire the dynamic blur filter according to the current gaze point position in response to determining that the change amplitude is greater than a preset amplitude threshold.

[0022] According to one embodiment of the present disclosure, the target parameters of the dynamic blur filter are adjustable, and the target parameters include one or more of the following parameters: blur intensity, transition slope and clear area size; the device also includes: a fifth acquisition module, used to obtain the input value of the target parameter; an acquisition module, used to obtain the dynamic blur filter according to the input value of the target parameter.

[0023] According to another aspect of the present disclosure, there is provided a display system, comprising: a display device, configured to display visual content for a user; an eye tracker, configured to track the eye movement of the user viewing the visual content to obtain a gaze point of the user on the display device; a controller communicatively connected to the display device and the eye tracker, configured to obtain a dynamic blur filter according to a gaze point of the user of the display device on the display device; the dynamic blur filter is configured to blur at least a portion of the visual content on the display device.

[0024] According to an embodiment of the present disclosure, the eye tracker includes a light source, and the eye tracker is further configured to generate a tracking signal according to light from the light source reflected by the eyes of the user.

[0025] According to one embodiment of the present disclosure, the tracking signal is one or more of the coordinates of the center of the pupil of the eye, a Purkinje image obtained from the cornea, an image or video of the user's eye, an electrooculogram (EOG) signal indicating eye movement, and an electromagnetic eye tracking signal.

[0026] According to an embodiment of the present disclosure, the controller is further configured to determine a gaze point of the user on the display device based on the tracking signal.

[0027] According to an embodiment of the present disclosure, the system further includes: a distance sensor communicatively connected to the controller, configured to obtain the distance between the user and the display device at a first predetermined frequency.

[0028] According to an embodiment of the present disclosure, the controller is further configured to determine a gaze point of the user on the display device based on the tracking signal and a distance between the user and the display device.

[0029] According to an embodiment of the present disclosure, the controller is further configured to update the gaze point according to changes in the tracking signal at a second predetermined frequency.

[0030] According to an embodiment of the present disclosure, the controller is further configured to update the motion blur filter at a third predetermined frequency according to changes in the gaze point.

[0031] According to an embodiment of the present disclosure, the controller is further configured to process the tracking signal to obtain the pupil size of the user's eye.

[0032] According to an embodiment of the present disclosure, the controller is further configured to obtain the motion blur filter according to the gaze point of the user on the display device and the pupil size of the user's eye.

[0033] According to an embodiment of the present disclosure, the eye tracker is one or more of a light detector, an image acquisition unit, a video recorder, an EOG signal recorder, and an electromagnetic signal recorder.

[0034] According to one embodiment of the present disclosure, the system also includes a user interface communicatively connected to the controller, and the controller is further configured to obtain the dynamic blur filter based on target parameters input from the user interface, wherein the target parameters include one or more of the following parameters: blur intensity, transition slope, and clear area size.

[0035] According to an embodiment of the present disclosure, the display device is at least one of a tablet computer, a personal computer, a notebook computer, a monitor, a television, a head-mounted display, and a smart phone.

[0036] According to another aspect of the present disclosure, an electronic device is provided, comprising: a memory, a processor, and executable instructions stored in the memory and executable in the processor, wherein the processor implements any of the above methods when executing the executable instructions.

[0037] According to another aspect of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, and when the executable instructions are executed by a processor, any of the above methods is implemented.

[0038] The embodiments of the present disclosure provide a computer program product or a computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the methods provided in the above-mentioned various optional implementations.

[0039] The display method provided by the embodiments of the present disclosure can prevent and / or delay the occurrence and / or development of myopia in the user of the display device to at least a certain extent by obtaining the content to be displayed of the display device and obtaining a dynamic blur filter obtained according to the gaze point of the user of the display device on the display device, and then displaying at least partially blurred content to be displayed on the display device based on the dynamic blur filter.

[0040] It is to be understood that the foregoing general description and the following detailed description are exemplary only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] The above and other objects, features and advantages of the present disclosure will become more apparent by describing in detail example embodiments thereof with reference to the attached drawings.

[0042] Figure 1 An exemplary system is shown according to an embodiment of the present disclosure.

[0043] Figure 2A-2C A schematic diagram of the display effect of a display device in a scenario of an embodiment is shown.

[0044] Figure 3 An example of digitally displaying text with a blur level that varies with the distance from the gaze point is exemplarily shown.

[0045] Figure 4 A flow chart of a display method in an embodiment of the present disclosure is shown.

[0046] Figure 5 A flow chart showing the operational steps of the method for preventing and / or delaying the occurrence and / or development of myopia according to an embodiment of the present disclosure.

[0047] Figure 6 A block diagram of a display device in an embodiment of the present disclosure is shown.

[0048] Figure 7 A schematic structural diagram of an electronic device in an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0049] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that the disclosure will be more comprehensive and complete and will fully convey the concepts of the example embodiments to those skilled in the art. The accompanying drawings are only schematic illustrations of the disclosure and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and thus their repeated description will be omitted.

[0050] In addition, the described features, structures or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced while omitting one or more of the specific details, or other methods, devices, steps, etc. may be adopted. In other cases, well-known structures, methods, devices, implementations or operations are not shown or described in detail to avoid obscuring various aspects of the present disclosure.

[0051] In addition, the terms "first", "second", etc. are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the present disclosure, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined. The symbol " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0052] In this disclosure, unless otherwise clearly specified and limited, terms such as "connection" should be understood in a broad sense, for example, it can be an electrical connection or can communicate with each other; it can be directly connected or indirectly connected through an intermediate medium. For ordinary technicians in this field, the specific meanings of the above terms in this disclosure can be understood according to specific circumstances.

[0053] As described above, some related technologies provide methods for preventing myopia and / or delaying the progression of myopia. For example, U.S. Patent No. 8,950,860 discloses a method for slowing down the progression of myopia by optically adjusting the defocus signal perceived by the eye. In this method, a concentric annular multi-zone refractive lens is used to slow down the progression of myopia, and the lens includes a correction zone for correcting refractive errors and a defocus zone for projecting a defocused image in front of the retina to inhibit eye growth.

[0054] Similar approaches are described in other U.S. patents, such as U.S. Patents 9,638,936, 10,268,050, and 11,353,721, which employ specialized optical lenses to replace conventional myopic lenses, with the goal of inducing myopic optical defocus or neutralizing hyperopic optical defocus in the eye. These patents demonstrate the growing interest in managing myopia progression in clinical ophthalmic care. However, a significant limitation of these optical lenses is their specialized and personalized nature, which makes them incompatible with electronic display devices and unsuitable for shared use.

[0055] U.S. Patent 11,048,102 provides a method and apparatus for limiting the growth of axial length of the eye. Unlike the mainstream theory that regulates axial growth based on directional optical signals or the focal plane of the retinal image, this patent proposes that eye growth is mainly affected by the spatial frequency content of the retinal image. The content disclosed in this patent shows that some success has been achieved in clinical trials by artificially blurring the retinal image using light scattering, opaque or translucent particles on the surface of optical lenses. However, this method also requires a specialized optical system and does not take into account the user's gaze direction, thereby affecting the perceived image quality.

[0056] Currently, myopia treatment mainly relies on contact lenses or frame glasses, and treatment is only performed after myopia has already developed. Therefore, there is a need in the art for a more general, non-specific treatment method or method or device that can prevent or delay the development of myopia. The present disclosure meets this need.

[0057] In the following description, devices, systems and / or methods for preventing and / or delaying the occurrence and / or development of myopia are presented as preferred examples. Those skilled in the art will appreciate that modifications, including additions and / or substitutions, may be made without departing from the scope and spirit of the present disclosure. Certain specific details may be omitted to avoid obfuscation of the present disclosure; however, the present disclosure is intended to enable those skilled in the art to practice the teachings of the present disclosure without unnecessary experimentation.

[0058] The following detailed description provides an overall understanding of a system for preventing and / or delaying the onset and progression of myopia. The system includes various components that work together to effectively address the problem.

[0059] The disclosed embodiments provide a system (hereinafter referred to as "the system") for preventing and / or delaying the occurrence and development of myopia in people in need. The system includes an eye tracker, a display device for projecting visual content, a controller communicatively connected to the eye tracker and the display device, and a dynamic blur filter for the visual content on the display device. The dynamic blur filter is adjusted by the controller based on information about the user's gaze point, wherein the dynamic blur filter forms a central clear area at the gaze point and blurs the surrounding visual content.

[0060] The eye tracker integrated in the system uses a variety of technologies, including a light detector, an image acquisition unit, a video recorder, an electro-oculogram (EOG) signal recorder, an electromagnetic signal recorder, or a combination thereof, to generate a tracking signal. To improve tracking accuracy, the eye tracker may also be equipped with a light source that emits invisible light to the user's eyes and generates a tracking signal based on the light received that is reflected back from the user's eyes.

[0061] The tracking signal generated by the eye tracker may include basic information such as the coordinates of the center of the eye pupil, a Purkinje image obtained from the cornea, an image or video of the user's eye, an EOG signal indicating eye movement, an electromagnetic eye tracking signal, or any combination of the above. In addition, the system may also integrate a distance sensor to dynamically calculate the distance between the user and the display device, thereby improving tracking accuracy.

[0062] In order to control the display device and manage the functions of the system, the present disclosure includes a controller that is communicatively coupled to the eye tracker and the display device. The controller processes the tracking signal to determine the pupil size of the user's eye and the point of gaze on the display device. The controller can continuously update the gaze point based on the real-time changes of the tracking signal and adjust the dynamic blur filter accordingly to respond to the change in the position of the gaze point on the display device to adjust the blur level. In addition, the controller also uses the tracking signal to determine the pupil size of the user's eye.

[0063] The system also includes a specially designed dynamic blur filter for adjusting the visual content displayed on the screen (i.e., display) of the display device. The filter is adjusted by the controller based on information about the user's gaze point. The dynamic blur filter selectively blurs the visual content around the central clear area corresponding to the user's gaze point. In other words, the dynamic blur filter forms a clear area around the gaze point while applying a blur effect to the peripheral area of ​​the display device screen.

[0064] The unique feature of the motion blur filter is its adaptability, which adjusts the blur intensity proportionally to the eccentricity of the retina at the user's gaze point. Therefore, it applies a stronger blur effect to the edge of the visual field and a weaker blur effect to the central clear area of ​​the focus of the line of sight, thus achieving optimal visual comfort.

[0065] The motion blur filter uses advanced image processing technology to analyze tracking signals and identify areas of interest in the visual content. It applies a variable degree of blur to the peripheral areas while maintaining a high level of visual clarity in the central clear area to enhance the user's visual experience.

[0066] Additionally, the motion blur filter is customizable so that the user or vision care professional can adjust blur characteristics, such as blur intensity, transition slope, and sharp area size, to meet individual preferences and visual needs.

[0067] To provide greater control, the system is equipped with a user interface that allows users to manually adjust the motion blur filter in real time based on their visual comfort and task requirements.

[0068] To provide richer functionality, the system can also be equipped with a distance sensor to dynamically calculate the distance between the user and the display device. This distance information helps the controller accurately determine the user's gaze point on the display device based on the tracking signal and the known distance.

[0069] The system can be widely used in a variety of display devices, including tablets, personal computers, laptops, monitors, TVs, head-mounted displays and smartphones. Its strong adaptability, rich personalization options and image processing capabilities make it an effective tool for preventing and slowing the occurrence and development of myopia.

[0070] The system provided by the present disclosure combines an eye tracker, a display device, a controller and a dynamic blur filter to prevent or slow the occurrence and development of myopia. By accurately tracking the user's gaze point, using the camera module as an optical sensor, and selectively blurring the peripheral visual content, the system aims to eliminate the optical signals that stimulate the growth of myopia, thereby promoting healthier viewing habits.

[0071] The present disclosure is implemented in some embodiments as follows Figure 1-4 As shown, a detailed description is now given. Figure 1 , Figure 1 According to an embodiment of the present disclosure, an exemplary system is shown, the system 100 includes a wearable eye tracker 101, a display device 102, a motion blur filter ( Figure 1), distance sensor 104 and controller 105. When a user wears eye tracker 101 and looks at display device 102, eye tracker 101 continuously emits invisible light to the user's eyes. This invisible light is reflected by the eyes and is reflected as reverse light by the light detector ( Figure 1 The controller 105 is used to guide, receive and detect the user's eye movement (not shown) to generate a tracking signal. The distance sensor 104 works in conjunction with the eye tracker 101 to calculate the distance between the user and the display device 102. The controller 105 then dynamically processes the tracking signal to generate the user's pupil center coordinates. In addition, once the controller 105 processes the pupil center coordinates and the distance to determine the pupil size and the user's real-time gaze point on the display device 102, the controller 105 will create a dynamic blur filter and apply it to the display device 102, thereby providing the user with a partially blurred image 103 to prevent the user's myopia and / or delay the development of the user's myopia as part of the treatment.

[0072] In some embodiments, the distance sensor can be connected to a wearable eye tracker, a separate head-mounted device, or the display device itself to determine the distance between the user and the display device. The distance measurement can be used to determine the real-time refractive defocus relative to the ideal working distance of the gaze-dependent blur system due to the movement of the user and / or the display device. The ambient refractive defocus caused by the distance between the eye and the display device can be used to dynamically adjust the blur level of the image on the user's retina.

[0073] The original image on the display device 102 can be a customized visual content specially designed to stimulate a specific visual pathway of the eye, or it can be an ordinary visual content available in the public domain. The image can be projected onto one eye through a single display module, or onto both eyes through two independent display modules. The resolution and size of the image can be set to provide optimal control over the blur kernel. Although highly pixelated display devices are very suitable for simulating fine blur patterns, one challenge is that the frequency of the simulated blur in the time domain will be reduced. The display device 102 can be implemented as an array of one or more flat displays in space, such as a tablet computer or a monitor. In some embodiments, the display device can have a curved or bowl-shaped structure to control the optical defocus of the relative peripheral area of ​​the field of view. The display device 102 can be set to have a specific working distance or a variable working distance between the user. When the working distance is allowed to change, the distance sensor 104 will detect the actual working distance of the user to determine and digitally correct the environmental refractive blur.

[0074] After the gaze point is determined, a dynamic blur filter is created and applied to the screen of the display device 102. The controller 105 performs digital blur processing on the real-time digital image by convolving the real-time digital image with the dynamic blur filter (or point spread function). The displayed visual image can be digitally blurred using common techniques in the art. For example, the dynamic blur filter can be approximated as a Gaussian function, a rotating elliptical function, or a cylindrical function, or can be represented using Zernike, Seidel, and other polynomials commonly used in visual science to describe eye aberrations and other common sources of visual blur.

[0075] Figures 2A-2C A schematic diagram showing the display effect of a display device in a scenario of an embodiment is shown. Figures 2A-2C The system 200 is specifically installed on an eye tracker 201 on a display device 202. For example, a common webcam can be integrated as the eye tracker 201. Figure 2A In FIG. 1 , the display device 202 is presenting an image for a specific user or customized. Figure 2B As shown, once the eye tracker 201 and the controller ( Figure 2B ) detects and calculates the gaze point of the user's eyes on the display device 202 (as indicated by the arrow), and the controller ( Figure 2B (not shown) a motion blur filter is applied on the display device 202. Figure 2C As shown, the detection and calculation of the gaze point of the user's eyes on the display device 202 are performed continuously and in real time. Once the gaze point of the user's eyes changes (as indicated by the arrow), the dynamic blur filter will be regenerated accordingly.

[0076] Figure 3 An example of digitally displaying text with varying blur levels depending on the distance from the gaze point is shown, which can be used to implement gaze point-dependent retinal blur processing. Figure 3 As shown, the motion blur filter 312 can vary in space and time, making it possible to apply the motion blur filter 312 to the entirety or a specific portion of the real-time digital image displayed by the display device 311. Figure 3As shown, the dynamic blur filter 312 has a non-blurred area in the vicinity closer to the center; the dynamic blur filter 312 forms a blurred area that is rotationally symmetrically distributed around the center, and the degree of blur of the blurred area can vary in a gradient manner with the radial distance from the center. The dynamic blur filter 312 can form a rotationally symmetric blur gradient with the center of the macula of the retina as the center point. In some embodiments, a blur gradient distribution in the form of a sigmoid function or other functional relationship can be adopted. In some embodiments, the convolution kernel for blur processing can vary with the eccentricity (radial distance from the center) to adjust the visual stimulus. For example, the size of the convolution kernel (which can also be referred to as the defocus kernel) for blur processing can be in a functional relationship with the neural sampling that varies with the visual field in the visual pathway. In some embodiments, the convolution kernel can be adjusted to cut off all spatial frequencies higher than the Nyquist sampling frequency of retinal ganglion cells. For example, this can be achieved by selecting the lowest simulated blur degree that satisfies the following relationship: MTF(f>f_Nyquist,E,θ)<C, where MTF is the modulation transfer function of the simulated blurred image at a given eccentricity E and angle θ, f=(f_x,f_y) is the image spatial frequency, f_Nyquist is the Nyquist frequency set according to retinal ganglion cells, and C is a constant used to consider an individual's sensitivity to blur and define the MTF threshold (below which the stimulation effect is ineffective). In some embodiments, for different eccentricities, a constant ratio is maintained between the size of the defocus kernel and the minimum resolvable feature defined by the Nyquist frequency to ensure consistent perception and sharpness across the entire visual field. Taking, for example, a cylindrical blur kernel, its defocus degree (D) can be obtained by the following formula: D = A / (P xf), where P represents the pupil diameter measured in millimeters, f is the Nyquist frequency (in cycles per degree) at a given eccentricity and angle condition, and A is a constant used to consider an individual's sensitivity to blur. The inner and outer radii of the annular blurred area can be adjusted separately to achieve an optimized treatment effect while maintaining satisfactory visual perception.

[0077] In some embodiments, the system is designed for children who view digital display screens, so it can reduce the risk of myopia in children who have not yet developed myopia. By applying the system provided in the embodiments of the present disclosure in an electronic device, a protective viewing environment is provided for children when using the electronic device to prevent the occurrence of myopia or delay the development of myopia. In other words, the system provided in the embodiments of the present disclosure reduces the potential myopia-causing hazards (such as hyperopic peripheral optical defocus and high-spatial-frequency content) when children and adolescents use electronic devices, thereby delaying the progression of myopia in children and adolescents who already have myopia and preventing the occurrence of myopia in children and adolescents.

[0078] In some embodiments, simulation systems with eye tracking capabilities can be integrated into electronic devices such as computers and tablets used by children and adolescents.

[0079] The implementation of this system will enable myopic children and adolescents to continue using electronic devices at close range without increasing the potential risk of myopia progression. Given that non-myopic children can be prevented from using electronic devices during their learning process, the implementation of this system will also effectively protect children from the early onset of myopia.

[0080] Figure 4 FIG. 1 is a flow chart of a display method according to an exemplary embodiment. Figure 4 The method shown can be applied, for example, to Figure 1 A display device in the system shown.

[0081] refer to Figure 4 , the method 40 provided in the embodiment of the present disclosure may include the following steps.

[0082] In step S402, the content to be displayed on the display device is obtained.

[0083] In some embodiments, the corresponding content to be displayed may be obtained from the server via the connected network according to the user input in the user interface.

[0084] In other embodiments, corresponding content to be displayed may be acquired from a memory of the display device according to user input in the user interface.

[0085] In step S404, a dynamic blur filter is obtained, where the dynamic blur filter is obtained according to a gaze point of a user of the display device on the display device.

[0086] In some embodiments, the above Figure 1 In one embodiment of the system, a motion blur filter is obtained through a controller.

[0087] In step S406, at least partially blurred content to be displayed is displayed on the display device based on the dynamic blur filter.

[0088] The implementation of step S406 in some embodiments can refer to Figures 2A to 3 .

[0089] The present disclosure also provides an effective method for preventing and / or delaying the occurrence of myopia in individuals in need thereof. The method comprises a series of steps that cooperate with each other to promote healthier examples and reduce the risk of myopia development.

[0090] The method involves showing a user a display screen equipped with an eye tracker to detect the movement and position of the user's eyes, and then generating a tracking signal based on this information. The tracking signal is then processed to determine the user's precise gaze point on the display screen. Next, a motion blur filter centered on the determined gaze point is created on the display screen.

[0091] This method uses a determined gaze point to create a motion blur filter on the display. The motion blur filter is specifically designed to provide a clear area with its center precisely aligned with the gaze point. This clear area ensures optimal visual acuity at the user's gaze point, resulting in clear and sharp perception. The area surrounding the motion blur filter is intentionally blurred to effectively distinguish the gaze point from the surrounding areas of the display.

[0092] The eye tracker used in the method can use various components to implement visual tracking functions, such as a photodetector, an image capture unit, a video recorder, an electrooculogram (EOG) signal recorder, an electromagnetic signal recorder, or any combination of the above components. In addition, the method can also include using an invisible light source to emit light to the user's eyes, and enabling the detector to generate a tracking signal based on the light reflected from the user's eyes.

[0093] The tracking signal may include eye pupil center coordinates, a Purkinje image obtained from the cornea, an image or video of the user's eye, an EOG signal indicating eye movement, an electromagnetic eye tracking signal, or any combination of the above.

[0094] In addition to the above core steps, the method provided by the embodiment of the present disclosure can also integrate other functions. For example, if the eye tracker is a wearable device and the distance between it and the display screen is variable, a distance sensor can be used to measure the distance between the user and the display screen to provide additional input for determining the gaze point. This distance information can improve the accuracy and reliability of the method.

[0095] By monitoring and adjusting the determination of the gaze point based on these changes, the method can ensure that the user's gaze point on the display screen remains accurate and keeps pace with the times, thereby changing the tracking signal in real time in response to the shift of the user's gaze point.

[0096] Likewise, the motion blur filter on the display is continuously updated to adapt to the dynamic changes in the user's gaze point. This ensures that the center of the sharp area remains consistent with the gaze point and aligned with the subject's visual focus, while the rest of the motion blur filter effectively achieves the desired blur effect.

[0097] In some embodiments, the invisible light used in the method may be infrared light. Using infrared light can achieve reliable tracking capabilities without causing any visual interference or discomfort to the user.

[0098] When the user's gaze moves in real time, the motion blur filter will adjust the degree of blur accordingly based on the change in the position of the gaze on the display.

[0099] In some embodiments, the dynamic blur filter can adjust its blur strength in proportion to the retinal eccentricity of the user's gaze point. This means that a stronger blur effect is applied to the edge areas of the visual field, while a weaker blur effect is applied to the central clear area of ​​the visual focus, thereby further optimizing visual comfort and therapeutic effect.

[0100] For efficient image processing, the motion blur filter uses advanced technology to analyze tracking signals and identify areas of interest in the visual content. This allows variable levels of blur to be applied to peripheral areas while maintaining high visual clarity in the central sharp area.

[0101] In some embodiments, the motion blur filter can be highly customizable, allowing the user or vision care professional to adjust its characteristics. Parameters such as blur intensity, transition slope, and clear area size can all be set according to individual preferences and visual needs.

[0102] In addition, the method also allows the user to manually adjust the dynamic blur filter. This enables real-time control of the blur settings, providing flexibility to override or modify the filter settings based on the user's visual comfort and specific task requirements.

[0103] The display device used in the method can be any screen of various devices, including tablets, personal computers, laptops, monitors, televisions, head-mounted displays or smartphones, etc., making the method applicable to different scenarios and technologies.

[0104] In summary, the method of the embodiment of the present disclosure provides a comprehensive strategy to prevent and slow down the occurrence and development of myopia. By implementing the steps of display presentation, tracking signal generation, gaze point determination, and dynamic blur filter creation, it is possible to ensure optimal visual clarity at the focus of the user's gaze, while suppressing the optical signals that stimulate the development of myopia, thereby reducing the risk of myopia development.

[0105] Figure 5 A flowchart showing the operation steps of the method for preventing and / or delaying the occurrence and / or development of myopia according to an embodiment of the present disclosure. Figure 5In steps 501 and 502, the user wears an eye tracker and looks at the display device. Step 503 involves determining the distance between the eye tracker and the display screen (i.e., the eye distance), which is optional. For example, when the distance between the eye tracker and the display screen is fixed, there is no need to measure the distance. In step 504, the eye tracker emits light to the user's eyes. Subsequently, the eye tracker is calibrated in step 505 to determine the position of the user's eyes, i.e., the coordinates of the user's pupil center and the position of its gaze point on the display screen. In addition, in step 506, the properties of the motion blur filter, including the global blur amplitude and spatial distribution, local blur mode and direction, etc., can be pre-adjusted to match individual sensitivity and refractive error.

[0106] After determining the eye's gaze point, in step 507, the controller may apply a retina-guided motion blur filter to the display device. During the presentation of the motion blur filter, the eye tracker will track eye movement in step 508. When the change in the eye gaze point detected in step 509 exceeds an amplitude threshold set based on the amplitude of a small eye movement, step 512 will be initiated to record the estimated gaze point change, and in step 513, a new motion blur filter will be calculated by inputting the change into the motion blur filter, which can be set, for example, to a chord length equivalent to the change in the gaze point angle. In step 510, whenever the eye distance change is detected to exceed the tolerance threshold, the eye distance will be re-estimated (step 511), and a new motion blur filter will be calculated by inputting the change in the peripheral refractive blur (step 513) to continuously update the motion blur filter applied to the display device (step 514).

[0107] Close eye use promotes myopia through a biofeedback mechanism triggered by defocusing of the eye. During close visual tasks, such as viewing a computer display, the display projects an optical image behind the retina, which is known as hyperopia or negative defocus. Hyperopic defocus on the retina is a signal that promotes myopia.

[0108] By pre-blurring the visual content on a digital display, the eye can be effectively prevented from detecting hyperopic defocus, thereby reducing the risk of myopia onset or progression. Reducing exposure to high spatial frequency retinal images may also help achieve this effect. And by using real-time eye tracking technology, the parts projected to the peripheral areas of the retina are identified. These peripheral areas will be processed by adjusting the blur (convolution) kernel and generating clear (unblurred) areas on the display so that the blur process will be carried out without affecting the subjective visual experience when using the digital display.

[0109] Table 1 exemplifies a method of determining blur distribution based on a mathematical model, wherein the displayed defocus degree corresponding to the blur degree is a function of the retinal eccentricity (expressed as an angle in Table 1, i.e., the angle between the line connecting the display position and the user's pupil center and the line connecting the gaze point and the user's pupil center is used to represent the distance between the corresponding display position and the gaze point), and this function can make the cutoff frequency of the displayed image lower than the Nyquist sampling limit.

[0110] Table 1. Relationship between eccentricity and defocus:

[0111]

[0112] Figure 6 FIG. 1 is a block diagram of a display device according to an exemplary embodiment. Figure 6 The device shown can be used, for example, Figure 1 In the display device shown.

[0113] refer to Figure 6 The device 60 provided in the embodiment of the present disclosure may include a first acquisition module 602 , a second acquisition module 604 and a display module 606 .

[0114] The first acquisition module 602 can be used to acquire content to be displayed on the display device.

[0115] The second acquisition module 604 may be used to acquire a dynamic blur filter, where the dynamic blur filter is acquired according to a gaze point of a user of the display device on the display device.

[0116] The display module 606 may be configured to display at least partially blurred content to be displayed on the display device based on the dynamic blur filter.

[0117] The specific implementation of each module in the device provided by the embodiment of the present disclosure can refer to the content of the above method, which will not be repeated here.

[0118] Figure 7 The following is a schematic diagram showing the structure of an electronic device in an embodiment of the present disclosure. It should be noted that: Figure 7 The device shown is only an example of a computer system, which should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0119] like Figure 7As shown, the device 700 includes a central processing unit (CPU) 701, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 702 or a program loaded from a storage portion 708 into a random access memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the device 700 are also stored. The CPU 701, the ROM 702, and the RAM 703 are connected to each other via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0120] The following components are connected to the I / O interface 705: an input section 706 including a keyboard, a mouse, etc.; an output section 707 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 708 including a hard disk, etc.; and a communication section 709 including a network interface card such as a LAN card, a modem, etc. The communication section 709 performs communication processing via a network such as the Internet. A drive 710 is also connected to the I / O interface 705 as needed. A removable medium 711, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 710 as needed, so that a computer program read therefrom is installed into the storage section 708 as needed.

[0121] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication part 709, and / or installed from a removable medium 711. When the computer program is executed by a central processing unit (CPU) 701, the above-mentioned functions defined in the system of the present disclosure are executed.

[0122] It should be noted that the computer-readable medium shown in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0123] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0124] The modules involved in the embodiments described in the present disclosure may be implemented by software or hardware. The modules described may also be set in a processor, for example, it may be described as: a processor includes a first acquisition module, a second acquisition module and a display module. The names of these modules do not constitute a limitation on the modules themselves in some cases, for example, the first acquisition module may also be described as a "module for acquiring the content to be displayed of the display device from the connected server end".

[0125] As another aspect, the present disclosure further provides a computer-readable medium, which may be included in the device described in the above embodiment; or may exist independently without being assembled into the device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by a device, the device includes:

[0126] By acquiring content to be displayed on a display device and acquiring a dynamic blur filter obtained according to a gaze point of a user of the display device on the display device, at least partially blurred content to be displayed is displayed on the display device based on the dynamic blur filter.

[0127] The embodiments of the present disclosure provide a computer program product or a computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the methods provided in the above-mentioned various optional implementations.

[0128] The exemplary embodiments of the present disclosure are specifically shown and described above. It should be understood that the present disclosure is not limited to the detailed structures, configurations or implementations described herein; on the contrary, the present disclosure is intended to cover various modifications and equivalent configurations included in the spirit and scope of the appended claims.

Claims

1. A display method, characterized in that: include: Obtain the content to be displayed on the display device; Acquire a dynamic blur filter, wherein the dynamic blur filter is obtained according to a gaze point of a user of the display device on the display device; Based on the dynamic blur filter, at least partially blurred content to be displayed is displayed on the display device.

2. The method according to claim 1, characterized in that: The dynamic blur filter is configured to increase the blur degree of the content to be displayed as the distance from the gaze point at the display position increases.

3. The method according to claim 2, characterized in that The blur degree is represented by defocus, the distance between the display positions and the gaze points is represented by eccentricity, and the dynamic blur filter is configured so that the defocus corresponding to the eccentricity is in a predetermined proportional relationship with the Nyquist frequency.

4. The method according to claim 2, characterized in that: The motion blur filter includes a first area and a second area, and the motion blur filter is configured such that the first area is centered on the gaze point, and a distance between the second area and the gaze point is greater than a distance between the first area and the gaze point.

5. The method according to claim 4, characterized in that The motion blur filter is configured not to blur the content to be displayed in the first area.

6. The method according to claim 4 or 5, characterized in that: Also includes: Acquiring an eye tracking signal of the user; Determine an area of ​​interest in the content to be displayed according to the eye tracking signal, wherein the motion blur filter is configured to be applied to the content to be displayed so that the area of ​​interest includes the first area and the second area.

7. The method according to any one of claims 1 to 5, characterized in that The motion blur filter is configured to eliminate image spatial frequencies above the Nyquist frequency in the content to be displayed.

8. The method according to any one of claims 2 to 5, characterized in that The dynamic blur filter is configured to cause the at least partially blurred content to be displayed to prevent the occurrence of myopia in the user and / or delay the progression of myopia in the user.

9. The method according to any one of claims 1 to 5, characterized in that The dynamic blur filter is configured to change in real time according to changes in the gaze point position.

10. The method according to claim 9, characterized in that Also includes: Obtaining a change amplitude of the gaze point position; In response to determining that the change amplitude is greater than a preset amplitude threshold, the dynamic blur filter is re-acquired according to the current gaze point position.

11. The method according to any one of claims 1 to 5, characterized in that: The target parameters of the dynamic blur filter are adjustable, and the target parameters include one or more of the following parameters: blur intensity, transition slope, and clear area size.

12. The method according to claim 11, characterized in that Also includes: Obtaining the input value of the target parameter; The motion blur filter is obtained according to the input value of the target parameter.

13. A display device, characterized in that: include: A first acquisition module, used to acquire content to be displayed on a display device; A second acquisition module, used to acquire a dynamic blur filter, wherein the dynamic blur filter is obtained according to a gaze point of a user of the display device on the display device; A display module is used to display at least partially blurred content to be displayed on the display device based on the dynamic blur filter.

14. The device according to claim 13, characterized in that The motion blur filter comprises a first area and a second area, the motion blur filter is configured such that the first area is centered on the gaze point, and a distance between the second area and the gaze point is greater than a distance between the first area and the gaze point; The device also includes: A third acquisition module, used to acquire an eye tracking signal of the user; A determination module is used to determine an area of ​​interest in the content to be displayed according to the eye tracking signal, wherein the motion blur filter is configured to be applied to the content to be displayed so that the area of ​​interest includes the first area and the second area.

15. The device according to claim 13 or 14, characterized in that The dynamic blur filter is configured to change in real time according to the change of the gaze point position; The device also includes: A fourth acquisition module, used to acquire the change amplitude of the gaze point position; The second acquisition module is further configured to, in response to determining that the change amplitude is greater than a preset amplitude threshold, reacquire the dynamic blur filter according to the current gaze point position.

16. The device according to claim 13 or 14, characterized in that The target parameters of the dynamic blur filter are adjustable, and the target parameters include one or more of the following parameters: blur intensity, transition slope, and clear area size; The device also includes: A fifth acquisition module, used to acquire the input value of the target parameter; The acquisition module is used to obtain the dynamic blur filter according to the input value of the target parameter.

17. A display system, characterized in that: include: A display device configured to display visual content to a user; An eye tracker configured to track eye movements of the user when viewing the visual content to obtain a gaze point of the user on the display device; a controller in communication with the display device and the eye tracker, configured to obtain a motion blur filter based on a gaze point of a user of the display device on the display device; The dynamic blur filter is configured to blur at least a portion of the visual content on the display device.

18. The system according to claim 17, characterized in that The eye tracker includes a light source, and is further configured to generate a tracking signal based on light from the light source reflected by the user's eyes.

19. The system according to claim 18, characterized in that The tracking signal is one or more of the coordinates of the center of the pupil of the eye, a Purkinje image obtained from the cornea, an image or video of the user's eye, an electrooculogram (EOG) signal indicating eye movement, and an electromagnetic eye tracking signal.

20. The system according to claim 18 or 19, characterized in that The controller is further configured to determine a gaze point of the user on the display device based on the tracking signal.

21. The system according to claim 20, characterized in that Also includes: The distance sensor, which is communicatively connected to the controller, is configured to obtain the distance between the user and the display device at a first predetermined frequency.

22. The system according to claim 21, characterized in that The controller is further configured to determine a gaze point of the user on the display device based on the tracking signal and a distance between the user and the display device.

23. The system according to claim 21 or 22, characterized in that The controller is further configured to update the gaze point according to changes in the tracking signal at a second predetermined frequency.

24. The system according to claim 23, characterized in that The controller is further configured to update the motion blur filter at a third predetermined frequency according to changes in the gaze point.

25. The system according to claim 18 or 19, characterized in that The controller is also configured to process the tracking signal to obtain the pupil size of the user's eye.

26. The system according to claim 25, characterized in that The controller is also configured to obtain the motion blur filter according to the user's gaze point on the display device and the user's eye pupil size.

27. The system according to any one of claims 17 to 19, characterized in that The eye tracker is one or more of a light detector, an image acquisition unit, a video recorder, an EOG signal recorder, and an electromagnetic signal recorder.

28. The system according to any one of claims 17 to 19, characterized in that It also includes a user interface that is communicatively connected to the controller, and the controller is further configured to obtain the dynamic blur filter according to target parameters input from the user interface, wherein the target parameters include one or more of the following parameters: blur intensity, transition slope, and clear area size.

29. The system according to any one of claims 17 to 19, characterized in that The display device is at least one of a tablet computer, a personal computer, a laptop computer, a monitor, a television, a head-mounted display and a smart phone.

30. An electronic device comprising: A memory, a processor, and executable instructions stored in the memory and executable in the processor, wherein the processor implements the method according to any one of claims 1 to 12 when executing the executable instructions.

31. A computer-readable storage medium having computer-executable instructions stored thereon, characterized in that: When the executable instructions are executed by a processor, the method according to any one of claims 1 to 12 is implemented.

32. A computer program product comprising a computer program / instructions, characterized in that When the computer program / instructions are executed by a processor, the method according to any one of claims 1 to 12 is implemented.

Images