Multimedia visual auxiliary control system based on myopia defocus

Abstract

The invention provides a multimedia visual auxiliary control system based on myopia defocus. The multimedia visual auxiliary control system comprises a virtual content display module and a virtual content regulation and control module, wherein the virtual content display module is used for displaying virtual content on eyeballs of a user; a long-range background light beam is transmitted through the virtual content display module and then enters eyeballs of a user; the virtual content regulation and control module is used for regulating the focusing position of the virtual content, and when a user watches the virtual content, myopic defocus is generated by the distant scene background light beam; an electronic display screen light source is combined with natural light, retina defocus difference is brought through lens near stimulation adjustment, and myopic defocus is generated. By means of the scheme, eyeballs can naturally and comfortably receive stimulation of natural light in an open environment, and meanwhile a long-time reading task can be achieved.

Description

Technical Field

[0001] The invention relates to a visual assistance control system, in particular to a multimedia visual assistance control system based on myopia defocus. Background Art

[0002] This section merely provides background information related to the present disclosure and is not necessarily prior art.

[0003] In recent years, the incidence of myopia in children and adolescents has shown a significant upward trend, becoming a public health issue of global concern. Studies have shown that the progression of myopia is closely related to the excessive extension of the eye axis during the development of the eyeball, and the growth of the eye axis is mainly affected by the optical signals received by the retina. A large number of studies have shown that one of the main causes of myopia is the lack of sunlight stimulation in the outdoor open environment (reference Sherwin, Justin C., et al. "The association between time spent outdoors and myopia in children and adolescents: a systematic review and meta-analysis." Ophthalmology 119.10 (2012): 2141-2151.). With the change of social living environment, people need to play, study and work in indoor spaces for a long time, use their eyes at close range to perceive the environment, and are less exposed to the natural open sunlight environment. Coupled with the popular use of electronic screen devices, the development of myopia has been further aggravated.

[0004] Special optically designed products such as frame glasses and contact lenses currently exist in the market, which cause the retina of the eye to produce a certain degree of myopic defocus when looking at objects. A large number of studies have shown that they can effectively delay the growth of the eye axis to a control effect of 21.1% to 74% (Reference 1: Kaymak H, Graff B, Neller K, Langenbucher A, Seitz B, Schwahn H (2021) Myopia treatment and prophylaxis with defocus incorporated multiple segments spectacle lenses. Ophthalmologe 118: 1280-1286; Reference 2: Lanca C, Pan CW, Grzybowski A (2024) Anti-myopia Spectacles: The Standard of Care in the Future? American Journal of Ophthalmology). The principle is to keep the central area of ​​the retina clearly focused, while creating myopic defocus in the peripheral area of ​​the retina (that is, the light is focused in front of the retina). This optical stimulation signal can inhibit the excessive growth of the eye axis, thereby slowing down the development of myopia.For example, orthokeratology (Ortho-K, OK lenses), hard corneal contact lenses that are worn for 8 to 10 hours at night and removed in the morning, and special daily-wear multifocal contact lenses, all have various designs that aim to correct myopia in the central macular area of ​​the retina, keep vision clear, and provide myopic defocus in the middle to peripheral areas of the retina to delay excessive growth of the eye axis. Frame glasses products such as a certain lens of a certain company (patent document CN104678572B) use multi-zone positive optical defocus (Defocus Incorporated Multiple Segments, DIMS) technology, using myopia control frame glasses with multiple small lens arrays, in which the central part of the macular area of ​​vision is used to provide a focal length for clear vision, while the small lenses on the periphery produce myopic defocus to inhibit eye axis growth. Similarly, a product lens of a French company uses highly aspherical microlens star control technology (Highly Aspherical Lenslet The HALT lens, through the special design of the lens, produces a special shield-shaped volume of myopic defocus (VoMD) in front of the retina around the center of the macula to give an axial growth inhibition signal. The principles are different but the result is the same, which is to allow the eyes to see objects clearly while providing retinal myopic defocus.

[0005] However, the common limitation of the above-mentioned optical products, whether wearing frame lenses or contact lenses, is that they need to be worn for a long time and frequently to effectively control myopia. Although they can provide myopia defocus, when using the eyes at close range, the eyes cannot simultaneously receive the natural sunlight (parallel light), and the human eye is still in a visual perception state in a small space. And other problems also include: wearing contact lenses may bring hygiene and infection risks, require frequent care, and are also expensive; the myopia defocus design of frame lens solution 1 (patent document CN104678572B) and solution 2 (patent document CN 110221454 A) requires regular replacement of lenses according to the change in degree, and the manufacturing process cost is also high. In addition, although there is a technology (patent document CN115542576B) that proposes a solution for dynamic defocus changes in the retina region, it requires the integration of complex human-machine environment sensing, eye tracking technology and optical zoom control technology, which is difficult to achieve under the existing market mature technology. In addition, there is also a solution proposed by Kubota Vision (patent document US11986669), which solves the myopic defocus problem by focusing an external LED light source in front of the retina. However, this solution cannot solve the problem of unstable retinal stimulation area when the eyeball of the glasses wearer moves.

[0006] In summary, with the increase in the use of multimedia teaching materials and electronic screens on campus, traditional defocus products are difficult to cope with this trend. Especially for modern children and teenagers, they use electronic screens for a long time every day in school and after school (such as reading learning materials, computer homework, watching online videos, etc.), and the usage time can even reach 6 to 8 hours a day. As a result, even if optical defocus products are used, it is necessary to consider the reduction of close-range eye use, and even further, it is necessary to combine various contradictions such as the lifestyle under natural sunlight with open and distant views. Therefore, the goal of this technical solution is to meet the myopic defocus stimulation while meeting the sunlight stimulation of overlooking the distant view of nature while meeting the long-term eye use.

[0007] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0008] Purpose of the invention: The technical problem to be solved by the present invention is to provide a multimedia visual assistance control system based on myopia defocus in view of the deficiencies in the prior art.

[0009] In order to solve the above technical problems, the present invention discloses a multimedia visual auxiliary control system and method based on myopia defocus, comprising:

[0010] A virtual content display module and a virtual content control module; wherein,

[0011] The virtual content display module is used to display virtual content on the user's eyeballs;

[0012] The distant background light beam passes through the virtual content display module and then enters the user's eyeball;

[0013] The virtual content control module adjusts the focus position of the virtual content so that when the user looks at the virtual content, the distant background light beam generates myopic defocus.

[0014] Furthermore, the virtual content display module uses a transparent display device to emit light and displays virtual content on the user's eyeballs, while transmitting the distant background light beam to the user's eyeballs.

[0015] Furthermore, the virtual content control module includes:

[0016] The zoom module zooms the light emitted by the transparent display device to generate an adjusted macular area focused light beam to display virtual content on the user's eyeball.

[0017] Furthermore, the zoom module forms an adjusted macular area focused beam while causing the distant background beam to produce myopic defocus in the peripheral and peripheral areas of the retina, and the defocus difference between the adjusted macular area focused beam and the distant background beam is set to a defocus amount greater than +0.00D.

[0018] Furthermore, the virtual content control module further includes:

[0019] The visual field proportion control module is used to adjust the total area proportion of the virtual content in the user's visual range.

[0020] Furthermore, the system also includes:

[0021] The virtual content analyzer is used to analyze the type, attributes and interaction requirements of the currently displayed virtual content. The analysis results provide a basis for the field of view proportion control module to adjust the total area proportion of the virtual content in the user's visual range. The adjustment goal is to minimize the proportion of the area of ​​the currently displayed virtual content in the full field of view.

[0022] Furthermore, the system also includes:

[0023] Sensor module and background filter control module, wherein:

[0024] The sensor module is used to sense the sensing data of the space where the user is located;

[0025] The background light filtering control module is used to adjust the brightness information relationship between the virtual content and the ambient light according to the sensing data.

[0026] Furthermore, the background filtering control module is adjusted based on the equivalent total distant background beam energy ETNDBBE, and the calculation method is as follows:

[0027] ETNDBBE=VOFA*BGE-(MA*OD(%)*BGE)-VOA*VOE

[0028] Among them, VOFA is the total area of ​​the full field of view; BGE is the brightness energy value of the distant ambient light measured by the sensor module; MA is the area of ​​any mask shape provided by the background filter control module; OD is the filter degree; VOA is the area of ​​the displayed virtual content; VOE is the brightness energy value of the displayed virtual content;

[0029] The adjustment goal is to maximize the equivalent total distant background light beam energy ETNDBBE entering the eyeball.

[0030] Furthermore, the method for adjusting the virtual content by the virtual content control module further includes:

[0031] The equivalent defocus stimulation index EDSI is defined as follows:

[0032] EDSI=k*F*A*E

[0033] Wherein, k is a constant value; F is the difference between the stimulus amount adjusted by the zoom module and the environmental depth converted into diopter, i.e., the defocus amount of the distant background beam and the adjusted macular area focused beam; A is the inverse value of the total area of ​​the adjusted macular area focused beam adjusted by the visual field proportion control module; E is the energy proportion of the distant background beam and the adjusted macular area focused beam;

[0034] The equivalent defocus stimulation index EDSI is used as an evaluation standard, that is, the maximization of the equivalent defocus stimulation index EDSI is used as an adjustment target, and the virtual content control module is used to adjust the virtual content.

[0035] Furthermore, the system also includes:

[0036] Eye tracking module, used to monitor the user's eye movements and predict the user's region of interest (ROI);

[0037] The virtual content regulation module further adjusts the virtual content according to the region of interest ROI predicted by the eye tracking module;

[0038] According to the user's region of interest ROI predicted by the eye tracking module, the field of view proportion control module is used to adjust the total area proportion of the virtual content in the user's visual range, and the background filtering control module is used to adjust the brightness information relationship between the virtual content and ambient light.

[0039] Beneficial effects:

[0040] The present invention uses an electronic display light source combined with natural light, and produces myopic defocus by adjusting the near stimulation of the lens to bring about retinal defocus difference. The adopted solution allows the eyeball to naturally and comfortably receive the stimulation of natural light in a vast environment, while also being able to perform long-term reading tasks. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments, and the above and / or other advantages of the present invention will become more clear.

[0042] Figure 1 This is a schematic diagram of myopic defocusing caused by the zoom module VFE.

[0043] Figure 2 This is a schematic diagram of the AFFB / NDBB field of view area ratio regulator.

[0044] Figure 3is a schematic diagram of the equivalent defocus stimulus index.

[0045] Figure 4 This is a schematic diagram of the calculation of the equivalent defocus stimulation index EDSI value based on text content.

[0046] Figure 5 It is a schematic diagram of dynamic control of background light.

[0047] Figure 6 Schematic diagram of a usage scenario of an AR / MR / XR display embedded with Birdbath in one embodiment.

[0048] Figure 7 is a schematic diagram of viewing a single virtual object in an embodiment.

[0049] Figure 8 is a schematic diagram of viewing multiple virtual objects in an embodiment.

[0050] Fig. 9 is a schematic diagram of viewing multiple virtual objects and adding background light control in one embodiment.

[0051] Fig.10 is a schematic diagram of an embodiment incorporating eye tracking technology.

[0052] Fig.11 It is a schematic diagram of TAR-VFE control curve. DETAILED DESCRIPTION

[0053] The present invention directly introduces natural ambient light and optical defocus design principles on the electronic screen, thereby providing a more fundamental myopia prevention and control method in the daily life scenes of children and adolescents. The overall design concept is as follows:

[0054] 1. Induce the natural close-range adjustment of the eye lens:

[0055] Contrary to previous technologies, traditional myopia prevention and control solutions (such as CN100477975C refractive telescope) are all designed to relax the adjustment of the lens as much as possible, but this solution goes against the natural visual habit of close-range fine reading. Specifically, when people focus on watching learning content, the line of sight in the human brain's visual field perception will be concentrated in a narrow range of 3 to 5 degrees, and further call the physiological reflex of eyeball close-range adjustment combined with binocular convergence. If you blindly relax your eyeballs, you are actually looking at close objects. There may still be a so-called Vergence-Accommodative Conflict (VAC) between the brain's visual perception and the eyeball, and there is a probability of a state of lens adjustment fatigue, which will produce hyperopic defocus stimulation that is easy to grow in the eyeball. In addition, the human eye cannot directly accept the stimulation of the distant background beam (Natural Distant Background Beam, NDBB) of the wide natural landscape in the distance, such as outside the window. Furthermore, with many existing technical solutions, the light beam that stimulates the retina of the eye can only choose one between a relatively close target and the real natural background light.

[0056] This system achieves multiple functions through effective intelligent content image area control and content and background light beam brightness contrast control, which allows the eyes to watch multimedia content and receive the stimulation of distant background light in the vast space of nature in a natural and comfortable close-up state, while also providing myopia defocus stimulation. This improvement solves the problem that traditional optical products cannot combine virtual content and background light, and significantly improves the myopia prevention and control effect.

[0057] 2. Introducing variable focus element (VFE):

[0058] Traditional optical products such as contact lenses and frame glasses adopt a fixed defocus design, which cannot be dynamically adjusted according to the changes in the user's line of sight, and it is difficult to adapt to complex viewing distances and diverse usage scenarios. The present invention adopts VFE, which controls the dynamic zoom of virtual content, induces the close-range adjustment of the lens, and generates an adjusted macular focusing beam (Adjusted Foveal Focusing Beam, AFFB). The lens system is allowed to adjust the near-adaptive, so that the central visual macular area of ​​the visual field maintains clear vision, and the algorithm is used to calculate the appropriate shading transparency in each area within the full visual field to generate NDBB, wherein the NDBB and AFFB will produce a stable myopic defocus in front of the retina. This dynamic adjustment improves the adaptability of the system and is suitable for different scenes and content, thereby more effectively controlling the progression of myopia. Among them, further, VFE can be a functional module integrated in the virtual object display module, and the solution used can be a holographic display technology or a light field display (Light Field Display) technology, which directly generates an optical focal length that induces crystal adjustment. In short, it can directly provide VFE functions on the virtual display component.

[0059] 3. Dynamically control background light control:

[0060] This system adjusts the intensity of the background light of the virtual image in real time through the strobe mask or transparency adjustment of the NDBB, ensuring that the visual contrast between the virtual content and the background light can match the most comfortable viewing experience for the individual user. The specific control principle is to maintain the clear contrast of the virtual image as much as possible, while maximizing the introduction of more Equivalent Total Natural Distant Background Beam Energy (ETNDBBE) into the eye. ETNDBBE is defined as the total effective light energy entering the eyeball, and its calculation method is:

[0061] VOFA*BGE-(MA*OD(%)*BGE)-VOA*VOE

[0062] VOFA is the total area of ​​the full field of view; BGE is the energy value of the distant ambient light measured by the light intensity sensing module; MA is the area of ​​any mask shape provided by the filter module; OD is the filter degree; VOA is the area of ​​the target virtual object; VOE is the energy value of the brightness of the target virtual object. MA can come from masks of multiple independent areas in the full field of view (e.g., MA Toll =MA1+MA2…+MA n ), each mask can be in pixel units and have its own OD value. Similarly, VOA*VOE can also be in pixel units.

[0063] BGE is the field of view that changes in different real-world environments; VOE can be coordinated and controlled by system devices. Virtual objects can be documents or videos for reading. The target virtual object is the background identified by the virtual content analyzer through AI or specific image algorithms, and the area calculation method is VOFA-VOA. For example, a Word text file image with black text on a white background, such as Figure 4 , where 103 is the text as the target virtual object, which is determined by the virtual content analyzer as the so-called VOA calculation area, and 104 is the background VOFA-VOA calculation area determined by the virtual content analyzer as the text. Similarly, the virtual content can also be a pre-loaded specific file format with a defined VOA area, without the need for a virtual content analyzer.

[0064] 4. Simple implementation scheme for defocus generation:

[0065] Traditional optical products rely on complex, tight, and high-cost lens designs to achieve myopic defocus stimulation. The present invention uses the principle of physiological near accommodation reflection focusing of the lens by combining the control system display module with a single optical focal length to allow AFFB and NDBB to produce retinal myopic defocus between each other. While ensuring clear imaging in the central visual area, a defocus difference of +0.50D to +5.00D is generated in the periphery of the retina. This improvement significantly simplifies the process of producing myopic defocus, and is deeply integrated with electronic display devices while reducing the cost of technical implementation.

[0066] 5. Integration and intelligence of system control:

[0067] Traditional optical defocus products are difficult to integrate with modern digital devices, especially in the use scenarios of multimedia and electronic devices. There are still no real retinal myopic defocus products today. The present invention dynamically controls the region of interest (ROI), transparency, focal length and background light transmission of virtual content through an integrated control system, and provides a multi-linked optical adjustment mechanism. The system can automatically / adaptively adjust according to the user's usage scenario and environmental changes, thereby achieving intelligent optimization of myopia prevention and control effects and improving the overall user experience. Specific description: In order to effectively produce a reasonable myopic defocus difference in a real environment, the technology of the present invention uses environmental distance as a variable, such as an infrared light / laser environmental distance sensor or a direct input system environmental distance, to link the VFE close-range focal length to induce near accommodation movement of the eye lens. For example, when the environmental rangefinder senses that the environmental depth is only 3m, the system controller sends a command to the VFE to adjust the focus of the virtual image, adjust the VFE to produce -2.17D diopter (about 40cm near object simulation focal length) to give the eyeball accommodation stimulation, and through the defocus difference of AFFB and NDBB, ensure that the eyeball can produce an effective myopic defocus of >+2.00D diopter from the center to the periphery of the retinal line of sight; in another scenario, when the environmental rangefinder senses that the environmental depth is 6m, the system adjusts the VFE to produce a crystal accommodation stimulation of -2.67D diopter (about 37.5cm near object simulation focal length), so as to produce a more ideal (>+2.50D) diopter myopic defocus.

[0068] 6. Defocus optimization in natural environment:

[0069] Existing defocus products cannot effectively use the light in the natural environment to stimulate the retina, especially for users who use electronic devices at close range for a long time, the optical stimulation of the peripheral retina is insufficient. The present invention combines a transparent display with background light to allow light in the natural environment (such as long-distance background light in an open environment) to enter the eyeball, increase the myopic defocus stimulation in the peripheral and peripheral areas of the retina, and effectively inhibit the excessive growth of the eye axis. This innovative design greatly enhances the application effect of the system in a natural environment.

[0070] 7. Simplified system solution:

[0071] In the prior art, the design of optics such as multi-focal planes is complex and difficult to adjust the diopter of different areas, which limits the diversity of application scenarios. The present invention greatly simplifies the threshold for controlling the eye axis using defocus. For example, the application of VEF integrated design can be manual focus (adjusted according to the user's actual environment). Under fixed virtual near object stimulation, background light can still be used to produce effective retinal global myopic defocus. It further reduces the cost of technical implementation, helps popularize products in society, and improves the flexibility of the system and user experience. Among them, the Equivalent Defocus Stimulation Index (EDSI) solution can establish effective monitoring indicators for the coordinated management of various variables.

[0072] Furthermore, in the configuration of the EDSI algorithm, the simulated diopter of the adjusted macular focus beam AFFB and the distant background beam NDBB is used as the basic calculation basis. The control of each module is converted into the equivalent defocus stimulation index (EDSI) in the algorithm as a quantifiable evaluation standard. The higher the EDSI, the better the optical stimulation effect of controlling the eye axis, which can be used in content control and eye environment evaluation. The EDSI index calculation method is: EDSI = k*F*A*E

[0073] Wherein k is a constant value; F is the difference between the VFE-adjusted stimulus amount and the environmental depth after conversion into diopter, namely, the NDBB-AFFB defocus amount; A is the inverse value of the final total AFFB area under the visual field ratio control module; E is the energy ratio NDBB / AFFB, the energy value of NDBB is E, and its control method can be the strobe mask amount or opaque mask amount of the above-mentioned filter mask and other previously known methods.

[0074] 8. Adaptability to user environment:

[0075] Traditional myopia prevention and control products are difficult to adapt to the problem of modern users using them in complex multimedia scenarios (such as watching electronic screens for a long time). The present invention uses a system control method and a dynamic defocus design that combines virtual content and natural background light, which is particularly suitable for users to use in multimedia and digital environments. The method can automatically adjust the focal length and light transmittance according to the user's use environment, ensuring that effective myopia prevention and control can be maintained even when using electronic devices for a long time.

[0076] In general, the present invention significantly improves the myopia prevention and control effect through multiple technical means such as transparent display technology, dynamic zoom control, background light regulation and system intelligent integration. It is especially suitable for users who use their eyes for a long time at close range in modern life.

[0077] The specific technical solutions of the present invention are as follows:

[0078] The present invention proposes a transparent display system based on retinal myopic defocus. Combining augmented reality (AR), mixed reality (MR) and digital display devices, through the dynamic combination of virtual content and natural environment background light, when users watch at close range, the mid-periphery and peripheral areas of the retina produce continuous myopic defocus, inhibiting excessive eye axis growth. The system provides an effective solution that takes into account both visual clarity and long-term myopia control, and is suitable for a variety of applications such as portable devices and educational scenarios.

[0079] The technical keywords in the present invention are as follows:

[0080] 1. Natural Distant Background Beam (NDBB).

[0081] 2. Adjusted Foveal Focusing Beam (AFFB).

[0082] 3.AFFB / NDBB field of view ratio adjuster

[0083] 4.AFFB / NDBB total energy ratio regulator

[0084] 5. Equivalent Defocus Stimulation Index (EDSI)

[0085] 6. Myopic Defocus

[0086] 7. Variable Focus Element (VFE)

[0087] 8. Electrochromism Technology (EC)

[0088] 9. Peripheral and Mid-Peripheral Retinal Defocus

[0089] 10. Crystalline Lens Near Accommodation

[0090] 11. Equivalent Total Natural Distant Background Beam Energy (ETNDBBE)

[0091] 12. Accommodative Response induced by the VFE module (TAR-VFE)

[0092] The key technical solutions of the present invention are as follows:

[0093] 1. Application of transparent display technology: Through the transparent display, the system can simultaneously present virtual content and allow natural light from the outside to penetrate. When the user watches virtual content at a close distance, the eyes can receive the distant background light from the real world, thereby generating the necessary optical defocus stimulation on the retina.

[0094] like Figure 1 As shown in the figure, the direct relationship diagram of the optical function modules of the system to realize the myopic defocusing technology solution in the eyeball is shown, 14 is the eyeball; the natural light 15 from the real distant scene is NDBB, the transparent display 12 controlled by the system displays the virtual content, and the light beam 16 emitted by it is the AFFB formed by the adjustment of the human eye lens, among which 13 is the optical module responsible for inducing the adjustment of the crystal to produce AFFB by VFE. After the crystal has an adjustment reaction, while the eyeball crystal and the brain focus on watching the content of 12, the NDBB enters the eye from a relatively long distance, and the optical focal length will converge in front of the retina, and a myopic defocusing focal point will appear, and its absolute value is the difference (absolute value) of AFFB minus NDBB, and the unit is diopter (D). And 11 is the module of the energy control mask of NDBB, which can be an EC liquid crystal filter with adjustable transmittance, or a means of directly controlling the brightness / saturation / brightness of the background of the content picture 12.

[0095] According to optical principles, the reciprocal of the physical distance of the environment is the diopter (D for short), and its formula is directly related to the focal length: D = 1 / f, where f is the physical distance of the environment (in meters, English abbreviation m). Furthermore, based on a large number of previous experiences in actual human clinical research on retinal myopic defocus stimulation, it is known that the most suitable myopic defocus control value for controlling the growth of the myopic eye axis is known, and the technical solution can be designed to produce the defocus difference of AFFB and NDBB in the system operation. The design expected control range can be from +0.00D to +10.00D of the defocus amount. The linkage control of the actual physical space distance environment and the diopter of the VFE module can be established through the known publicly published clinical reports. In other words, the VFE module generates an appropriate optical focal length for inducing lens accommodation. The control of the system's allocation of VFE data operations must comply with the natural physiological characteristics of near accommodation of the human eye. The basis for data control can be based on a large number of previous clinical vision research experiences (for example, one of the articles Harb, Elise, Frank Thorn, and David Troilo. "Characteristics of accommodative behavior during sustained reading in emmetropes and myopes." Vision Research 46.16 (2006): 2581-2592.), as is known, for a focal distance of about 0.25m to 0.4m, the lens ciliary muscle system needs to produce an accommodation amount of +2.5D to +4.0D for close-range accommodation. If the lens accommodation amount produced by the AFFB is allowed to remain in this range for a long time, it is very easy to induce visual fatigue. Therefore, in the above-mentioned parameter control case, the system can be used to control the VFE module to generate virtual content to simulate the accommodation amount boundary induced by close-range focal length, and establish a more optimized target lens near accommodation amount induced by the VFE module (Accommodative Response induced by the VFE module, TAR-VFE). After adjustment, the upper limit is +2.0D to +2.75D, but it actually needs to be adjusted according to comprehensive conditions such as individual visual physiology. The application details of such clinical parameter technical adjustment are not within the scope of the technology of the present invention.

[0096] Further, using Fig.11To illustrate, 120 is the intensity value of TAR-VFE (in diopters D), 122 is the actual physical distance of the environment that generates NDBB, and 121 is the TAR-VFE control curve. Among them, 121 is within the distance of 0.2m to 0.8m of the actual physical background space, such as a small indoor environment. In fact, it is difficult to generate an effective NDBB, which belongs to the close-range eye space. At this time, the system commands the VFE module to control TAR-VFE to 0D and relax the ciliary muscle as much as possible. When the environmental rangefinder senses the environmental depth of 6m, the system adjusts the VFE to generate -2.00D diopters, and then the curve gradually flattens to avoid visual fatigue. Among them, the actual control inducing basis for calling the physical space distance environment and the diopter linkage control of the VFE module can be a call from a database, and the database can be completed through the existing known AI artificial intelligence machine learning or table lookup method or mathematical formula means in statistics.

[0097] AFFB / NDBB field of view ratio regulator, such as Figure 2 As shown, in addition to the above-mentioned VFE control, under the further control of the system, the area of ​​virtual content in the field of view is controlled, the total field of view of the human eye p is constant, and the virtual picture c, when the system controls the virtual content area to shrink from c to c', the corresponding area difference of pc is even greater. Further, the area of ​​the 601 light beam AFFB emitted by the virtual picture c is correspondingly changed to a smaller 602 light beam AFFB, so that the original 701 NDBB light beam becomes more 702 NDBB entering the eye.

[0098] like Figure 3 As shown, it further illustrates the picture seen by the human eye. Within the display screen fixed in front of the eyes, the virtual target body 201 is reduced and moved to 203 under the control of the system, and the center of the eye's sight follows it, and the area of ​​the NDBB area with a large defocus amount changes from 202 to a larger 204.

[0099] 2. Dynamic zoom of virtual content: The control system uses VFE to control the focal length of the virtual content to the eye based on the dynamic adjustment of the field of view and the target near accommodation amount (TAR-VFE) induced by the VFE module mentioned above. The size of the virtual content display area is controlled by pixel units, translucency control mode, etc., and ensures that the area within the range of 1° to 30° in the center of the fine visual field in medical theory falls on the virtual content to be viewed, maintaining clear imaging. At the same time, when the lens is in a relaxed state of accommodation, the VFE zoom module provides an additional refractive power between -5.00D and -0.33D to induce physiological near accommodation of the lens to form AFFD, while producing NDBB myopic defocus in the peripheral and peripheral areas of the retina. Figure 4As shown in the figure, it is further explained how the virtual content with the word as the unit defines the distribution of the AFFB and NDBB focal length areas, and the human eye reads the text scene through this system. The word King of the virtual content 103 is in the AFD area generated by the human eye to concentrate on reading the letters. 101 is the eye movement target ROI area monitored by the system. The user is reading the letter K, where 102 is the gap between the letters, and the secondary area is also the NDBB area. 104 is the display area that can be displayed and dimmed; 105 is the area except for display and dimming.

[0100] 3. Dynamic control of background light, adjustment of the total energy ratio of AFFB / NDBB: After processing by the control center based on the above-mentioned equivalent total distant background beam energy ETNDBBE and equivalent defocus stimulus index EDSI, such as Figure 5 As shown, using electrochromic technology (EC) or other filter modules or the above Figure 1 The system dynamically controls the amount of background light entering the eye through the functional integration of 11 and 12. This regulation ensures the contrast between virtual content and real-world light, and at the same time, by changing the flicker frequency or transmittance, ensures that the retina receives sufficient defocus stimulation to optimize the visual experience and image quality. Figure 4 , the virtual object is 501. In order to cope with the background optical interference of the environment that affects the viewing experience, and to increase the content contrast, the background light in the NDBB area is low, 502. However, when the user moves from a strong sunlight environment to a place where the sunlight is slightly shaded, during the display process, the system can further issue instructions to reduce the flash frequency of the filter mask in the NDBB area or increase the transmittance, and the NDBB area changes from 502 to 504, allowing more NDBB to enter the eye. This is also one of the coordination examples of the system based on the equivalent defocus stimulus index EDSI value.

[0101] 4. Adjustment of defocus range: In addition to the above-mentioned precise control scheme of the defocus optical energy of the retina to cope with different visual field areas (equivalent total distant background beam energy ETNDBBE and equivalent defocus stimulus index EDSI, etc.), the system controls the focal length difference between the virtual content and the NDBB background light through the zoom module. In the center of gaze area, the virtual content maintains the emmetropization focal length under AFFB to ensure image clarity; in the mid-peripheral and peripheral areas of the retina, the focal length difference between the virtual content and the NDBB background light is controlled within a range greater than +0.00D, preferably within the range of +0.00D to +10.00D (the commonly used defocus amount can be +0.50D to +5.00D, and is actually personalized according to individual differences), forming a stable myopic defocus stimulus. At the same time, this defocus effect can also work together with the emmetropization focal length of some virtual content in the same area of ​​the retina.

[0102] 5. Use in natural open environments: In open environments, the system ensures that the user's eyes can continuously receive the stimulation of the long-distance background light of natural sunlight, enhancing the myopic defocus signals of the mid-peripheral and peripheral retina, thereby inhibiting the excessive growth of the eye axis and effectively controlling the development of myopia.

[0103] Furthermore, Example 1 is used to illustrate how the entire system is integrated and implemented.

[0104] Embodiment 1:

[0105] like Figure 6 The case shown illustrates the usage scenario of the AR / MR / XR display implanted in Birdbath and how the whole system works. The central control system 802 of the present invention is equipped with a control logic core based on ETNDBBE and EDSI values. Using environmental distance measurement technology means (environmental rangefinder) such as 801 infrared light / laser, an emmetropic eye (or an eye that has corrected myopia through optical lenses or surgery) will follow the VFE module 807 controlled by 802 in the near adjustment response of the lens in order to see the virtual image displayed by 808 clearly. For example, when the environmental rangefinder senses that the physical distance depth of the real background environment 804 is 6m far away, the focal length of the virtual image is provided, that is, calculated through the system controller to adjust the generated 807. -2.67D diopter (about 37.5cm near object simulated focal length) adjustment stimulation, let 810 light beam emitted by 808 be reflected by 806 spectroscopic mirror and then be adjusted by crystal near to produce AFFB and converge on the retina, and 805 is an adjustable light shielding filter module to help virtual content to set off the contrast under strong light, it will filter and weaken 809 NDBB, at this time 810 and 809 enter the eye at the same time, produce 811 myopic defocus difference in the eye, and generate a signal to reduce the growth of the eye axis. Through these steps, the control system of the present invention ensures that in the case of long-term close-range eye use, the user's eyeball can effectively delay the growth of the eye axis through dynamic optical defocus stimulation and reduce the progression of myopia.

[0106] In summary, the technical solution of the present invention adopts existing mature display technology and optical technology, can more effectively realize retinal myopic defocus, and calls the VFE zoom solution corresponding to the dynamic sensing environment. It uses the environmental sensing distance technology. Technically speaking, the line of sight difficulty is also much lower than the eye tracking technology, and the implementation scene is simple, and the technical solution can be directly implemented on the electronic display.

[0107] At the same time, the present invention uses a natural electronic display screen light source combined with natural light, combined with the retinal defocus difference generated by stimulating the near accommodation of the lens, and the solution adopted is natural and comfortable. Figure 6 illustrate:

[0108] 1. How does the control module that induces near accommodation of the eyeball control the zoom module VFE? First, the 801 environmental space distance sensor detects the depth of the user's environmental space, then calls the near reading optical focal length stimulus of the eyeball, and uses the zoom module VFE to dynamically adjust the display focal length of the virtual content to induce a natural accommodation response.

[0109] The control module for inducing near accommodation of the eyeball further comprises:

[0110] (a) a sensor 801 for capturing the depth distance of the environment where the user's eyes are located;

[0111] (b) A real-time computing model calculates the focal length adjustment required to induce the user's eyeball accommodation through the 802 central control system master program using the above sensor data, and dynamically adjusts the focal length of the displayed content based on the distance between the user and the virtual object.

[0112] 3. The visual field ratio control module (AFFB / NDBB visual field area ratio regulator) adjusts the total area ratio of virtual content in the user's visual range in real time according to the characteristics of the multimedia content watched by the user, ensuring that the content is always in a certain optimal adaptation ratio;

[0113] The field of view proportion control module has a certain optimal adaptation ratio, which dynamically adjusts the field of view area of ​​the multimedia content according to the following factors. In principle, the smaller the proportion of the area of ​​the virtual content in the full field of view, the better, that is, the smaller the AFFB, the better, and the ratio of AFFB / NDBB is also the smaller the better:

[0114] (a) When the content viewed by the user is text, animation, or mixed content, the virtual content analyzer used in the calculation of the equivalent total distant background beam energy (ETNDBBE) is used to determine the visual AFFB and NDBB field area ratio in real time, or the AFFB and NDBB field area ratio is pre-loaded and defined, without the need for a virtual content analyzer to determine;

[0115] (b) the interactive requirements of virtual content and the user’s task priorities;

[0116] (c) The relative position relationship between the visual field that the user's ROI may reach and the multimedia content.

[0117] (d) Provides user customization options to manually adjust the optical focal length of virtual content to meet individual needs.

[0118] 4. The background filter control module (physical terminal optical module controlled by the AFFB / NDBB total energy ratio regulator) can analyze the user's current line of sight and the NDBB information behind the virtual environment through the ambient brightness sensing module, and dynamically adjust the background filter intensity. For example, when the environment is brighter, the filter mask module is automatically adjusted to reduce the background light and improve the user's visual contrast clarity of the virtual content screen. In principle, the equivalent total NDBB is increased as much as possible without affecting the contrast of the virtual screen.

[0119] Furthermore, the background filter control module adjusts the filter energy in the following manner:

[0120] (a) Regional filter mask adjustment: Analyze the ROI that the user is viewing and lower the filter intensity of NDBB in the 1-15° visual field area near the ROI virtual object, so that the equivalent total distant background beam energy ETNDBBE in the full visual field will not decrease too much, ensuring the stability of the full retinal defocus stimulation;

[0121] (b) According to the format of the virtual content that the user is watching and the equivalent total NDBB mentioned above, the NDBB filter intensity of each area in the field of view is adjusted, but it can be linked to the area size control of the virtual content. The specific relationship is the product of light energy and the area of ​​the virtual object, which can be obtained based on the calculation and control method of the equivalent total NDBB mentioned above.

[0122] like Figure 5 As shown, within the fixed display screen area 502 and 504, the virtual target body 501 does not change under the control of the system. The energy luminance and focal length of 503 are the same as 502, while 504 changes, reducing the force transparency or strobe mask, so that the NDBB large defocus difference signal per unit time can stimulate the retina more in the unit time, but at the same time, the image contrast is reduced, which will sacrifice the image quality. The control function of the equivalent total distant background beam energy ETNDBBE or EDSI can take the method of calling the defocus control data to stimulate more near accommodation, or as Figure 3 Reduce the main content area (the content theme changes from 201 to 203) so that 504 does not need to reduce the filter mask so much, which affects the image quality contrast.

[0123] (b-1) If the virtual content analyzer identifies that the content is in a text reading mode, in order to allow the user to read more comfortably, the intensity of the NDBB is reduced, and the natural real background image that penetrates into the eye is reduced to interfere with reading, but at the same time the area of ​​the NDBB is increased. Specifically, the increase can be made by making the reading target such as the font smaller and the strokes thinner so that the font width in the fixation ROI active area is reduced by 5% to 60%;

[0124] (b-2) There is another situation, such as the virtual content analyzer identifies that the content being watched is a dynamic video, that is, the background and the ROI position of the eyeball are constantly changing, the brightness of the picture content can be dynamic and flickering, and it is presented in different local visual field areas, which becomes difficult to calculate. At this time, in order to reduce the delay of the electronic system processor calculation or the energy consumption of the image processing control optical system, according to the area where the ROI is located, the overall and local visual field NDBB filter values ​​are adjusted at the same time, rather than the virtual object brightness and NDBB filter of the local visual field region. Further, in short, the system can complete the myopic defocus stimulation of the dynamic image of the eyeball by loading the pre-set virtual object visual field ratio and energy control data based on the above-mentioned ETNDBBE and EDSI-based control strategy.

[0125] (c) Provide user customization options to manually adjust the filter range and intensity to meet individual needs.

[0126] 5. The multimedia visual assistance control system based on myopic defocus also includes a user eye tracking module, which estimates the user's ROI area in the display screen by monitoring the direction of eye movement, and provides appropriate AFFB / NDBB energy and field of view area ratio in a timely manner.

[0127] Embodiment 2:

[0128] Another embodiment of the present invention is as follows: Figure 7 As shown, the eyeball produces a defocus difference when viewing a single virtual object, and the long-distance light beams of the real-world background can simultaneously reach the eyeball through the transparent background.

[0129] 904 is the real world background, 905 is a single virtual object, 906 is the image superimposed on the retina, that is, what the user can actually see in the field of vision. 907 is the focal length of the long-distance natural background light beam emitted from 904, 909 is the focal length of the light beam emitted by the virtual object 905, and 908 is the myopic defocus difference produced by 907 and 909, which stimulates the slowing down of the eye axis development.

[0130] Embodiment 3:

[0131] Another embodiment of the present invention is as follows: Figure 8 As shown, the eyeball views multiple virtual objects, and the long-distance light beams of the real world background are simultaneously transmitted to the eye through the transparent background between the virtual objects.

[0132] 910 is the real world background, 911 is multiple virtual objects, 912 is the image superimposed on the retina, that is, what the user can actually see in the field of vision. The size and area of ​​the object 911 can be in pixels. 907 is the focal length of the long-distance natural background light beam emitted from 910, 909 is the focal length of the light beam emitted by the multiple virtual objects 911, and 908 is the myopic defocus difference produced by 907 and 909, which stimulates the slowing down of the eye axis development.

[0133] Embodiment 4:

[0134] Another embodiment of the present invention is as follows: Fig. 9 As shown, the eyeball views multiple virtual objects, and the long-distance light beams of the real world background are simultaneously transmitted to the eye through the transparent background between the virtual objects.

[0135] 913 is the real world background, 914 is the multiple virtual objects combined with 915 background light energy control mask, the mask can be controlled by strobing or transparency, 916 is the image superimposed on the retina, that is, what the user can actually see in the field of vision. The size and area of ​​the object 914 can be in pixels. 907 is the focal length of the long-distance natural background light beam emitted from 914 after being adjusted by 195, 909 is the focal length of the light beam emitted by 911 multiple virtual objects, and 908 is the myopic defocus difference produced by 907 and 909, which stimulates the slowing down of the eye axis development.

[0136] Further, such as Fig.10 As shown, the system can introduce eye-tracking technology. In the aforementioned 913 corresponding to the brain perception background image 917, combined with the aforementioned 914 and 915 corresponding to the brain perception background image, an overall picture is formed, and the eyeball rotates to read or watch a specific 920 virtual content target, that is, the ROI in the field of view (FOV). No matter how the eyeball rotates, as long as the center of sight always falls on any multiple virtual targets, the continuous 923 AFFB will be constantly given to the retina. At the same time, the real world background light around the ROI will be used as the NDBB of the paracentral beam 922 to form a myopic defocus point around the retina in the eyeball, forming an image shell 921 to help delay the growth of the eye axis. With the help of eye tracking to deal with the ROI, the system can give a constant ROI area image that is always fixed in front of the eyes as the eyeball rotates, and continuously give NDBB myopic defocus point stimulation to the paracentral visual area outside the 1° to 10° fine visual central perception area.

[0137] In a specific implementation, the present application provides a computer storage medium and a corresponding data processing unit, wherein the computer storage medium can store a computer program, and when the computer program is executed by the data processing unit, the invention content of a multimedia visual assistance control system based on myopia defocus provided by the present invention and some or all of the steps in each embodiment can be run. The storage medium can be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0138] Those skilled in the art can clearly understand that the technical solutions in the embodiments of the present invention can be implemented by means of computer programs and their corresponding general hardware platforms. Based on such an understanding, the technical solutions in the embodiments of the present invention can be essentially or partly contributed to the prior art in the form of computer programs, i.e., software products, which can be stored in a storage medium and include several instructions for enabling a device including a data processing unit (which can be a personal computer, a server, a single-chip microcomputer, an MCU or a network device, etc.) to execute the methods described in various embodiments of the present invention or certain parts of the embodiments.

[0139] The present invention provides a multimedia visual assistance control system based on myopia defocus. There are many methods and ways to implement the technical solution. The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention. These improvements and modifications should also be regarded as the protection scope of the present invention. All components not specified in this embodiment can be implemented by existing technologies.

Claims

1. A multimedia visual assistance control system based on myopia defocus, characterized in that: include: A virtual content display module and a virtual content control module; wherein, The virtual content display module is used to display virtual content on the user's eyeballs; The distant background light beam passes through the virtual content display module and then enters the user's eyeball; The virtual content control module adjusts the focus position of the virtual content so that when the user looks at the virtual content, the distant background light beam generates myopic defocus.

2. A multimedia visual assistance control system based on myopia defocus according to claim 1, characterized in that: The virtual content display module uses a transparent display device to emit light and displays virtual content on the user's eyeballs, while transmitting distant background light beams to the user's eyeballs.

3. A multimedia visual assistance control system based on myopia defocus according to claim 1, characterized in that: The virtual content control module includes: The zoom module zooms the light emitted by the transparent display device to generate an adjusted macular area focused light beam to display virtual content on the user's eyeball.

4. A multimedia visual assistance control system based on myopia defocus according to claim 3, characterized in that: The zoom module forms an adjusted macular area focused beam and simultaneously causes the distant background beam to produce myopic defocus in the peripheral and peripheral areas of the retina, and the defocus difference between the adjusted macular area focused beam and the distant background beam is set to a defocus amount greater than +0.00D.

5. A multimedia visual assistance control system based on myopia defocus according to claim 4, characterized in that: The virtual content control module further includes: The visual field proportion control module is used to adjust the total area proportion of the virtual content in the user's visual range.

6. A multimedia visual assistance control system based on myopia defocus according to claim 5, characterized in that: The system further comprises: The virtual content analyzer is used to analyze the type, attributes and interaction requirements of the currently displayed virtual content. The analysis results provide a basis for the field of view proportion control module to adjust the total area proportion of the virtual content in the user's visual range. The adjustment goal is to minimize the proportion of the area of ​​the currently displayed virtual content in the full field of view.

7. A multimedia visual assistance control system based on myopia defocus according to claim 6, characterized in that: The system further comprises: Sensor module and background filter control module, wherein: The sensor module is used to sense the sensing data of the space where the user is located; The background light filtering control module is used to adjust the brightness information relationship between the virtual content and the ambient light according to the sensing data.

8. The multimedia visual assistance control system based on myopia defocus according to claim 7, characterized in that: The background filtering control module is adjusted based on the equivalent total distant background beam energy ETNDBBE, which is calculated as follows: ETNDBBE=VOFA*BGE-(MA*OD(%)*BGE)-VOA*VOE Among them, VOFA is the total area of ​​the full field of view; BGE is the brightness energy value of the distant ambient light measured by the sensor module; MA is the area of ​​any mask shape provided by the background filter control module; OD is the filter degree; VOA is the area of ​​the displayed virtual content; VOE is the brightness energy value of the displayed virtual content; The adjustment goal is to maximize the equivalent total distant background light beam energy ETNDBBE entering the eyeball.

9. The multimedia visual assistance control system based on myopia defocus according to claim 8, characterized in that: The method for adjusting the virtual content by the virtual content control module further includes: The equivalent defocus stimulation index EDSI is defined as follows: EDSI=k*F*A*E Wherein, k is a constant value; F is the difference between the stimulus amount adjusted by the zoom module and the environmental depth converted into diopter, i.e., the defocus amount of the distant background beam and the adjusted macular area focused beam; A is the inverse value of the total area of ​​the adjusted macular area focused beam adjusted by the visual field proportion control module; E is the energy proportion of the distant background beam and the adjusted macular area focused beam; The equivalent defocus stimulation index EDSI is used as an evaluation standard, that is, the maximization of the equivalent defocus stimulation index EDSI is used as an adjustment target, and the virtual content control module is used to adjust the virtual content.

10. The multimedia visual assistance control system based on myopia defocus according to claim 9, characterized in that: The system further comprises: Eye tracking module, used to monitor the user's eye movements and predict the user's region of interest (ROI); The virtual content regulation module further adjusts the virtual content according to the region of interest ROI predicted by the eye tracking module; According to the user's region of interest ROI predicted by the eye tracking module, the field of view proportion control module is used to adjust the total area proportion of the virtual content in the user's visual range, and the background filtering control module is used to adjust the brightness information relationship between the virtual content and ambient light.

Images