Eye state adjustment information generation method based on AR glasses, AR glasses and medium

Abstract

The embodiment of the invention discloses an eye state adjustment information generation method based on AR glasses, the AR glasses and a medium. A specific embodiment of the method comprises the following steps: acquiring eye state parameters of a user wearing the corresponding AR glasses; interaction content corresponding to the eye state parameters is loaded in the AR glasses, the interaction content has differentiated display content when being displayed on a left eye display module and a right eye display module, and the interaction content has a changing visual focus for the wearer; in response to determining that the interaction content meets a preset loading ending condition, obtaining an updated eye state parameter of the wearing user; and according to the eye state parameters and the updated eye state parameters, generating eye state adjustment information corresponding to the wearer. According to the embodiment, when the user trains the eyesight, a special myopia training optimization instrument is not needed, the weight of the equipment is reduced, and the equipment is convenient to carry.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to the field of AR technology, and in particular to a method for generating eye state adjustment information based on AR glasses, AR glasses, and a medium. Background Art

[0002] As the use of electronic products increases, more and more users are experiencing vision problems caused by eye fatigue. At present, the commonly used method to alleviate vision loss caused by eye fatigue is to wear a special myopia training optimization instrument.

[0003] However, the inventors have found that when the above method is adopted, the following technical problems often occur: the dedicated myopia training and optimization instrument is usually bulky and difficult to carry.

[0004] The above information disclosed in this Background section is only for enhancement of understanding of the background of the inventive concept and therefore it may contain information that does not form the prior art that is already known in this country to a person of ordinary skill in the art. Summary of the invention

[0005] The content of this disclosure is used to introduce concepts in a brief form, which will be described in detail in the detailed implementation section below. The content of this disclosure is not intended to identify the key features or essential features of the technical solution claimed for protection, nor is it intended to limit the scope of the technical solution claimed for protection.

[0006] Some embodiments of the present disclosure propose an eye state adjustment information generation method based on AR glasses, AR glasses, and computer-readable media to solve one or more of the technical problems mentioned in the above background technology section.

[0007] In a first aspect, some embodiments of the present disclosure provide a method for generating eye state adjustment information based on AR glasses, which is applied to AR glasses. The AR glasses include two display modules, corresponding to the left eye and the right eye of the user respectively. The method includes: obtaining eye state parameters corresponding to the user wearing the AR glasses; loading interactive content corresponding to the eye state parameters in the AR glasses, the interactive content having differentiated display content when displayed on the left eye and the right eye display modules, so that the interactive content has a changing visual focus for the wearing user; in response to determining that the interactive content meets a preset loading end condition, obtaining updated eye state parameters of the wearing user; generating eye state adjustment information corresponding to the wearing user according to the eye state parameters and the updated eye state parameters.

[0008] Optionally, the AR glasses include an eye tracking sensor; and the obtaining of eye state parameters corresponding to the user wearing the AR glasses includes: obtaining eye movement information of the user wearing the AR glasses through the eye tracking sensor, wherein the eye state parameters include the eye movement information.

[0009] Optionally, the AR glasses include a pupil measurement device; and the step of obtaining eye state parameters corresponding to the user wearing the AR glasses includes: obtaining, by means of the pupil measurement device, various pupil sizes of the pupils of the user wearing the AR glasses under various light illuminations, wherein the eye state parameters include various pupil information, and each pupil information includes a pupil size and a corresponding light illumination.

[0010] Optionally, the above-mentioned acquisition of eye state parameters corresponding to the user wearing the above-mentioned AR glasses includes: executing the following vision test steps: displaying vision test information in the above-mentioned AR glasses; detecting feedback information of the above-mentioned wearing user corresponding to the above-mentioned vision test information; in response to determining that the currently displayed vision test information does not meet the preset test end conditions, executing the above-mentioned vision test steps again; in response to determining that the currently displayed vision test information meets the above-mentioned preset test end conditions, generating a vision test result according to each feedback information detected, wherein the above-mentioned eye state parameters include the above-mentioned vision test result.

[0011] Optionally, the above-mentioned displaying of vision test information in the above-mentioned AR glasses includes: modeling the environment around the user in the above-mentioned AR glasses to form a mixed reality space; and displaying the vision test information at a set test distance in the mixed reality space in the above-mentioned AR glasses.

[0012] Optionally, the above-mentioned displaying of vision test information in the above-mentioned AR glasses includes: determining the vision test information corresponding to the current vision test step; adjusting the above-mentioned vision test information according to various feedback information from previous detections to update the vision test information; and displaying the updated vision test information in the above-mentioned AR glasses.

[0013] Optionally, the above-mentioned loading of the interactive content corresponding to the above-mentioned eye state parameters in the above-mentioned AR glasses includes: determining each scene element included in the above-mentioned interactive content; determining the motion information of each of the above-mentioned scene elements; and loading the above-mentioned scene elements in the mixed reality space of the above-mentioned AR glasses according to the respective motion information corresponding to the above-mentioned scene elements.

[0014] Optionally, the method further comprises: storing the above-mentioned eye state parameters and the above-mentioned updated eye state parameters.

[0015] Optionally, the method also includes: in response to detecting that the duration of the AR glasses using the standard mode meets a preset duration condition, configuring the AR glasses to an eye adjustment mode; and loading preset three-dimensional playback content into the AR glasses.

[0016] Optionally, the AR glasses are AR glasses with adjustable refractive power; and the obtaining of eye state parameters corresponding to the user wearing the AR glasses includes: in response to receiving a target refractive power configured by the wearing user, determining the target refractive power as the eye state parameter, and adjusting the refractive power of the AR glasses to the target refractive power.

[0017] In a second aspect, some embodiments of the present disclosure provide an AR glasses, comprising: one or more processors; a storage device on which one or more programs and interactive content are stored, and two display modules, corresponding to the left and right eyes of a user, respectively, for displaying the above-mentioned interactive content, and the above-mentioned interactive content has a changing visual focus when displayed by the above-mentioned two display modules; when the above-mentioned one or more programs are executed by the above-mentioned one or more processors, the above-mentioned one or more processors implement the method described in any implementation manner of the first aspect.

[0018] In a third aspect, some embodiments of the present disclosure provide a computer-readable medium having a computer program stored thereon, wherein when the program is executed by a processor, the method described in any implementation manner of the first aspect is implemented.

[0019] The above-mentioned embodiments of the present disclosure have the following beneficial effects: through the eye state adjustment information generation method based on AR glasses of some embodiments of the present disclosure, when the user trains vision, there is no need for a dedicated myopia training optimization instrument, and the weight of the equipment is reduced, which is easy to carry. Specifically, the reason for the difficulty in carrying is that the dedicated myopia training optimization instrument is usually bulky and not easy to carry. Based on this, the eye state adjustment information generation method based on AR glasses of some embodiments of the present disclosure, first, obtains the eye state parameters of the user wearing the above-mentioned AR glasses. Thus, the eye state parameters of the wearing user before watching the interactive content can be directly obtained through the AR glasses. Then, the interactive content corresponding to the above-mentioned eye state parameters is loaded in the above-mentioned AR glasses, and the above-mentioned interactive content has differentiated display content when the display modules of the left eye and the right eye are displayed, so that the above-mentioned interactive content has a changing visual focus for the above-mentioned wearing user. Thus, the user wearing the AR glasses can watch the interactive content adapted to his eye state. Secondly, in response to determining that the above-mentioned interactive content meets the preset loading end condition, the updated eye state parameters of the above-mentioned wearing user are obtained. Thus, the eye state parameters of the wearing user can be obtained again after the interactive content ends display. Finally, according to the above-mentioned eye state parameters and the above-mentioned updated eye state parameters, the eye state adjustment information corresponding to the above-mentioned wearing user is generated. Thus, the generated eye state adjustment information can characterize the adjustment of the eye state of the wearing user after watching the interactive content. Also because the interactive content watched by the wearing user has differentiated display content when displayed by the display modules of the left eye and the right eye, the above-mentioned interactive content can have a changing visual focus for the above-mentioned wearing user to achieve vision training. Also because AR glasses are not dedicated myopia training optimization instruments, they can be worn directly on the user's head, are light in weight, and are easy to carry. Therefore, when the user trains vision, there is no need for a dedicated myopia training optimization instrument, and the weight of the equipment is reduced, which is easy to carry. Also because AR glasses can present a mixed reality space that integrates virtual and real scenes to users, different training scenes can be customized for users based on different real spaces, which improves the diversity and fun of the entire training, and can be customized for different users. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that components and elements are not necessarily drawn to scale.

[0021] Figure 1 is a flowchart of some embodiments of a method for generating eye state adjustment information based on AR glasses according to the present disclosure;

[0022] Figure 2 is a schematic diagram of an application scenario of the method for generating eye state adjustment information based on AR glasses according to the present disclosure;

[0023] Figure 3 It is a schematic diagram of the structure of AR glasses suitable for implementing some embodiments of the present disclosure. DETAILED DESCRIPTION

[0024] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0025] It should also be noted that, for ease of description, only the parts related to the invention are shown in the drawings. In the absence of conflict, the embodiments and features in the embodiments of the present disclosure can be combined with each other.

[0026] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0027] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0028] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0029] With regard to the collection, storage, and use of user personal information (such as eye status parameters) involved in this disclosure, before performing the corresponding operations, the relevant organizations or individuals shall fulfill their obligations, including conducting personal information security impact assessments, fulfilling the obligation to inform the personal information subject, and obtaining the authorization and consent of the personal information subject in advance.

[0030] The present disclosure will be described in detail below with reference to the accompanying drawings and in conjunction with embodiments.

[0031] Figure 1The process 100 of some embodiments of the method for generating eye state adjustment information based on AR glasses according to the present disclosure is shown. The method for generating eye state adjustment information is applied to AR glasses, and the AR glasses include two display modules, corresponding to the left eye and the right eye of the user respectively. The method includes the following steps:

[0032] Step 101: Obtain eye state parameters of a user wearing the corresponding AR glasses.

[0033] In some embodiments, the execution subject (e.g., a server) of the eye state adjustment information generation method may obtain eye state parameters corresponding to the user wearing the above-mentioned AR glasses. Among them, the above-mentioned AR glasses may be a device worn on the user's head so that the user can view the displayed content. The above-mentioned AR glasses may be one-piece glasses or split glasses. The above-mentioned AR glasses may also be anti-blue light glasses. The above-mentioned two display modules may be two display screens. Here, the display screen may be a micro display screen, which may be used in conjunction with optical elements to enable the user to view three-dimensional display content. The above-mentioned eye state parameters may be parameters related to the eye state of the wearing user measured by AR glasses. In practice, the above-mentioned execution subject may obtain the latest eye state parameters of the above-mentioned wearing user. The eye state parameters may include, but are not limited to, at least one of the following: diopter, pupil size, intraocular pressure, corneal curvature, corneal topography.

[0034] Optionally, the AR glasses described above may include an eye tracking sensor.

[0035] In some optional implementations of some embodiments, the execution subject may obtain the eye movement information of the user wearing the wearable device through the eye tracking sensor. The eye movement information may be relevant information for recording the eye movement process. The eye movement information may include movement information corresponding to the left eye and the right eye, respectively. The movement information may include an eye movement trajectory. The eye movement trajectory may include a gaze point information sequence. Each gaze point information may include, but is not limited to: gaze point position, gaze duration. The eye movement information may be used as a parameter in the eye state parameter. The eye state parameter includes the eye movement information. Thus, the eye movement of the user wearing the wearable device may be monitored.

[0036] Optionally, the AR glasses include a pupil measurement device. The pupil measurement device may include a camera. The camera may be used to measure pupil size. The pupil measurement device may also include but is not limited to at least one of the following: a light sensor and a lighting lamp. The light sensor may be used to detect light intensity. The lighting lamp may be used to emit light of different light intensities. Thus, it is possible to measure pupil size under different lighting conditions.

[0037] In some optional implementations of some embodiments, the execution subject may obtain the pupil sizes of the pupils of the user wearing the eyeglasses under various light illuminations through the pupil measurement device. The eye state parameter includes various pupil information. Each pupil information includes pupil size and corresponding light illumination. The various pupil information may be used as parameters in the eye state parameter.

[0038] In some optional implementations of some embodiments, the execution subject may perform the following vision testing steps:

[0039] The first step is to display vision test information in the AR glasses. The vision test information may be information for testing the vision of the wearer. For example, the vision test information may be a vision test chart. The vision test chart may include a character or a pattern.

[0040] The second step is to detect the feedback information of the wearing user corresponding to the vision test information. The feedback information may correspond to the content displayed in the vision test chart. For example, when the vision test chart shows characters that need to be identified by the wearing user, the feedback information may include the character orientation confirmed by the wearing user. For another example, when the vision test chart shows text that needs to be identified by the wearing user, the feedback information may include the text confirmed by the wearing user. It should be noted that the wearing user can provide feedback and interaction through verbal answers, eye movements, gestures, or other methods supported by AR glasses.

[0041] The third step is to execute the vision test step again in response to determining that the currently displayed vision test information does not meet the preset test end condition, wherein the preset test end condition may be that the currently displayed vision test information is the last vision test information.

[0042] The fourth step is to generate a vision test result according to each feedback information detected in response to determining that the currently displayed vision test information meets the above-mentioned preset test end condition. Among them, the above-mentioned eye state parameter includes the above-mentioned vision test result. The vision test result can be used as a parameter included in the eye state parameter. In practice, the above-mentioned execution subject can determine whether each feedback information is correct based on the correct answer corresponding to each displayed vision test information. Then, based on the judgment result of whether the corresponding feedback information is correct, the test vision can be generated as the vision test result. Here, the test vision can be expressed in diopters. In this way, the user's vision can be measured through user feedback interaction.

[0043] In some optional implementations of some embodiments, the execution subject may display the vision test information in the AR glasses through the following steps:

[0044] The first step is to model the environment around the user in the AR glasses to form a mixed reality space. In practice, the execution subject can take a set of photos or videos of the real scene through the camera outside the AR glasses. Then, the three-dimensional mixed reality space can be constructed using the set of photos or videos taken.

[0045] The second step is to display the vision test information at a set test distance in the mixed reality space of the AR glasses. The test distance can be set by the wearer, and can represent the distance between the vision test information displayed in the mixed reality space and the wearer's eyes. Thus, the user can set the vision test distance by himself to perform different types of tests, such as myopia or hyperopia tests.

[0046] In some optional implementations of some embodiments, the execution subject may display the vision test information in the AR glasses through the following steps:

[0047] The first step is to determine the vision test information corresponding to the current vision test step.

[0048] The second step is to adjust the vision test information according to the feedback information previously detected to update the vision test information. In practice, the execution entity may determine the number of feedback information that meets the preset continuous correctness condition among the feedback information previously detected. The preset continuous correctness condition may be that each feedback information is the correct feedback information detected most recently. Then, the number may be input into a preset subtraction function to obtain an adjustment multiple. The adjustment multiple is less than 1. Finally, the execution entity may reduce the size of the vision test information according to the adjustment multiple to obtain the updated vision test information. Optionally, the execution entity may also adjust the clarity of the vision test information in the manner of adjusting the size.

[0049] The third step is to display the updated vision test information in the AR glasses. Thus, the vision test information can be adaptively adjusted according to the user's feedback.

[0050] Optionally, the AR glasses are AR glasses with adjustable diopter.

[0051] In some optional implementations of some embodiments, the execution subject may determine the target diopter as an eye state parameter and adjust the diopter of the AR glasses to the target diopter in response to receiving the target diopter configured by the wearing user. The wearing user may configure the target diopter through a pulley provided on the AR glasses, and may also configure the target diopter through touch, gesture, voice, and the like. Here, the target diopter may be the target diopter to be adjusted to set by the user. Thus, the target may be adjusted according to the user's diopter, and suitable interactive content may be recommended for viewing.

[0052] Step 102, loading interactive content corresponding to the eye state parameters into the AR glasses, the interactive content has differentiated display content when displayed on the left eye and right eye display modules, so that the interactive content has a variable visual focus for the wearer.

[0053] In some embodiments, the execution subject may load the interactive content corresponding to the eye state parameters in the AR glasses. The interactive content has differentiated display content when displayed by the left eye and right eye display modules, so that the interactive content has a variable visual focus for the wearing user. For example, the interactive content may be a video. The eye state parameters and the corresponding interactive content may be pre-set. Each interactive content may correspond to a range of pre-configured eye state parameters.

[0054] In some optional implementations of some embodiments, the execution subject may load the interactive content corresponding to the eye state parameter in the AR glasses through the following steps:

[0055] The first step is to determine the scene elements included in the interactive content. The scene elements may be objects for display in a three-dimensional space. For example, the scene elements may include a small fish that can move and change postures. The three-dimensional space may be a mixed reality space.

[0056] The second step is to determine the motion information of each of the above scene elements. The above motion information may include but is not limited to at least one of the following: motion mode, motion trajectory, and motion speed. The motion mode may include but is not limited to at least one of the following: trajectory random motion, speed random motion, and uniform motion. The motion trajectory may include a sequence of motion points in three-dimensional space.

[0057] The third step is to load the above-mentioned scene elements into the mixed reality space of the above-mentioned AR glasses according to the respective motion information corresponding to the above-mentioned scene elements. Thus, the moving scene elements can be displayed in the three-dimensional space according to the pre-configured respective motion information.

[0058] Step 103 , in response to determining that the interactive content meets a preset loading end condition, obtaining updated eye state parameters of the wearing user.

[0059] In some embodiments, the execution subject may obtain the updated eye state parameters of the wearing user in response to determining that the interactive content satisfies the preset loading end condition. The preset loading end condition may be that the interactive content has been played. The preset loading end condition may also be an operation of detecting that the wearing user has ended the playback of the interactive content. Here, the interaction method of the wearing user on the AR glasses may include but is not limited to at least one of the following: touch operation, gesture operation, head control operation, and voice command control operation. The updated eye state parameters may be the re-collected eye state parameters of the wearing user. The pupil size included in the eye state parameters may be collected by a camera on the inside of the AR glasses. The refractive power included in the eye state parameters may be determined by displaying various vision test information on the AR glasses and feedback from the wearing user (for example, displaying a vision test pattern).

[0060] Step 104: Generate eye state adjustment information corresponding to the wearing user according to the eye state parameter and the updated eye state parameter.

[0061] In some embodiments, the execution subject may generate eye state adjustment information corresponding to the wearing user according to the eye state parameter and the updated eye state parameter. The eye state adjustment information may be information related to the adjustment of the eye state of the wearing user after watching the interactive content. The eye state adjustment information may include but is not limited to at least one of the following: adjustment process report, vision adjustment suggestion information, and change trend information. The adjustment process report may be a standard report recording the acquired eye state parameters of the wearing user. The vision adjustment suggestion information may be adjustment suggestion related information matched according to the updated eye state parameter. The vision adjustment suggestion information may include but is not limited to at least one of the following: text, picture, video, audio. The change trend information may be information characterizing the change trend of the eye state of the wearing user. For example, the change trend information may include a line graph of diopter change. In practice, the execution subject may fill the eye state parameter, the updated eye state parameter, and the difference between each parameter in the updated eye state parameter and the eye state parameter into the initial adjustment process report to obtain the adjustment process report. It should be noted that each adjustment process report obtained may be used as the initial adjustment process report for the next time. The standard template of the initial adjustment process report may be pre-set. The above-mentioned execution subject can also determine the vision adjustment suggestion information corresponding to the above-mentioned updated eye state parameters in the preset vision adjustment suggestion information set. Among them, each vision adjustment suggestion information in the vision adjustment suggestion information set can correspond to the range of eye state parameters. The above-mentioned execution subject can also generate a change trend graph as the change trend information according to the various eye state parameters corresponding to the above-mentioned wearing user and the various acquisition times corresponding to the above-mentioned various eye state parameters. Among them, in the change trend graph, the acquisition time can be used as the horizontal axis data and the various parameters included in the eye state parameters can be used as the various vertical axis data, so that various change broken lines can be obtained, and each change broken line can represent the change trend of the parameters of one dimension. Finally, the obtained adjustment process report, vision adjustment suggestion information, and change trend information can be determined as the eye state adjustment information corresponding to the above-mentioned wearing user.

[0062] Optionally, the execution entity may also store the eye state parameters and the updated eye state parameters. In practice, the execution entity may store the eye state parameters and the updated eye state parameters locally. Optionally, the execution entity may also store the eye state parameters and the updated eye state parameters in the cloud. Optionally, the execution entity may also store the eye state parameters and the updated eye state parameters locally and synchronize them to the cloud. This allows users to view their history records at any time and share them with doctors or ophthalmologists to obtain professional advice.

[0063] Optionally, the execution subject may also configure the AR glasses to the eye adjustment mode in response to detecting that the duration of the AR glasses using the standard mode meets the preset duration condition. Then, the preset three-dimensional playback content may be loaded in the AR glasses. Among them, the preset duration condition may be that the duration of the AR glasses using the standard mode is greater than the preset duration. For example, the preset duration may be 2 hours. The eye adjustment mode may be a mode for allowing the wearing user to watch interactive content. The standard mode may be a mode for using other functions of the AR glasses (functions different from the eye adjustment mode, such as video, game, guide, office). The preset three-dimensional playback content may be content for display in a three-dimensional space. For example, the preset three-dimensional playback content may be a three-dimensional video. Thus, the user may be allowed to watch the preset three-dimensional playback content at regular intervals, and the preset three-dimensional playback content has a changing visual focus for the wearing user, which can be used to train the user's eyeballs.

[0064] Reference below Figure 2 , showing one or more embodiments of actual usage scenarios of users. The user is wearing an AR glasses device 21 and is watching AR content 22 in a real space 23. The real space 23 and the AR content 22 constitute a mixed reality space. The interactive content seen by the user may be one or more moving animals, such as dolphins, and the dolphins may present a swimming visual effect.

[0065] In another embodiment, when the interactive content 22 is presented to the user, the AR glasses can simultaneously enable the user interaction monitoring capability to obtain the user's interactive feedback. The user's interactive feedback is made based on the displayed interactive content 22, which may include certain correct interactions and incorrect interactions. The AR glasses can record the success rate of the user's interactive feedback to determine the user's current eye-brain reaction ability and coordination ability.

[0066] In another embodiment, considering that in some scenarios, the user may only need AR glasses to relieve eye fatigue, only interactive content with different depths can be displayed to the user without detecting the glasses status information before and after displaying the interactive content.

[0067] The above-mentioned embodiments of the present disclosure have the following beneficial effects: through the eye state adjustment information generation method based on AR glasses of some embodiments of the present disclosure, when the user trains vision, there is no need for a dedicated myopia training optimization instrument, and the weight of the equipment is reduced, which is easy to carry. Specifically, the reason for the difficulty in carrying is that the dedicated myopia training optimization instrument is usually bulky and not easy to carry. Based on this, the eye state adjustment information generation method based on AR glasses of some embodiments of the present disclosure, first, obtains the eye state parameters of the user wearing the above-mentioned AR glasses. Thus, the eye state parameters of the wearing user before watching the interactive content can be directly obtained through the AR glasses. Then, the interactive content corresponding to the above-mentioned eye state parameters is loaded in the above-mentioned AR glasses, and the above-mentioned interactive content has differentiated display content when the display modules of the left eye and the right eye are displayed, so that the above-mentioned interactive content has a changing visual focus for the above-mentioned wearing user. Thus, the user wearing the AR glasses can watch the interactive content adapted to his eye state. Secondly, in response to determining that the above-mentioned interactive content meets the preset loading end condition, the updated eye state parameters of the above-mentioned wearing user are obtained. Thus, the eye state parameters of the wearing user can be obtained again after the interactive content ends display. Finally, according to the above-mentioned eye state parameters and the above-mentioned updated eye state parameters, the eye state adjustment information corresponding to the above-mentioned wearing user is generated. Thus, the generated eye state adjustment information can characterize the adjustment of the eye state of the wearing user after watching the interactive content. Also because the interactive content watched by the wearing user has differentiated display content when displayed by the left eye and right eye display modules, the above-mentioned interactive content can have a variable visual focus for the above-mentioned wearing user to achieve vision training. Also because AR glasses are not dedicated myopia training optimization instruments, they can be worn directly on the user's head, are light in weight, and are easy to carry. Therefore, when the user trains his vision, there is no need for a dedicated myopia training optimization instrument, and the weight of the equipment is reduced, making it easy to carry.

[0068] Reference below Figure 3 , which shows a schematic structural diagram of AR glasses 300 suitable for implementing some embodiments of the present disclosure. Figure 3 The AR glasses shown are merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0069] like Figure 3As shown, the AR glasses 300 may include a processing device 301 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 302 or a program loaded from a storage device 308 to a random access memory (RAM) 303. In RAM 303, various programs and data required for the operation of the AR glasses 300 are also stored. The processing device 301, ROM 302, and RAM 303 are connected to each other via a bus 304. An input / output (I / O) interface 305 is also connected to the bus 304.

[0070] Typically, the following devices can be connected to the I / O interface 305: input devices 306 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 307 including, for example, a display screen (micro display screen), a speaker, a vibrator, etc.; and communication devices 309. The communication device 309 can allow the AR glasses 300 to communicate wirelessly or wired with other devices to exchange data. The optical element can cooperate with the display screen to form an image in front of the user's eyes. Although Figure 3 The AR glasses 300 with various devices are shown, but it should be understood that it is not required to implement or have all the devices shown. More or fewer devices may be implemented or have instead. Figure 3 Each block shown in the figure may represent one device, or may represent multiple devices as required.

[0071] It should be noted that the AR glasses 300 include two display modules, corresponding to the left and right eyes of the user respectively, for displaying the above-mentioned interactive content. When the above-mentioned interactive content is displayed by the above-mentioned two display modules, it has a changing visual focus.

[0072] Optionally, the AR glasses may include an eye tracking sensor. Optionally, the AR glasses may include a pupil measurement device.

[0073] In particular, according to some embodiments of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, some embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In some such embodiments, the computer program can be downloaded and installed from the network through the communication device 309, or installed from the storage device 308, or installed from the ROM 302. When the computer program is executed by the processing device 301, the above-mentioned functions defined in the method of some embodiments of the present disclosure are executed.

[0074] It should be noted that the computer-readable medium recorded in some embodiments of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In some embodiments of the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In some embodiments of the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0075] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0076] The computer-readable medium may be included in the AR glasses; or it may exist independently without being assembled into the AR glasses. The computer-readable medium carries one or more programs. When the one or more programs are executed by the AR glasses, the AR glasses: obtain eye state parameters corresponding to the user wearing the AR glasses; load interactive content corresponding to the eye state parameters in the AR glasses, and the interactive content has differentiated display content when displayed by the left eye and right eye display modules, so that the interactive content has a variable visual focus for the wearing user; in response to determining that the interactive content meets the preset loading end condition, obtain the updated eye state parameters of the wearing user; generate eye state adjustment information corresponding to the wearing user according to the eye state parameters and the updated eye state parameters.

[0077] Computer program code for performing the operations of some embodiments of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0078] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0079] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0080] The above descriptions are only some preferred embodiments of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solutions formed by a specific combination of the above-mentioned technical features, but should also cover other technical solutions formed by any combination of the above-mentioned technical features or their equivalent features without departing from the above-mentioned inventive concept. For example, the above-mentioned features are replaced with the technical features with similar functions disclosed in the embodiments of the present disclosure (but not limited to) and the technical solutions formed.

Claims

1. A method for generating eye state adjustment information based on AR glasses, applied to AR glasses, wherein the AR glasses include two display modules, corresponding to the left eye and the right eye of the user respectively, and the method includes: Obtaining eye state parameters corresponding to a user wearing the AR glasses; Loading interactive content corresponding to the eye state parameter in the AR glasses, wherein the interactive content has differentiated display content when displayed by the left eye and right eye display modules, so that the interactive content has a variable visual focus for the wearer; In response to determining that the interactive content meets a preset loading end condition, obtaining updated eye state parameters of the wearing user; Eye state adjustment information corresponding to the wearing user is generated according to the eye state parameter and the updated eye state parameter.

2. The method according to claim 1, wherein: The AR glasses include an eye tracking sensor; and The obtaining of eye state parameters corresponding to the user wearing the AR glasses includes: The eye movement information of the wearing user is obtained through the eye tracking sensor, wherein the eye state parameter includes the eye movement information.

3. The method according to claim 1, wherein: The AR glasses include a pupil measurement device; as well as The obtaining of eye state parameters corresponding to the user wearing the AR glasses includes: The pupil measurement device is used to obtain the pupil sizes of the user wearing the eyeglasses at various light illuminations, wherein the eye state parameters include various pupil information, and each pupil information includes a pupil size and a corresponding light illumination.

4. The method according to claim 1, wherein: The obtaining of eye state parameters corresponding to the user wearing the AR glasses includes: Follow these vision test steps: Displaying vision test information in the AR glasses; Detecting feedback information of the wearing user corresponding to the vision test information; In response to determining that the currently displayed vision test information does not meet the preset test end condition, executing the vision test step again; In response to determining that the currently displayed vision test information meets the preset test end condition, a vision test result is generated according to the detected feedback information, wherein the eye state parameter includes the vision test result.

5. The method according to claim 4, wherein: The displaying of vision test information in the AR glasses includes: Modeling the environment around the user in the AR glasses to form a mixed reality space; In the mixed reality space in the AR glasses, vision test information is displayed at a set test distance.

6. The method according to claim 4, wherein: The displaying of vision test information in the AR glasses includes: Determining vision test information corresponding to the current vision test step; According to each feedback information of the previous detection, the vision test information is adjusted to update the vision test information; The updated vision test information is displayed in the AR glasses.

7. The method according to claim 1, wherein: The loading of the interactive content corresponding to the eye state parameter in the AR glasses includes: Determining various scene elements included in the interactive content; Determining motion information of each of the scene elements; According to the motion information corresponding to the scene elements, the scene elements are loaded in the mixed reality space of the AR glasses.

8. The method according to claim 1, wherein: The method further comprises: The eye state parameter and the updated eye state parameter are stored.

9. The method according to claim 1, wherein: The method further comprises: In response to detecting that the duration of the use of the AR glasses in the standard mode meets a preset duration condition, configuring the AR glasses to the eye adjustment mode; The preset three-dimensional playback content is loaded into the AR glasses.

10. The method according to claim 1, wherein: The AR glasses are AR glasses with adjustable diopter; as well as The obtaining of eye state parameters corresponding to the user wearing the AR glasses includes: In response to receiving the target refractive power configured by the wearing user, the target refractive power is determined as an eye state parameter, and the refractive power of the AR glasses is adjusted to the target refractive power.

11. An AR glasses, comprising: one or more processors; A storage device storing one or more programs and interactive contents, Two display modules, corresponding to the left and right eyes of the user respectively, for displaying the interactive content, wherein the interactive content has a variable visual focus when displayed by the two display modules; When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 10.

12. A computer readable medium having a computer program stored thereon, wherein: When the computer program is executed by a processor, the method according to any one of claims 1 to 10 is implemented.

Images