Optical parameter setting method of equipment and terminal equipment

Abstract

The invention discloses an optical parameter setting method of a device and a terminal device, relates to the technical field of optics, can provide an optical display effect suitable for the specific vision condition of a user for the user, and improves the user experience. According to the scheme, when the user uses the terminal equipment, the terminal equipment can automatically measure the vision conditions of the user, such as myopia, hyperopia, astigmatism, night vision, color weakness and narrow visual field, and the severity of the vision problem of the user, and corresponding optical parameter adaptation is carried out based on the specific vision conditions. And meanwhile, the terminal equipment can store the measured vision information of the user in the equipment, so that the optical parameters of the intelligent glasses can be adjusted to be adaptive to the state of the user without re-measurement when the user uses the intelligent glasses next time. Based on the scheme, user operation can be simplified, meanwhile, it is ensured that the user can accurately and clearly obtain related picture information in the process of using the terminal equipment, and humanized visual experience is provided for the user.

Description

Technical Field

[0001] The present application relates to the field of optical technology, and in particular to a method for setting optical parameters of a device and a terminal device. Background Art

[0002] With the rapid development of related hardware technologies and software technologies such as virtual reality (VR), augmented reality (AR), extended reality (XR), and mixed reality (MR), related products are being used more and more widely in actual learning, work, and life.

[0003] We know that vision problems (such as myopia, hyperopia, astigmatism, night vision, color weakness, color blindness, narrow field of vision, etc.) are common problems among the current population. For users with different vision conditions, their requirements for the optical configuration of terminal equipment will be different. However, when users use terminal equipment, they often need to manually adjust the relevant optical parameters according to their actual vision conditions. Manual operation may not be able to be adjusted in place at one time. Not only is there a problem of accuracy, but it may also require users to operate multiple times, so it is more troublesome for users; in addition, manual operation has a high learning cost for users. In summary, the way that existing terminal devices set optical parameters according to the actual vision of users does not provide a good experience for users. Summary of the invention

[0004] The present application provides a method for setting the optical parameters of a device and a terminal device, which can automatically adapt the relevant optical parameters for users with different vision conditions (such as myopia, hyperopia, astigmatism, night vision, color weakness, color blindness, narrow field of vision, etc.), while simplifying user operations, providing users with optical display effects suitable for the user's specific vision conditions, thereby improving the user experience.

[0005] In order to achieve the above objectives, this application adopts the following technical solutions:

[0006] In a first aspect, a method for setting optical parameters of a device is provided, which can be applied to a terminal device, and the method comprises: the terminal device collects user information of a user; the terminal device searches for corresponding vision information from stored information according to the collected user information, wherein the stored information includes a correspondence between user information and vision information of one or more users, wherein the vision information includes but is not limited to at least one of the user's myopia, hyperopia, astigmatism, night vision, color weakness, and field of view; further, when the corresponding vision information is found from the stored information, the terminal device sets the corresponding optical parameters according to the found vision information; or, when the corresponding vision information is not found from the stored information, the terminal device measures the vision information to obtain the user's vision information, and sets the corresponding optical parameters according to the user's vision information; wherein the optical parameters may include but are not limited to one or more of the following: refractive power value, astigmatism axis, contrast of three primary colors, and display brightness value.

[0007] Exemplarily, the terminal device described in the present application can provide an interface display service for the user. Exemplarily, the interface display service may include but is not limited to display services of VR interface, AR interface, XR interface, MR interface, etc.

[0008] Exemplarily, the terminal device described in the present application may be a smart head-mounted device, such as smart glasses.

[0009] Exemplarily, the user information of the user described in the present application may include, but is not limited to, one or more of the following: a password entered by the user, voice information entered by the user, iris information of the user, fingerprint information entered by the user, facial features of the user, etc.

[0010] In the solution provided in the first aspect above, the terminal device can store the vision information of multiple users, so that the user's vision condition can be determined without measuring again the next time the user uses the terminal device, and the optical parameters of the smart glasses can be adjusted to a state suitable for the user. In addition, when the user's vision information is not stored, the terminal device can automatically obtain the user's specific vision condition through measurement, such as whether the user has vision problems such as myopia, hyperopia, astigmatism, night vision, color deficiency, narrow field of vision, and the severity of the user's vision problem, and perform corresponding optical parameter adaptation based on the user's specific vision condition. Based on this solution, while simplifying user operations, it can ensure that the user can accurately and clearly obtain relevant screen information during the use of the terminal device, providing the user with a humanized visual experience.

[0011] As a possible implementation, after the terminal device measures the user's vision information, the method further includes: the terminal device saves the measured user's vision information. Based on this, the user's vision can be determined without measuring again the next time the user uses the terminal device, and the optical parameters of the smart glasses can be adjusted to a state suitable for the user, simplifying the user's operation while ensuring that the user can accurately and clearly obtain relevant image information when using the terminal device.

[0012] As a possible implementation method, the terminal device measures vision information to obtain the user's vision information, including: the terminal device measures vision information in sequence based on a preset measurement order to obtain the user's myopia, hyperopia, astigmatism, night vision, color weakness, and multiple vision conditions in the visual field; wherein the preset measurement order is related to the distribution of vision problems in the statistical population or is determined according to the user's instructions. Based on this, the measurement process can be made more in line with the actual situation of the user or more in line with the current distribution of vision problems in the population, providing a scientific and efficient measurement process to the maximum extent.

[0013] As a possible implementation, the terminal device measures the vision information to obtain the user's vision information, including: the terminal device displays an astigmatism table to the user; the terminal device detects the lines in the astigmatism table that the user can see clearly as reported by the user; the terminal device determines the user's astigmatism condition based on the user's feedback. Through the above simple human-computer interaction process, the user's astigmatism condition can be automatically and accurately measured, providing reliable support for the subsequent accurate setting of corresponding optical parameters.

[0014] As a possible implementation method, the terminal device measures the vision information to obtain the user's vision information, including: the terminal device displays multiple images of different brightness to the user in a step-by-step manner; the terminal device detects the image that the user can see clearly among the multiple images of different brightness fed back by the user; the terminal device determines the user's night vision according to the brightness value corresponding to the image that the user can see clearly. Through the above simple human-computer interaction process, the user's night vision can be measured automatically and accurately, providing reliable support for the subsequent accurate setting of corresponding optical parameters.

[0015] As a possible implementation method, the terminal device measures vision information to obtain the user's vision information, including: the terminal device displays images including different brightness areas to the user in a step-by-step manner; the terminal device detects the brightness area that the user can see clearly among the above different brightness areas reported by the user; the terminal device determines the user's night vision according to the brightness value corresponding to the brightness area that the user can see clearly. Through the above simple human-computer interaction process, the user's night vision can be measured automatically and accurately, providing reliable support for the subsequent accurate setting of corresponding optical parameters.

[0016] As a possible implementation method, the terminal device measures vision information to obtain the user's vision information, including: the terminal device displays a color weakness detection chart to the user, wherein the color weakness detection chart includes multiple detection color disks; the terminal device detects the color disk that the user cannot see clearly among the multiple detection color disks reported by the user; the terminal device determines the user's color weakness classification based on the color disk that the user cannot see clearly. Through the above simple human-computer interaction process, the user's color weakness classification can be measured automatically and accurately, providing reliable support for the subsequent accurate setting of corresponding optical parameters.

[0017] As a possible implementation, after the terminal device determines the user's color weakness type, the above method also includes: the terminal device displays the color weakness detection diagram with different three-primary color contrasts to the user; the terminal device detects the color disk that the user can see clearly in the color weakness detection diagram with different three-primary color contrasts fed back by the user; the terminal device determines the user's color weakness level according to the three-primary color contrasts corresponding to the color disk that the user can see clearly. Based on this, on the basis of the user's color weakness type having been determined, the user's color weakness level can be automatically and accurately obtained through the above simple human-computer interaction process, providing reliable support for the subsequent accurate setting of corresponding optical parameters.

[0018] As a possible implementation method, the terminal device measures the vision information to obtain the user's vision information, including: the terminal device displays a visual field detection map to the user; the terminal device detects the outer edge of the visual field detection map that the user can see clearly as reported by the user; the terminal device determines the user's visual field based on the position information of the outer edge of the visual field detection map that the user can see clearly. Based on this, the user's visual field can be automatically and accurately obtained through the simple human-computer interaction process, providing reliable support for the subsequent accurate setting of corresponding optical parameters.

[0019] As a possible implementation method, the terminal device measures vision information to obtain the user's vision information, including: the terminal device displays multiple diopter test images at different diopters to the user in a step-by-step manner; the terminal device detects the diopter test image that the user can see clearly among the multiple diopter test images at different diopters fed back by the user; the terminal device determines the user's myopia and / or hyperopia according to the diopter value corresponding to the diopter test image that the user can see clearly. Based on this, the user's myopia and / or hyperopia can be automatically and accurately obtained through the simple human-computer interaction process, providing reliable support for the subsequent accurate setting of corresponding optical parameters.

[0020] As a possible implementation, before the terminal device collects the user information of the user, the method further includes: when a preset condition is met, the terminal device determines that the user uses the terminal device; wherein the preset condition includes one or more of the following: the posture of the terminal device undergoes a preset change, the terminal device receives a preset operation, and the terminal device receives a preset instruction. Based on this, the terminal device can automatically recognize that a user is using the terminal device, thereby triggering the intelligent optical parameter setting solution of the present application, providing operational convenience for the user.

[0021] As a possible implementation, before the terminal device performs corresponding optical parameter settings, the method further includes: the terminal device notifies the user of the optical parameter configuration strategy determined based on the vision information; the terminal device continues to perform corresponding optical parameter settings according to the user's feedback or provides the user with an option to manually input vision information. Based on this, the accuracy of the optical parameter configuration strategy can be further ensured.

[0022] In a second aspect, a terminal device is provided, which includes: a measuring unit for collecting user information of a user; a storage unit for storing the correspondence between user information and vision information of one or more users, wherein the vision information includes but is not limited to at least one of the user's myopia, hyperopia, astigmatism, night vision, color weakness, visual field, etc.; a processing unit for: searching the storage unit for corresponding vision information according to the user information collected by the measuring unit; and when the corresponding vision information is found from the stored information, setting corresponding optical parameters according to the found vision information; or, when the corresponding vision information is not found from the stored information, measuring the vision information of the user by the measuring unit, and setting corresponding optical parameters according to the user's vision information; wherein the optical parameters may include but are not limited to one or more of the following: refractive power value, astigmatism axis, contrast of three primary colors, display brightness value.

[0023] In some implementations, the terminal device may be a smart head-mounted device, such as smart glasses.

[0024] In the solution provided in the second aspect above, the terminal device can store the vision information of multiple users, so that the next time the user uses the terminal device, the user's vision condition can be determined without measuring it again, and the optical parameters of the smart glasses can be adjusted to a state suitable for the user. In addition, when the user's vision information is not stored, the terminal device can automatically obtain the user's specific vision condition through measurement, such as whether the user has vision problems such as myopia, hyperopia, astigmatism, night vision, color deficiency, narrow field of vision, and the severity of the user's vision problem, and perform corresponding optical parameter adaptation based on the user's specific vision condition. Based on this solution, while simplifying user operations, it can ensure that the user can accurately and clearly obtain relevant screen information during the use of the terminal device, providing the user with a humanized visual experience.

[0025] As a possible implementation, after the measurement unit measures the user's vision information, the storage unit is further used to save the measured user's vision information. Based on this, the user's vision can be determined without measuring again the next time the user uses the terminal device, and the optical parameters of the smart glasses can be adjusted to a state suitable for the user, simplifying the user's operation while ensuring that the user can accurately and clearly obtain relevant screen information during the use of the terminal device.

[0026] As a possible implementation, the measurement unit measures the vision information to obtain the user's vision information, including: the measurement unit measures the vision information in sequence based on a preset measurement order to obtain the user's myopia, hyperopia, astigmatism, night vision, color weakness, and multiple vision conditions in the visual field; wherein the preset measurement order is related to the distribution of vision problems in the statistical population or is determined according to the user's instructions. Based on this, the measurement process can be made more in line with the actual situation of the user or more in line with the current distribution of vision problems in the population, providing a scientific and efficient measurement process to the maximum extent.

[0027] As a possible implementation, the above-mentioned measurement unit measures the vision information to obtain the vision information of the user, including: the measurement unit displays the astigmatism table to the user; the measurement unit detects the lines in the astigmatism table that the user can see clearly as reported by the user; the measurement unit determines the astigmatism of the user according to the user's feedback. Through the above-mentioned simple human-computer interaction process, the user's astigmatism can be measured automatically and accurately, providing reliable support for the subsequent accurate setting of corresponding optical parameters.

[0028] As a possible implementation, the measurement unit measures the vision information to obtain the vision information of the user, including: the measurement unit displays multiple images of different brightness to the user in a step-by-step manner; the measurement unit detects the image that the user can see clearly among the multiple images of different brightness fed back by the user; the measurement unit determines the user's night vision according to the brightness value corresponding to the image that the user can see clearly. Through the simple human-computer interaction process, the user's night vision can be measured automatically and accurately, providing reliable support for the subsequent accurate setting of corresponding optical parameters.

[0029] As a possible implementation, the measurement unit measures the vision information to obtain the vision information of the user, including: the measurement unit displays images including different brightness areas to the user in a step-by-step manner; the measurement unit detects the brightness area that the user can see clearly in the above different brightness areas fed back by the user; the measurement unit determines the user's night vision according to the brightness value corresponding to the brightness area that the user can see clearly. Through the above simple human-computer interaction process, the user's night vision can be measured automatically and accurately, providing reliable support for the subsequent accurate setting of corresponding optical parameters.

[0030] As a possible implementation, the measurement unit measures the vision information to obtain the vision information of the user, including: the measurement unit displays a color weakness detection chart to the user, wherein the color weakness detection chart includes multiple detection color disks; the measurement unit detects the color disk that the user cannot see clearly among the multiple detection color disks reported by the user; the measurement unit determines the color weakness classification of the user based on the color disk that the user cannot see clearly. Through the above simple human-computer interaction process, the user's color weakness classification can be measured automatically and accurately, providing reliable support for the subsequent accurate setting of corresponding optical parameters.

[0031] As a possible implementation, after the measurement unit determines the user's color weakness type, the measurement unit is further used to: show the user a color weakness detection diagram with different three-primary color contrasts; detect the color disk that the user can see clearly in the color weakness detection diagram with different three-primary color contrasts fed back by the user; and determine the user's color weakness level according to the three-primary color contrasts corresponding to the color disk that the user can see clearly. Based on this, on the basis of the user's color weakness type having been determined, the user's color weakness level can be automatically and accurately obtained through the above-mentioned simple human-computer interaction process, providing reliable support for the subsequent accurate setting of corresponding optical parameters.

[0032] As a possible implementation method, the above-mentioned measurement unit measures the vision information to obtain the vision information of the user, including: the measurement unit displays a visual field detection map to the user; the measurement unit detects the outer edge of the visual field detection map that the user can see clearly as feedback; the measurement unit determines the user's visual field according to the position information of the outer edge of the visual field detection map that the user can see clearly. Based on this, the user's visual field can be automatically and accurately obtained through the above-mentioned simple human-computer interaction process, providing reliable support for the subsequent accurate setting of corresponding optical parameters.

[0033] As a possible implementation, the above-mentioned measurement unit measures vision information to obtain the vision information of the user, including: the measurement unit sequentially displays multiple diopter test images at different diopters to the user in a step-by-step manner; the measurement unit detects the diopter test image that the user can see clearly among the multiple diopter test images at different diopters fed back by the user; the measurement unit determines the myopia and / or hyperopia of the user according to the diopter value corresponding to the diopter test image that the user can see clearly. Based on this, the myopia and / or hyperopia of the user can be automatically and accurately obtained through the above-mentioned simple human-computer interaction process, providing reliable support for the subsequent accurate setting of corresponding optical parameters.

[0034] As a possible implementation, the processing unit is also used to: before the measurement unit collects the user information of the user, when the preset conditions are met, determine that the user uses the terminal device; wherein the preset conditions include one or more of the following: the posture of the terminal device undergoes a preset change, the terminal device receives a preset operation, and the terminal device receives a preset instruction. Based on this, the terminal device can automatically recognize that a user is using the terminal device, thereby triggering the intelligent optical parameter setting solution of the present application, providing operational convenience for the user.

[0035] As a possible implementation, the terminal device further includes: an information notification unit, which is used to notify the user of the optical parameter configuration strategy determined based on the vision information before the measurement unit performs the corresponding optical parameter setting; the processing unit is also used to: continue to perform the corresponding optical parameter setting according to the user's feedback or provide the user with an option to manually input the vision information. Based on this, the accuracy of the optical parameter configuration strategy can be further ensured.

[0036] In a third aspect, a terminal device is provided, comprising: a measurement component for measuring user information and vision information; a memory for storing computer program instructions and the correspondence between user information and vision information of one or more users; and a processor for executing the computer program instructions to support the terminal device to implement a method as in any possible implementation of the first aspect.

[0037] In some embodiments, the measurement component may include an optical module.

[0038] In some embodiments, the measurement component may further include a sensor and / or a camera.

[0039] In some implementations, the terminal device may be a smart head-mounted device, such as smart glasses.

[0040] According to a fourth aspect, a computer-readable storage medium is provided, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the method in any possible implementation of the first aspect is implemented.

[0041] According to a fifth aspect, a computer program product comprising instructions is provided. When the computer program product is run on a computer, the computer implements the method in any possible implementation of the first aspect.

[0042] In a sixth aspect, a chip system is provided, the chip system comprising a processing circuit and a storage medium, wherein the storage medium stores computer program instructions; when the computer program instructions are executed by the processor, the method in any possible implementation of the first aspect is implemented. The chip system may be composed of a chip, or may include a chip and other discrete devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 A schematic diagram of the hardware structure of a terminal device provided in an embodiment of the present application;

[0044] Figure 2 A schematic diagram of the structure of a pair of smart glasses provided in an embodiment of the present application;

[0045] Figure 3 A flow chart of a method for setting optical parameters of a device provided in an embodiment of the present application;

[0046] Figure 4 A schematic diagram of a user myopia measurement process provided in an embodiment of the present application;

[0047] Figure 5 A schematic diagram of a diopter test image provided in an embodiment of the present application;

[0048] Figure 6 A schematic diagram of a user astigmatism measurement process provided in an embodiment of the present application;

[0049] Figure 7 A schematic diagram of a user's night vision measurement process provided in an embodiment of the present application;

[0050] Figure 8A schematic diagram of a user color blindness measurement process provided in an embodiment of the present application;

[0051] Fig. 9 A schematic diagram of a user's visual field measurement process provided in an embodiment of the present application;

[0052] Fig.10 A structural block diagram of a terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0053] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0054] In the following, the terms "first", "second", etc. are only used to distinguish different description objects, and have no limiting effect on the position, order, priority, quantity or content of the described objects. For example, if the described object is a "field", the ordinal number before the "field" in the "first field" and the "second field" does not limit the position or order between the "fields", and the "first" and "second" do not limit whether the "fields" they modify are in the same message, nor do they limit the order of the "first field" and the "second field". For another example, if the described object is a "level", the ordinal number before the "level" in the "first level" and the "second level" does not limit the priority between the "levels". For another example, the number of described objects is not limited by the ordinal number, and can be one or more. Taking the "first device" as an example, the number of "devices" can be one or more. In addition, the objects modified by different prefixes can be the same or different. For example, if the described object is a "device", the "first device" and the "second device" can be the same type of device or different types of devices. For another example, if the described object is "information", the "first information" and the "second information" can be information of the same content or information of different contents. In summary, the use of prefixes such as ordinal numbers to distinguish the described objects in the embodiments of the present application does not constitute a limitation on the described objects. For the statement of the described objects, please refer to the description in the context of the claims or embodiments, and no unnecessary limitation should be constituted due to the use of such prefixes.

[0055] Furthermore, in the embodiments of the present application, "connection" may be a direct connection or an indirect connection; in addition, it may refer to an electrical connection or a communication connection; for example, the connection between two electrical components A and B may refer to a direct connection between A and B, or may refer to an indirect connection between A and B through other electrical components or connecting media, or may refer to an indirect connection between A and B through other communication devices or communication media, as long as communication between A and B can be achieved.

[0056] For ease of understanding, the relevant optical terms involved in the embodiments of the present application are first explained and illustrated below.

[0057] 1. Diopter

[0058] When light is incident from one object to another substance with different light density, the propagation direction of the light is deflected. This phenomenon is called refraction. The unit of this refraction is diopter (abbreviated as "D"). 1D refractive power is equivalent to focusing parallel light on a focal length of 1 meter. Diopter is also called "focal power".

[0059] Refractive power can be used to indicate whether you have myopia, hyperopia, or astigmatism, as well as the severity of your myopia, hyperopia, or astigmatism.

[0060] 2. Myopia

[0061] Myopia is a type of refractive error. When parallel light rays are refracted by the relaxed eyeball and imaged on the retina, a clear image can be formed; however, when parallel light rays are refracted by the relaxed eyeball and imaged in front of the retina, a clear image cannot be formed on the retina, which is called myopia.

[0062] For example, myopia of 100 degrees in daily life is equivalent to -1.00D of diopter, and myopia of 200 degrees is equivalent to -2.00D of diopter. Both indicate the severity of myopia, but are expressed in different ways.

[0063] 3. Hyperopia

[0064] Hyperopia is also a type of refractive error. Hyperopia refers to a refractive state in which parallel light rays are refracted by the relaxed eyeball and imaged on the retina, resulting in a failure to form a clear image on the retina. Hyperopia occurs when the refractive power of the eyeball is insufficient.

[0065] For example, in our daily life, hyperopia of 100 degrees means a diopter of 1.00D, and hyperopia of 200 degrees means a diopter of 2.00D. Both indicate the severity of hyperopia, but are expressed in different ways.

[0066] 4. Astigmatism

[0067] Astigmatism is also a type of refractive error. Astigmatism is related to the curvature of the cornea. When parallel light rays enter the eyeball, due to the different refractive powers of the eyeball on different meridians, the light rays cannot be focused on one point (focus), and thus a clear image cannot be formed. This situation is called astigmatism.

[0068] Astigmatism includes myopic astigmatism and hyperopic astigmatism.

[0069] 5. Night Vision

[0070] Night vision, also known as "night blindness", refers to the situation in which one cannot see clearly or completely and has difficulty moving in dim light or at night.

[0071] 6. Color weakness

[0072] Color weakness is also called "abnormal trichromatic vision". Color weakness refers to the ability to recognize colors but with low sensitivity. For example, the ability to distinguish colors is poor, and colors can only be seen when they are saturated, or changes in color can only be distinguished when there are large differences in wavelength.

[0073] Color deficiency often includes red-green deficiency, blue-green deficiency, yellow-yellow deficiency and panchromatism. Among them, red-green deficiency (type A) and green-green deficiency (type B) are more common, while blue-green deficiency, yellow-yellow deficiency and panchromatism are extremely rare. Among them, red-green deficiency refers to the poor ability to distinguish red; green-green deficiency refers to the poor ability to distinguish green.

[0074] 7. Color blindness

[0075] Color blindness refers to the inability to distinguish various colors or certain colors in the natural spectrum. The difference between color blindness and color weakness is that although color weakness has poor color discrimination ability, it can still distinguish colors, while color blindness refers to the inability to distinguish.

[0076] Color blindness often includes red-green color blindness, blue-yellow color blindness and total color blindness. Among them, red-green color blindness is the most common, while blue-yellow color blindness and total color blindness are extremely rare.

[0077] In some cases, there is no strict boundary between color weakness and color blindness. For example, in dim light, color-weak patients may not be able to successfully distinguish various colors or certain colors in the natural spectrum. Alternatively, it can be understood that color blindness is defined as color weakness (such as color weakness level) reaching a certain value. For example, if the color weakness level is higher than L k (k is a positive integer) level, it can be considered color blind; if the color weakness level is lower than or equal to L k (k is a positive integer) level, it can be considered as color blindness.

[0078] In the following embodiments, color blindness is classified as color weakness for introduction.

[0079] 8. Narrow field of vision

[0080] Narrow field of vision refers to a situation where the user's field of vision is smaller than the normal range, which can be, for example, 56 degrees above, 65 degrees to the side of the nose, 74 degrees below, and 91 degrees to the outside.

[0081] We know that for some users, their vision may be different at different times and in different scenarios. For example, for night-blind users, their vision is good during the day, but their vision is often poor in dim light. In addition, for some terminal devices shared by many users, the vision of different users is often different. Therefore, how the terminal device can automatically adapt the corresponding optical parameters according to the actual vision of the user is a direction that needs to be studied.

[0082] In order to provide users with a more accurate, clear, convenient and intelligent visual experience, an embodiment of the present application provides a method for setting the optical parameters of a device. Based on this method, when a user uses a terminal device, the user does not need to perform complex parameter configuration operations. The terminal device can automatically adapt the corresponding optical parameters according to the user's specific vision conditions, such as whether the user has myopia, hyperopia, astigmatism, night vision, color blindness, narrow field of vision and other vision problems, as well as the severity of the user's vision problems, to ensure that the user can accurately and clearly obtain relevant picture information when using the terminal device, thereby providing the user with a humanized visual experience.

[0083] Among them, the terminal device described in the embodiment of the present application can provide an interface display service for the user. Exemplarily, the interface display service may include but is not limited to display services of VR interface, AR interface, XR interface, MR interface, etc.

[0084] In some embodiments, the terminal device described in the embodiments of the present application may be a smart head-mounted device, such as VR glasses, AR glasses, XR glasses, MR glasses and other smart glasses. However, the application does not limit the specific functions and types of the terminal device. For example, the terminal device may also include but is not limited to mobile phones, netbooks, tablet computers, vehicle-mounted devices, wearable devices (such as smart watches, smart bracelets, etc.), cameras (such as SLR cameras, card cameras, etc.), personal computers (personal computers, PCs) (including desktop computers or laptops), PDAs, PDAs, PMPs, smart screen devices, vehicle-mounted devices, AR / VR / XR / MR devices, televisions or somatosensory game consoles in human-computer interaction scenarios, and other electronic devices that have the function of detecting user vision conditions and adapting optical parameters based on user vision conditions.

[0085] For example, please refer to Figure 1 , Figure 1 FIG. 1 is a schematic diagram showing the hardware structure of a terminal device provided in an embodiment of the present application. Figure 1As shown, the terminal device may include a processor 110, a memory (including an external memory interface 120 and an internal memory 121), a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a camera 191, a display screen 192, etc. Among them, the sensor module 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

[0086] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the terminal device. In other embodiments of the present application, the terminal device may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0087] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a flight controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors.

[0088] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0089] In the embodiment of the present application, the processor 110 may instruct one or more modules such as the camera 191 and the sensor module 180 to collect user-related information when a preset trigger condition is met. For example, the preset trigger condition is met, such as receiving a preset trigger action, not finding the user's vision information, etc. The user-related information may include but is not limited to the user's visual focus area, etc.

[0090] Furthermore, in an embodiment of the present application, the processor 110 can also determine the optical parameter adjustment strategy corresponding to the display screen 192 based on user-related information collected by one or more modules such as the camera 191 and the sensor module 180, and instruct the display screen 192 to make corresponding optical parameter adjustments.

[0091] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0092] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be coupled to the touch sensor, microphone, camera 191, etc. through different I2C bus interfaces.

[0093] The PCM interface can be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface to implement the function of answering a call via a Bluetooth headset; or, receive the audio signal input by the wireless communication module 160 via the PCM interface to obtain audio data collected by a wireless microphone, such as audio data obtained after directional sound pickup.

[0094] The MIPI interface can be used to connect the processor 110 with the display screen 192, the camera 191 and other devices. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 191 communicate through the CSI interface to realize the shooting function of the terminal device. The processor 110 and the display screen 192 communicate through the DSI interface to realize the display function of the terminal device, such as realizing the display function of virtual reality pictures, augmented reality pictures, etc.

[0095] In some embodiments of the present application, an I2S interface or a MIPI interface may be used to transmit image information captured by the camera 191 to the processor 110 .

[0096] It should be understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration and does not constitute a structural limitation on the terminal device. In other embodiments of the present application, the terminal device may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0097] The charging management module 140 is used to receive charging input from the charger. The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, the internal memory 121, the display screen 192, the camera 191 and the wireless communication module 160.

[0098] The wireless communication function of the terminal device can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0099] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the terminal device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0100] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to terminal devices. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0101] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as WiFi networks), Bluetooth BT, global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) and the like applied to the terminal device. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of the signal, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0102] In some embodiments, the antenna 1 of the terminal device is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the terminal device can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0103] The terminal device implements the display function through a GPU, a display screen 192, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 192 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0104] The display screen 192 is used to display images, videos, etc. The display screen 192 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the terminal device may include 1 or N display screens 192, where N is a positive integer greater than 1.

[0105] In some embodiments of the present application, the display screen 192 can be used to display visual content, such as virtual information generated based on VR / AR / XR / MR technology.

[0106] In some embodiments of the present application, the display screen 192 may also be used to provide a see-through function so that the user can see visual content in the real environment through the display screen 192 .

[0107] Among them, in the embodiment of the present application, the display screen 192 can support the display of images, such as a refractive power test image, an astigmatism table (also called a clock table), a color weakness detection chart, a visual field range detection chart, etc.

[0108] The camera 191 is used to capture screen information, such as static images or videos. For example, in the embodiment of the present application, the camera 191 can be used to collect user information such as the user's iris, user's facial features, and perform user eye tracking.

[0109] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, user identity information (such as passwords, voice information, iris information, fingerprint information, facial features, etc.) and user vision information (such as myopia information, hyperopia information, astigmatism information, night vision information, color weakness information, visual field information, etc.) can be stored in the external memory card.

[0110] Internal memory 121 may be used to store computer executable program code. For example, the computer program may include an operating system program and an application program. The operating system may include but is not limited to apple The executable program code includes instructions. The processor 110 executes various functional applications and data processing of the terminal device by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. The program storage area may store an operating system, an application required for at least one function, etc.

[0111] The storage data area can store data created during the use of the terminal device, etc. For example, the storage data area can store user identity information (such as password, voice information, iris information, fingerprint information, etc.) and user vision information (such as myopia information, hyperopia information, astigmatism information, night vision information, color weakness information, visual field information, etc.) and other information.

[0112] In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the terminal device, such as user identification, matching of user vision information, adjustment of optical parameters, etc., by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0113] The terminal device can realize audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C and the application processor, such as music playing and recording. For the specific working principles and functions of the audio module 170, the speaker 170A, the receiver 170B and the microphone 170C, reference can be made to the introduction in the conventional technology.

[0114] It is understandable that this application Figure 1 The illustrated structure does not constitute a specific limitation on the terminal device. In other embodiments of the present application, the terminal device may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0115] In some embodiments, please refer to Figure 2 , Figure 2 Taking the terminal device as smart glasses as an example, a structural schematic diagram of a terminal device provided in an embodiment of the present application is shown.

[0116] like Figure 2As shown, the smart glasses include a camera mounted on the frame, a processor (such as a CPU, etc.) and the like (other modules such as a wireless communication module and a sensor are not shown, and can be referred to as Figure 1 The optical module is mainly used for imaging of the smart glasses.

[0117] Among them, the optical module includes an optical combiner, an optical waveguide / prism / free-form surface, etc.

[0118] It is understandable that since smart glasses need to provide a see-through function, that is, smart glasses must support users to see the real environment through the smart glasses, and also support users to see virtual information through the smart glasses. Therefore, the imaging system of smart glasses cannot block the user's line of sight. This requires an optical combiner to "stack" the virtual information and the real environment into one, complement each other, and "enhance" each other. Exemplarily, the optical combiner is a curved mirror semi-reflective Birdbath.

[0119] As three optical lens components, optical waveguides, prisms and free-form surfaces can reflect, refract and diffract the light beams emitted by the micro display screen, and finally project them onto the user's retina to form an image.

[0120] Among them, the prism can split the light beam of the image source or diffract the light beam into the human eye to form an image through a transparent object surrounded by planes that intersect each other but are not parallel to each other.

[0121] The free-form surface can refract the light beam from the image source through an optical surface that does not have translational symmetry or rotational symmetry, and then the light beam enters the human eye to form an image.

[0122] The optical waveguide can be a transparent substrate with a high refractive index. A specific coupling-in structure is arranged on the side of the substrate of the optical waveguide. The coupling-in structure can couple the light beam of the image source. The light beam of the coupled image source can be totally reflected and propagated in the substrate of the optical waveguide until it is coupled out through a specific coupling-out structure when it is close to the human eye, enters the human eye, and forms an image. Exemplarily, the optical waveguide includes a geometric reflection waveguide, a diffraction-etched grating waveguide, a holographic grating waveguide, and the like.

[0123] For the specific structure of smart glasses and the specific working principle of each module, please refer to conventional technology, and the present application embodiment will not be repeated. Figure 2 This is only an example of the structure of smart glasses, and this application does not limit the specific structure of the smart glasses.

[0124] It should be noted that the embodiments of the present application do not limit the specific scenarios in which the optical parameter setting method can be applied. For example, the optical parameter setting method of the device provided in the embodiments of the present application can be applied to office scenarios, game scenarios, navigation scenarios, medical scenarios, educational scenarios, and other scenarios that rely on terminal devices such as smart glasses.

[0125] The following will describe in detail the optical parameter setting method of the device provided in the embodiment of the present application in conjunction with the accompanying drawings.

[0126] For example, please refer to Figure 3 , Figure 3 Taking the terminal device as smart glasses as an example, a flow chart of a method for setting optical parameters of a device provided by an embodiment of the present application is shown. Figure 3 As shown, the method may include S301-S303, or S301-S302 and S304-S306:

[0127] S301: The smart glasses collect user information.

[0128] The user information may include, but is not limited to, one or more of a password input by a user, voice information input by a user, iris information of a user, fingerprint information input by a user, facial features of a user, and the like.

[0129] In some embodiments, the smart glasses can determine that a user is using the smart glasses when the smart glasses meet preset conditions, thereby triggering the collection of user information. Exemplarily, the smart glasses meeting the preset conditions may include but are not limited to: the posture of the smart glasses undergoes a preset change, the smart glasses receive a preset operation, etc.

[0130] For example, when a user wants to use smart glasses and then picks up the smart glasses and puts them on, the spatial posture of the smart glasses often undergoes a movement process. Based on this, the smart glasses can pre-store information about the spatial posture change process. When the smart glasses detect that their posture has undergone a preset change, the smart glasses can determine that a user is using the smart glasses, thereby triggering the collection of user information.

[0131] For another example, when a user wants to use smart glasses, the user usually turns on the switch of the smart glasses. Based on this, a trigger action can be pre-set in the smart glasses. When the switch of the smart glasses is turned on by the user, the smart glasses can determine that the user is using the smart glasses, thereby triggering the collection of user information.

[0132] It should be noted that the trigger mechanism for the above-mentioned smart glasses to collect user information is only an example, and this application does not make any specific limitations on this. For example, smart glasses can also trigger the collection of user information when receiving preset instructions such as voice commands. The specific details may depend on the specific hardware and software configuration, functions or operating mechanisms of the terminal device.

[0133] S302: Based on the collected user information, the smart glasses obtain corresponding vision information from the stored information.

[0134] The smart glasses may have the function of locally storing the vision information of the user using the smart glasses. As an example, when user A uses the smart glasses, the smart glasses may locally store the corresponding relationship between the vision information of user A and the user information of user A as part of the stored information.

[0135] In some implementations, after collecting user information of a user using the smart glasses, the smart glasses may use the user information as an index to search in the stored information to obtain corresponding vision information.

[0136] In some embodiments, the vision information obtained by the smart glasses from the stored information based on the user information may be the vision information of the user measured by the smart glasses last time.

[0137] Among them, the vision information described in the embodiment of the present application includes but is not limited to at least one of myopia, hyperopia, astigmatism, night vision, color weakness, field of view, etc. Exemplarily, myopia may include whether myopia, myopia degree (including left eye myopia degree and right eye myopia degree); hyperopia may include whether hyperopia, hyperopia degree (including left eye hyperopia degree and right eye hyperopia degree); astigmatism may include whether astigmatism, astigmatism degree (including left eye astigmatism degree and right eye astigmatism degree); night vision may include whether night vision, night vision degree level; color weakness may include whether color weakness, color weakness classification, color weakness degree level, etc.; field of view may include field of view, etc.

[0138] It should be noted that the embodiments of the present application do not limit the form in which the user's vision information is expressed in the smart glasses. For example, in some embodiments, the degree of myopia and hyperopia can also be expressed in the form of diopter values.

[0139] When the smart glasses match the corresponding vision information in the stored information according to the collected user information, the smart glasses may continue to execute S303.

[0140] S303: The smart glasses perform corresponding optical parameter settings based on the acquired vision information.

[0141] The optical parameters may include but are not limited to one or more of the refractive power value, astigmatism axis, three-primary color contrast, display brightness value, etc.

[0142] In some embodiments, if the vision information obtained by the smart glasses includes that the a-eye of user A is myopic by 300 degrees, the smart glasses can set the diopter value of the a-lens of the smart glasses to -3.00D. Alternatively, if the vision information obtained by the smart glasses indicates that the a-eye of user A is hyperopic by 200 degrees, the smart glasses can set the diopter value of the a-lens of the smart glasses to 2.00D. Exemplarily, in an embodiment of the present application, the smart glasses can adjust the diopter value of the lens (i.e., set the diopter value) by moving the lens position (such as by moving the lens position with a knob). Among them, the a-eye can be the left eye or the right eye. The a-lens of the smart glasses is the lens corresponding to the a-eye of user A. Based on this, the diopter value can be adjusted to make the diopter corresponding to the displayed image meet the actual needs of the user, so that the light can be correctly focused on the user's retina, so that the user can clearly see the displayed picture.

[0143] In some embodiments, if the vision information acquired by the smart glasses indicates that the astigmatism axis of the eye a of the user A is 200 degrees, the smart glasses can adjust the curvature radius and axial parameters of the lens a of the smart glasses accordingly. Based on this, by adjusting the curvature radius and axial parameters, the light can be correctly focused on the user's retina, so that the user can clearly see the displayed image.

[0144] In some embodiments, if the vision information acquired by the smart glasses includes the night vision level (such as night blindness level) of user A's eye a as L n (n is a positive integer) level, the smart glasses can adjust the brightness value of the displayed image corresponding to the a lens of the smart glasses to the night blindness level L n Based on this, by enhancing the brightness value of the image displayed when the night blind user uses the smart glasses, the corresponding eye brightness of the displayed image can meet the actual needs of the user, so that the user can clearly see the displayed image.

[0145] In some embodiments, if the vision information acquired by the smart glasses includes that the color blindness type of user A's eye a is type A, and the color blindness level (such as color blindness level) is L m (m is a positive integer) level, the smart glasses can enhance the red signal of the three primary colors of the displayed image corresponding to the a lens of the smart glasses to L m The intensity value corresponding to the level, for example, L for red signal m The intensity value corresponding to the level can be preset, and the color weakness level and the intensity value can be one-to-one corresponding. If the vision information obtained by the smart glasses indicates that the color weakness type of user A's eye a is type B, and the color weakness level (such as color weakness level) is L mlevel, the smart glasses can enhance the green signal of the three primary colors of the displayed image corresponding to the a lens of the smart glasses to L m The intensity value corresponding to the level, for example, L for green signal m The intensity value corresponding to the level can be preset, and the color weakness level and the intensity value can be one-to-one corresponding. Based on this, by changing the contrast between the target color and other colors in the three primary colors, the contrast of the three primary colors corresponding to the displayed image can be made to meet the actual needs of the user, so that each color signal can sufficiently stimulate the red-sensitive pigment in the user's cone cells, thereby enabling the user to distinguish colors normally. It should be noted that when the user's eyes are other color weakness types, the method of adjusting the color signal with poor user discrimination ability can refer to the adjustment method when the color weakness type is type A or type B, which will not be repeated here.

[0146] In some embodiments, if the vision information acquired by the smart glasses includes that the field of view of user A's eye a (such as 50 degrees above, 60 degrees to the nose, 70 degrees below, and 90 degrees outside) is smaller than the normal range, the smart glasses can increase the framing range of the framing camera corresponding to the a lens of the smart glasses so that the field of view can be compensated to the normal range. Based on this, by adjusting the framing range, the display range of the displayed image in the user's field of view can meet the actual needs of the user, so that the user can see the complete display screen.

[0147] It should be noted that the embodiments of the present application do not specifically limit the user's vision information, nor do they specifically limit the optical parameter setting process for the vision information. For example, the optical parameter setting may be for a single vision problem (such as myopia) or for multiple vision problems (such as myopia and astigmatism). The smart glasses described in the embodiments of the present application have the ability to set corresponding optical parameters for any vision problem of the user.

[0148] In some embodiments, before the smart glasses perform corresponding optical parameter settings based on the acquired vision information, the smart glasses may notify the user of the optical parameters to be configured so that the user can understand the relevant situation in a timely manner. For example, the smart glasses may notify the user of the optical parameters to be configured through voice or interface display.

[0149] In some embodiments, before the smart glasses perform corresponding optical parameter settings based on the acquired vision information, the smart glasses may also present the user with an option to confirm the optical parameters to be configured. When the user confirms the configuration strategy, the smart glasses may continue to execute the subsequent process to perform the corresponding optical parameter settings. When the user rejects the configuration strategy, the smart glasses may provide a setting option for the user to manually modify or re-enter their vision information, or may start a custom vision information measurement process according to the user's instructions, or may start a standard vision information measurement process to perform vision information measurement, such as executing Figure 3 S304 and S305 are shown.

[0150] In some embodiments, when the smart glasses do not match corresponding vision information in the stored information based on the collected user information, the smart glasses may continue to execute S304-S306.

[0151] S304: The smart glasses measure vision information according to preset steps and determine an optical parameter configuration strategy.

[0152] In some embodiments, the smart glasses can measure vision information in sequence based on a preset measurement order to obtain at least one of the user's vision conditions such as myopia, hyperopia, astigmatism, night vision, color deficiency, and visual field range.

[0153] In some embodiments, illustratively, the preset measurement order is such as myopia → hyperopia → astigmatism → night vision → color weakness → visual field, or such as diopter → astigmatism → night vision → color weakness → visual field, and the embodiments of the present application do not limit the specific measurement order. In addition, the above-mentioned multiple measurement items can also be combined and performed simultaneously, and the preset measurement order can also be such as diopter & visual field → astigmatism → night vision → color weakness, which is not specifically limited in the embodiments of the present application, and depends on the specific device function, configuration, and usage scenario.

[0154] In some embodiments, the preset measurement order is related to the distribution of vision problems in the statistical population. For example, assuming that the distribution of vision problems in the statistical population is specifically myopia > hyperopia > astigmatism > night vision > color blindness > narrow visual field, the measurement can be performed in the order of myopia → hyperopia → astigmatism → night vision → color blindness → visual field.

[0155] The following will introduce specific methods of measuring vision information using smart glasses with examples.

[0156] A. Myopia

[0157] In some embodiments, Figure 4As shown in (a) in the figure, the smart glasses can display a diopter test image (referred to as the first image) to the user. The diopter test image may include multiple image areas, each of which displays image elements corresponding to different diopters. The smart glasses can detect the image area that can be seen clearly as reported by the user, and determine the user's myopia based on the user's feedback, for example, determining the user's myopia based on the diopter value corresponding to the image area that can be seen clearly as reported by the user. The diopter test image may include but is not limited to Figure 5 Eye chart shown.

[0158] For example, the user's feedback on the diopter test image in the embodiment of the present application may be the user's active feedback, such as the user can provide manual feedback (such as manually clicking on the corresponding area, etc.), voice feedback, or action feedback (such as blinking, etc.) on the image area that can be seen clearly, etc. Alternatively, the user's feedback on the diopter test image may also be the user's unconscious feedback. For example, when the user can clearly see the image elements in a certain area of ​​the diopter test image, the user's eyes tend to focus on the area. Based on this, the smart glasses can identify the current focus position of the user's eyes by tracking the user's eyes, determine the image area that the user can see clearly, and then determine the user's myopia.

[0159] In some embodiments, Figure 4 As shown in (b), the smart glasses can display the diopter test images at different diopters to the user in a step-by-step manner, such as displaying the second image, the third image, etc. in sequence, wherein the diopter value of the second image is greater than the diopter value of the third image. The smart glasses can detect the diopter test image that can be seen clearly by the user's active feedback or unconscious feedback, and determine the user's myopia based on the user's feedback, for example, determine the user's myopia based on the diopter value corresponding to the diopter test image that can be seen clearly by the user's feedback. Exemplarily, the smart glasses can achieve the conversion between different diopters by moving the lens position (such as the way a knob moves the lens position). During the measurement process, if the user is not satisfied with the diopter test image of a certain diopter, the smart glasses can fall back to the diopter test image of the previous diopter according to the user's feedback as the diopter suitable for the user.

[0160] For example, in the embodiment of the present application, the smart glasses can measure the myopia of each eyeglass of the user in the order of left lens → right lens or right lens → left lens. For example, when testing the left eye, the smart glasses can only display the image in the field of view of the left lens; when testing the right eye, the smart glasses can only display the image in the field of view of the right lens.

[0161] B. Hyperopia

[0162] The measurement of hyperopia is essentially the measurement of refraction, so the method for measuring hyperopia can also refer to the method for obtaining myopia.

[0163] C. Astigmatism

[0164] In some embodiments, Figure 6 As shown in (a), smart glasses can show users Figure 6 The astigmatism table (also called a clock table) shown in (b) in the figure detects the clearly visible lines that the user actively or unconsciously feeds back, and determines the user's astigmatism based on the user's feedback, such as obtaining the astigmatism axis based on the method of the smallest Arabic numeral corresponding to the line × 30.

[0165] For example, Figure 6 As shown in (b), if the user can clearly see the lines at 2 o'clock and 8 o'clock, it means that the astigmatism axis of the user's eye is 2×30°=60°; if the user can clearly see the lines between 1-2 o'clock and 8-9 o'clock, it means that the astigmatism axis of the user's eye is 1.5×30°=45°

[0166] D. Night vision

[0167] In some embodiments, Figure 7 As shown in (a) in the figure, the smart glasses can display images of different brightness to the user in a step-by-step manner (the same image or different images), detect the images of brightness that the user can see clearly actively or unconsciously, and determine the user's night vision based on the user's feedback. For example, the user's night vision level is determined based on the brightness value corresponding to the image of brightness that the user can see clearly. Each image of different brightness will correspond to a night vision level. For example, the images of different brightness in a step-by-step manner may be as follows: Figure 7 During the measurement process, if the user is not satisfied with an image of a certain brightness, the smart glasses can revert to an image of the previous brightness based on the user's feedback as the brightness suitable for the user.

[0168] In some embodiments, the smart glasses may display images including different brightness areas to the user, detect the brightness areas that can be seen clearly as actively or unconsciously fed back by the user, and determine the user's night vision based on the user's feedback, for example, determine the user's night vision level based on the brightness values ​​corresponding to the brightness areas that can be seen clearly as fed back by the user. Each brightness area corresponds to a night vision level.

[0169] E. color weakness

[0170] In some embodiments, Figure 8As shown, the smart glasses can display a color weakness detection chart, such as Ishihara's color weakness detection chart, to the user, and detect the color disc that the user actively or unconsciously feedbacks cannot see clearly, and determine the color weakness type of the user based on the user's feedback, for example, determine the color weakness type of the user based on the color features of the color disc that the user feedbacks cannot see clearly. After determining the color weakness type of the user, further, such as Figure 8 As shown, the smart glasses can display color weakness detection images of different three-primary color contrasts to the user for the determined color weakness classification, such as displaying color weakness detection images of different three-primary color contrasts in a stepwise manner, and detecting the color disk that can be seen clearly according to the user's active or unconscious feedback, and determining the user's color weakness level based on the user's feedback, for example, determining the user's color weakness level based on the three-primary color contrast of the color disk that can be seen clearly according to the user's feedback. During the measurement process, if the user is not satisfied with the color weakness detection image of a certain contrast, the smart glasses can fall back to the color weakness detection image of the previous contrast according to the user's feedback as the three-primary color contrast suitable for the user.

[0171] F. Field of view

[0172] In some embodiments, Fig. 9 As shown, the smart glasses can display a field of view detection map to the user. When the user looks directly at the center of the field of view detection map, the smart glasses detect the outermost edge that can be seen clearly as reported by the user, and determine the user's field of view based on the user's feedback, for example, determining the user's field of view based on the position information of the outermost edge that the user can see clearly.

[0173] Exemplarily, when the smart glasses perform the above-mentioned vision information measurement, the smart glasses can perform corresponding measurements in the order of left lens→right lens or right lens→left lens to obtain the user's left eye vision information and right eye vision information respectively.

[0174] It should be noted that the above-mentioned specific measurement method and process of the user's vision information are only examples, and the embodiments of the present application do not limit the specific methods. For example, the smart glasses can also obtain the user's various vision conditions based on other conventional detection principles. In addition, in the process of measuring vision information, the smart glasses can guide (such as interface guidance, voice guidance, etc.) the user to cooperate in the corresponding measurement, such as cooperating in providing relevant feedback, etc.

[0175] S305: The smart glasses perform corresponding optical parameter settings based on the measured vision information.

[0176] It should be noted that the specific implementation of setting the corresponding optical parameters based on the vision information in step S305 can refer to the relevant description of setting the corresponding optical parameters based on the vision information in step S303, which will not be repeated here.

[0177] S306: The smart glasses save the measured vision information of the user.

[0178] For example, the smart glasses can store the correspondence between the detected user information and the measured vision information of the user locally. Based on this, the next time the user uses the smart glasses, the smart glasses can automatically adjust the optical parameters of the smart glasses to a state suitable for the user without measurement or manual input by the user.

[0179] It should be noted that the embodiments of the present application do not limit the specific execution order of S305 and S306. For example, the smart watch may execute S305 first and then S306, or may execute S306 first and then S305, or may execute S305 and S306 at the same time.

[0180] It can be understood that based on the optical parameter setting method of the device provided in the embodiment of the present application, when the user uses the terminal device, the terminal device can automatically obtain the user's specific vision conditions through measurement, such as whether the user has myopia, hyperopia, astigmatism, night vision, color weakness, narrow field of vision and other vision problems, as well as the severity of the user's vision problems, and perform corresponding optical parameter adaptation based on the user's specific vision conditions. At the same time, the terminal device can save the measured user's vision information in the device, so that the user can determine the user's vision condition without measuring it again when the user uses the terminal device next time, and then adjust the optical parameters of the smart glasses to a state adapted to the user. Based on this solution, while simplifying the user's operation, it can ensure that the user can accurately and clearly obtain relevant picture information during the use of the terminal device, providing the user with a humanized visual experience.

[0181] It should be noted that the above embodiment is only an example of the implementation process of the idea of ​​automatic measurement → optical parameter adaptation + information storage → index information → optical parameter adaptation. In some embodiments, based on this idea, the following process can also be used to complete the adaptation of optical parameters: automatic measurement of vision information → optical parameter adaptation → optical parameter configuration policy storage → index optical parameter configuration policy → optical parameter adaptation. In other words, after the terminal device obtains the specific vision of the user through measurement and performs corresponding optical parameter adaptation based on the specific vision of the user, the terminal device can also save the optical parameter configuration policy corresponding to the user. When the user uses the terminal device next time, the terminal device can directly index the optical parameter configuration policy applicable to the user from the stored information, and further perform corresponding optical parameter settings based on the optical parameter configuration policy.

[0182] It should be understood that the various schemes of the embodiments of the present application can be used in reasonable combination, and the explanations or descriptions of the various terms appearing in the embodiments can be mutually referenced or explained in the various embodiments, without limitation.

[0183] It should also be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0184] It is understandable that, in order to implement the functions of any of the above-mentioned embodiments, the terminal device (such as smart glasses) includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0185] The embodiment of the present application can divide the terminal device (such as smart glasses) into functional modules. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0186] In some embodiments, Fig.10 As shown, the terminal device (such as smart glasses) may include a measuring unit 1010, a storage unit 1020 and a processing unit 1030 according to the division of functional modules. Among them, the measuring unit 1010 is used to measure the user's vision, obtain user information, etc. The storage unit 1020 stores computer program instructions and data created during the use of the terminal device, such as user information, vision information, etc. The processing unit 1030 performs corresponding optical parameter adaptation according to the user's vision information. Of course, in some examples, the terminal device may also include other units, such as a display unit, etc., which are not specifically limited in the embodiments of the present application.

[0187] It should also be understood that each module in the terminal device (such as smart glasses) can be implemented in software and / or hardware form, without specific limitation. In other words, the terminal device (such as smart glasses) is presented in the form of functional modules. The "module" here can refer to a specific application integrated circuit ASIC, a circuit, a processor and memory that executes one or more software or firmware programs, an integrated logic circuit, and / or other devices that can provide the above functions.

[0188] In an optional manner, when data transmission is implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is implemented in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a digital video disk (DVD)), or a semiconductor medium (e.g., a solid state disk (SSD)), etc.

[0189] The steps of the method or algorithm described in conjunction with the embodiments of the present application can be implemented in hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, register, hard disk, mobile hard disk, CD-ROM or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC. In addition, the ASIC can be located in a terminal device (such as smart glasses). Of course, the processor and the storage medium can also exist as discrete components.

[0190] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

Claims

1. A method for setting optical parameters of a device, It is characterized in that Applied to a terminal device, the method comprises: Collect user information of users; Searching for corresponding vision information from stored information according to the user information, wherein the stored information includes a correspondence between user information and vision information of one or more users, wherein the vision information includes at least one of the user's myopia, hyperopia, astigmatism, night vision, color blindness, and visual field; When the corresponding vision information is found from the stored information, the corresponding optical parameters are set according to the found vision information; or, When the corresponding vision information is not found in the stored information, the vision information is measured to obtain the vision information of the user, and corresponding optical parameters are set according to the vision information of the user; The optical parameters include one or more of the following: diopter value, astigmatism axis, three-primary color contrast, and display brightness value.

2. The method according to claim 1, It is characterized in that After measuring the vision information of the user, the method further includes: The measured vision information of the user is saved.

3. The method according to claim 1 or 2, It is characterized in that The step of measuring vision information to obtain the vision information of the user includes: Perform vision information measurement in sequence based on a preset measurement order to obtain the user's myopia, hyperopia, astigmatism, night vision, color deficiency, and multiple vision conditions within the visual field; The preset measurement sequence is related to the distribution of vision problems in the statistical population or is determined according to the user's instructions.

4. The method according to any one of claims 1 to 3, It is characterized in that The step of measuring vision information to obtain the vision information of the user includes: presenting an astigmatism table to the user; Detecting the lines in the astigmatism chart that can be seen clearly as reported by the user; The astigmatism condition of the user is determined according to the feedback of the user.

5. The method according to any one of claims 1 to 4, It is characterized in that The step of measuring vision information to obtain the vision information of the user includes: Displaying a plurality of images of different brightness to the user in a step-by-step manner; Detecting an image that the user can see clearly among the multiple images of different brightness fed back by the user; The night vision condition of the user is determined according to the brightness value corresponding to the image that the user can see clearly.

6. The method according to any one of claims 1 to 4, It is characterized in that The step of measuring vision information to obtain the vision information of the user includes: Displaying images including different brightness areas to the user in a step-by-step manner; Detecting a brightness area that the user can see clearly according to the user feedback; The night vision condition of the user is determined according to the brightness value corresponding to the brightness area that the user can see clearly.

7. The method according to any one of claims 1 to 6, It is characterized in that The step of measuring vision information to obtain the vision information of the user includes: Displaying a color weakness detection chart to the user, wherein the color weakness detection chart includes a plurality of detection color disks; Detecting the color disk that the user cannot see clearly as reported by the user; The color deficiency type of the user is determined based on the color disk that the user cannot see clearly.

8. The method according to claim 7, It is characterized in that After determining the color deficiency type of the user, the method further includes: Displaying color weakness detection images with different three-primary color contrasts to the user; Detecting the color disc that the user can see clearly in the color weakness detection image with different three-primary color contrasts fed back by the user; The color blindness level of the user is determined according to the contrast ratio of the three primary colors corresponding to the color disk that the user can see clearly.

9. The method according to any one of claims 1 to 8, It is characterized in that The step of measuring vision information to obtain the vision information of the user includes: Displaying a visual field detection map to the user; Detecting the outer edge of the visual field detection image that can be clearly seen as fed back by the user; The user's field of view is determined according to the position information of the outer edge of the field of view detection image that can be clearly seen.

10. The method according to any one of claims 1 to 9, It is characterized in that The step of measuring vision information to obtain the vision information of the user includes: Displaying a plurality of diopter test images at different diopters to the user in a step-by-step manner; Detecting a refractive power test image that the user can see clearly among the multiple refractive power test images at different refractive powers fed back by the user; The myopia and / or hyperopia of the user is determined according to the diopter value corresponding to the diopter test image that the user can see clearly.

11. The method according to any one of claims 1 to 10, It is characterized in that Before collecting the user information of the user, the method further includes: When a preset condition is met, it is determined that the user uses the terminal device; the preset condition includes one or more of the following: a preset change occurs in the posture of the terminal device, the terminal device receives a preset operation, and the terminal device receives a preset instruction.

12. The method according to any one of claims 1 to 11, It is characterized in that Before performing corresponding optical parameter setting, the method further includes: Notifying the user of an optical parameter configuration strategy determined based on the vision information; Continue to set corresponding optical parameters according to the user's feedback or provide the user with an option of manually inputting vision information.

13. The method according to any one of claims 1 to 12, It is characterized in that The user information of the user includes one or more of the following: a password input by the user, voice information input by the user, iris information of the user, fingerprint information input by the user, and facial features of the user.

14. A terminal device, It is characterized in that The terminal device comprises: A memory, used to store computer program instructions, user information, and vision information corresponding to the user information; A display, used for interface display; A processor, configured to execute the computer program instructions so that the terminal device implements the method according to any one of claims 1 to 13.

15. A pair of smart glasses, It is characterized in that The smart glasses include: A memory, used to store computer program instructions, user information, and vision information corresponding to the user information; A display, used for interface display; A processor, configured to execute the computer program instructions so that the smart glasses implement the method as described in any one of claims 1-13.

16. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores computer program instructions, and when the computer program instructions are executed by a processing circuit, the method according to any one of claims 1 to 13 is implemented.

17. A computer program product comprising instructions, It is characterized in that When the computer program product is run on a computer, the computer is caused to execute the method according to any one of claims 1 to 13.

18. A chip system, It is characterized in that The chip system includes a processing circuit and a storage medium, wherein the storage medium stores computer program instructions; when the computer program instructions are executed by the processing circuit, the method according to any one of claims 1 to 13 is implemented.

Images