An imaging adjustment apparatus and method, wearable device, storage medium
Patent Information
- Application Number
- CN202110836879.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-07-23
- Publication Date
- 2026-09-04
- Estimated Expiration
- 2041-07-23
AI Technical Summary
虽然,VR/AR眼保仪为近视患者带来了福音,但是基础版的VR/AR眼保仪在调距矫正策略上仍存在着缺陷,这就使得VR/AR眼保仪的矫正效果大打折扣
[0053] Compared with related technologies, the imaging adjustment device and method, wearable device, and storage medium of this application determine the eye state by converting the second light reflected from the user's eye into an electrical signal, and adjust the imaging surface of the imaging system composed of the optical system and the eye according to the eye state. It can adjust the position of the imaging surface of the imaging system according to the user's squinting or open-eye state, so as to monitor the user's vision in a timely and automatic manner, and adjust the imaging position in a timely and automatic manner according to the monitoring results, thereby improving the user's comfort.
Smart Images

Figure CN115670368B_ABST
Abstract
Description
Technical Field
[0001] This application relates to, but is not limited to, the field of smart wearable technology, and particularly to an imaging adjustment device and method, wearable devices, and storage media. Background Technology
[0002] With the advancement of technology, people have more and more ways to entertain themselves. VR (Virtual Reality) and AR (Augmented Reality) technologies are gradually being applied to audio-visual entertainment, greatly enhancing the fun of various audio-visual entertainment devices. The emergence of VR / AR eye care devices allows patients with pseudomyopia to correct their myopia while using VR or AR devices for entertainment. Although VR / AR eye care devices have brought good news to myopia patients, basic versions still have shortcomings in their distance adjustment correction strategies, which significantly reduces the corrective effect. Summary of the Invention
[0003] The problem to be solved by the embodiments of this application is to provide an imaging adjustment device and method, a wearable device, and a storage medium to improve user comfort.
[0004] To address the aforementioned technical problems, this application provides an imaging adjustment device for adjusting the imaging surface of an imaging system composed of an optical system and a user's eye, comprising: a light-emitting device, a photoelectric conversion device, a control device, and a driving device;
[0005] The light-emitting device is used to emit a first light ray so that the first light ray shines on the user's eyes;
[0006] The photoelectric conversion device is used to perform photoelectric conversion based on the second light reflected from the user's eye to generate an electrical signal, and to provide the generated electrical signal to the control device.
[0007] The control device is used to determine the user's eye state based on the electrical signal and control the drive device to work according to the user's eye state.
[0008] The driving device is used to adjust the position of the imaging surface of the imaging system under the control of the control device.
[0009] In some embodiments, the wavelength of the first light emitted by the light-emitting device is within the spectral response range of the photoelectric conversion device.
[0010] In some embodiments, the light-emitting device and the photoelectric conversion device are disposed on the side of the optical imaging system to avoid obstructing the optical path of the optical imaging system.
[0011] In some embodiments, the imaging adjustment device further includes a comparison device;
[0012] The photoelectric conversion device is used to provide the generated electrical signal to the comparison device;
[0013] The comparison device is used to compare the electrical signal generated by the photoelectric conversion device with a preset electrical signal, generate a comparison result signal, and send the comparison result signal to the control device.
[0014] The control device is used to control the operation of the drive device according to the comparison result signal.
[0015] In some embodiments, the imaging adjustment device further includes a filtering device and a signal amplification device;
[0016] The filtering device is connected to the photoelectric conversion device and the signal amplification device, and is used to filter the electrical signal generated by the photoelectric conversion device.
[0017] The signal amplification device is connected to the filtering device and the comparison device, and is used to amplify the filtered signal and provide the amplified signal to the comparison device.
[0018] In some embodiments, the photoelectric conversion device includes a phototransistor and a signal conversion resistor;
[0019] The collector of the phototransistor is connected to the signal conversion resistor, and the connection node between the phototransistor and the signal conversion resistor serves as the output terminal of the photoelectric conversion device.
[0020] In some embodiments, the drive device includes an object distance adjustment motor;
[0021] The object distance adjustment motor is used to adjust the position of the imaging lens in the optical system under the control of the control device.
[0022] In some embodiments, the imaging adjustment device further includes an eye state acquisition device;
[0023] The eye state acquisition device is used to acquire eye state information;
[0024] The control device is used to control the operation of the drive device based on the electrical signal and the eye state information.
[0025] This application also provides a wearable device, including an optical system and an imaging adjustment device as described in any of the above embodiments, wherein the imaging adjustment device is used to adjust the imaging surface of the imaging system composed of the optical system and the user's eye.
[0026] In some embodiments, the wearable device also includes a screen;
[0027] The display surface of the screen faces the optical system.
[0028] In some embodiments, the imaging adjustment device adjusts the imaging surface of the imaging system by adjusting the position of the imaging lens in the optical system.
[0029] In some embodiments, the optical system includes a first imaging lens and a second imaging lens;
[0030] The first imaging lens is disposed between the eye and the second imaging lens;
[0031] The second imaging lens is disposed between the first imaging lens and the screen;
[0032] The imaging adjustment device is used to adjust the position of the first imaging lens or the second imaging lens, thereby adjusting the position of the imaging surface of the imaging system composed of the optical system and the eye.
[0033] This application embodiment also provides an imaging adjustment method, applied to any of the imaging adjustment devices described above, the method comprising:
[0034] The first ray of light is emitted so that it shines into the user's eyes;
[0035] The user's eye condition is determined based on the electrical signal generated after the photoelectric conversion of the second light. The second light is the light reflected from the user's eye after the first light shines on it.
[0036] The position of the imaging surface of the imaging system is adjusted according to the user's eye condition.
[0037] In some embodiments, the method further includes:
[0038] The initial position of the imaging surface of the imaging system is set, and the initial position is matched with the user's initial visual acuity.
[0039] In some embodiments, the user's eye state includes: the user's squinting state, the user's open-eye state, and the user's vision assessment results.
[0040] In some embodiments, after adjusting the position of the imaging surface of the imaging system according to the user's eye condition, the method further includes: adjusting the position of the imaging surface according to the vision assessment result at a preset cycle.
[0041] In some embodiments, setting the initial position of the imaging surface of the imaging system includes: setting the initial position of the imaging surface of the imaging system when a trigger condition is met, wherein the trigger condition includes one or more of the following:
[0042] The usage duration is greater than or equal to the preset adjustment cycle;
[0043] The time interval since the last adjustment is greater than or equal to N times the preset adjustment cycle, where N≥1;
[0044] The determined eye condition is the preset eye condition.
[0045] In some embodiments, the optical system includes a first imaging lens and a second imaging lens; the imaging system also includes a screen, wherein the first imaging lens is located between the screen and the user's eye, and the second imaging lens is located between the first imaging lens and the screen;
[0046] Adjusting the distance between the imaging surface of the imaging system and the user's eye includes:
[0047] Adjust the distance between the second imaging lens and the screen.
[0048] In some embodiments, adjusting the position of the imaging surface of the imaging system according to the user's eye state includes: adjusting the position of the imaging surface of the imaging system according to the user's eye state when a trigger condition is met, wherein the trigger condition includes one or more of the following:
[0049] The usage duration is greater than or equal to the preset adjustment cycle;
[0050] The time interval since the last adjustment is greater than or equal to N times the preset adjustment cycle, where N≥1;
[0051] The determined eye condition is the preset eye condition.
[0052] This application also provides a computer-readable storage medium for storing computer program instructions, wherein the computer program instructions, when executed, can implement any of the imaging adjustment methods described above.
[0053] Compared with related technologies, the imaging adjustment device and method, wearable device, and storage medium of this application determine the eye state by converting the second light reflected from the user's eye into an electrical signal, and adjust the imaging surface of the imaging system composed of the optical system and the eye according to the eye state. It can adjust the position of the imaging surface of the imaging system according to the user's squinting or open-eye state, so as to monitor the user's vision in a timely and automatic manner, and adjust the imaging position in a timely and automatic manner according to the monitoring results, thereby improving the user's comfort.
[0054] Other features and advantages of this application will be set forth in the following description, and will be apparent in part from the description, or may be learned by practicing the application. Other advantages of this application can be realized and obtained by means of the solutions described in the description and the accompanying drawings. Attached Figure Description
[0055] The accompanying drawings are used to provide an understanding of the technical solutions of this application and constitute a part of the specification. They are used together with the embodiments of this application to explain the technical solutions of this application and do not constitute a limitation on the technical solutions of this application.
[0056] Figure 1 A schematic diagram of the structure of an imaging plane adjustment device provided in an embodiment of this disclosure;
[0057] Figure 2 A schematic diagram illustrating the application structure of an imaging plane adjustment device provided in an embodiment of this disclosure;
[0058] Figure 3 A schematic diagram of the structure of the light-emitting device provided in the embodiments of this disclosure;
[0059] Figures 4a-4c A schematic diagram of the structure of the light-emitting device and photoelectric conversion device provided in the embodiments of this disclosure;
[0060] Figure 5 This is a schematic diagram of an imaging adjustment device provided in an embodiment of the present disclosure;
[0061] Figure 6 This is a schematic diagram of an imaging adjustment device provided in an embodiment of the present disclosure;
[0062] Figure 7 This is a schematic diagram of the application structure of an imaging adjustment device provided in an embodiment of the present disclosure;
[0063] Figure 8 Voltage timing diagram of the photoelectric conversion device received by the comparison device provided in the embodiments of this disclosure;
[0064] Figure 9 A timing diagram showing the output level of the comparison device to the control device provided in an embodiment of this disclosure;
[0065] Figure 10 This is a schematic diagram of the imaging adjustment device provided in the embodiments of this disclosure;
[0066] Figure 11 This is a schematic diagram of a wearable device structure provided in an embodiment of the present disclosure;
[0067] Figure 12This is a schematic diagram of a wearable device structure provided in an embodiment of the present disclosure;
[0068] Figure 13 This is a schematic diagram of the application structure of a wearable device provided in an embodiment of the present disclosure;
[0069] Figures 14a-14c This is a schematic diagram of optical path adjustment provided in an embodiment of the present disclosure;
[0070] Figures 15a-15c This is another schematic diagram of optical path adjustment provided in an embodiment of the present disclosure;
[0071] Figures 16a-16c This is another schematic diagram of optical path adjustment provided in an embodiment of the present disclosure;
[0072] Figures 17a-17c This is another schematic diagram of optical path adjustment provided in an embodiment of the present disclosure;
[0073] Figure 18 This is a flowchart of an imaging adjustment method provided in this disclosure;
[0074] Figure 19 The diagram shown is a schematic representation of the application structure of a wearable device provided in this disclosure.
[0075] Figure 20 This is a flowchart of an imaging adjustment method provided in this disclosure;
[0076] Figure 21 This is a flowchart of another imaging adjustment method provided in this disclosure. Detailed Implementation
[0077] To make the objectives, technical solutions, and advantages of the present invention clearer, the embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that, unless otherwise specified, the embodiments and features described in this application can be arbitrarily combined with each other.
[0078] Unless otherwise defined, the technical or scientific terms used in the embodiments of this application shall have the ordinary meaning understood by those skilled in the art to which this invention pertains. The terms "first," "second," and similar terms used in the embodiments of this application do not indicate any order, quantity, or importance, but are merely used to distinguish different components. Terms such as "comprising" or "including" encompass the elements or objects listed after the term and their equivalents, without excluding other elements or objects.
[0079] In this specification, for convenience, terms such as "middle," "upper," "lower," "front," "rear," "vertical," "horizontal," "top," "bottom," "inner," and "outer" are used to indicate orientation or positional relationships in conjunction with the accompanying drawings. This is solely for the purpose of simplifying the description and is not intended to indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, it should not be construed as a limitation of the invention. The positional relationships of the constituent elements may be appropriately varied depending on the direction in which each constituent element is described. Therefore, the use of terms not limited to those described in the specification may be appropriately replaced as needed.
[0080] In this specification, unless otherwise expressly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate component; and they can refer to the internal connection of two components. Those skilled in the art can understand the specific meaning of the above terms in this invention in light of the specific circumstances.
[0081] Currently, the correction strategies of VR or AR eye care devices are based on two main approaches: one is a preset adjustment correction strategy based on the patient's myopia, and the other is manual adjustment by the user. However, both strategies ignore two facts: first, a patient's myopia is dynamic, and the preset adjustment correction strategy may become unsuitable for the patient's eyes after a period of time, potentially harming their vision; second, when patients are immersed in VR entertainment, the probability of them actively adjusting their eyes is very low, rendering the active adjustment strategy largely idle in practical applications. This leads to a decrease in user comfort.
[0082] To address the issue of poor user comfort in existing eye massagers, such as... Figure 1 As shown, this application provides an imaging adjustment device 10, which is used to adjust the imaging surface of an imaging system composed of an optical system and a user's eye. The imaging adjustment device 10 includes: a light-emitting device 101, a photoelectric conversion device 102, a control device 103, and a driving device 104;
[0083] The light-emitting device 101 is used to emit a first light ray so that the first light ray shines on the user's eyes;
[0084] The photoelectric conversion device 102 is used to perform photoelectric conversion based on the second light reflected from the user's eye to generate an electrical signal, and to provide the generated electrical signal to the control device 103.
[0085] The control device 103 is used to determine the eye state based on electrical signals and control the drive device 104 to work according to the user's eye state.
[0086] The driving device 104 is used to adjust the position of the imaging surface of the imaging system under the control of the control device 103.
[0087] The imaging adjustment device provided in this application embodiment can determine the eye state based on the electrical signal generated by photoelectric conversion of the second light reflected from the user's eye, and adjust the imaging surface of the imaging system composed of the optical system and the eye according to the eye state; it can adjust the position of the imaging surface of the imaging system according to the user's eye state such as squinting or opening the eyes, so as to monitor the user's vision in a timely and automatic manner, so as to adjust the position of the imaging surface in a timely and automatic manner according to the monitoring results, thereby improving the user's comfort.
[0088] Studies show that nearsighted individuals subconsciously squint when their vision suddenly becomes blurry as they move to a distance. Firstly, squinting reduces the area of the cornea from which light enters, creating a small focusing effect. Secondly, the contraction of the orbicularis oculi muscle exerts pressure on the cornea, forcing it to change its refractive surface. This alters the angle of light refraction, allowing it to focus on the retina. Conversely, some farsighted individuals also subconsciously squint when their vision blurs as they move closer. Therefore, monitoring a user's eye state—whether they are open or squinting—can be used to assess vision and comfort. Squinting indicates an unsuitable imaging plane position and user discomfort, while open eyes suggest a suitable position and greater comfort.
[0089] Tests show that the reflectivity of the human eyelid is stronger than that of the eyeball surface. Therefore, when a user squints, the intensity of the second light ray reflected from the first light ray incident on the eyelid by the light-emitting device increases. As the intensity of the second light ray received by the photoelectric conversion device increases, the electrical signal generated by the photoelectric conversion also increases. Conversely, when a user opens their eyes, the intensity of the second light ray reflected from the first light ray incident on the eyelid by the light-emitting device decreases. As the intensity of the second light ray received by the photoelectric conversion device decreases, the electrical signal generated by the photoelectric conversion also decreases. Based on this principle, embodiments of this disclosure detect the user's squinting or open-eye state according to the magnitude of the electrical signal from the photoelectric conversion device.
[0090] The imaging adjustment device provided in this disclosure can be applied to the adjustment of the imaging surface position of an imaging system consisting of eyeglasses (such as myopia glasses, hyperopia glasses, 3D glasses, etc.), vision correction devices, head-mounted devices (such as helmets, VR eye care devices, AR eye care devices, other VR or AR devices, etc.) and eyes, but is not limited to these devices and scenarios.
[0091] Most eyeglasses currently come with a fixed prescription. When the actual prescription changes and no longer matches the original lens prescription, the user needs to go to an optician for a new eye exam and new lenses, often resulting in the original lenses being discarded, leading to resource waste. However, with the imaging adjustment device provided in this application, the prescription can be adjusted by changing the position of the imaging surface. This eliminates the need to replace the glasses when the original lens prescription becomes incompatible, significantly reducing lens waste.
[0092] In head-mounted devices, such as helmets, which currently rarely have vision correction functions, the imaging surface adjustment device provided in this application embodiment can be installed in the helmet, eliminating the need to wear glasses and enabling real-time monitoring and correction of vision.
[0093] In one exemplary embodiment, the eye state includes an open eye state, a squinting eye state, or the eye state is a user's vision assessment result.
[0094] In this embodiment of the disclosure, the user's vision assessment result can be obtained by using the imaging adjustment device 10 to assess the user's vision. The vision assessment result can be the user's vision limit determined based on the monitored state of the user's eyes. The imaging adjustment method can be referred to later, and will not be described in detail here.
[0095] The imaging adjustment device provided in this disclosure adjusts the imaging surface of the imaging system, which consists of an optical system and the eye, according to the user's eye condition. This allows for timely and automatic adjustment of the distance or focus of the imaging system, improving user comfort. Embodiments of this disclosure can also be used to correct a user's vision.
[0096] One application scenario of this disclosure is that the position of the imaging plane of the imaging system formed by the optical system and the eye can be adjusted in real time according to the user's eye opening or squinting state to adapt to the user's current eye prescription. This is equivalent to real-time monitoring and / or correction of vision.
[0097] Another application scenario of this disclosure embodiment: The control device 103 in the imaging surface adjustment device 10 can be set to a preset time, and after the preset time is reached, the imaging adjustment device 10 is triggered to adjust the position of the imaging surface. This is equivalent to periodically performing vision monitoring and / or correction.
[0098] Another application scenario of this application embodiment: The control device 103 in the imaging surface adjustment device 10 can be set to a preset time. After the preset time is reached, the imaging adjustment device 10 is triggered to adjust the position of the imaging surface to obtain a vision assessment result, and then the position of the imaging surface is adjusted according to the vision assessment result. This is equivalent to performing vision assessment and / or correction periodically.
[0099] In this embodiment of the application, the driving device 104 adjusts the position of the imaging surface on the side of the optical system closer to the eye under the control of the control device 103, so that the position of the adjusted imaging surface falls on the retina of the eye as much as possible.
[0100] In one exemplary embodiment, the wavelength of the first light emitted by the light-emitting device 101 is within the spectral response range of the photoelectric conversion device 102, so that the photoelectric conversion device 102 can perform photoelectric conversion based on the second light.
[0101] In this embodiment, when selecting the light-emitting device 101 and the photoelectric conversion device 102, their spectral ranges are those that do not fall within the spectral range of light received when the eye observes an object, and will not cause harm to the eyes. For example, the visible light spectral range can be avoided, and the infrared light spectral range (wavelength range of 760nm-1400nm) can be selected. For example, the wavelength of light emitted by the light-emitting device 101 and the response wavelength of the photoelectric conversion device are both 850nm. In actual implementation, as long as it will not cause harm to the eyes and avoids the spectral range of light received when observing an object, the selection method is not limited here.
[0102] The choice of which device to use for the light-emitting device 101 and the photoelectric conversion device 102 is not limited here, as long as the corresponding function can be achieved. For example, the light-emitting device 101 can be an infrared light-emitting diode, and the corresponding photoelectric conversion device 102 can be a photodiode or a phototransistor that senses infrared light; or, the light-emitting device 101 can be an infrared light-emitting transistor, and the corresponding photoelectric conversion device 102 can be an infrared photodiode or a phototransistor.
[0103] In one exemplary embodiment, such as Figure 2 As shown, the photoelectric conversion device 102 includes a phototransistor and a signal conversion resistor; the collector of the phototransistor is connected to the signal conversion resistor R1, and the connection point between the phototransistor and the signal conversion resistor R1 serves as the output terminal of the photoelectric conversion device 102. The signal conversion resistor R1 converts the current signal generated by the phototransistor through photoelectric conversion into a voltage signal.
[0104] In the embodiments of this disclosure, the light-emitting device 101 can emit light under the control of the control device 103. The photoelectric conversion device 102 can perform photoelectric conversion under the control of the control device 103. Another feasible implementation is to set a first switch to control the photoelectric conversion device 102 to control the photoelectric conversion device 102 to perform photoelectric conversion, and to set a second switch to control the light-emitting device 101 to control the light-emitting device 101 to emit light. The first switch and the second switch can be the same switch, and the photoelectric conversion device 102 and the light-emitting device can start working simultaneously after the switch is closed, or they can be set separately.
[0105] In one exemplary embodiment, such as Figure 2 As shown, the light-emitting device 101 and the photoelectric converter 102 are disposed on the side of the optical system 20 to avoid blocking the light path of the optical system 20.
[0106] Figure 2 The diagram shows an application of the imaging adjustment device 10, including a structural diagram of the user's eye, the optical system 20, and the imaging adjustment device 10. To avoid obstructing the light path transmission between the optical system 20 and the user's eye, the light-emitting device 101 and the photoelectric conversion device 102 can be positioned around the optical system 20. The relative positions of the light-emitting device 101 and the photoelectric conversion device 102 are not limited to these, as long as the first light emitted by the light-emitting device 101 can illuminate the user's eye, and the second light reflected by the user's eye can illuminate the photoelectric conversion device 102.
[0107] In this embodiment of the application, in order to increase the light intensity received by the user's eyes, multiple light-emitting devices 101 can be arranged in the peripheral area 201 of the optical system 20, and the multiple light-emitting devices 101 can be arranged around the optical system 20. For example Figure 3 The diagram shown is a schematic diagram of a structure in which multiple light-emitting devices 101 are arranged in the peripheral area 201 of the optical system 20.
[0108] In this embodiment, one or more photoelectric conversion devices 102 may be provided. To ensure that the photoelectric conversion device 102 can better receive the second light rays reflected by the human eye, such as... Figure 4a As shown, multiple photoelectric conversion devices 102 can be provided. One feasible implementation is as follows: Figure 4a As shown, multiple photoelectric conversion devices 102 can be arranged in the peripheral area 201 of the optical system 20. The arrangement of the photoelectric conversion devices 102 and the light-emitting device 101 is not limited to... Figure 4a The structure shown; as Figure 4b and Figure 4c As shown, the photoelectric conversion device 102 and the light-emitting device 101 can be positioned relative to each other in the peripheral area 201 of the optical system. There are no restrictions on the arrangement of the photoelectric conversion device 102 and the light-emitting device 101, as long as their respective functions can be realized.
[0109] In this embodiment of the present disclosure, the photoelectric conversion device 102 and the light-emitting device 101 can be as follows: Figures 4a-4cThe light-emitting device 101 and the photoelectric conversion device are not limited to being disposed in the peripheral area 201 of the optical system 20, but can be disposed in other devices around the optical system 20 as long as they can achieve the corresponding functions. For example, when the application scenario of the imaging adjustment device 10 is eyeglasses, the photoelectric conversion device 102 and the light-emitting device 101 can be disposed on the frame of the eyeglasses, as long as they can avoid blocking the light path of the optical system 20 and at the same time achieve the corresponding functions.
[0110] In this embodiment, the fixing method of the optical system 20 can be set according to the application scenario and device. If it is applied to glasses, the optical system 20 can be fixed to the frame; if it is applied to wearable devices, it can be set inside the wearable device.
[0111] In this embodiment, the positions of the driving device 104 and the control device 103 are not limited, as long as they can achieve their respective functions and do not obstruct the optical path transmission.
[0112] In this embodiment, the light-emitting device 101 can be connected to the control device 103, which provides it with power, or it can be provided with power by other power supply equipment.
[0113] In one exemplary embodiment, such as Figure 5 As shown, the imaging adjustment device 10 also includes a comparison device 105;
[0114] The photoelectric conversion device 101 is used to provide the generated electrical signal to the comparison device 105;
[0115] The comparison device 105 is used to compare the electrical signal generated by the photoelectric conversion device 101 with a preset electrical signal, generate a comparison result signal, and send the comparison result signal to the control device 103.
[0116] The control device 103 is used to control the operation of the drive device 104 according to the comparison result signal.
[0117] In one exemplary embodiment, in order to enhance the strength of the electrical signal output by the photoelectric conversion device 102 so that the comparison device 105 can accurately obtain the comparison result signal, a signal enhancement device may also be provided.
[0118] like Figure 6 As shown, the signal enhancement device may include a filter device 106 and a signal amplification device 107;
[0119] The filtering device 106 is connected to the photoelectric conversion device 102 and the signal amplification device 107, and is used to filter the electrical signal generated by the photoelectric conversion device 102.
[0120] The signal amplification device 107 is connected to the filtering device 106 and the comparison device 105, and is used to amplify the filtered signal and then provide the amplified signal to the comparison device 105.
[0121] In the embodiments of this application, the comparison device 105, the filtering device 106, and the signal amplification device 107 can be circuits in related technologies that can achieve the corresponding functions.
[0122] like Figure 7 The diagram shown illustrates another application of the imaging adjustment device 10, representing a different structural arrangement of the user's eye, optical system 20, and imaging adjustment device 10. The electrical signal output from the phototransistor in the photoelectric conversion device 102 is filtered by the filter device 106, amplified by the signal amplification device 107, and then compared by the comparison device 105 before being output to the control device 103 as a comparison result signal. For example, if the voltage signal output from the phototransistor in the photoelectric conversion device 102, after filtering and amplification, is output to the comparison device 105 and is higher than a preset electrical signal, then the comparison result signal output by the comparison device 105 to the control device 103 is a high-level signal (logic value 1); if the voltage signal output from the phototransistor, after filtering and amplification, is output to the comparison device 105 and is lower than a preset electrical signal, then the comparison result signal output by the comparison device 105 to the control device 103 is a low-level signal (logic value 0). The relationship between the eye state, the electrical signal (i.e., the voltage in Table 1), and the comparison result signal is shown in Table 1.
[0123] Table 1
[0124] Open eyes state <680mV 0 Squinting ≥680mV 1
[0125] The voltage in Table 1 is the photovoltage generated by photoelectric conversion device 102 after photoelectric conversion, which is then filtered, amplified and transmitted to the control comparison device. 680mV is the preset electrical signal set by the comparison device 105 (the preset electrical signal can also be called the threshold voltage). The threshold voltage can be set according to the actual situation and is not limited to 680mV.
[0126] like Figure 8 As shown, this represents the voltage received at the input terminal of the eye state comparison device 105 at different time periods (i.e., the voltage signal generated by photoelectric conversion by the photoelectric conversion device 102, which is then filtered, amplified, and output to the comparison device 105). Figure 9The diagram shows the logic values corresponding to the comparison result signals sent by the comparison device 105 to the control device 103 at different time periods. Specifically, during the time periods 0-t1, t2-t3, t4-t5, t6-t7, t8-t9, and t10-t11, if the voltage received at the input of the comparison device 105 is higher than the threshold voltage, the comparison device 105 generates a comparison result signal with a logic value of 1 and sends it to the control device 103. The control device 103 determines the user's eye state as squinting based on the comparison result signal with a logic value of 1. During the time periods t1-t2, t3-t4, t5-t6, t7-t8, and t9-t10, if the voltage received at the input of the comparison device 105 is lower than the threshold voltage, the comparison device 105 generates a comparison result signal with a logic value of 0 and sends it to the control device 103. The control device 103 determines the user's eye state as open based on the comparison result signal with a logic value of 0.
[0127] In this embodiment, the comparison device 105 can be a voltage comparator. Correspondingly, the signal obtained after photoelectric conversion by the photoelectric conversion device 102 is a voltage signal. As shown in Table 1, the comparison result signal is obtained by the comparison device 105 by comparing a threshold voltage with the received voltage. The voltage signal obtained after photoelectric conversion by the photoelectric conversion device 102 is filtered, amplified, and then output to the voltage input terminal of the comparison device 105. The reference terminal of the comparison device 105 is input with the threshold voltage (i.e., a preset electrical signal is the threshold voltage). The threshold voltage input to the reference terminal is compared with the voltage received at the input terminal. When the voltage at the input terminal of the comparison device 105 is greater than or equal to the threshold voltage input to the reference terminal, a comparison result signal of logic value 1 is output to the control device 103. When the voltage at the input terminal of the comparison device 105 is less than the threshold voltage input to the reference terminal, a comparison result signal of logic value 0 is output to the control device 103. The value of the comparison result signal is not limited to this; it can be set to achieve the corresponding function based on the actual scenario.
[0128] In this embodiment of the disclosure, the comparison device 105 is not limited to a voltage comparator, but can also be a current comparator, and the final comparison is of the current value; correspondingly, the photoelectric conversion device 102 outputs a current signal to the comparison device 105.
[0129] In one exemplary embodiment, such as Figure 10 As shown, the imaging adjustment device may further include an eye state acquisition device 108;
[0130] Eye status acquisition, used to obtain eye status information;
[0131] The control device 103 is used to control the operation of the drive device 104 based on electrical signals and eye state information.
[0132] In this embodiment of the disclosure, the eye state information acquired by the eye state acquisition device 108 includes open eye state information, squinting eye state information, closed eye state information, blinking eye state information, etc.
[0133] In this embodiment of the disclosure, the eye state acquisition device 108 may be an eye state acquisition device in the related art, which will not be described in detail here.
[0134] In the embodiments of this disclosure, the eye state acquisition device 108 is used to acquire the user's eye state information, and the control device 103 can use the eye state information to help determine whether the user's eyes are open or closed. For example, when the user blinks, the eye state information provided by the eye state acquisition device is used to help determine the eye state, avoiding the control device 103 from misjudging the blinking state as a squinting state, thereby avoiding incorrect control of the drive device 104 to perform related operations.
[0135] In an exemplary embodiment, the aforementioned eye state acquisition device 108 may be a camera device, which acquires the user's eye state information, and the control device 103 controls the operation of the drive device 104 based on the eye state information and electrical signals. For example, the camera device can acquire the user's eye state information by taking a picture or recording a video.
[0136] In some other embodiments of this disclosure, the imaging adjustment device 10 described above can be disposed on an eye-tracking device of the related art, so that the eye-tracking device has the function of the imaging adjustment device 10 described above.
[0137] In the embodiments of this disclosure, to avoid misjudging a closed-eye state as a squinting state, a preset voltage can be set. When the electrical signal formed by the second light reflected from the light-emitting device 101 when the eyes are closed and converted by the photoelectric conversion device 102 is higher than this preset voltage, it is determined that the eyes are closed and not squinting. Alternatively, it can be determined whether it is squinting or closed by combining it with the eye state acquisition device 108.
[0138] In some embodiments of this application, the eye state can be determined based on electrical signals and the duration or number of times the electrical signals are received. For example, if it is determined that the squinting state is maintained for more than a preset duration or more than a preset number of times, the eye state is determined to be squinting rather than blinking.
[0139] In one exemplary embodiment, the driving device 104 includes an object distance adjustment motor, which is used to adjust the position of the imaging lens in the optical system under the control of the control device 103. Figure 2 and Figure 7 As shown, the object distance adjustment motor can be used to adjust the position of the imaging lens L2 in the optical system 20. Figure 2 and Figure 7In the structure shown, the object distance adjustment motor can also be configured to adjust the position of the optical lens L1, which is not limited here.
[0140] This application also provides a wearable device, including an optical system and an imaging adjustment device 10 as described in any of the above embodiments. The imaging adjustment device 10 is used to adjust the imaging surface of the imaging system composed of the optical system and the user's eye.
[0141] like Figure 11 The diagram shows an exemplary module composition block diagram of a wearable device. The optical system 20 is connected to the driving device 104 in the imaging surface adjustment device 10, and can adjust the position of the imaging surface under the drive of the driving device 104.
[0142] In this embodiment of the disclosure, the wearable device can be a VR or AR device (including a VR or AR eye care device), a helmet, glasses, etc.
[0143] In some embodiments of this disclosure, the wearable device can be configured as a closed structure, so that the light-emitting device can reflect multiple times in the closed space, allowing the photoelectric conversion device 102 in the imaging adjustment device 10 to receive more second light, thereby increasing the electrical signal generated by photoelectric conversion.
[0144] The wearable device provided in this disclosure can adjust the imaging surface of the imaging system composed of the optical system and the eye according to the user's eye condition through the imaging adjustment device 10. This allows for timely and automatic adjustment of the distance or focus of the imaging system, improving user comfort. This disclosure can also be used to correct a user's vision.
[0145] One application scenario of this disclosure is that the position of the imaging plane of the imaging system formed by the optical system and the eye can be adjusted in real time according to the user's eye opening or squinting state to adapt to the user's current eye prescription. This is equivalent to real-time monitoring and / or correction of vision.
[0146] Another application scenario of this disclosure embodiment: The control device 103 in the imaging surface adjustment device 10 can be set to a preset time, and after the preset time is reached, the imaging adjustment device 10 is triggered to adjust the position of the imaging surface. This is equivalent to periodically performing vision monitoring and / or correction.
[0147] Another application scenario of this disclosure embodiment: The control device 103 in the imaging surface adjustment device 10 can be set to a preset time. After the preset time is reached, the imaging adjustment device 10 is triggered to adjust the position of the imaging surface to obtain a vision assessment result, and then the position of the imaging surface is adjusted according to the vision assessment result. This is equivalent to performing vision assessment and / or correction periodically.
[0148] In one exemplary embodiment, such as Figure 12 As shown, the wearable device may also include a screen 21; the display surface of the screen 21 faces the optical system 20.
[0149] In one exemplary embodiment, the screen 21 is disposed on the side of the optical system 20 away from the eyes of the wearer of the wearable device.
[0150] like Figure 13 The image shown is a schematic diagram of an application scenario for a wearable device. The image displayed on the screen 21 enters the eyes of the wearer through the optical system 20. Figure 13 The structure shown can be customized in different ways depending on the actual application scenario, as long as it can achieve its function. No restrictions are imposed here.
[0151] In one exemplary embodiment, the imaging adjustment device 10 adjusts the position of the imaging surface of the imaging system, which consists of the eye and the optical system 20, located on the side of the eye by adjusting the position of the imaging lens in the optical system 20.
[0152] like Figure 14a , Figure 14b , Figure 14c The diagram shown is a schematic of an imaging adjustment (i.e., adjustment of the position of the imaging plane). Figures 14a-14c In the optical system 20, there is an imaging lens L1, 30 represents the eyeball, 31 represents the retina, and 32 represents the lens. Figure 14a In the middle, the intersection of the light rays after passing through lens L1 and lens 32 falls in front of retina 31; Figure 14b , Figure 14c When the imaging lens L1 is brought closer to the eyeball 30, the intersection of the same light rays after passing through the imaging lens L2 and the lens 32 falls on the retina 31. Figure 14b The dashed line in the image represents lens L1 in... Figure 14a For clarity, the position of the light source and the path of light propagation are shown. Figure 14c To be Figure 14b The diagram shows the optical path after removing the lens and light propagation path in the dashed section. It can be seen that by adjusting the position of the imaging lens (such as imaging lens L1) in the optical system 20, the position of the image plane closest to the eye in the imaging system formed by the optical system 20 and the eye can be adjusted, making it possible to place the image plane on the retina as close as possible.
[0153] like Figures 15a-15c As shown, the optical system 20 may include two imaging lenses L1 and L2. The position of the imaging surface of the optical system formed by the optical system 20 and the eye can be adjusted by adjusting the distance M between the imaging lens L2 or L1 and the screen 21. Figures 15a-15cThis is a schematic diagram assuming the position of imaging lens L1 remains unchanged, while only the position of imaging lens L2 is adjusted. In the imaging adjustment device 10, the driving device 104, under the control of the control device 103, adjusts the distance between imaging lens L2 and screen 21 to adjust the position of the imaging surface of the imaging system. Figure 15b It is Figure 15a A schematic diagram of the optical path transmission after the distance between the imaging lens L2 and the screen 21 is adjusted from M1 to M2. Figure 15b The dashed lines in the middle correspond to Figure 15a The position of the imaging lens L2 and the light propagation path, Figure 15c It is Figure 15b The optical path diagram with the dashed line removed. In practical applications, the driving device 104 can also adjust the position of the imaging lens L1, or the driving device 104 can adjust the positions of the imaging lenses L1 and L2 simultaneously. The setting method is not limited here, as long as the intended function can be achieved.
[0154] In this embodiment, the number of imaging lenses in the optical system 20 is not limited to one or two as shown in Figures 14-15, and multiple lenses can be provided according to actual needs. Furthermore, the imaging lenses in the optical system 20 are not limited to convex lenses, and concave lenses (such as...) can be provided according to actual needs. Figures 16a-16c As shown), or a combination of concave and convex lenses (such as...). Figures 17a-17c As shown in the image, no limitation is made here, as long as the corresponding function can be achieved. When there are multiple lenses, the position of one or more lenses can be adjusted according to actual needs, and no limitation is made here.
[0155] In one exemplary embodiment, the optical system includes a first imaging lens and a second imaging lens;
[0156] The first imaging lens is positioned between the eye and the second imaging lens;
[0157] The second imaging lens is disposed between the first imaging lens and the screen 21;
[0158] The imaging adjustment device 10 is used to adjust the position of the first imaging lens or the second imaging lens, thereby adjusting the position of the imaging surface of the imaging system composed of the optical system and the eye.
[0159] Referring to Figures 15-17, the first imaging lens is L1, the second imaging lens is L2, and the imaging adjustment device 10 adjusts the position of the imaging surface of the imaging system by adjusting the position of the second imaging lens L2.
[0160] This disclosure also provides an imaging adjustment method for adjusting the imaging surface of an imaging system composed of an optical system and a user's eye, such as... Figure 18 As shown, it includes:
[0161] Step S1: Emit the first ray of light so that it shines on the user's eyes;
[0162] Step S2: Determine the user's eye state based on the electrical signal generated after photoelectric conversion of the second light. The second light is the light reflected from the user's eye after the first light shines on it.
[0163] Step S3: Adjust the position of the imaging surface of the imaging system according to the user's eye condition.
[0164] The imaging adjustment method provided in this disclosure can be applied to the imaging adjustment device described above, and also to the wearable device described above. Schematic diagrams of the imaging adjustment device and the wearable device, as well as a schematic diagram of the imaging surface adjustment, are provided below. Figure 1-Figure 1 As shown in Figure 7, it will not be repeated here.
[0165] The imaging adjustment method provided in this application embodiment can determine the eye state based on the electrical signal generated by photoelectric conversion of the second light reflected from the user's eye, and adjust the imaging surface of the imaging system composed of the optical system and the eye according to the eye state; it can monitor the user's vision in real time according to the user's eye state, and adjust the position of the imaging surface of the system by the eye state of squinting and opening the eyes, which can adjust the distance or focus in real time and automatically, bringing a better experience to the user.
[0166] In this embodiment of the disclosure, the user's eye state is determined based on electrical signals, and the position of the imaging surface of the imaging system is adjusted according to the user's eye state. An optional implementation is to determine the user's eye state based on electrical signals, and adjust the position of one or more imaging lenses in the optical system according to the user's eye state, thereby adjusting the position of the imaging surface of the imaging system.
[0167] In some embodiments, adjusting the position of the imaging surface of the imaging system according to the user's eye condition includes: adjusting the position of the imaging surface of the imaging system according to the user's eye condition when a trigger condition is met, wherein the trigger condition includes one or more of the following:
[0168] The usage duration is greater than or equal to the preset adjustment cycle;
[0169] The time interval since the last adjustment is greater than or equal to N times the preset adjustment cycle, where N≥1;
[0170] The determined eye condition is the preset eye condition.
[0171] For example, the preset eye state is squinting.
[0172] In one exemplary embodiment, the user's eye state includes: the user squinting, the user's open eyes, and the user's vision assessment result.
[0173] In one exemplary embodiment, after adjusting the position of the imaging surface of the imaging system according to the user's eye condition, the method further includes: adjusting the position of the imaging surface according to a preset cycle based on a vision assessment result. This adjustment of the imaging surface position based on the user's eye condition yields a vision assessment result, which can then be used to adjust the correction strategy. The adjusted correction strategy allows for automatic and real-time vision correction, improving user comfort and facilitating convenient, real-time, and automatic vision correction.
[0174] In this disclosure, adjusting the position of the imaging surface according to a preset cycle based on vision assessment results can prevent eye strain and improve user comfort. For example, the preset cycle is 30 minutes or 10 minutes, and the position of the imaging surface can be adjusted by adjusting the position of the imaging lens in the imaging system.
[0175] In one exemplary embodiment, the imaging adjustment method further includes:
[0176] Set the initial position of the imaging surface of the imaging system, which is a position that matches the user's initial visual acuity.
[0177] In this embodiment of the disclosure, setting the initial position of the imaging surface of the imaging system is equivalent to initializing the position of the imaging surface. An optional approach is to adjust the position of one or more imaging lenses in the optical lens to the initial position, which can match the position of the user's initial vision lens.
[0178] In one exemplary embodiment, setting the initial position of the imaging surface of the imaging system includes: setting the initial position of the imaging surface of the imaging system when a trigger condition is met, wherein the trigger condition includes one or more of the following:
[0179] The usage duration is greater than or equal to the preset adjustment cycle;
[0180] The time interval since the last adjustment is greater than or equal to N times the preset adjustment cycle, where N≥1;
[0181] The determined eye condition is the preset eye condition.
[0182] For example, the preset eye state is squinting.
[0183] In some embodiments of this disclosure, the user's visual limit or visual assessment result can be obtained based on the position of the imaging lens corresponding to the preset eye state detected.
[0184] In one exemplary embodiment, the optical system includes a first imaging lens and a second imaging lens; the imaging system also includes a screen, the first imaging lens being located between the screen and the user's eye, and the second imaging lens being located between the first imaging lens and the screen;
[0185] Adjusting the distance between the imaging surface of the imaging system and the user's eye includes adjusting the distance between the second imaging lens and the screen.
[0186] In this embodiment of the disclosure, adjusting the distance between the second imaging lens and the screen can be achieved by moving the second imaging lens in units of a preset diopter to adjust the distance between the second imaging lens and the screen.
[0187] The preset refractive power can be either myopia or hyperopia. Taking myopia as an example, if the preset refractive power is 0.01D (diopter is a unit for measuring the refractive power of a lens, abbreviated as D), then one adjustment is 0.01D. The distance between the second imaging lens and the screen will be referred to as the object distance. Table 2 shows the relationship between myopia refractive power and object distance adjustment:
[0188] Table 2
[0189] 3.4 0.2D 3.5 0.3D 3.7 0.7D 4.0 1D 4.8 2D 5.6 3D 6.3 4D 10.1 10D
[0190] In Table 2, when the object distance M is 3.4 mm, the corresponding myopia diopter is 0.2 D. Therefore, Table 2 can also be understood as the correspondence between myopia diopter and object distance. When actually adjusting the object distance, based on the correspondence between object distance and myopia diopter, the object distance can be converted to the corresponding diopter value, or the diopter value can be converted to the corresponding object distance.
[0191] In this embodiment of the disclosure, the screen distance can also be adjusted according to the relationship between the screen distance, the object distance M, and the myopia diopter. The adjustment relationship between the object distance M, the screen distance, and the myopia diopter is shown in Table 3.
[0192] Table 3
[0193] 3.4 5000 0.2D 3.5 3000 0.3D 3.7 1500 0.7D 4.0 1000 1D 4.8 500 2D 5.6 330 3D 6.3 250 4D 10.1 100 10D
[0194] In this embodiment, the object distance and screen distance can be adjusted according to the adjustment relationship between object distance M, screen distance, and myopia refractive error in Table 3, such as adjusting the screen distance and object distance M in a VR or AR eye care device. When playing VR images, based on the variable distance adjustment, the image can be strategically zoomed in or out in a timely manner. The user's visual limit can be tested by whether squinting is detected, thereby judging the improvement of the user's vision and adjusting the distance correction strategy in real time.
[0195] In one implementation, Tables 2 and 3 correspond to Figures 15a-15c The adjustment relationship of the imaging system.
[0196] Because squinting alters the eye's reflectivity, at the hardware level, an infrared light-emitting device illuminates the eye, and a photoelectric conversion device senses the change in reflectivity. This is achieved through an imaging adjustment device, or by building a sensor-based eye-tracking circuit on top of the imaging adjustment device, or by building an imaging adjustment device on top of a related eye-tracking device, or by building an eye state acquisition device 108 on top of the imaging adjustment device. This effectively identifies squinting or opening the eyes. At the software level, a corresponding feedback architecture (including a vision assessment program and a distance adjustment strategy program) is designed, allowing for the successful implementation of a dynamic adjustment distance correction strategy. The feedback architecture is referenced [reference needed]. Figure 19 As shown.
[0197] In one implementation, such as Figure 19 As shown, the control device executing the above method allocates a timing register to store timing information, and configures a vision assessment program and a distance adjustment strategy program in the control device. The imaging adjustment method is as follows: Figure 20 As shown, it includes:
[0198] Step S11: Trigger the vision assessment procedure;
[0199] In step S11, when the state stored in the timer register indicates that the timer has expired, the vision assessment program is triggered. The vision assessment program can be triggered if the user's usage time is greater than or equal to the preset adjustment period, or if the time interval since the last adjustment is greater than or equal to N times the preset adjustment period (N≥1).
[0200] Alternatively, in step S11, a vision assessment procedure can be triggered when the eye state is determined to be squinting based on electrical signals.
[0201] Eye state determination based on electrical signals can be based on the electrical signal itself and the duration or number of times the electrical signal is continuously received. For example, if the relationship between the received electrical signal and eye state is set so that a high level electrical signal corresponds to a squinting state, then if the received electrical signal is high and the number of times the high level is received exceeds a preset number or a preset duration, then the eye state is determined to be squinting.
[0202] In this embodiment of the disclosure, the preset adjustment period can be set according to actual needs and is not limited here. For example, the preset adjustment period is 2 days, 2 months or 2 hours.
[0203] After the vision assessment program is triggered by the timing register in step S11, the imaging adjustment method may further include resetting the timer and starting the timing for the next cycle. Optionally, when the vision assessment program is triggered based on an electrical signal indicating that the eye is squinting, the timer may also be reset and the timing for the next cycle may begin.
[0204] Step S12: Set the initial position of the imaging surface of the imaging system.
[0205] Step S12 includes: the vision assessment procedure adjusts the object distance to a distance that matches the user's initial vision.
[0206] In this embodiment of the application, the distance that initially matches the user's vision can be the distance of the object distance at the normal vision level, or it can be the object distance initially set for a certain user, or the object distance after the user's last correction.
[0207] In the embodiments of this application, the relationship between myopia refractive power and object distance can be referred to Table 2 above. For example, if the initial visual acuity is 1D, the matching distance is 4.0mm; if the current visual acuity is 2D, the matching distance is 4.8mm.
[0208] If the movement is in units of 0.01D, and the initialization is from 2D to 1D, then the drive device needs to be moved (2D-1D) / 0.01D = 100 times. In this step, the movement is not limited to units of 0.01D; the drive device can also be directly controlled to move to the distance matching the initial visual acuity in one go.
[0209] Step S13: Based on the monitored user eye condition, control the drive device to adjust the imaging lens in the imaging system to adjust the position of the imaging surface of the imaging system.
[0210] Step S13 includes: the vision assessment procedure receiving electrical signals, judging the eye condition based on the electrical signals, and adjusting the imaging surface position of the imaging system based on the eye condition.
[0211] Adjusting the imaging plane position of the imaging system according to the eye condition includes: the vision assessment program controls the drive device to adjust the object distance in units of preset myopia diopters based on the monitored user eye condition.
[0212] In step S13, the vision assessment procedure detects the logic value received by the control device from the comparison device. If the logic value is 1, it is determined to be squinting; if the logic value is 0, it is determined to be open eyes. Monitoring open or squinting is performed by the light emitter, photoelectric conversion device, comparison device, and control device described in the above embodiments. For details, please refer to the description in the above embodiments, which will not be repeated here.
[0213] In this disclosure, the preset myopia diopter may be, but is not limited to, 0.01D. The optical relationship between myopia diopter and object distance is as described above and will not be repeated here.
[0214] In this disclosure, 15a- Figure 15c Taking the imaging system shown as an example, if the monitored user remains with their eyes open, it is determined that the user's maximum eye strain limit has not been reached, and the drive device continues to move the second imaging lens L2 in units of preset myopia diopters; if the system detects the user squinting, it is determined that the user's maximum eye strain limit has been reached, and the drive device stops moving the second imaging lens L2. Figures 15a-15c As shown, assume the initial position of the object distance M is M2 (e.g., Figure 15c As shown), the visual evaluation program controls the drive device to adjust the position of the imaging lens L2, gradually decreasing the object distance M. When the object distance M reaches a value of M1 (as shown), the visual evaluation program controls the drive device to adjust the position of the imaging lens L2, gradually decreasing the object distance M. Figure 15a As shown in the figure, when the user's eye state is detected to be squinting, the movement of the second imaging lens L2 is stopped.
[0215] For example, if the initial vision is 3D, the corresponding object distance M is 5.6mm (M2 in Figure 15). As long as the user is not squinting, the control drive device will decrease the object distance M in units of 0.01D myopia diopters. Once the user is detected squinting, the control drive device will stop moving the second imaging lens L2. For example, if the number of times the movement is 200 when the user is detected squinting, the corresponding diopter is 1D, and the corresponding object distance M is 4.0mm (M1 in Figure 15).
[0216] Optionally, in this disclosure, after the control drive device stops moving the dual imaging lens L2, it further includes: sending the number of movements to the distance adjustment strategy program.
[0217] In this embodiment of the disclosure, the number of movements recorded by the visual evaluation program is the number of times the user's eyes are at their maximum range. For example, if the initial object distance is 5.6 mm, the corresponding refractive power is 3D. After 200 movements, the maximum range of eye use is detected, which can also be understood as the user's visual evaluation result. The corresponding object distance is 4 mm, and the corresponding refractive power is 1D.
[0218] Optionally, after step S13 above, the method further includes: the distance adjustment strategy adjustment procedure performs strategy adjustment based on the number of movements from the vision assessment procedure.
[0219] The strategy adjustment based on the position of the adjusted imaging surface, as described above, includes: the distance adjustment strategy adjustment program performs strategy adjustment based on the number of movements from the vision assessment program.
[0220] In this embodiment, the distance adjustment program adjusts the strategy based on the object distance M, screen distance, myopia refractive error adjustment relationship, initial object distance, and number of movements in Table 3 above. For example, when the number of movements is 200, the distance adjustment program determines the myopia refractive error corresponding to the user's vision assessment result as 1D based on the initial visual acuity 3D and the number of movements 200, and then performs strategy adjustment based on the myopia refractive error 1D. The strategy adjustment based on the myopia refractive error corresponding to the user's vision assessment result can adjust the object distance according to a preset cycle (i.e., adjust the image plane position according to a preset cycle). For example, the adjustment strategy corresponding to myopia refractive error 1D is: the preset cycle is 30 minutes; for 10 minutes, the screen distance is adjusted to 800mm by adjusting the object distance; for the next 10 minutes, the screen distance is adjusted to 400mm by adjusting the object distance; for the next 10 minutes, the screen distance is adjusted to 600mm; at the beginning of the second cycle, the screen distance is adjusted to 800mm, and so on.
[0221] Optionally, in this embodiment of the present disclosure, the distance adjustment strategy adjustment program is nested in the original object distance adjustment program in the form of a sub-function, and an offset is applied to the distance adjustment function in the main function according to the number of movements returned by the vision assessment program.
[0222] Figure 20 Steps S11-S13 can be understood as performing a vision assessment based on the monitored squinting or open-eye state, ultimately obtaining a user vision assessment result. Subsequently, the distance adjustment program executes a strategy adjustment based on this vision assessment result, performing real-time, automatic vision correction according to the adjusted correction strategy. Since the timing register and vision assessment device are both located in the control device, the main body executing steps S11-S13 can also be directly understood as being executed by the control device. The adjusted correction strategy may include: adjusting the position of the imaging surface according to a preset cycle based on the vision assessment result, and adjusting the position of the imaging surface at a preset distance within the preset cycle. For example, if the preset cycle is 30 minutes or 10 minutes, the position of the imaging surface can be adjusted by adjusting the position of the imaging lens in the imaging system. If it is a VA or AR eye care device, adjusting the position of the imaging lens also adjusts the screen distance. For example, by adjusting the position of the imaging lens, with a preset cycle of 30 minutes, the screen distance within one cycle is 300 meters for 10 minutes, 800 meters for 10 minutes, and 600 meters for 10 minutes.
[0223] In the embodiments of this disclosure, during the process of adjusting the distance according to the vision assessment results and correcting according to the adjusted correction strategy, when the user's eye state is detected to be squinting, the vision assessment program can also be triggered to perform a vision assessment. After the vision assessment program obtains a new vision assessment result, the adjustment program adjusts the vision correction according to the strategy corresponding to the new vision assessment result.
[0224] It should be noted that the distance adjustment program has corresponding adjustment strategies for the vision assessment results obtained from the vision assessment program. The correction adjustment strategy can be set according to the actual situation and is not limited here.
[0225] In some embodiments, the imaging plane adjustment method of this application can also be applied to real-time monitoring of a user's vision, such as... Figure 21 As shown, the specific method is as follows:
[0226] Step S21: When the user squints, the imaging plane is adjusted.
[0227] Step S21 may include controlling the driving device to drive the imaging lens in the optical system to adjust the optical path if the control device receives a high level signal from the comparison device or if the received electrical signal is higher than the first preset electrical signal.
[0228] For example, the first preset electrical signal is 680mV. The specific method of adjusting the optical path is as described above, adjusting the relationship between the object distance between the imaging lens and the screen and the myopia diopter, such as moving the imaging lens in the optical system in units of 0.01D.
[0229] In step S21, when driving the imaging lens to adjust the optical path (i.e., adjusting the position of the imaging surface of the imaging system), the number of times the imaging lens is moved is also recorded.
[0230] Step S22: When the user's eyes are detected to be open, stop adjusting the imaging plane.
[0231] Step S22 may include: if the control device receives a low level signal from the comparison device, or if the received electrical signal is lower than the second preset electrical signal, then the control drive device stops driving the imaging lens in the optical system.
[0232] If the myopia diopter before the image plane adjustment is triggered is 1D, the corresponding object distance is 4.0mm. After moving 100 times, the adjustment stops. As shown in Table 2, the myopia diopter after the adjustment is 2D, and the corresponding object distance is 4.8mm.
[0233] After step S22, correction can be performed according to the correction strategy corresponding to the eye's refractive power at the time the image plane adjustment was stopped. For example, vision correction according to the correction strategy corresponding to myopia 2D may include adjusting the screen distance according to the cycle corresponding to myopia 2D.
[0234] In some embodiments of this disclosure, the screen distance corresponds to the myopia refractive power and the object distance, as shown in Table 3.
[0235] In some embodiments of this disclosure, a correction strategy is implemented to better protect the eyes while ensuring comfort during use. The screen distance can be set according to a preset cycle. For example, the preset cycle is 40 minutes, with the screen distance set at 500mm for the first 10 minutes, 1000mm for the next 10 minutes, 1500mm for the next 10 minutes, and 1000mm for the following 10 minutes.
[0236] This disclosure also provides a computer-readable storage medium for storing computer program instructions, wherein the computer program instructions, when executed, can implement the imaging adjustment method described in any of the above embodiments.
[0237] This application provides an imaging adjustment device and method, a wearable device, and a storage medium. It generates an electrical signal through photoelectric conversion based on a second ray reflected from the user's eye. The eye state is determined based on the electrical signal, and the imaging surface of the imaging system, composed of an optical system and the eye, is adjusted accordingly. The device can adjust the position of the imaging surface of the optical system based on the user's squinting or opening eye movements, thereby enabling timely and automatic monitoring and correction of the user's vision. This allows for timely and automatic adjustment of the imaging position based on the monitoring results, improving user comfort.
[0238] It will be understood by those skilled in the art that all or some of the steps, systems, or apparatuses disclosed above, and their functional modules / units, can be implemented as software, firmware, hardware, or suitable combinations thereof. In hardware implementations, the division between functional modules / units mentioned above does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed collaboratively by several physical components. Some or all components may be implemented as software executed by a processor, such as a digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit (ASIC). Such software may be distributed on a computer-readable medium, which may include computer storage media (or non-transitory media) and communication media (or transient media). As is known to those skilled in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and can be accessed by a computer. Furthermore, it is well known to those skilled in the art that communication media typically contain computer-readable instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.
[0239] The accompanying drawings of the embodiments in this application only involve the structures involved in the embodiments of this application; other structures can refer to general designs.
[0240] Where there is no conflict, the embodiments of the present invention, i.e. the features in the embodiments, can be combined with each other to obtain new embodiments.
[0241] While the embodiments disclosed in this invention are as described above, the content is merely for the purpose of facilitating understanding of the invention and is not intended to limit the invention. Any person skilled in the art to which this invention pertains may make any modifications and changes to the form and details of the implementation without departing from the spirit and scope disclosed herein; however, the scope of patent protection of this invention shall still be determined by the scope defined in the appended claims.
Claims
1. An imaging adjustment device, used to adjust the imaging surface of an imaging system composed of an optical system and a user's eye, characterized in that, include: Light-emitting devices, photoelectric conversion devices, control devices, and drive devices; The light-emitting device and the photoelectric conversion device are disposed on the side of the optical system; The light-emitting device is used to emit a first light ray so that the first light ray shines on the user's eyes; The photoelectric conversion device is used to perform photoelectric conversion based on the second light reflected from the user's eyes to generate an electrical signal, and to provide the generated electrical signal to the control device; the intensity of the second light formed by the reflection of the first light illuminating the user's eyes by the light-emitting device in the user's squinting state is greater than the intensity of the second light formed by the reflection of the second light in the user's open-eyed state; the electrical signal generated by the photoelectric conversion device based on the second light reflected from the user's squinting state is greater than the electrical signal generated based on the second light reflected from the user's open-eyed state. The control device is used to determine the user's eye state based on the magnitude of the electrical signal, and control the drive device to work according to the user's eye state. The user's eye state includes the user's squinting state and the user's open-eye state, and the electrical signal of the user's squinting state is greater than the electrical signal of the user's open-eye state. The driving device is used to adjust the position of the imaging surface of the imaging system under the control of the control device.
2. The imaging adjustment device according to claim 1, characterized in that, It also includes a comparison device; The photoelectric conversion device is used to provide the generated electrical signal to the comparison device; The comparison device is used to compare the electrical signal generated by the photoelectric conversion device with a preset electrical signal, generate a comparison result signal, and send the comparison result signal to the control device. The control device is used to control the operation of the drive device according to the comparison result signal.
3. The imaging adjustment device according to claim 2, characterized in that, It also includes filtering devices and signal amplification devices; The filtering device is connected to the photoelectric conversion device and the signal amplification device, and is used to filter the electrical signal generated by the photoelectric conversion device. The signal amplification device is connected to the filtering device and the comparison device, and is used to amplify the filtered signal and provide the amplified signal to the comparison device.
4. The imaging adjustment device according to any one of claims 1-3, characterized in that, The photoelectric conversion device includes a phototransistor and a signal conversion resistor; The collector of the phototransistor is connected to the signal conversion resistor, and the connection node between the phototransistor and the signal conversion resistor serves as the output terminal of the photoelectric conversion device.
5. The imaging adjustment device according to claim 1, characterized in that, The driving device includes an object distance adjustment motor; The object distance adjustment motor is used to adjust the position of the imaging lens in the optical system under the control of the control device.
6. A wearable device, characterized in that, It includes an optical system and an imaging adjustment device as described in any one of claims 1-5, the imaging adjustment device being used to adjust the imaging surface of an imaging system consisting of the optical system and the user's eye.
7. The wearable device according to claim 6, characterized in that, It also includes the screen; The display surface of the screen faces the optical system.
8. The wearable device according to claim 7, characterized in that, The optical system includes a first imaging lens and a second imaging lens; The first imaging lens is disposed between the eye and the second imaging lens; The second imaging lens is disposed between the first imaging lens and the screen; The imaging adjustment device is used to adjust the position of the first imaging lens or the second imaging lens, thereby adjusting the position of the imaging surface of the imaging system composed of the optical system and the eye.
Citation Information
Patent Citations
Head-mounted display optical system and head-mounted display equipment
CN110727111A