Artificial intelligence infrared eccentric photography optometry, optometry system and optometry method

Abstract

The present application discloses an artificial intelligence infrared eccentric photography ophthalmometer, an optometry system and an optometry method, and belongs to the field of optometry technology. The artificial intelligence infrared eccentric photography ophthalmometer includes a light source array assembly, a camera module and a controller. The light source array assembly includes a plurality of first light sources. The light source array assembly has a first position point. The plurality of first light sources are spaced apart and distributed around the first position point. The first light source is suitable for emitting a first light ray to the eyeball of the subject. The camera module shoots the eyeball based on the first light ray to generate first image data of the eyeball. The controller is electrically connected to the light source array assembly and the camera module, and the controller determines the refractive detection result based on the first image data of the eyeball. The present application does not rely on the subjective response of the subject and can provide more objective test results. Compared with traditional computer ophthalmometers that require professional optometrists and subjects to work together to perform optometry, the subject of the present application does not need to make visual judgments, which makes the detection process fast and efficient.

Description

Technical Field

[0001] The present application belongs to the field of optometry technology, and in particular relates to an artificial intelligence infrared eccentric photography optometry instrument, an optometry system and an optometry method. Background Art

[0002] A computerized ophthalmometer is an optometry instrument used to measure the convergence of light upon entering the eye, thereby determining visual acuity and diopter. Computerized ophthalmometers are objective optometry methods that operate on the same principles as retinoscopy, using infrared light to relax the eye's accommodation and optoelectronic and automated control technologies to measure diopter.

[0003] Traditional computer ophthalmometers need to be operated in conjunction with professional optometrists, and professional optometrists and the subjects need to work together to achieve good optometry for the subjects. However, with the increase in vision problems among the population, especially myopia among school-age children, a device that is both fast and accurate is needed for optometry. Summary of the Invention

[0004] The present application aims to solve at least one of the technical problems existing in the prior art. To this end, the present application proposes an artificial intelligence infrared eccentric photography ophthalmometer, an ophthalmometer system and an ophthalmometer method.

[0005] In a first aspect, the present application provides an artificial intelligence infrared eccentric photographic ophthalmometer, comprising:

[0006] A light source array assembly, the light source array assembly comprising a plurality of first light sources, the light source array assembly having a first position point, the plurality of first light sources being spaced apart and distributed around the first position point, the first light sources being adapted to emit first light rays toward an eyeball of a subject;

[0007] a camera module, wherein the camera module captures the eyeball based on the first light to generate first image data of the eyeball;

[0008] A controller is electrically connected to the light source array assembly and the camera module, and the controller determines a refractive detection result based on the first image data of the eyeball.

[0009] According to the artificial intelligence infrared eccentric photographic ophthalmometer of the present application, multiple first light sources are evenly distributed around the first position point. This layout allows the eyeball to be illuminated from different angles. This multi-angle illumination helps to fully capture the eyeball's response to light, especially when evaluating astigmatism and other complex refractive errors of the eyeball, and can provide more comprehensive data; at the same time, the controller determines the refractive detection result based on the first image data of the eyeball, which does not depend on the subjective response of the subject, and it can provide more objective test results; compared with traditional computer ophthalmometers, which are complicated to operate and require professional optometrists and subjects to work together to perform eye examinations, the subject of the present application does not need to make visual judgments, which reduces the psychological pressure and physical fatigue of the subject during the examination, making the detection process fast and efficient.

[0010] According to one embodiment of the present application, the light source array assembly further comprises a second light source;

[0011] The second light source is suitable for emitting a second light ray toward the eyeball, the second light ray or an extension of the second light ray passes through the first position point, and the camera module captures the eyeball based on the second light ray to generate second image data of the eyeball;

[0012] The controller is electrically connected to the second light source, and determines the position of the eyeball relative to the second light based on the second image data of the eyeball.

[0013] According to the artificial intelligence infrared eccentric photographic ophthalmometer of the present application, the reflected image of the eyeball is captured by the camera module. If the second light emitted by the second light source is directly facing the center of the eyeball, the light spot formed by the reflection of the eyeball should be located at the center of the image captured by the camera. If the light spot deviates from the center, this indicates that the center of the eye is offset relative to the second light emitted by the second light source. According to the position of the light spot in the image captured by the camera, the offset direction and offset position of the center of the eyeball relative to the second light can be determined. This embodiment can inform the subject of the offset direction and offset position of the center of the eyeball relative to the second light, so that the subject can adjust by himself and the center of the subject's eyeball is located on the second light, thereby improving the accuracy of the refractive power measurement when the first light source is used for subsequent illumination.

[0014] According to one embodiment of the present application, the distance between the center of the eyeball and the second light is d. If the distance d is less than a preset distance, the center of the eyeball is located on the second light.

[0015] According to one embodiment of the present application, the artificial intelligence infrared eccentric photography ophthalmometer further includes: a first spectroscope and a second spectroscope;

[0016] The light emitted by the light source array assembly is transmitted to the eyeball of the subject through the beam splitter, and after being reflected by the eyeball of the subject, is transmitted through the second beam splitter and is imaged on the camera module;

[0017] Alternatively, the optometry system further comprises: a switching member, a reflector, a first beam splitter, and a second beam splitter;

[0018] The number of the light source array assemblies is two, and the number of the light source array assemblies is the same as the number of the first beam splitter and the second beam splitter. The reflector is arranged between the two eyeballs of the subject, and the light source array assembly, the first beam splitter and the second beam splitter are respectively provided on both sides of the reflector. The rotating end of the switching component is fixedly connected to the reflector, and is used to drive the reflector to rotate to one side, and the light emitted by the light source array assembly is transmitted to the eyeball of the subject through the beam splitter, and after being reflected by the eyeball of the subject, it is reflected by the reflector to be imaged on the camera module.

[0019] In a second aspect, the present application further provides an optometry system, comprising the artificial intelligence infrared eccentric photographic optometry instrument described in any of the above embodiments, and further comprising: a position adjustment mechanism;

[0020] The controller is electrically connected to the position adjustment mechanism and is used to control the position adjustment mechanism to move the eyeball toward the direction of the second light.

[0021] According to one embodiment of the present application, the controller includes: a processing unit and a storage unit;

[0022] The storage unit stores the eye position information of the subject's eyeballs;

[0023] The processing unit is connected to the position adjustment mechanism and the storage unit, and is configured to control the position adjustment mechanism to move the eyeball onto the second light based on the eye position information.

[0024] According to one embodiment of the present application, the position adjustment mechanism includes: a movable headgear and a movable seat;

[0025] The movable head cover is used to be placed on the head of the subject, and the movable seat is used to support the subject;

[0026] Wherein, the movable head cover and the movable seat are both connected to the controller, and the movable head cover and the movable seat are configured to move synchronously in the same direction in a plane perpendicular to the second light.

[0027] According to one embodiment of the present application, the optometry system further includes: an optometry housing;

[0028] The light source array assembly, the camera module and the controller are all arranged in the optometrist housing;

[0029] The position adjustment mechanism further includes: a first driving part; a driving end of the first driving part is detachably connected to the outer wall surface of the movable head cover, and is used to drive the movable head cover to move in a horizontal direction;

[0030] And / or, the position adjustment mechanism further includes: a second driving unit; a driving end of the second driving unit is connected to the movable seat, and is used to drive the movable seat to move in a horizontal direction.

[0031] According to one embodiment of the present application, the first driving part includes: a housing, a guide rod, a first power source and a moving block;

[0032] The housing has guide grooves arranged in a vertical direction on the opposite inner wall surfaces, and the guide rod is arranged horizontally and includes a first rod body and a second rod body. One end of the first rod body and the second rod body is provided with a guide sleeve; the first rod body and the second rod body can be rotatably installed in the corresponding guide sleeve and slidably arranged in the guide groove through the guide sleeve;

[0033] The rotating end of the first power source is fixedly connected to the other end of the second rod, and the second rod is fixedly connected to the first rod via the first power source;

[0034] The moving block is threadedly sleeved on the second rod body, and the moving block is detachably connected to the moving head cover;

[0035] And / or, the movable chair includes a supporting portion and a lifting portion, the lifting end of the lifting portion is fixedly connected to the supporting portion, and is used to drive the supporting portion to move in a vertical direction, and the supporting portion is used to support the person being measured.

[0036] In a third aspect, the present application further provides an optometry method, the method comprising:

[0037] controlling a second light source to emit a second light ray toward the eyeball of the subject, wherein the second light ray or an extension of the second light ray passes through the first position point;

[0038] Acquiring second image data of the eyeball generated by reflection of the eyeball of the subject;

[0039] determining a position of the eyeball relative to the second light based on the second image data of the eyeball;

[0040] Controlling a first light source to emit a first light beam toward the eyeball of the subject, wherein a plurality of the first light sources are spaced apart and distributed around the first position point;

[0041] Acquiring first image data of the eyeball generated by reflection of the eyeball of the subject;

[0042] A refraction detection result is determined based on the first image data of the eyeball.

[0043] According to the optometry method of the present application, the position of the eyeball relative to the second light is first determined, and the offset direction and offset position of the center of the eyeball relative to the second light are informed to the subject, so that the subject can adjust himself and the center of the eyeball of the subject is located on the second light, thereby improving the accuracy of the refractive power measurement when the first light source is used for subsequent illumination.

[0044] In a fourth aspect, the present application provides an electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the optometry method as described in the third aspect above when executing the computer program.

[0045] In a fifth aspect, the present application provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the optometry method as described in the third aspect above.

[0046] In a sixth aspect, the present application provides a chip comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the optometry method as described in the third aspect.

[0047] In a seventh aspect, the present application provides a computer program product, comprising a computer program, which, when executed by a processor, implements the optometry method as described in the third aspect above.

[0048] The above one or more technical solutions in the embodiments of the present application have at least one of the following technical effects:

[0049] Furthermore, multiple first light sources are evenly distributed around the first position point. This layout allows the eyeball to be illuminated from different angles. This multi-angle illumination helps to fully capture the eyeball's response to light, especially when evaluating astigmatism and other complex refractive errors of the eyeball, and can provide more comprehensive data; at the same time, the controller determines the refractive detection result based on the first image data of the eyeball, which does not rely on the subjective response of the subject, and it can provide more objective test results; compared with traditional computer ophthalmometers, which are complicated to operate and require professional optometrists and subjects to work together to perform optometry, the subject of this application does not need to make visual judgments, which reduces the psychological pressure and physical fatigue of the subject during the examination, making the detection process fast and efficient.

[0050] Furthermore, the reflected image of the eyeball is captured by the camera module. If the second light emitted by the second light source is directly facing the center of the eyeball, the light spot formed by the reflection of the eyeball should be located at the center of the image captured by the camera. If the light spot deviates from the center, this indicates that the center of the eye is offset relative to the second light emitted by the second light source. According to the position of the light spot in the image captured by the camera, the offset direction and offset position of the center of the eyeball relative to the second light can be determined. This embodiment can inform the subject of the offset direction and offset position of the center of the eyeball relative to the second light, so that the subject can adjust by himself and the center of the subject's eyeball is located on the second light, thereby improving the accuracy of the refractive power measurement when the first light source is used for subsequent illumination.

[0051] The above one or more technical solutions in the embodiments of the present application have at least one of the following technical effects:

[0052] Furthermore, multiple first light sources are evenly distributed around the first position point. This layout allows the eyeball to be illuminated from different angles. This multi-angle illumination helps to fully capture the eyeball's response to light, especially when evaluating astigmatism and other complex refractive errors of the eyeball, and can provide more comprehensive data; at the same time, the controller determines the refractive detection result based on the first image data of the eyeball, which does not rely on the subjective response of the subject, and it can provide more objective test results; compared with traditional computer ophthalmometers, which are complicated to operate and require professional optometrists and subjects to work together to perform optometry, the subject of this application does not need to make visual judgments, which reduces the psychological pressure and physical fatigue of the subject during the examination, making the detection process fast and efficient.

[0053] Furthermore, when capturing a reflected image of the eyeball using a camera module, if the second light beam emitted by the second light source is directed directly at the center of the eyeball, the light spot formed by the reflection from the eyeball should be located at the center of the image captured by the camera. If the light spot deviates from the center, this indicates that the center of the eyeball is offset relative to the second light beam emitted by the second light source. By informing the subject of the offset direction and position of the eyeball's center relative to the second light beam, the subject can adjust the eyeball's position and ensure that the center of the eyeball is aligned with the second light beam. This improves the accuracy of diopter measurements when subsequently illuminated with the first light source.

[0054] Furthermore, the mobile headgear is placed on the head of the subject to limit the subject's eyeballs to be as directly opposite to the first position point as possible. The mobile seat is located directly below the mobile headgear to support the subject. The mobile headgear and the mobile seat are both connected to the controller, and the mobile headgear and the mobile seat are configured to move synchronously in the same direction within a plane perpendicular to the second light. If the headgear and the seat do not move synchronously, the subject may need to make unnatural head or body adjustments to adapt, which may cause physical burden and discomfort to the subject. In the present embodiment, the mobile headgear and the mobile seat are configured to move synchronously in the same direction within a plane perpendicular to the second light, which can reduce the physical burden and discomfort of the subject.

[0055] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become obvious from the description below, or will be learned through practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0057] Figure 1 This is one of the structural schematic diagrams of the artificial intelligence infrared eccentric photography ophthalmometer provided in the embodiment of the present application;

[0058] Figure 2 This is the second structural diagram of the artificial intelligence infrared eccentric photography ophthalmometer provided in the embodiment of the present application;

[0059] Figure 3 This is a schematic diagram of the structure of the center of the eyeball relative to the second light provided in an embodiment of the present application;

[0060] Figure 4 This is the third structural diagram of the artificial intelligence infrared eccentric photography ophthalmometer provided in the embodiment of the present application;

[0061] Figure 5 is a structural diagram of the optometry system provided in an embodiment of the present application;

[0062] Figure 6 is a structural schematic diagram of the first driving unit provided in an embodiment of the present application;

[0063] Figure 7 1 is a flow chart of the optometry method provided in an embodiment of the present application;

[0064] Figure 8 is a structural schematic diagram of the first light source provided in an embodiment of the present application;

[0065] Figure 9 It is one of the crescent diagrams provided in the embodiments of the present application;

[0066] Figure 10 This is the second crescent diagram provided in the embodiment of the present application;

[0067] Figure 11 It is a structural diagram of an electronic device provided in an embodiment of the present application.

[0068] Reference numerals:

[0069] 100, light source array assembly; 110, first light source; 120, second light source;

[0070] 200, camera module; 210, imaging element; 220, imaging lens;

[0071] 300, controller;

[0072] 400, position adjustment mechanism;

[0073] 410, movable headgear; 420, movable seat;

[0074] 430, first driving unit;

[0075] 431, housing; 4311, guide groove;

[0076] 432, guide rod; 4321, first rod body; 4322, second rod body; 4323, guide sleeve;

[0077] 433. First power source;

[0078] 434, moving blocks;

[0079] 440, second driving unit;

[0080] 510, first beam splitter; 520, second beam splitter; 530, reflector;

[0081] a. First position point; b. Eyeball; c. Ophthalmometer housing;

[0082] 700. Electronic device; 710. Processor; 720. Memory. DETAILED DESCRIPTION

[0083] The following will be combined with the accompanying drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the embodiments described are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.

[0084] The terms "first," "second," and the like in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of this application can be implemented in an order other than that illustrated or described herein, and that the objects distinguished by "first," "second," and the like are generally of the same type, and do not limit the number of objects; for example, the first object can be one or more. In addition, the term "and / or" in the specification and claims refers to at least one of the connected objects, and the character " / " generally indicates that the objects connected are in an "or" relationship.

[0085] Reference below Figures 1-4 An artificial intelligence infrared eccentric photographic ophthalmometer according to an embodiment of the present application is described.

[0086] like Figure 1 As shown, the artificial intelligence infrared eccentric photography ophthalmometer includes: a light source array assembly 100, a camera module 200 and a controller 300.

[0087] The light source array assembly 100 includes a plurality of first light sources 110 . The light source array assembly 100 has a first position point a. The plurality of first light sources 110 are spaced apart and distributed around the first position point a.

[0088] The first position point a may be located at the center of the plurality of first light sources 110 , and the first light sources 110 may be disposed in different directions passing through the first position point a.

[0089] like Figure 1 and Figure 8 As shown, in actual implementation, the plurality of first light sources 110 are evenly spaced and distributed, and there may be three first light sources 110 in the same direction passing through the first position point a.

[0090] The first light source 110 is suitable for emitting a first light ray toward the eyeball b of the subject. The first light source 110 includes but is not limited to an infrared LED lamp and a near-infrared LED lamp.

[0091] It should be noted that when the first light is infrared or near-infrared, it is safe for the human eye, will not cause retinal damage, and is more comfortable for the subject.

[0092] The camera module 200 captures the eyeball b based on the first light to generate first image data of the eyeball b.

[0093] like Figure 2As shown, in actual implementation, the camera module 200 may include a camera element 210 and an imaging lens 220. The camera element 210 is conjugate with the subject's eyeball b relative to the imaging lens 220. The camera element 210 is used to photograph the eyeball b to generate first image data of the eyeball b.

[0094] The controller 300 is electrically connected to the light source array assembly 100 and the camera module 200 , and the controller 300 determines a refractive detection result based on the first image data of the eyeball b.

[0095] Specifically, the controller 300 receives the first image data of the eyeball b from the camera module 200 and processes the first image data.

[0096] For example, various denoising algorithms (such as Gaussian blur, median filtering, etc.) are used to clean up the image and ensure the accuracy of feature extraction; the boundaries and centers of the pupils are identified by using edge detection (such as the Canny algorithm) and circular Hough transform;

[0097] Analyze image sequences of the same eye captured under different LED light sets. Compare changes in specific reflective areas created by the light in these images, and use an optical model to calculate the refractive state of the eye.

[0098] The above specific implementation is only an exemplary embodiment of the controller 300 determining the refractive detection result based on the first image data. Of course, the camera module 200 captures and generates the reflection and scattering images of the eyeball b to light. By analyzing the light spot scattering patterns in these images, the refractive state of the eyeball b can also be determined. This embodiment does not limit this.

[0099] In the above embodiment of the present application, multiple first light sources 110 are evenly distributed around the first position point a. This layout allows the eyeball b to be illuminated from different angles, and the intensity and direction of the light at each angle can be controlled by adjusting the brightness and switch of the light source.

[0100] This multi-angle illumination helps to fully capture the eye's response to light, especially providing more comprehensive data when evaluating astigmatism and other complex refractive errors in the eye.

[0101] Compared with traditional computer ophthalmometers that are complicated to operate and require cooperation between professional optometrists and the test subjects to perform eye examinations, the test subjects in this embodiment do not need to make visual judgments, which reduces the psychological pressure and physical fatigue of the test subjects during the examination process, making the detection process fast and efficient.

[0102] At the same time, the controller 300 of this embodiment determines the refractive detection result based on the first image data of the eyeball b, that is, this embodiment relies on image data analysis rather than the subjective response of the subject, and it can provide more objective test results, which is especially important for children or special groups who cannot accurately express their visual perception.

[0103] In summary, the present application discloses an artificial intelligence infrared eccentric photographic ophthalmometer, in which multiple first light sources 110 are evenly distributed around a first position point a. This layout allows the eyeball b to be illuminated from different angles. This multi-angle illumination helps to fully capture the reaction of the eyeball b to light, especially when evaluating the astigmatism and other complex refractive abnormalities of the eyeball b, and can provide more comprehensive data; at the same time, the controller 300 determines the refractive detection result based on the first image data of the eyeball b, which does not depend on the subjective response of the subject, and it can provide more objective test results; compared with traditional computer ophthalmometers, which are complicated to operate and require professional optometrists and subjects to work together to perform eye examinations, the subject of the present application does not need to make visual judgments, which reduces the psychological pressure and physical fatigue of the subject during the examination, making the detection process fast and efficient.

[0104] It should be noted that when the relevant technology performs objective measurement of the human eye, the forehead of an average person will be placed against the optometrist. At this time, the person's head is not in a natural daily state. Some people will unconsciously tilt their face to one side, causing the head to appear horizontally / vertically tilted. Even if the position of the optometrist can be adjusted, the person still has to control his neck and body to complete the action of fixing the forehead against the machine. This link cannot be quantified. At this time, the position b of the eyeballs of both eyes may not be in a position that can accurately achieve optometry.

[0105] In fact, in the related art, it is inevitable that the eyeball b will deviate from the center of the multiple first light sources 110, the difference is that the degree is greater or lesser, which will have a greater impact on the eye examination.

[0106] In the above embodiment of the present application, if the center of the subject's eyeball b is not collinear with the first position point a, the light illumination becomes asymmetric.

[0107] This means that some first light sources 110 are closer to the eyeball b, while others are farther away. The light spots of the closer first light sources 110 on the eyeball b will be larger and more scattered; while the light spots formed by the farther first light sources 110 will be smaller and more concentrated.

[0108] This non-uniform spot distribution leads to inconsistency in light intensity and coverage area of different parts of the subject's eyeball b, thereby reducing the actual effective first image data, and further affecting the accuracy of the controller 300 in processing and analyzing the image data.

[0109] like Figure 2 As shown, in some embodiments, the light source array assembly 100 further includes a second light source 120 .

[0110] The second light source 120 is suitable for emitting a second light ray toward the eyeball b, and the second light ray or an extension line of the second light ray passes through the first position point a.

[0111] When the second light source 120 is specifically arranged, the second light source 120 can be set at the first position point a, or can be set at a position collinear with the first position point a. The second light source 120 includes but is not limited to a light source with high collimation, such as a low-power laser light source.

[0112] The camera module 200 captures the eyeball b based on the second light to generate second image data of the eyeball b.

[0113] The controller 300 is electrically connected to the second light source 120 , and the controller 300 determines the position of the eyeball b relative to the second light based on the second image data of the eyeball b.

[0114] Specifically, the camera module 200 captures the eyeball b and generates second image data of the eyeball b, which includes detailed information such as the pupil and iris of the eyeball b, as well as reflections and highlights formed on the eyeball b by the irradiated light.

[0115] After the controller 300 receives the image data sent by the camera module 200, it uses an image processing algorithm (such as Hough transform, pupil positioning algorithm based on deep learning) to analyze it to accurately identify the center of the eyeball b, and at the same time identify the light spot or reflection point formed by the second light of the second light source 120 on the eyeball b.

[0116] The controller 300 may calculate the distance and direction between the center of the eyeball b and the light spot, and determine the offset direction and offset position of the center of the eyeball b relative to the second light.

[0117] This can be achieved through simple geometric calculations, such as measuring the pixel distance between two points on the image and converting it into an actual angle or distance based on the calibration parameters of the camera module 200.

[0118] In this embodiment, the reflected image of the eyeball b is captured by the camera module 200. If the second light emitted by the second light source 120 is facing the center of the eyeball b, then the light spot formed by the reflection of the eyeball b should be located in the center of the image captured by the camera.

[0119] If the light spot deviates from the center, this indicates that the center of the eyeball b is offset relative to the second light beam emitted by the second light source 120. In this embodiment, the subject can be informed of the offset direction and offset position of the center of the eyeball b relative to the second light beam, so that the subject can adjust the center of the eyeball b to the second light beam, thereby improving the accuracy of diopter measurement when the first light source 110 is used for subsequent illumination.

[0120] like Figure 3 As shown, in some embodiments, the distance between the center of the eyeball b and the second light is d. If the distance d is less than a preset distance, the center of the eyeball b is located on the second light.

[0121] In this embodiment, the distance d is required to be equal to 0. To achieve complete alignment between the center of the eyeball b and the second light ray may require multiple adjustments and re-measurements, which significantly reduces operational efficiency. Allowing a small range of deviation can speed up the measurement process while still maintaining a certain accuracy in the refractive measurement.

[0122] like Figure 2 As shown, in some embodiments, the artificial intelligence infrared eccentric photography ophthalmometer further includes: a first spectroscope 510 and a second spectroscope 520.

[0123] The light emitted by the light source array assembly 100 is transmitted to the subject's eyeball b through the beam splitter, and after being reflected by the subject's eyeball b, it is transmitted through the second beam splitter 520 and formed into an image on the camera module 200;

[0124] like Figure 4 As shown, in some embodiments, the artificial intelligence infrared eccentric photography ophthalmometer further includes: a switching component, a reflector 530 , a first spectroscope 510 and a second spectroscope 520 .

[0125] There are two light source array assemblies 100, which is the same as the number of the first beam splitter 510 and the second beam splitter 520. The reflector 530 is arranged between the two eyeballs b of the subject. The light source array assembly 100, the first beam splitter 510 and the second beam splitter 520 are respectively provided on both sides of the reflector 530. The rotating end of the switching component is fixedly connected to the reflector 530, and is used to drive the reflector 530 to rotate to one side. The light emitted by the light source array assembly 100 is transmitted to the eyeball b of the subject through the beam splitter, and after being reflected by the eyeball b of the subject, it is reflected by the reflector 530 to form an image on the camera module 200.

[0126] In this embodiment, the reflector 530 is located between the two eyes of the subject. The reflector 530 can be controlled to rotate to one side by a switching component. At the same time, the light emitted by the source array component is transmitted to the subject's eye b through the spectroscope, and after being reflected by the subject's eye b, it is transmitted through the second spectroscope 520 and reflected by the reflector 530, and is imaged on the camera module 200. In this design, the eye examination of the subject's two eyeballs b is completed through only one camera module 200.

[0127] It should be noted that when using two cameras to measure the subject's two eyeballs (B), inconsistent imaging quality may occur. For example, even camera modules 200 of the same model may exhibit different imaging characteristics due to minor differences in materials, assembly, and other aspects during the manufacturing process. These differences may affect image clarity, contrast, or color balance. In this embodiment, using only one camera module 200 ensures consistent imaging quality.

[0128] like Figure 5 As shown, the present application also proposes an optometry system, comprising the artificial intelligence infrared eccentric photographic optometry instrument and position adjustment mechanism described in any of the above embodiments.

[0129] The controller 300 is electrically connected to the position adjustment mechanism 400 and is used to control the position adjustment mechanism 400 to move the eyeball b toward the direction of the second light.

[0130] In this embodiment, the automatic position adjustment mechanism 400 can quickly align the subject's eyeball b to the desired position, greatly speeding up the entire optometry process and improving the efficiency of clinical work.

[0131] This also reduces the amount of physical adjustments that the person being tested needs to make, which is particularly important for children or people with special needs who may have difficulty understanding instructions.

[0132] In some embodiments, the controller 300 includes a processing unit and a storage unit.

[0133] The storage unit stores the eye position information of the subject's eyeball b.

[0134] The eye position information includes the position of the eyeball b in three-dimensional space.

[0135] The processing unit is connected to the position adjustment mechanism 400 and the storage unit, and is used to control the position adjustment mechanism 400 to move the center of the eyeball b to the second light based on the eye position information.

[0136] In this embodiment, during the review or continuous detection process, the processing unit of the controller 300 can quickly call the eye position information previously stored in the storage unit, and control the position adjustment mechanism 400 to move the center of the eyeball b to the second light. This can improve the detection efficiency for subjects who need frequent inspections.

[0137] like Figure 5 and Figure 6 As shown, in some embodiments, the position adjustment mechanism 400 includes: a movable headgear 410 and a movable seat 420 .

[0138] The movable headgear 410 is mounted on the head of the subject to limit the subject's eyeball b to face the first position point a as much as possible.

[0139] The movable seat 420 is disposed directly below the movable headgear and is used to support the person being measured.

[0140] The moving head cover 410 and the moving seat 420 are both connected to the controller 300 , and the moving head cover 410 and the moving seat 420 are configured to move synchronously in the same direction within a plane perpendicular to the second light.

[0141] It should be noted that if the headgear and the seat do not move synchronously, the subject may need to make unnatural head or body adjustments to adapt, which may cause physical burden and discomfort to the subject.

[0142] In this embodiment, the movable headgear 410 and the movable seat 420 are configured to move synchronously in the same direction within a plane perpendicular to the second light ray, thereby reducing the physical burden and discomfort of the subject.

[0143] like Figure 5 and Figure 6 As shown, in some embodiments, the optometry system further includes an optometry housing c.

[0144] The light source array assembly 100, the camera module 200 and the controller 300 are all disposed in the ophthalmometer housing c.

[0145] The position adjustment mechanism 400 further includes: a first driving portion 430; a driving end of the first driving portion 430 is detachably connected to the outer wall surface of the movable head cover 410, and is used to drive the movable head cover 410 to move in a horizontal direction.

[0146] In this embodiment, the detachable connection between the driving end of the first driving part 430 and the mobile head cover 410 allows, on the one hand, selection of a suitable mobile head cover 410 according to the head size and shape of different subjects, which can improve the applicability of the mobile head cover 410 to the subjects and ensure that each subject can obtain optimal comfort; on the other hand, the mobile head cover 410 is used to stabilize the subject's head and prevent the subject from changing position during the eye examination process, which is crucial to ensuring the accuracy of refractive power measurement.

[0147] In actual implementation, the position adjustment mechanism 400 further includes: a second driving unit 440 .

[0148] A driving end of the second driving portion 440 is connected to the movable seat 420 and is used to drive the movable seat 420 to move in a horizontal direction.

[0149] like Figure 6 As shown, in some embodiments, the first driving unit 430 includes: a housing 431 , a guide rod 432 , a first power source 433 and a moving block 434 .

[0150] The opposite inner wall surfaces of the housing 431 are respectively provided with guide grooves 4311 arranged along the vertical direction.

[0151] The guide rod 432 is arranged horizontally and includes a first rod body 4321 and a second rod body 4322. One end of the first rod body 4321 and the second rod body 4322 is provided with a guide sleeve 4323; the first rod body 4321 and the second rod body 4322 can be rotatably installed in the corresponding guide sleeve 4323, and are slidably arranged in the guide groove 4311 through the guide sleeve 4323.

[0152] The rotating end of the first power source 433 is fixedly connected to the other end of the second rod 4322 , and the second rod 4322 is fixedly connected to the first rod 4321 through the first power source 433 .

[0153] The moving block 434 is threadedly sleeved on the second rod 4322 , and the moving block 434 is detachably connected to the moving head cover 410 .

[0154] In this embodiment, when the movable seat 420 rises or falls vertically, the subject will rise or fall vertically synchronously. Since the subject wears the movable head cover 410 on his head, and the movable head cover 410 is connected to the movable block 434, the synchronous vertical rise or fall of the movable block 434 will drive the first rod 4321, the second rod 4322 and the corresponding guide sleeve 4323 to rise or fall vertically synchronously in the guide groove 4311.

[0155] This design can reduce the number of power sources, that is, only the first drive unit 430 is designed without designing other power sources. The power source is used to coordinate the vertical rise or fall of the mobile seat 420 and synchronously drive the mobile block 434 to rise or fall vertically.

[0156] At the same time, the first power source 433 is fixedly connected to the second rod body 4322 through its rotating end. When the first power source 433 is started, the second rod body 4322 can be driven to rotate relative to the first rod body 4321, thereby realizing the horizontal movement of the moving block 434 and the horizontal movement of the moving head cover 410.

[0157] like Figure 6 As shown, in actual implementation, the first power source 433 includes but is not limited to a micro motor.

[0158] In actual implementation, the mobile chair 420 includes a support part and a lifting part. The lifting end of the lifting part is fixedly connected to the support part to drive the support part to move in the vertical direction. The support part is used to support the subject (not shown).

[0159] The optometry method of the optometry system may be applied to a terminal, and may be specifically executed by hardware or software in the terminal.

[0160] The terminal includes, but is not limited to, a portable communication device such as a mobile phone or tablet computer having a touch-sensitive surface (e.g., a touch screen display and / or a touch pad). It should also be understood that, in some embodiments, the terminal may not be a portable communication device, but a desktop computer having a touch-sensitive surface (e.g., a touch screen display and / or a touch pad).

[0161] In the following embodiments, a terminal including a display and a touch-sensitive surface is described. However, it should be understood that the terminal may include one or more other physical user interface devices such as a physical keyboard, a mouse, and a joystick.

[0162] The optometry method of the optometry system provided in the embodiment of the present application can be executed by an electronic device or a functional module or functional entity in the electronic device that can implement the optometry method. The electronic devices mentioned in the embodiment of the present application include but are not limited to mobile phones, tablets, computers, cameras and wearable devices. The optometry method provided in the embodiment of the present application is described below using an electronic device as an example of the execution subject.

[0163] like Figure 7 As shown, the optometry method includes: step 610, step 620, step 630, step 640 and step 650.

[0164] Step 610: Control the second light source 120 to emit a second light ray toward the eyeball b of the subject, and the second light ray or the extension line of the second light ray passes through the first position point a.

[0165] In this step, the second light source 120 may be disposed at the first position point a, or may be disposed at a position collinear with the first position point a.

[0166] In actual implementation, the second light source 120 includes but is not limited to a light source with high collimation, such as a low-power laser light source.

[0167] Step 620: Acquire second image data of the eyeball b generated by reflection of the eyeball b of the subject.

[0168] In this step, the second image data may include detailed information of the pupil and iris of the eyeball b, as well as light spots or highlights formed on the eyeball b by the irradiating light.

[0169] Step 630: Determine the position of the center of the eyeball b relative to the second light ray based on the second image data of the eyeball b.

[0170] In this step, the controller 300 obtains the second image data of the eyeball b and can use image processing algorithms (such as Hough transform, pupil positioning algorithm based on deep learning) for analysis to accurately identify the center of the eyeball b, and at the same time identify the light spot or highlight formed on the eyeball b by the second light of the second light source 120.

[0171] The controller 300 may calculate the distance and direction between the center of the eyeball b and the light spot, and determine the offset direction and offset position of the eyeball b relative to the second light.

[0172] This can be achieved through simple geometric calculations, such as measuring the pixel distance between two points on the image and converting it into an actual angle or distance based on the calibration parameters of the camera module 200.

[0173] It should be noted that this step can improve the accuracy of refractive power measurement by informing the subject of the offset direction and offset position of the center of the eyeball b relative to the second light ray, so that the subject can adjust himself and the center of the subject's eyeball b is located on the second light ray, thereby improving the accuracy of refractive power measurement when the first light source 110 is used for subsequent irradiation.

[0174] Step 640: Control the first light source 110 to emit a first light beam toward the eyeball b of the subject, wherein a plurality of first light sources 110 are spaced apart and distributed around the first position point a.

[0175] In this step, the first position point a can be at the center of multiple first light sources 110, and the first light source 110 can be set in different directions through the first position point a. At the same time, the multiple first light sources 110 are evenly spaced and distributed, and there can be three first light sources 110 in the same direction through the first position point a.

[0176] In actual implementation, the first light source 110 includes but is not limited to an infrared LED lamp and a near-infrared LED lamp.

[0177] It should be noted that when the first light is infrared or near-infrared, it is safe for the human eye, will not cause retinal damage, and is more comfortable for the subject.

[0178] Step 650: Acquire first image data of the eyeball b generated by reflection of the eyeball b of the subject.

[0179] In this step, the first image data may include reflected images of the pupil, iris and other intraocular structures of the subject's eyeball b, such as light spots or highlights reflected by the pupil.

[0180] Step 660: Determine a refractive detection result based on the first image data of the eyeball b.

[0181] In this step, the controller 300 receives the first image data of the eyeball b from the camera module 200 and processes the first image data.

[0182] For example, various denoising algorithms (such as Gaussian blur, median filtering, etc.) are used to clean up the image to ensure the accuracy of feature extraction; the boundaries and centers of the pupils are identified by using edge detection (such as the Canny algorithm) and circular Hough transform.

[0183] Analyze image sequences of the same eye captured under different LED light sets. Compare changes in specific reflective areas created by the light in these images, and use an optical model to calculate the refractive state of the eye.

[0184] It should be noted that if the subject's eyeball b is not on the extension line of the first position point a, the light irradiation becomes asymmetric.

[0185] This means that some first light sources 110 are closer to the eyeball b, while others are farther away. The closer first light sources 110 create larger and more diffuse light spots on the eyeball b, while the farther first light sources 110 create smaller and more concentrated light spots. This uneven distribution of light spots results in inconsistent light intensity and coverage across different parts of the subject's eyeball b, reducing the amount of valid first image data available for analysis. This, in turn, affects the accuracy of the controller 300's processing and analysis of this image data, impacting the actual diopter measurement.

[0186] In the above embodiment of the present application, the position of the eyeball b relative to the second light is first determined, and the offset direction and offset position of the center of the eyeball b relative to the second light are informed to the subject, so that the subject can adjust himself and the center of the eyeball b of the subject is located on the second light, thereby improving the accuracy of the refractive power measurement when the first light source 110 is used for subsequent illumination.

[0187] like Figure 8 As shown, in some embodiments, the number of the first light sources 110 is 18, and the 18 first light sources 110 are evenly spaced and distributed and arranged around a regular hexagonal area. Each side of the regular hexagon is provided with a first light source 110, and 3 first light sources 110 are provided in a direction perpendicular to each side of the regular hexagon.

[0188] The 18 first light sources 110 are configured to be turned on in a clockwise direction from the inside to the outside, and only one first light source 110 is allowed to be turned on at a time.

[0189] The sequences of 18 first light sources 110 are defined as A1, A2, A3, B1, B2, B3, C1, C2, C3, D1, D2, D3, E1, E2, E3, F1, F2, and F3.

[0190] The eyeball b image is captured multiple times at different time points by the camera module 200. Each LED light group is synchronously photographed when it lights up in a specific cycle, forming a series of images (eg, A1, A2, ..., F3).

[0191] like Figure 9 and Figure 10 As shown, in some embodiments, step 660, determining the refractive detection result based on the first image data of the eyeball b, includes:

[0192] Step 661: Pupil location: Use edge detection and circular Hough transform to identify the boundary and center of the pupil.

[0193] Step 662: Crescent image analysis. By analyzing the shape, area, position, black-white ratio, and grayscale distribution of the crescent image, the propagation and refraction of light in the eye can be inferred.

[0194] It should be noted that the crescent is a specific reflective area formed by light on the pupil.

[0195] Step 663: Analyze the image sequences acquired by the same eye under different illuminations of the first light sources 110 and compare the changes of the crescent figures in these images.

[0196] It should be noted that the image sequence acquired under the illumination of the first light source 110 may be the same as the sequence of the first light source 110 .

[0197] Step 664: Calculate the refractive state of eyeball b using the optical model based on the position and morphological changes of the crescent image, and determine the refractive test result.

[0198] The optometry system in the embodiment of the present application may include an electronic device, or a component of the electronic device, such as an integrated circuit or a chip. The electronic device may be a terminal, or other devices other than a terminal.

[0199] Exemplarily, the electronic device may be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile Internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc. It may also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), an ATM or an kiosks, etc., and the embodiments of the present application are not specifically limited.

[0200] The optometry system in the embodiment of the present application may be a device having an operating system. The operating system may be a Microsoft (Windows) operating system, an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0201] In some embodiments, as Figure 11 As shown, an embodiment of the present application further provides an electronic device 700, including a processor 710, a memory 720, and a computer program stored in the memory 720 and executable on the processor 710. When the program is executed by the processor 710, the various processes of the above-mentioned optometry system and optometry method embodiments are implemented, and the same technical effects can be achieved. To avoid repetition, they will not be described here.

[0202] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0203] An embodiment of the present application also provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various processes of the optometry method embodiment of the above-mentioned optometry system are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0204] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0205] An embodiment of the present application further provides a computer program product, including a computer program, which implements the optometry method of the above-mentioned optometry system when executed by a processor.

[0206] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0207] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the optometry method embodiment of the above-mentioned optometry system, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0208] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0209] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0210] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), including a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0211] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms without departing from the purpose of this application and the scope of protection of the claims, all of which are within the protection of this application.

[0212] Throughout this specification, reference to terms such as "one embodiment," "some embodiments," "illustrative embodiments," "examples," "specific examples," or "some examples" means that the specific features, structures, materials, or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

[0213] Although the embodiments of the present application have been shown and described, those skilled in the art will appreciate that various changes, modifications, substitutions, and variations may be made to the embodiments without departing from the principles and intent of the present application, and that the scope of the present application is defined by the claims and their equivalents.

Claims

1. An artificial intelligence infrared eccentric photography ophthalmometer, characterized in that: include: A light source array assembly, the light source array assembly comprising a plurality of first light sources, the light source array assembly having a first position point, the plurality of first light sources being spaced apart and distributed around the first position point, the first light sources being adapted to emit first light rays toward an eyeball of a subject; a camera module, wherein the camera module captures the eyeball based on the first light to generate first image data of the eyeball; a controller, the controller being electrically connected to the light source array assembly and the camera module, and the controller determining a refractive detection result based on the first image data of the eyeball; The light source array assembly further comprises a second light source; The second light source is suitable for emitting a second light ray toward the eyeball, the second light ray or an extension of the second light ray passes through the first position point, and the camera module captures the eyeball based on the second light ray to generate second image data of the eyeball; The controller is electrically connected to the second light source, and determines the position of the center of the eyeball relative to the second light based on the second image data of the eyeball.

2. The artificial intelligence infrared eccentric photographic ophthalmometer according to claim 1, characterized in that: The distance between the center of the eyeball and the second light is d, and if the distance d is less than a preset distance, the center of the eyeball is located on the second light.

3. The artificial intelligence infrared eccentric photographic ophthalmometer according to claim 1, characterized in that: Also includes: a first beam splitter and a second beam splitter; The light emitted by the light source array assembly is transmitted to the eyeball of the subject through the first beam splitter, and after being reflected by the eyeball of the subject, is transmitted through the second beam splitter and formed into an image on the camera module; Alternatively, the artificial intelligence infrared eccentric photography ophthalmometer comprises: a switching member, a reflector, a first spectroscope and a second spectroscope; The number of the light source array assemblies is two, and the number of the light source array assemblies is the same as the number of the first beam splitter and the second beam splitter. The reflector is arranged between the two eyeballs of the subject, and the light source array assembly, the first beam splitter and the second beam splitter are respectively provided on both sides of the reflector. The rotating end of the switching component is fixedly connected to the reflector, and is used to drive the reflector to rotate to one side, and the light emitted by the light source array assembly is transmitted to the eyeball of the subject through the first beam splitter, and after being reflected by the eyeball of the subject, it is reflected by the reflector to be imaged on the camera module.

4. An optometry system, characterized in that: include: The artificial intelligence infrared eccentric photographic ophthalmometer and position adjustment mechanism according to any one of claims 1 to 3; The controller is electrically connected to the position adjustment mechanism, and is used to control the position adjustment mechanism to move the eyeball closer to the direction of the second light; The position adjustment mechanism includes: a movable headgear and a movable seat; The movable head cover is used to be placed on the head of the subject, and the movable seat is used to support the subject; Wherein, the movable headgear and the movable seat are both connected to the controller, and the movable headgear and the movable seat are configured to move synchronously in a plane perpendicular to the second light and in the same direction; The optometry system also includes: optometry housing; The light source array assembly, the camera module and the controller are all arranged in the optometrist housing; The position adjustment mechanism further includes: a first driving part; a driving end of the first driving part is detachably connected to the outer wall surface of the movable head cover, and is used to drive the movable head cover to move in a horizontal direction; And / or, the position adjustment mechanism further comprises: a second driving unit; a driving end of the second driving unit is connected to the movable seat, and is used to drive the movable seat to move in a horizontal direction; The first driving part includes: a housing, a guide rod, a first power source and a moving block; The housing has guide grooves arranged in a vertical direction on the opposite inner wall surfaces, and the guide rod is arranged horizontally and includes a first rod body and a second rod body. One end of the first rod body and the second rod body is provided with a guide sleeve; the first rod body and the second rod body can be rotatably installed in the corresponding guide sleeve and slidably arranged in the guide groove through the guide sleeve; The rotating end of the first power source is fixedly connected to the other end of the second rod, and the second rod is fixedly connected to the first rod via the first power source; The moving block is threadedly provided on the second rod body, and the moving block is detachably connected to the moving head cover; And / or, the movable chair includes a supporting portion and a lifting portion, the lifting end of the lifting portion is fixedly connected to the supporting portion, and is used to drive the supporting portion to move in a vertical direction, and the supporting portion is used to support the person being measured.

5. The optometry system according to claim 4, characterized in that: The controller includes: a processing unit and a storage unit; The storage unit stores the eye position information of the subject's eyeballs; The processing unit is connected to the position adjustment mechanism and the storage unit, and is configured to control the position adjustment mechanism to move the center of the eyeball to the second light based on the eye position information.

Images