Artificial intelligence infrared eccentric photography optometry unit, optometry system and optometry method

Abstract

The invention discloses an artificial intelligent infrared eccentric photorefractometer, an optometry system and an optometry method, and belongs to the technical field of optometry. The artificial intelligence infrared eccentric photorefractometer comprises a light source array assembly, a camera module and a controller, the light source array assembly comprises a plurality of first light sources, the light source array assembly is provided with a first position point, the first light sources are distributed around the first position point at intervals, and the first light sources are suitable for emitting first light rays to eyeballs of a testee; the camera module shoots eyeballs based on the first light to generate first image data of the eyeballs; the controller is electrically connected with the light source array assembly and the camera module, and the controller determines a refraction detection result based on the first image data of the eyeball. The method does not depend on the subjective reaction of the testee, and can provide a more objective test result; compared with a traditional computer optometry unit which needs a professional optometrist to cooperate with the testee for optometry, the computer optometry unit has the advantage that the testee does not need to make visual judgment, so that the detection process is rapid and efficient.

Description

Technical Field

[0001] The present application belongs to the field of optometry technology, and in particular relates to an artificial intelligence infrared eccentric photography optometry instrument, an optometry system and an optometry method. Background Art

[0002] Computer optometry is a vision optometry instrument used to check the convergence of light after it enters the eyeball, so as to detect visual acuity and diopter. Computer optometry belongs to objective optometry, and its principle is basically the same as retinoscopy. It uses infrared light source to relax the eyeball adjustment, and uses photoelectric technology and automatic control technology to check diopter.

[0003] Traditional computer ophthalmometers need to be operated in conjunction with professional optometrists, and professional optometrists and the subjects need to work together to achieve a good eye test for the subjects. However, with the increase in vision problems among the population, especially myopia among school-age children, a device that is both fast and accurate is needed for eye testing. Summary of the invention

[0004] The present application aims to solve at least one of the technical problems existing in the prior art. To this end, the present application proposes an artificial intelligence infrared eccentric photography optometry instrument, an optometry system and an optometry method.

[0005] In a first aspect, the present application provides an artificial intelligence infrared eccentric photography optometry instrument, comprising: A light source array assembly, the light source array assembly comprising a plurality of first light sources, the light source array assembly having a first position point, the plurality of first light sources being spaced apart and distributed around the first position point, the first light sources being adapted to emit first light rays to the eyeball of the subject; a camera module, wherein the camera module photographs the eyeball based on the first light to generate first image data of the eyeball; A controller is electrically connected to the light source array assembly and the camera module, and the controller determines a refractive detection result based on the first image data of the eyeball.

[0006] According to the artificial intelligence infrared eccentric photography ophthalmometer of the present application, multiple first light sources are evenly distributed around the first position point. This layout allows the eyeball to be illuminated from different angles. This multi-angle illumination helps to fully capture the eyeball's response to light, especially when evaluating astigmatism and other complex refractive abnormalities of the eyeball, and can provide more comprehensive data; at the same time, the controller determines the refractive detection result based on the first image data of the eyeball, which does not depend on the subjective response of the subject, and it can provide more objective test results; compared with traditional computer ophthalmometers, which are complicated to operate and require professional optometrists and subjects to work together to perform optometry, the subject of the present application does not need to make visual judgments, which reduces the psychological pressure and physical fatigue of the subject during the examination, making the detection process fast and efficient.

[0007] According to one embodiment of the present application, the light source array assembly further has a second light source; The second light source is suitable for emitting a second light ray to the eyeball, the second light ray or an extension line of the second light ray passes through the first position point, and the camera module photographs the eyeball based on the second light ray to generate second image data of the eyeball; The controller is electrically connected to the second light source, and determines the position of the eyeball relative to the second light based on the second image data of the eyeball.

[0008] According to the artificial intelligence infrared eccentric photography ophthalmometer of the present application, the reflected image of the eyeball is captured by the camera module. If the second light emitted by the second light source is directly opposite to the center of the eyeball, the light spot formed by the reflection of the eyeball should be located at the center of the image captured by the camera. If the light spot deviates from the center, this indicates that the center of the eye is offset relative to the second light emitted by the second light source. According to the position of the light spot in the image captured by the camera, the offset direction and offset position of the center of the eyeball relative to the second light can be determined. In this embodiment, the offset direction and offset position of the center of the eyeball relative to the second light can be informed to the subject of the test, so that the subject can adjust by himself and the center of the subject's eyeball is located on the second light, thereby improving the accuracy of the refractive power measurement when the first light source is used for subsequent irradiation.

[0009] According to one embodiment of the present application, the distance between the center of the eyeball and the second light ray is d. If the distance d is less than a preset distance, the center of the eyeball is located on the second light ray.

[0010] According to one embodiment of the present application, the artificial intelligence infrared eccentric photography ophthalmometer further includes: a first spectroscope and a second spectroscope; The light emitted by the light source array assembly is transmitted to the eyeball of the subject through the beam splitter, and after being reflected by the eyeball of the subject, it is transmitted through the second beam splitter and imaged on the camera module; Or, the optometry system further comprises: a switching member, a reflector, a first beam splitter and a second beam splitter; The number of the light source array assemblies is two, and the number of the light source array assemblies is the same as the number of the first beam splitter and the second beam splitter. The reflector is arranged between the two eyeballs of the subject, and the light source array assembly, the first beam splitter and the second beam splitter are respectively arranged on both sides of the reflector. The rotating end of the switching component is fixedly connected to the reflector, and is used to drive the reflector to rotate to one side, and the light emitted by the light source array assembly is transmitted to the eyeball of the subject through the beam splitter, and after being reflected by the eyeball of the subject, it is reflected by the reflector to be imaged on the camera module.

[0011] In a second aspect, the present application further provides an optometry system, including the artificial intelligence infrared eccentric photography optometry instrument described in any of the above embodiments, and further including: a position adjustment mechanism; The controller is electrically connected to the position adjustment mechanism, and is used to control the position adjustment mechanism to make the eyeball move closer to the direction of the second light.

[0012] According to one embodiment of the present application, the controller includes: a processing unit and a storage unit; The storage unit stores the eye position information of the subject's eyeballs; The processing unit is connected to the position adjustment mechanism and the storage unit, and is used to control the position adjustment mechanism to move the eyeball to the second light based on the eye position information.

[0013] According to one embodiment of the present application, the position adjustment mechanism includes: a movable headgear and a movable seat; The movable head cover is used to be mounted on the head of the subject, and the movable seat is used to support the subject; Wherein, the moving head cover and the moving seat are both connected to the controller, and the moving head cover and the moving seat are configured to move synchronously in the same direction in a plane perpendicular to the second light.

[0014] According to one embodiment of the present application, the optometry system further includes: an optometry instrument housing; The light source array assembly, the camera module and the controller are all arranged in the optometry housing; The position adjustment mechanism further includes: a first driving unit; a driving end of the first driving unit is detachably connected to the outer wall surface of the movable head cover, and is used to drive the movable head cover to move in a horizontal direction; And / or, the position adjustment mechanism further includes: a second driving unit; a driving end of the second driving unit is connected to the movable seat, and is used to drive the movable seat to move in a horizontal direction.

[0015] According to one embodiment of the present application, the first driving part includes: a housing, a guide rod, a first power source and a moving block; The inner wall surfaces opposite to each other of the shell are respectively provided with guide grooves arranged in the vertical direction. The guide rod is arranged horizontally and comprises a first rod body and a second rod body. One end of the first rod body and the second rod body are both provided with guide sleeves. The first rod body and the second rod body can be rotatably installed in the corresponding guide sleeves and are slidably arranged in the guide grooves through the guide sleeves. The rotating end of the first power source is fixedly connected to the other end of the second rod body, and the second rod body is fixedly connected to the first rod body through the first power source; The moving block is threadedly sleeved on the second rod body, and the moving block is detachably connected to the moving head cover; And / or, the mobile chair includes a supporting part and a lifting part, the lifting end of the lifting part is fixedly connected to the supporting part, and is used to drive the supporting part to move in a vertical direction, and the supporting part is used to support the person being measured.

[0016] In a third aspect, the present application also provides an optometry method, the method comprising: Controlling a second light source to emit a second light ray toward the eyeball of the subject, wherein the second light ray or an extension line of the second light ray passes through the first position point; Acquire second image data of the eyeball generated by reflection of the eyeball of the subject; determining a position of the eyeball relative to the second light based on the second image data of the eyeball; Controlling a first light source to emit a first light beam toward the eyeball of the subject, wherein a plurality of the first light sources are spaced apart and distributed around the first position point; Acquire first image data of the eyeball generated by reflection of the eyeball of the subject; Based on the first image data of the eyeball, a refraction detection result is determined.

[0017] According to the optometry method of the present application, the position of the eyeball relative to the second light is first determined, and the offset direction and offset position of the center of the eyeball relative to the second light are informed to the subject, so that the subject can adjust himself and the center of the eyeball of the subject is located on the second light, thereby improving the accuracy of refractive power measurement when the first light source is used for subsequent irradiation.

[0018] In a fourth aspect, the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the optometry method as described in the third aspect above when executing the computer program.

[0019] In a fifth aspect, the present application provides a non-transitory computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the optometry method as described in the third aspect above is implemented.

[0020] In a sixth aspect, the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the optometry method as described in the third aspect.

[0021] In a seventh aspect, the present application provides a computer program product, including a computer program, which, when executed by a processor, implements the optometry method as described in the third aspect above.

[0022] The above one or more technical solutions in the embodiments of the present application have at least one of the following technical effects: Furthermore, multiple first light sources are evenly distributed around the first position point. This layout allows the eyeball to be illuminated from different angles. This multi-angle illumination helps to fully capture the eyeball's response to light, especially when evaluating astigmatism and other complex refractive errors of the eyeball, and can provide more comprehensive data; at the same time, the controller determines the refractive detection result based on the first image data of the eyeball, which does not rely on the subjective response of the subject, and it can provide more objective test results; compared with traditional computer ophthalmometers, which are complicated to operate and require professional optometrists and subjects to work together to perform optometry, the subject of the present application does not need to make visual judgments, which reduces the psychological pressure and physical fatigue of the subject during the examination, making the detection process fast and efficient.

[0023] Furthermore, by capturing the reflected image of the eyeball through the camera module, if the second light emitted by the second light source is directly facing the center of the eyeball, then the light spot formed by the reflection of the eyeball should be located at the center of the image captured by the camera. If the light spot deviates from the center, this indicates that the center of the eye is offset relative to the second light emitted by the second light source. According to the position of the light spot in the image captured by the camera, the offset direction and offset position of the center of the eyeball relative to the second light can be determined. In this embodiment, the offset direction and offset position of the center of the eyeball relative to the second light can be informed to the subject of the test, so that the subject can adjust by himself and the center of the eyeball of the subject is located on the second light, thereby improving the accuracy of the refractive power measurement when the first light source is used for subsequent irradiation.

[0024] The above one or more technical solutions in the embodiments of the present application have at least one of the following technical effects: Furthermore, multiple first light sources are evenly distributed around the first position point. This layout allows the eyeball to be illuminated from different angles. This multi-angle illumination helps to fully capture the eyeball's response to light, especially when evaluating astigmatism and other complex refractive errors of the eyeball, and can provide more comprehensive data; at the same time, the controller determines the refractive detection result based on the first image data of the eyeball, which does not rely on the subjective response of the subject, and it can provide more objective test results; compared with traditional computer ophthalmometers, which are complicated to operate and require professional optometrists and subjects to work together to perform optometry, the subject of the present application does not need to make visual judgments, which reduces the psychological pressure and physical fatigue of the subject during the examination, making the detection process fast and efficient.

[0025] Furthermore, by capturing the reflected image of the eyeball through the camera module, if the second light emitted by the second light source is directly facing the center of the eyeball, then the light spot formed by the reflection of the eyeball should be located at the center of the image captured by the camera. If the light spot deviates from the center, this indicates that the center of the eyeball is offset relative to the second light emitted by the second light source. By informing the subject of the offset direction and offset position of the center of the eyeball relative to the second light, the subject can adjust by himself and the center of the eyeball of the subject is located on the second light, so that the accuracy of the diopter measurement is improved when the first light source is used for subsequent irradiation.

[0026] Furthermore, the mobile headgear is mounted on the head of the subject to limit the subject's eyeballs to face the first position point as much as possible. The mobile seat is arranged directly below the mobile headgear to support the subject. The mobile headgear and the mobile seat are both connected to the controller, and the mobile headgear and the mobile seat are configured to move synchronously in the same direction in a plane perpendicular to the second light. If the headgear and the seat do not move synchronously, the subject may need to make unnatural head or body adjustments to adapt, which may cause physical burden and discomfort to the subject. In the present embodiment, the mobile headgear and the mobile seat are configured to move synchronously in the same direction in a plane perpendicular to the second light, which can reduce the physical burden and discomfort of the subject.

[0027] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which: Figure 1 This is one of the structural schematic diagrams of the artificial intelligence infrared eccentric photography ophthalmometer provided in the embodiment of the present application; Figure 2 This is the second structural schematic diagram of the artificial intelligence infrared eccentric photography ophthalmometer provided in the embodiment of the present application; Figure 3 is a schematic diagram of the structure of the center of the eyeball relative to the second light provided in an embodiment of the present application; Figure 4 This is the third structural schematic diagram of the artificial intelligence infrared eccentric photography ophthalmometer provided in the embodiment of the present application; Figure 5 is a structural schematic diagram of an optometry system provided in an embodiment of the present application; Figure 6 is a structural schematic diagram of a first driving unit provided in an embodiment of the present application; Figure 7 It is a flowchart of the optometry method provided in the embodiment of the present application; Figure 8 is a schematic structural diagram of a first light source provided in an embodiment of the present application; Fig. 9 It is one of the crescent diagrams provided in the embodiments of the present application; Fig.10 This is the second crescent diagram provided in the embodiment of the present application; Fig.11 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0029] Reference numerals: 100, light source array assembly; 110, first light source; 120, second light source; 200, camera module; 210, camera element; 220, imaging lens; 300, controller; 400, position adjustment mechanism; 410, mobile headgear; 420, mobile seat; 430, first driving unit; 431, housing; 4311, guide groove; 432, guide rod; 4321, first rod body; 4322, second rod body; 4323, guide sleeve; 433. The first power source; 434, moving blocks; 440, second driving unit; 510, a first beam splitter; 520, a second beam splitter; 530, a reflector; a, first position point; b, eyeball; c, ophthalmometer housing; 700. Electronic device; 710. Processor; 720. Memory. DETAILED DESCRIPTION

[0030] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0031] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0032] Reference below Figure 1-Figure 4 An artificial intelligence infrared eccentric photography ophthalmometer according to an embodiment of the present application is described.

[0033] like Figure 1 As shown, the artificial intelligence infrared eccentric photography ophthalmometer includes: a light source array assembly 100, a camera module 200 and a controller 300.

[0034] The light source array assembly 100 includes a plurality of first light sources 110 . The light source array assembly 100 has a first position point a. The plurality of first light sources 110 are spaced apart and distributed around the first position point a.

[0035] The first position point a may be located at the center of the plurality of first light sources 110 , and the first light sources 110 may be disposed in different directions passing through the first position point a.

[0036] like Figure 1 and Figure 8 As shown, in actual implementation, the plurality of first light sources 110 are evenly spaced and distributed, and there may be three first light sources 110 in the same direction passing through the first position point a.

[0037] The first light source 110 is suitable for emitting a first light to the eyeball b of the subject, and the first light source 110 includes but is not limited to an infrared LED lamp and a near-infrared LED lamp.

[0038] It should be noted that when the first light is infrared or near-infrared, it is safe for human eyes, will not cause retinal damage, and is more comfortable for the subject.

[0039] The camera module 200 captures the eyeball b based on the first light to generate first image data of the eyeball b.

[0040] like Figure 2 As shown, in actual implementation, the camera module 200 may include a camera element 210 and an imaging lens 220. The camera element 210 is conjugate with the eyeball b of the subject relative to the imaging lens 220. The camera element 210 is used to photograph the eyeball b to generate first image data of the eyeball b.

[0041] The controller 300 is electrically connected to the light source array assembly 100 and the camera module 200 , and the controller 300 determines the refraction detection result based on the first image data of the eyeball b.

[0042] Specifically, the controller 300 receives the first image data of the eyeball b from the camera module 200 and processes the first image data.

[0043] For example, various denoising algorithms (such as Gaussian blur, median filtering, etc.) are used to clean up the image and ensure the accuracy of feature extraction; the boundaries and centers of the pupils are identified by using edge detection (such as the Canny algorithm) and circular Hough transform; Analyze the image sequences of the same eye under different LED light groups, compare the changes in the specific reflective areas formed by the light in these images, and use the optical model to calculate the refractive state of the eyeball b.

[0044] The above specific implementation is only an exemplary implementation scheme for showing that the controller 300 determines the refractive detection result based on the first image data. Of course, the reflection and scattering images of the eyeball b to the light are captured by the camera module 200. By analyzing the scattering patterns of the light spots in these images, the refractive state of the eyeball b can also be determined. This embodiment does not impose any limitation on this.

[0045] In the above embodiment of the present application, multiple first light sources 110 are evenly distributed around the first position point a. This layout allows the eyeball b to be illuminated from different angles, and the intensity and direction of the light can be controlled at each angle by adjusting the brightness and switch of the light source.

[0046] This multi-angle illumination helps to fully capture the eye's response to light, providing more comprehensive data, especially when evaluating astigmatism and other complex refractive errors in the eye.

[0047] Compared with the traditional computer ophthalmometer, which is complicated to operate and requires cooperation between a professional optometrist and the person being tested, the person being tested in this embodiment does not need to make a visual judgment, which reduces the psychological pressure and physical fatigue of the person being tested during the examination, making the detection process fast and efficient.

[0048] At the same time, the controller 300 of this embodiment determines the refractive detection result based on the first image data of the eyeball b, that is, this embodiment relies on image data analysis rather than the subjective response of the subject, and it can provide more objective test results, which is especially important for children or special groups who cannot accurately express their visual perception.

[0049] In summary, the present application discloses an artificial intelligence infrared eccentric photography ophthalmometer, in which multiple first light sources 110 are evenly distributed around a first position point a. This layout allows the eyeball b to be illuminated from different angles. This multi-angle illumination helps to fully capture the reaction of the eyeball b to light, especially when evaluating the astigmatism and other complex refractive abnormalities of the eyeball b, and can provide more comprehensive data; at the same time, the controller 300 determines the refractive detection result based on the first image data of the eyeball b, which does not depend on the subjective reaction of the subject, and it can provide more objective test results; compared with the traditional computer ophthalmometer, which is complicated to operate and requires the cooperation of professional optometrists and the subject to perform optometry, the subject of the present application does not need to make visual judgments, which reduces the psychological pressure and physical fatigue of the subject during the examination, making the detection process fast and efficient.

[0050] It should be noted that when the relevant technology conducts objective measurement of the human eye, the forehead of an average person will be pressed against the optometry instrument. At this time, the person's head is not in a natural daily state. Some people will unconsciously tilt their face to one side, causing the head to appear horizontally / vertically tilted. Even if the position of the optometry instrument can be adjusted, people still have to control their neck and body to complete the action of fixing the forehead to the machine. This link cannot be quantified. At this time, the position b of the eyeballs of both eyes may not be in a position that can accurately achieve optometry.

[0051] In fact, in the related technology, it is inevitable that the eyeball b will deviate from the center of the multiple first light sources 110, the difference is that the degree is greater or lesser, which will have a greater impact on the eye examination.

[0052] In the above-mentioned embodiment of the present application, if the center of the subject's eyeball b is not collinear with the first position point a, the light irradiation becomes asymmetric.

[0053] This means that some of the first light sources 110 are closer to the eyeball b, while others are farther away. The light spots of the closer first light sources 110 on the eyeball b will be larger and more scattered; while the light spots formed by the farther first light sources 110 will be smaller and more concentrated.

[0054] This non-uniform distribution of light spots leads to inconsistency in light intensity and coverage area of ​​different parts of the subject's eyeball b, thereby reducing the actual effective first image data, and further affecting the accuracy of the controller 300 in processing and analyzing the image data.

[0055] like Figure 2 As shown, in some embodiments, the light source array assembly 100 further has a second light source 120 .

[0056] The second light source 120 is suitable for emitting a second light ray toward the eyeball b, and the second light ray or an extension line of the second light ray passes through the first position point a.

[0057] When the second light source 120 is specifically arranged, the second light source 120 can be set at the first position point a, or can be set at a position colinear with the first position point a. The second light source 120 includes but is not limited to a light source with high collimation, such as a low-power laser light source.

[0058] The camera module 200 captures the eyeball b based on the second light to generate second image data of the eyeball b.

[0059] The controller 300 is electrically connected to the second light source 120 , and the controller 300 determines the position of the eyeball b relative to the second light based on the second image data of the eyeball b.

[0060] Specifically, the camera module 200 photographs the eyeball b and generates second image data of the eyeball b, which includes detailed information such as the pupil and iris of the eyeball b, as well as reflections and highlights formed on the eyeball b by the irradiated light.

[0061] After the controller 300 receives the image data sent by the camera module 200, it uses an image processing algorithm (such as Hough transform, pupil positioning algorithm based on deep learning) to analyze it to accurately identify the center of the eyeball b, and at the same time identify the light spot or reflection point formed on the eyeball b by the second light of the second light source 120.

[0062] The controller 300 can calculate the distance and direction between the center of the eyeball b and the light spot, and determine the offset direction and offset position of the center of the eyeball b relative to the second light.

[0063] This can be achieved through simple geometric calculations, such as measuring the pixel distance between two points on the image and converting it into an actual angle or distance based on the calibration parameters of the camera module 200.

[0064] In this embodiment, the reflected image of the eyeball b is captured by the camera module 200. If the second light emitted by the second light source 120 is directly facing the center of the eyeball b, then the light spot formed by the reflection of the eyeball b should be located at the center of the image captured by the camera.

[0065] If the light spot deviates from the center, it indicates that the center of the eyeball b is offset relative to the second light emitted by the second light source 120. In this embodiment, the offset direction and offset position of the center of the eyeball b relative to the second light can be informed to the subject, so that the subject can adjust by himself and the center of the eyeball b of the subject is located on the second light, so that the accuracy of the diopter measurement is improved when the first light source 110 is used for subsequent irradiation.

[0066] like Figure 3 As shown, in some embodiments, the distance between the center of the eyeball b and the second light is d. If the distance d is less than a preset distance, the center of the eyeball b is located on the second light.

[0067] In this embodiment, the distance d is required to be equal to 0. To achieve complete alignment between the center of the eyeball b and the second light ray may require multiple adjustments and re-measurements, which will significantly reduce operational efficiency. Allowing a small range of deviation can speed up the measurement process while still maintaining a certain accuracy in refractive measurement.

[0068] like Figure 2 As shown, in some embodiments, the artificial intelligence infrared eccentric photography ophthalmometer also includes: a first spectroscope 510 and a second spectroscope 520.

[0069] The light emitted by the light source array assembly 100 is transmitted to the eyeball b of the subject through the beam splitter, and after being reflected by the eyeball b of the subject, it is transmitted through the second beam splitter 520 and imaged on the camera module 200; like Figure 4 As shown, in some embodiments, the artificial intelligence infrared eccentric photography ophthalmometer further includes: a switching component, a reflector 530, a first beam splitter 510 and a second beam splitter 520.

[0070] There are two light source array assemblies 100, which are the same as the first beam splitter 510 and the second beam splitter 520. The reflector 530 is arranged between the two eyeballs b of the subject. The light source array assemblies 100, the first beam splitter 510 and the second beam splitter 520 are respectively arranged on both sides of the reflector 530. The rotating end of the switching component is fixedly connected to the reflector 530, which is used to drive the reflector 530 to rotate to one side, and the light emitted by the light source array assembly 100 is transmitted to the eyeball b of the subject through the beam splitter, and after being reflected by the eyeball b of the subject, it is reflected by the reflector 530 to form an image on the camera module 200.

[0071] In this embodiment, the reflector 530 is located between the two eyes of the subject, and the reflector 530 can be controlled to rotate to one side by a switching component. At the same time, the light emitted by the source array component is transmitted to the eyeball b of the subject through the beam splitter, and after being reflected by the eyeball b of the subject, it is transmitted through the second beam splitter 520 and reflected by the reflector 530, and is imaged on the camera module 200. In this design, the eyesight of the two eyeballs b of the subject is completed through only one camera module 200.

[0072] It should be noted that when two cameras are used to measure the two eyeballs b of the subject, inconsistent imaging quality may occur. For example, even if the camera module 200 is of the same model, it may exhibit different imaging characteristics due to slight differences in materials, assembly, etc. during the manufacturing process. These differences may affect the clarity, contrast or color balance of the image. In this embodiment, only one camera module 200 is used to ensure consistent imaging quality.

[0073] like Figure 5 As shown, the present application also proposes an optometry system, comprising the artificial intelligence infrared eccentric photography optometry instrument and position adjustment mechanism described in any of the above embodiments.

[0074] The controller 300 is electrically connected to the position adjustment mechanism 400, and is used to control the position adjustment mechanism 400 to move the eyeball b toward the direction of the second light.

[0075] In this embodiment, the automatic position adjustment mechanism 400 can quickly align the subject's eyeball b to the desired position, greatly speeding up the entire optometry process and improving the efficiency of clinical work.

[0076] It also reduces the amount of physical adjustments that the subject needs to make, which is especially important for children or subjects with special needs who may not easily understand instructions.

[0077] In some embodiments, the controller 300 includes: a processing unit and a storage unit.

[0078] The storage unit stores the eye position information of the subject's eyeball b.

[0079] The eye position information includes the position of the eyeball b in the three-dimensional space.

[0080] The processing unit is connected to the position adjustment mechanism 400 and the storage unit, and is used to control the position adjustment mechanism 400 to move the center of the eyeball b to the second light based on the eye position information.

[0081] In this embodiment, during the review or continuous detection process, the processing unit of the controller 300 can quickly call the eye position information previously stored in the storage unit, and control the position adjustment mechanism 400 to move the center of the eyeball b to the second light. This can improve the detection efficiency for the subjects who need frequent inspections.

[0082] like Figure 5 and Figure 6 As shown, in some embodiments, the position adjustment mechanism 400 includes: a movable headgear 410 and a movable seat 420 .

[0083] The movable head cover 410 is mounted on the head of the subject to limit the subject's eyeball b to face the first position point a as much as possible.

[0084] The mobile seat 420 is disposed directly below the mobile headgear and is used to support the person being measured.

[0085] The moving head cover 410 and the moving seat 420 are both connected to the controller 300, and the moving head cover 410 and the moving seat 420 are configured to move synchronously in the same direction in a plane perpendicular to the second light.

[0086] It should be noted that if the headgear and the seat do not move synchronously, the subject may need to make unnatural head or body adjustments to adapt, which may cause physical burden and discomfort to the subject.

[0087] In this embodiment, the movable headgear 410 and the movable seat 420 are configured to move synchronously in the same direction within a plane perpendicular to the second light ray, thereby reducing the physical burden and discomfort of the subject.

[0088] like Figure 5 and Figure 6As shown, in some embodiments, the optometry system further includes an optometry instrument housing c.

[0089] The light source array assembly 100, the camera module 200 and the controller 300 are all disposed in the ophthalmometer housing c.

[0090] The position adjustment mechanism 400 further includes: a first driving unit 430; a driving end of the first driving unit 430 is detachably connected to the outer wall surface of the moving head cover 410, and is used to drive the moving head cover 410 to move in a horizontal direction.

[0091] In this embodiment, the detachable connection between the driving end of the first driving unit 430 and the mobile head cap 410 allows, on the one hand, selection of a suitable mobile head cap 410 according to the head size and shape of different subjects, which can improve the applicability of the mobile head cap 410 to the subjects and ensure that each subject can obtain the best comfort; on the other hand, the mobile head cap 410 is used to stabilize the subject's head to prevent the subject from changing position during the eye examination, which is crucial to ensuring the accuracy of the refractive power measurement.

[0092] In actual implementation, the position adjustment mechanism 400 further includes: a second driving unit 440 .

[0093] A driving end of the second driving unit 440 is connected to the moving seat 420 and is used to drive the moving seat 420 to move in a horizontal direction.

[0094] like Figure 6 As shown, in some embodiments, the first driving unit 430 includes: a housing 431 , a guide rod 432 , a first power source 433 and a moving block 434 .

[0095] The opposite inner wall surfaces of the housing 431 are respectively provided with guide grooves 4311 arranged along the vertical direction.

[0096] The guide rod 432 is arranged horizontally and includes a first rod body 4321 and a second rod body 4322. One end of the first rod body 4321 and the second rod body 4322 is provided with a guide sleeve 4323; the first rod body 4321 and the second rod body 4322 can be rotatably installed in the corresponding guide sleeve 4323, and are slidably arranged in the guide groove 4311 through the guide sleeve 4323.

[0097] The rotating end of the first power source 433 is fixedly connected to the other end of the second rod 4322 , and the second rod 4322 is fixedly connected to the first rod 4321 through the first power source 433 .

[0098] The moving block 434 is threadedly sleeved on the second rod body 4322 , and the moving block 434 is detachably connected to the moving head cover 410 .

[0099] In this embodiment, when the movable seat 420 rises or falls vertically, the subject will rise or fall vertically synchronously. Since the subject wears the movable head cover 410 on his head, and the movable head cover 410 is connected to the movable block 434, the movable block 434 rises or falls vertically synchronously, which will drive the first rod body 4321, the second rod body 4322 and the corresponding guide sleeve 4323 to rise or fall vertically synchronously in the guide groove 4311.

[0100] This design can reduce the number of power sources, that is, only the first drive unit 430 is designed without designing other power sources. The power source is used to coordinate the vertical rise or fall of the moving seat 420 and synchronously drive the moving block 434 to rise or fall vertically.

[0101] At the same time, the first power source 433 is fixedly connected to the second rod body 4322 through its rotating end. When the first power source 433 is started, the second rod body 4322 can be driven to rotate relative to the first rod body 4321, thereby realizing the horizontal movement of the moving block 434 and the horizontal movement of the moving head cover 410.

[0102] like Figure 6 As shown, in actual implementation, the first power source 433 includes but is not limited to a micro motor.

[0103] In actual implementation, the mobile chair 420 includes a supporting part and a lifting part. The lifting end of the lifting part is fixedly connected to the supporting part to drive the supporting part to move in the vertical direction. The supporting part is used to support the person being measured (not shown).

[0104] Among them, the optometry method of the optometry system can be applied to a terminal, and can be specifically executed by hardware or software in the terminal.

[0105] The terminal includes, but is not limited to, a portable communication device such as a mobile phone or tablet computer with a touch-sensitive surface (e.g., a touch screen display and / or a touch pad). It should also be understood that in some embodiments, the terminal may not be a portable communication device, but a desktop computer with a touch-sensitive surface (e.g., a touch screen display and / or a touch pad).

[0106] In the following various embodiments, a terminal including a display and a touch-sensitive surface is described. However, it should be understood that the terminal may include one or more other physical user interface devices such as a physical keyboard, a mouse and a joystick.

[0107] The optometry method of the optometry system provided in the embodiment of the present application may be executed by an electronic device or a functional module or functional entity in the electronic device that can implement the optometry method. The electronic devices mentioned in the embodiment of the present application include but are not limited to mobile phones, tablet computers, computers, cameras, and wearable devices. The optometry method provided in the embodiment of the present application is described below using an electronic device as an example of the execution subject.

[0108] like Figure 7 As shown, the optometry method includes: step 610, step 620, step 630, step 640 and step 650.

[0109] Step 610: Control the second light source 120 to emit a second light ray toward the eyeball b of the subject, and the second light ray or an extension line of the second light ray passes through the first position point a.

[0110] In this step, the second light source 120 may be disposed at the first position point a, or may be disposed at a position colinear with the first position point a.

[0111] In actual implementation, the second light source 120 includes but is not limited to a light source with high collimation, such as a low-power laser light source.

[0112] Step 620: Acquire second image data of the eyeball b generated by reflection of the eyeball b of the subject.

[0113] In this step, the second image data may include detailed information such as the pupil and iris of the eyeball b, as well as light spots or highlights formed on the eyeball b by the irradiated light.

[0114] Step 630: Based on the second image data of the eyeball b, determine the position of the center of the eyeball b relative to the second light ray.

[0115] In this step, the controller 300 obtains the second image data of the eyeball b and can use image processing algorithms (such as Hough transform, pupil positioning algorithm based on deep learning) for analysis to accurately identify the center of the eyeball b, and at the same time identify the light spot or highlight point formed on the eyeball b by the second light of the second light source 120.

[0116] The controller 300 can calculate the distance and direction between the center of the eyeball b and the light spot, and determine the offset direction and offset position of the eyeball b relative to the second light.

[0117] This can be achieved through simple geometric calculations, such as measuring the pixel distance between two points on the image and converting it into an actual angle or distance based on the calibration parameters of the camera module 200.

[0118] It should be noted that, in this step, the subject can be informed of the offset direction and offset position of the center of the eyeball b relative to the second light ray, so that the subject can adjust himself and the center of the subject's eyeball b is located on the second light ray, thereby improving the accuracy of the refractive power measurement when the first light source 110 is used for subsequent irradiation.

[0119] Step 640: Control the first light source 110 to emit a first light beam toward the eyeball b of the subject, wherein a plurality of first light sources 110 are spaced apart and distributed around the first position point a.

[0120] In this step, the first position point a can be at the center of multiple first light sources 110, and the first light sources 110 can be set in different directions through the first position point a. At the same time, the multiple first light sources 110 are evenly spaced and distributed, and there can be three first light sources 110 in the same direction through the first position point a.

[0121] In actual implementation, the first light source 110 includes but is not limited to an infrared LED lamp and a near-infrared LED lamp.

[0122] It should be noted that when the first light is infrared or near-infrared, it is safe for human eyes, will not cause retinal damage, and is more comfortable for the subject.

[0123] Step 650: Acquire the first image data of the eyeball b generated by reflection of the eyeball b of the subject.

[0124] In this step, the first image data may include reflected images of the pupil, iris and other intraocular structures of the subject's eyeball b, such as light spots or highlights reflected by the pupil.

[0125] Step 660: Determine the refraction detection result based on the first image data of the eyeball b.

[0126] In this step, the controller 300 receives the first image data of the eyeball b from the camera module 200 and processes the first image data.

[0127] For example, various denoising algorithms (such as Gaussian blur, median filtering, etc.) are used to clean up the image to ensure the accuracy of feature extraction; the boundaries and centers of the pupils are identified by using edge detection (such as the Canny algorithm) and circular Hough transform.

[0128] Analyze the image sequences of the same eye under different LED light groups, compare the changes in the specific reflective areas formed by the light in these images, and use the optical model to calculate the refractive state of the eyeball b.

[0129] It should be noted that if the eyeball b of the subject is not on the extension line of the first position point a, the light irradiation becomes asymmetric.

[0130] This means that some first light sources 110 are closer to the eyeball b, while others are farther away. The light spots of the first light sources 110 closer to the eyeball b will be larger and more scattered, while the light spots formed by the first light sources 110 farther away will be smaller and more concentrated. This non-uniform distribution of light spots leads to inconsistency in the light intensity and coverage area of ​​different parts of the eyeball b of the subject, thereby reducing the effective first image data that can be used for analysis, thereby affecting the accuracy of the controller 300 in processing and analyzing these image data, and affecting the actual diopter measurement.

[0131] In the above embodiment of the present application, the position of the eyeball b relative to the second light ray is first determined, and the subject is informed of the offset direction and offset position of the center of the eyeball b relative to the second light ray, so that the subject can adjust himself and the center of the eyeball b of the subject is located on the second light ray, thereby improving the accuracy of the refractive power measurement when the first light source 110 is used for subsequent irradiation.

[0132] like Figure 8 As shown, in some embodiments, the number of the first light sources 110 is 18, and the 18 first light sources 110 are evenly spaced and distributed and arranged around a regular hexagonal area, each side of the regular hexagon is provided with a first light source 110, and three first light sources 110 are provided in a direction perpendicular to each side of the regular hexagon.

[0133] The 18 first light sources 110 are configured to be turned on in a clockwise direction from the inside to the outside, and only one first light source 110 is allowed to be turned on at a time.

[0134] The sequences of 18 first light sources 110 are defined as A1, A2, A3, B1, B2, B3, C1, C2, C3, D1, D2, D3, E1, E2, E3, F1, F2, and F3.

[0135] The eyeball b image is captured multiple times at different time points by the camera module 200. Each LED light group is synchronously photographed when it is lit in a specific cycle, forming a series of images (eg, A1, A2, ..., F3).

[0136] like Fig. 9 and Fig.10 As shown, in some embodiments, step 660, determining the refraction detection result based on the first image data of the eyeball b, includes: Step 661: Pupil location: using edge detection and circular Hough transform to identify the boundary and center of the pupil.

[0137] Step 662: crescent analysis: by analyzing the shape, area, position, black-white ratio and grayscale distribution of the crescent, the propagation and refraction of light in the eye can be inferred.

[0138] It should be noted that the crescent is a specific reflective area formed by light on the pupil.

[0139] Step 663: Analyze the image sequences acquired from the same eye under illumination of different first light sources 110, and compare the changes of the crescent images in these images.

[0140] It should be noted that the image sequence acquired under the illumination of the first light source 110 may be the same as the first light source 110 sequence.

[0141] Step 664: According to the position and shape changes of the crescent diagram, the refractive state of the eyeball b is calculated using the optical model to determine the refractive detection result.

[0142] The optometry system in the embodiment of the present application may include an electronic device, or may include a component in the electronic device, such as an integrated circuit or a chip. The electronic device may be a terminal, or may be other devices other than a terminal.

[0143] Exemplarily, the electronic device may be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile Internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc. It may also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiments of the present application.

[0144] The optometry system in the embodiment of the present application may be a device having an operating system. The operating system may be a Microsoft (Windows) operating system, an Android (Android) operating system, an IOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0145] In some embodiments, Fig.11As shown, the embodiment of the present application also provides an electronic device 700, including a processor 710, a memory 720, and a computer program stored in the memory 720 and executable on the processor 710. When the program is executed by the processor 710, each process of the above-mentioned optometry system and optometry method embodiments is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.

[0146] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0147] The embodiment of the present application also provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various processes of the embodiment of the optometry method of the above-mentioned optometry system are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0148] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0149] An embodiment of the present application also provides a computer program product, including a computer program, which implements the optometry method of the above-mentioned optometry system when executed by a processor.

[0150] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0151] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement various processes of the optometry method embodiment of the above-mentioned optometry system, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0152] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0153] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0154] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0155] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

[0156] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials, or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0157] Although the embodiments of the present application have been shown and described, those skilled in the art will appreciate that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present application, and that the scope of the present application is defined by the claims and their equivalents.

Claims

1. An artificial intelligence infrared eccentric photography ophthalmometer, characterized in that: include: A light source array assembly, the light source array assembly comprising a plurality of first light sources, the light source array assembly having a first position point, the plurality of first light sources being spaced apart and distributed around the first position point, the first light sources being adapted to emit first light rays to the eyeball of the subject; a camera module, wherein the camera module photographs the eyeball based on the first light to generate first image data of the eyeball; A controller is electrically connected to the light source array assembly and the camera module, and the controller determines a refractive detection result based on the first image data of the eyeball.

2. According to the artificial intelligence infrared eccentric photography optometry instrument described in claim 1, it is characterized in that: The light source array assembly also has a second light source; The second light source is suitable for emitting a second light ray to the eyeball, the second light ray or an extension line of the second light ray passes through the first position point, and the camera module photographs the eyeball based on the second light ray to generate second image data of the eyeball; The controller is electrically connected to the second light source, and determines the position of the center of the eyeball relative to the second light based on the second image data of the eyeball.

3. According to the artificial intelligence infrared eccentric photography optometry instrument described in claim 2, it is characterized in that: The distance between the center of the eyeball and the second light ray is d, and if the distance d is less than a preset distance, the center of the eyeball is located on the second light ray.

4. The artificial intelligence infrared eccentric photography optometry instrument according to claim 1, characterized in that: Also includes: a first beam splitter and a second beam splitter; The light emitted by the light source array assembly is transmitted to the eyeball of the subject through the first beam splitter, and after being reflected by the eyeball of the subject, it is transmitted through the second beam splitter and imaged on the camera module; Alternatively, the artificial intelligence infrared eccentric photography optometry instrument comprises: a switching member, a reflector, a first beam splitter and a second beam splitter; The number of the light source array assemblies is two, and the number of the light source array assemblies is the same as the number of the first beam splitter and the second beam splitter. The reflector is arranged between the two eyeballs of the subject, and the light source array assembly, the first beam splitter and the second beam splitter are respectively arranged on both sides of the reflector. The rotating end of the switching component is fixedly connected to the reflector, and is used to drive the reflector to rotate to one side, and the light emitted by the light source array assembly is transmitted to the eyeball of the subject through the first beam splitter, and after being reflected by the eyeball of the subject, it is reflected by the reflector to be imaged on the camera module.

5. An optometry system, characterized in that: include: The artificial intelligence infrared eccentric photography ophthalmometer and position adjustment mechanism as described in any one of claims 1 to 4; The controller is electrically connected to the position adjustment mechanism, and is used to control the position adjustment mechanism to make the eyeball move closer to the direction of the second light.

6. The optometry system according to claim 5, characterized in that: The controller includes: a processing unit and a storage unit; The storage unit stores the eye position information of the subject's eyeballs; The processing unit is connected to the position adjustment mechanism and the storage unit, and is used to control the position adjustment mechanism to move the center of the eyeball to the second light based on the eye position information.

7. The optometry system according to claim 5, characterized in that: The position adjustment mechanism comprises: a movable headgear and a movable seat; The movable head cover is used to be mounted on the head of the subject, and the movable seat is used to support the subject; Wherein, the movable head cover and the movable seat are both connected to the controller, and the movable head cover and the movable seat are configured to move synchronously in a plane perpendicular to the second light and in the same direction.

8. The optometry system according to claim 7, characterized in that: Also includes: Optometre housing; The light source array assembly, the camera module and the controller are all arranged in the optometry housing; The position adjustment mechanism further includes: a first driving unit; a driving end of the first driving unit is detachably connected to the outer wall surface of the movable head cover, and is used to drive the movable head cover to move in a horizontal direction; And / or, the position adjustment mechanism further includes: a second driving unit; a driving end of the second driving unit is connected to the movable seat, and is used to drive the movable seat to move in a horizontal direction.

9. The optometry system according to claim 8, characterized in that: The first driving part comprises: a housing, a guide rod, a first power source and a moving block; The inner wall surfaces opposite to each other of the shell are respectively provided with guide grooves arranged in the vertical direction. The guide rod is arranged horizontally and comprises a first rod body and a second rod body. One end of the first rod body and the second rod body are both provided with guide sleeves. The first rod body and the second rod body can be rotatably installed in the corresponding guide sleeves and are slidably arranged in the guide grooves through the guide sleeves. The rotating end of the first power source is fixedly connected to the other end of the second rod body, and the second rod body is fixedly connected to the first rod body through the first power source; The moving block is threadedly disposed on the second rod body, and the moving block is detachably connected to the moving head cover; And / or, the mobile chair includes a supporting part and a lifting part, the lifting end of the lifting part is fixedly connected to the supporting part, and is used to drive the supporting part to move in a vertical direction, and the supporting part is used to support the person being measured.

10. A method of optometry, characterized in that: include: Controlling a second light source to emit a second light ray toward the eyeball of the subject, wherein the second light ray or an extension line of the second light ray passes through the first position point; Acquire second image data of the eyeball generated by reflection of the eyeball of the subject; Based on the second image data of the eyeball, determining the position of the center of the eyeball relative to the second light; Controlling a first light source to emit a first light beam toward the eyeball of the subject, wherein a plurality of the first light sources are spaced apart and distributed around the first position point; Acquire first image data of the eyeball generated by reflection of the eyeball of the subject; Based on the first image data of the eyeball, a refraction detection result is determined.

Images