A portable pupil diameter measuring instrument capable of opening eyelids and a measuring method thereof

By designing a portable pupil diameter measuring instrument, using glasses frame structure and automated image processing technology, the problems of subjective inaccuracy, inconvenient equipment and difficult operation in the existing measurement methods are solved, and efficient and accurate pupil diameter measurement is achieved.

CN110251075BActive Publication Date: 2025-03-11TONGJI HOSPITAL ATTACHED TO TONGJI MEDICAL COLLEGE HUAZHONG SCI TECH
View PDF 10 Cites 0 Cited by

Patent Information

Application Number
CN201910691178.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2019-07-29
Publication Date
2025-03-11
Estimated Expiration
2039-07-29

AI Technical Summary

Technical Problem

The existing pupil diameter measurement methods have problems such as subjective inaccuracy when manually reading the size, dimensional distortion during projection imaging, inconvenient equipment and difficulty in operation, especially when the patient loses consciousness or eyes are closed, the measurement efficiency is low.

Method used

A portable pupil diameter measuring instrument is designed, adopting glasses frame structure, built-in camera module, lighting system, distance sensor and display screen, and the auxiliary structure can open the eyelids, automatically capture the pupil position through the human eye artificial neural network model and image enhancement algorithm, and calculate the pupil diameter by using the Hoff circle transformation method and camera calibration method.

Benefits of technology

It realizes pupil diameter measurement with simple operation, accurate results and portable results, avoids subjective errors in manual reading and inconvenient equipment, and improves the work efficiency of medical staff.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN110251075B_ABST
    Figure CN110251075B_ABST
Patent Text Reader

Abstract

The present invention discloses a portable pupil diameter measuring instrument, which includes a glasses frame and a foldable glasses frame arranged on both sides of the glasses frame, a base block is arranged in the glasses frame, an auxiliary support plate is arranged on the glasses frame, and a camera module, a lighting system, a distance sensor and a display screen are arranged on the base block. The advantages of the present invention are: the present invention has a relatively simple structure, is portable and easy to use, and the measurement results are objective and accurate. Its size is similar to that of glasses. When using it, it only needs to be worn on the eyes, turn on the power, and press the relevant button to start measuring. The present invention uses a CCD camera instead of a traditional comparison ruler for measurement, uses infrared light to enhance the pupil display, and uses a human eye artificial neural network model to automatically capture the pupil position. The test results are more scientific and reliable, and its auxiliary structure can also open the eyelids to improve the work efficiency of the staff.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to the technical field of medical pupil measurement, in particular to a portable pupil diameter measuring instrument and a measuring method thereof. Background Art

[0002] In medicine, measuring the diameter of the pupil can be used to preliminarily determine changes in the patient's intracranial pressure, and indirectly reflect the severity and outcome of the patient's neurological disease. The measurement of pupil diameter plays an important role.

[0003] At present, the methods for clinical observation of pupil diameter include ruler or pupil comparison ruler measurement method, picture comparison method, and digital video test method. The ruler or pupil comparison ruler measurement method and picture comparison method are simple to operate, but it is easy to cause large errors through manual comparison and visual inspection. The measurement results depend on the proficiency and subjective judgment of medical staff, and the accuracy and consistency of the measurement results are poor; and the equipment of the digital video test method is large and inconvenient to carry, so it is often inconvenient to use and operate on the bed, so the measurement results of this method also have the problem of inaccuracy. Moreover, when measuring the pupil diameter of the patient, in many cases the patient is unconscious and the eyes are closed. At present, in order to measure the pupil, medical staff need to open the eyelids by hand. This is inconvenient for medical staff to operate and affects work efficiency.

[0004] The patent document (publication number CN 208475002U) discloses a medical pen-type flashlight, which has a scale engraved on the front lens of the flashlight. After turning on the flashlight, a scale can be projected on the illuminated area of ​​the patient's eye, and the diameter can be read by the projected scale. When measuring the pupil, visible light can cause discomfort to the patient, and when the projection distance is not fixed, the projected scale will produce a large error, resulting in a large error in the measurement result.

[0005] The patent document (publication number CN205514527U) discloses a pupil measuring instrument, which is rectangular and uses a camera module to collect images of the pupil to calculate the diameter. This method uses the method of photographing pupil images for processing. When measuring, it is impossible to fix the distance from the pupil to the camera, resulting in errors in the distance during shooting, and the visual system cannot be accurately calibrated. After the image is taken, it is difficult to convert the accurate size, resulting in inaccurate measurement results.

[0006] The patent document (publication number CN104545787A) discloses a wearable pupil light reflection measurement device, which uses an infrared camera to measure pupil diameter, but the device cannot calibrate the camera in real time. When collecting photos of human eyes, due to the different tightness of the camera or the difference in the size of the patient's head structure, the distance from the pupil to the camera lens is different after the device is worn, and the misalignment between the pupil center and the camera lens will also be more serious. Therefore, when measuring pupils, the results will have a large error. In addition, the device consists of an eye mask and a data processing device, which are connected by a data cable, and the structure is complicated and inconvenient to use.

[0007] Therefore, there is an urgent clinical need for a pupil diameter measurement device that is easy to operate, provides accurate results, is portable, and can open the eyelids. Summary of the invention

[0008] The purpose of the present invention is to provide a portable pupil diameter measuring instrument, which effectively avoids the subjective inaccuracy when manually reading the size, or the size distortion caused by the near being larger and the far being smaller when using projection imaging, and its auxiliary structure can also open the eyelids to improve the work efficiency of medical staff.

[0009] To achieve the above-mentioned purpose, the present invention provides a portable pupil diameter measuring instrument, comprising a glasses frame and a foldable glasses frame arranged on both sides of the glasses frame, wherein a base block is arranged in the glasses frame, an auxiliary support plate is arranged on the glasses frame, and a camera module, a lighting system, a distance sensor and a display screen are arranged on the base block; the camera module, the lighting system and the distance sensor are arranged on the base block and on the same side as the foldable glasses frame, and the camera module, the lighting system and the distance sensor are directly opposite to the user's eyes when in use, and the display screen is arranged on the base block and opposite to the direction of the foldable glasses frame; a controller and a power supply are also arranged in the base block, and a power switch and a light adjustment knob are arranged on the glasses frame; the controller The input end of the controller is connected to the camera module and the distance sensor respectively, and the output end of the controller is connected to the display screen; the power switch is connected to the power supply, the light adjustment knob is connected to the lighting system, and the power supply is connected to the camera module, the lighting system, the distance sensor and the display screen respectively; the auxiliary support plate includes a structural plate, a slider and a handle are provided inside the structural plate, a viscous body is provided on the slider, and the viscous body abuts against the user's eyelid when in use, the slider is connected to the handle, a through hole is provided on the structural plate, a slide rail is provided above the through hole, the slider is arranged on the slide rail, the slider can be moved on the slide rail by moving the handle, and the through hole is directly opposite to the user's eye when in use.

[0010] Furthermore, the base block is arranged at the left and right lens installation positions of the eyeglass frame, and the camera module, lighting system, distance sensor and display screen are respectively provided in two portions, and the two camera modules, lighting systems, distance sensors and display screens are respectively arranged in the left and right parts of the base block, and the symmetrically arranged camera modules, lighting systems and distance sensors are directly facing the user's eyes when in use. In this way, the pupil size of the user's eyes can be measured synchronously when in use, which is convenient to operate and improves the work efficiency of the staff.

[0011] Furthermore, the lighting system is a ring light source, and the ring light source is an infrared LED lamp and a white light LED lamp that are evenly distributed alternately, and the lighting system is arranged around the corresponding camera module. In this way, the light source can shine on the user's eyes in all directions as needed, and infrared light is used to enhance the pupil display, so that the user's eye pictures are clearer and the pupil diameter calculation is more accurate.

[0012] Furthermore, a crank mechanism is also provided in the structural plate, and the crank mechanism is connected to the slider and the handle respectively, and the crank mechanism includes a first connecting rod hinged at one end on the structural plate and a second connecting rod hinged at one end on the slider, the first connecting rod and the second connecting rod are hinged, and the first connecting rod is hinged to the handle, so that when the handle moves, the slider is driven to move a greater distance through the crank mechanism. Such a structure, that is, through the principle of effort lever, the moving distance of the handle is magnified to the slider, making the operation more convenient. A latch is provided on the structural plate, and a pin shaft hole is provided on the eyeglass frame. The latch is detachably arranged in the pin shaft hole, and the two sides of the structural plate are close to the eyeglass frame. Such a structure allows the structural plate to be detachably mounted on the measuring instrument, and the structural plate can be mounted on the measuring instrument for use when the structural plate is needed.

[0013] As a preferred option, a wireless module is also provided in the basic block, the wireless module is connected to the controller, and the power supply is connected to the wireless module. In this way, the remote control of the measuring instrument can be realized, that is, the built-in Bluetooth or wifi function, all control functions and results can be controlled via terminals such as mobile phones or computers.

[0014] A method for measuring the diameter of pupil using a portable pupil measuring instrument, characterized in that it comprises the following steps:

[0015] Step 1: The user wears the measuring instrument so that the camera module, the lighting system and the distance sensor are facing the user's eyes;

[0016] Step 2: The camera module captures an image of the user's eyes, and the controller calls the human eye artificial neural network model to identify the user's eyes and generate an image of the region of interest (ROI);

[0017] Step 3: The controller uses an image enhancement algorithm on the image of the region of interest ROI in step 2 to make the pupil more obvious, thereby obtaining a processed pupil image;

[0018] Step 4: The controller uses the Hough circle transform method to extract the circular outline of the pupil from the pupil image processed in step 3, and obtains the pixel value of the pupil diameter;

[0019] Step 5: The controller reads the distance from the lens to the human eye through the distance sensor, and uses the camera calibration method to calculate the pixel value of the pupil diameter in step 4 to obtain the true value of the pupil diameter, and displays it on the display screen.

[0020] Furthermore, in step 2, the method for calling the human eye artificial neural network model is specifically as follows:

[0021] The human eye artificial neural network model is based on a convolutional neural network model. When in use, the controller takes the image of the user's eye as input, obtains the eye pattern on the image after calculation, and locates and selects the region of interest ROI containing the iris.

[0022] Furthermore, in step 3, the image enhancement algorithm is specifically:

[0023] The controller automatically adjusts the contrast, histogram equalization, statistical square map enhancement, and image smoothing and sharpening of the photos taken by the camera module.

[0024] Furthermore, in step 5, the camera calibration method specifically comprises the following steps:

[0025] According to the pixel value of the pupil diameter in step 4, the distance between the farthest two pixels is M pixels, and the distance L from the camera module lens to the pupil measured by the distance sensor is 1 , the actual distance between two pixels in this direction of the camera is deduced to be S 1 , that is, pupil diameter S 1 The calculation formula is:

[0026] S 1 =M×s×L 1 (1)

[0027] Where: s is the camera calibration coefficient.

[0028] Furthermore, in step 5, the camera calibration coefficient s is calculated as follows:

[0029] The focal length of the lens is known to be f, the distance from the calibration plate to the camera module lens is L, the distance between any two points on the calibration plate is known to be S, and the camera module measures the distance between the two points on the calibration plate to be N pixels. The distance represented by N pixels is A, then:

[0030] A=(S×f) / L (2)

[0031] The camera calibration coefficient s, that is, the actual distance between each pixel when the distance from the calibration plate to the camera module lens is a unit distance and the focal length of the camera module is fixed, is:

[0032] s=A / (N×L) (3)

[0033] Substituting formula 2 into formula 3, the calculation formula for the camera calibration coefficient s is obtained as follows:

[0034] s=(S×f) / (L 2 ×N) (4).

[0035] The advantages of the present invention are:

[0036] The present invention has a relatively simple structure, is portable and easy to use, and has objective and accurate measurement results. Its size is similar to that of glasses. When in use, it only needs to be worn on the eyes, the power is turned on, and the relevant button is pressed to start the measurement. It not only does not require human participation in the operation during the measurement process, but also automatically quantifies and measures the pupil diameter, and can measure the light reflection of the patient's pupil. It can also be directly controlled by buttons or remotely controlled by mobile phones. It is a small wearable Internet of Things device, and the pictures taken and the measurement results can be uploaded to mobile phones, computers and other terminals for further processing. The present invention uses a CCD camera to replace the traditional comparison ruler for measurement, uses infrared illumination to enhance the pupil display, and uses the human eye artificial neural network model to automatically capture the pupil position. The test results are more scientific and reliable, and its auxiliary structure can also open the eyelids to improve the work efficiency of medical staff. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 It is a structural schematic diagram of the present invention;

[0038] Figure 2 It is a structural schematic diagram of another perspective of the present invention;

[0039] Figure 3 This is a schematic diagram of the structure of the present invention after the auxiliary support plate is removed;

[0040] Figure 4 is a structural schematic diagram of an auxiliary support plate;

[0041] Figure 5 A schematic diagram of the structure of the auxiliary support plate from another perspective;

[0042] Figure 6 This is a schematic diagram of the internal structure of the auxiliary support plate when not in use;

[0043] Figure 7 A schematic diagram of the internal structure of the auxiliary support plate when in use;

[0044] Figure 8 It is a circuit connection schematic diagram of the present invention;

[0045] Fig. 9 This is a schematic diagram of the position of the calibration plate and the lens during calibration;

[0046] Fig.10 This is a schematic diagram of the position of the pupil and lens in actual use.

[0047] In the figure: eyeglass frame 1, foldable eyeglass frame 2, base block 3, camera module 4, lighting system 5, distance sensor 6, display screen 7, controller 8, power supply 9, power switch 10, light adjustment knob 11, auxiliary support plate 12, structural plate 13, slider 14 (including: viscous body 14a), handle 15 (including: pin 15a), through hole 16, slide rail 17, crank mechanism 18 (including: first connecting rod 18a, second connecting rod 18b), latch 19, pin hole 20, wireless module 21. DETAILED DESCRIPTION

[0048] The present invention is further described in detail below with reference to the accompanying drawings and specific implementations:

[0049] like Figures 1 to 8, a portable pupil diameter measuring instrument and measuring method are shown in the figure, the device comprises a glasses frame 1 and a foldable glasses frame 2 arranged on both sides of the glasses frame 1, characterized in that: a base block 3 is arranged in the glasses frame 1, an auxiliary support plate 12 is arranged on the glasses frame 1, a camera module 4, a lighting system 5, a distance sensor 6 and a display screen 7 are arranged on the base block 3; the camera module 4, the lighting system 5 and the distance sensor 6 are arranged on the base block 3 and on the same side as the foldable glasses frame 2, the camera module 3, the lighting system 4 and the distance sensor 5 are directly facing the user's eyes when in use, the display screen 6 is arranged on the base block 3 and opposite to the foldable glasses frame 2; the base block 3 A controller 8 and a power supply 9 are also provided inside the eyeglass frame 1. A power switch 10 and a light adjustment knob 11 are provided on the eyeglass frame 1. The input end of the controller 8 is connected to the camera module 4 and the distance sensor 6 respectively, and the output end of the controller 8 is connected to the display screen 7. The power switch 10 is connected to the power supply 9, and the light adjustment knob 11 is connected to the lighting system 5. The power supply 9 is connected to the camera module 4, the lighting system 5, the distance sensor 6 and the display screen 7 respectively. The basic block 3 is arranged at the left and right lens installation positions of the eyeglass frame 1. There are two camera modules 4, two lighting systems 5, two distance sensors 6 and two display screens 7 respectively. The two camera modules 4, two lighting systems 5, two distance sensors 6 and two display screens 7 are respectively arranged at the left and right parts of the basic block 3. The symmetrically arranged camera modules 3, lighting systems 4 and distance sensors 5 face the user's eyes when in use. The lighting system 5 is a ring light source, and the ring light source is an infrared LED lamp and a white light LED lamp alternately and evenly distributed, and the lighting system 5 is arranged around the corresponding camera module 4. The base block 3 is also provided with a wireless module 21, the wireless module 21 is connected to the controller 8, and the power supply 9 is connected to the wireless module 21. The power switch 10 and the light adjustment knob 11 are both arranged on the top of the eyeglass frame 1, and the power switch 10 and the light adjustment knob 11 are respectively arranged above the left and right parts of the base block 3.

[0050] The auxiliary support plate 12 includes a structural plate 13, a slider 14 and a handle 15 are provided inside the structural plate 13, a viscous body 14a is provided on the slider 14, the viscous body 14a abuts against the user's eyelid when in use, the slider 14 is connected to the handle 15, a through hole 16 is provided on the structural plate 13, a slide rail 17 is provided above the through hole 16, the slider 14 is arranged on the slide rail 17, the slider 14 can be moved on the slide rail 17 by moving the handle 15, and the through hole 16 is directly opposite to the user's eye when in use. A crank mechanism 18 is also provided in the structural plate 13, and the crank mechanism 18 is connected to the slider 14 and the handle 15 respectively. The crank mechanism 18 includes a first connecting rod 18a having one end hinged on the structural plate 13 and a second connecting rod 18b having one end hinged on the slider 14. The first connecting rod 18a and the second connecting rod 18b are hinged, and the first connecting rod 18a is hinged to the handle 15, so that when the handle 15 moves, the slider 14 is driven to move a greater distance through the crank mechanism 18. There are two through holes 16, two sliders 14 and two slide rails 17, each of which is arranged in the corresponding slide rail 17, and each slider 14 covers the corresponding through hole 16. Two first connecting rods 18a and second connecting rods 18b are symmetrically arranged in the crank mechanism 18, one end of the two first connecting rods 18a is hinged, and the other ends of the two first connecting rods 18a are respectively hinged to the corresponding second connecting rods 18b, and the other ends of the second connecting rods 18b are respectively hinged to the slider 14. Two pins 15a are arranged at the bottom of the handle 15, and the two pins 15a are respectively arranged in the middle of the two first connecting rods 18a and hinged to the corresponding first connecting rods 18a. A latch 19 is arranged on the structural plate 13, and a pin hole 20 is arranged on the eyeglass frame 1. The latch 19 is detachably arranged in the pin hole 20, and the two sides of the structural plate 13 are close to the eyeglass frame 2. The slide rail 17 is arranged vertically upward in the structural plate 13. The handle 15 has a wavy surface.

[0051] A method for measuring the diameter of pupil using a portable pupil measuring instrument, characterized in that it comprises the following steps:

[0052] Step 1: The user wears the measuring instrument so that the camera module 4, the lighting system 5 and the distance sensor 6 are facing the user's eyes;

[0053] Step 2: The camera module 4 captures an image of the user's eyes, and the controller 8 calls the human eye artificial neural network model to identify the user's eyes and generate an image of the region of interest ROI; the human eye artificial neural network model is based on a convolutional neural network model. When in use, the controller 8 takes the image of the user's eyes as input, calculates the eye pattern on the image, and locates and selects the region of interest ROI containing the iris.

[0054] Step 3: The controller 8 uses an image enhancement algorithm to the image of the region of interest ROI in step 2 to make the pupil more obvious and obtain a processed pupil image; the image enhancement algorithm is specifically: the controller 8 automatically adjusts the contrast, histogram equalization, statistical square map enhancement, and image smoothing and sharpening of the photos taken by the camera module 4.

[0055] Step 4: the controller 8 uses the Hough circle transform method to extract the circular outline of the pupil from the pupil image processed in step 3, and obtains the pixel value of the pupil diameter;

[0056] Step 5: The controller 8 reads the distance from the lens to the human eye through the distance sensor, and uses the camera calibration method to calculate the pixel value of the pupil diameter in step 4 to obtain the real value of the pupil diameter, and displays it on the display screen 7. The specific steps of the camera calibration method are:

[0057] It is known that the focal length of the lens is f, the distance from the calibration plate to the camera module 4 lens is L, the distance between any two points on the calibration plate is S, and the camera module 4 measures the distance between the two points on the calibration plate as N pixels. The distance represented by N pixels is A, then:

[0058] A=(S×f) / L (1)

[0059] The camera calibration coefficient s, that is, the actual distance between each pixel when the distance from the calibration plate to the camera module (4) lens is a unit distance and the focal length of the camera module (4) is fixed, is:

[0060] s=A / (N×L) (2)

[0061] Substituting formula 2 into formula 3, the calculation formula for the camera calibration coefficient s is obtained as follows:

[0062] s=(S×f) / (L 2 ×N) (3)

[0063] According to the pixel value of the pupil diameter in step 4, the distance between the farthest two pixels is M pixels, and the distance L from the camera module 4 lens to the pupil measured by the distance sensor 6 is 1 , the actual distance between two pixels in this direction of the camera is deduced to be S 1 , that is, pupil diameter S 1 The calculation formula is:

[0064] S 1 =M×s×L 1 (4)

[0065] Where: s is the camera calibration coefficient.

[0066] When the present invention is actually used,

[0067] The camera module 4 is a CCD camera, which is a module that supports infrared photography. Under white light, the iris and pupil are close in color, and the pupil is surrounded by the iris, making it difficult to capture the pupil. Under infrared light, the contrast between the pupil and the iris is very large, and the infrared camera module can clearly capture the pupil, making it easy to calculate the pupil diameter. The camera module 4 can be selected in many ways, and its related products can be found through various search engines on the Internet. Currently, there are many brands and models with small sizes that can be used in the measuring instrument of the present invention.

[0068] The lighting system 5 around the camera module 4 is a ring light source, and the lighting system 5 is an infrared LED lamp and a white light LED lamp that are evenly distributed alternately. The intensity of the infrared light is fixed, and the intensity of the white light can be controlled separately by the light adjustment knob 11, and the infrared light and the white light are lit and extinguished at the same time. The infrared light of the lighting system 5 is used to enhance the development of the user's pupil on the camera module 4, so that the pupil is clearer in the photographed picture. The white light can gradually adjust the light intensity, which is convenient for testing the pupil's light reflection.

[0069] The adhesive body 14a is made of a material that is adhesive and harmless to the skin and is adhered to the eyelid. The material may be, but is not limited to, soft silicone.

[0070] The side surface of the handle 15 is wavy, and has a certain self-locking force, so as to prevent the slider 14 from sliding when in use.

[0071] The controller 8 can be, but is not limited to, the following models: Samsung's s5p6818, Texas Instruments' am3354, Broadcom's bcm2837, Freescale's iMX6Q. The wireless module 21 has Bluetooth or WiFi functions, and all control functions and results can be controlled by terminals such as mobile phones or computers through the wireless module 21. Corresponding APPs can be developed on the terminals to control the power on and off of the measuring instrument, adjust the light intensity, display measurement pictures and results, draw light reflection charts, etc., and extended functions can also be developed based on the measurement results, print out the measurement results, send the measurement results to a database, etc.

[0072] When the camera calibration method is described,

[0073] like Fig. 9 , the focal length of the lens is known to be f, the distance from the calibration plate to the camera module 4 lens is L, the distance between any two points on the calibration plate is known to be S, and the camera module 4 measures the distance between the two points on the calibration plate to be N pixels, then the distance represented by N pixels is A; as shown in Figure 10, according to the pixel value of the pupil diameter in step 4, the distance between the farthest two pixels is M pixels, and the distance L from the camera module 4 lens to the pupil measured by the distance sensor 6 is 1 , then the actual distance between two pixels in this direction is S 1 ;

[0074] Assume the camera calibration coefficient s, that is, the actual distance of each pixel when the distance from the calibration plate to the camera module 4 lens is a unit distance, then:

[0075] A=s×N×L=(S×f) / L

[0076] A 1 =s×M×L 1 =(S 1 ×f) / L 1

[0077] but:

[0078] s=(S×f) / (N×L 2 ) is a constant,

[0079] S 1 The calculation formula is:

[0080] S 1 =M×s×L 1 In step 1, there are two situations when the user wears the measuring instrument:

[0081] When the user is an unconscious patient, the pin 19 of the auxiliary support plate 12 is inserted into the pin hole 20 of the measuring instrument eyeglass frame 1. At this time, the two sides of the auxiliary support plate 12 are close to the foldable eyeglass frame 2, and then the measuring instrument is placed on the user's face, so that the foldable eyeglass frame 2 is clamped behind the user's ears. At this time, the viscous body 14a is close to the user's eyelids, and then the medical staff lifts the handle 15 to a certain height and clamps it. At this time, the viscous body 14a drives the user's eyelids to open, and the camera module, the lighting system and the distance sensor are directly facing the user's eyes through the through hole 16 of the auxiliary support plate 12, so that the measurement can start;

[0082] When the user is conscious and can open his eyes by himself, the pin 19 of the auxiliary support plate 12 is removed from the pin hole 20 of the measuring instrument eyeglass frame 1. At this time, the user can actively open his eyes, and the camera module, lighting system and distance sensor are directly facing the user's eyes, so that measurement can begin.

[0083] Finally, it should be pointed out that the above embodiments are only representative examples of the present invention. Obviously, the present invention is not limited to the above embodiments, and there are many variations. Any simple modification, equivalent changes and modifications made to the above embodiments based on the technical essence of the present invention should be considered to belong to the protection scope of the present invention.

Claims

1. A method for measuring pupil diameter using a portable pupil diameter measuring instrument, wherein the device comprises a spectacle frame (1) and foldable spectacle frames (2) arranged on both sides of the spectacle frame (1), characterized in that: A base block (3) is provided in the eyeglass frame (1), an auxiliary support plate (12) is provided on the eyeglass frame (1), and a camera module (4), a lighting system (5), a distance sensor (6) and a display screen (7) are provided on the base block (3); The camera module (4), the lighting system (5) and the distance sensor (6) are arranged on the base block (3) and on the same side as the foldable spectacle frame (2); the camera module (4), the lighting system (5) and the distance sensor (6) are directly opposite to the eyes of the user when in use; and the display screen (7) is arranged on the base block (3) and opposite to the foldable spectacle frame (2); The base block (3) is also provided with a controller (8) and a power supply (9), and the eyeglass frame (1) is provided with a power switch (10) and a light adjustment knob (11); The input end of the controller (8) is connected to the camera module (4) and the distance sensor (6) respectively, and the output end of the controller (8) is connected to the display screen (7); The power switch (10) is connected to the power supply (9), the light adjustment knob (11) is connected to the lighting system (5), and the power supply (9) is respectively connected to the camera module (4), the lighting system (5), the distance sensor (6) and the display screen (7); The auxiliary support plate (12) comprises a structural plate (13), a slider (14) and a handle (15) are arranged inside the structural plate (13), a viscous body (14a) is arranged on the slider (14), and the viscous body (14a) abuts against the eyelid of the user when in use, the slider (14) is connected to the handle (15), a through hole (16) is arranged on the structural plate (13), a slide rail (17) is arranged above the through hole (16), the slider (14) is arranged on the slide rail (17), and the slider (14) can be moved on the slide rail (17) by moving the handle (15), and the through hole (16) faces the eye of the user when in use; The measurement method includes the following steps: Step 1: The user wears the measuring instrument so that the camera module (4), the lighting system (5) and the distance sensor (6) are facing the user's eyes; Step 2: The camera module (4) captures an image of the user's eyes, and the controller (8) calls a human eye artificial neural network model to identify the user's eyes and generate an image of a region of interest (ROI); Step 3: The controller (8) uses an image enhancement algorithm on the image of the region of interest ROI in step 2 to make the pupil more obvious, thereby obtaining a processed pupil image; Step 4: The controller (8) uses the Hough circle transform method to extract the circular outline of the pupil from the pupil image processed in step 3, and obtains the pixel value of the pupil diameter; Step 5: The controller (8) reads the distance from the lens to the human eye through the distance sensor (6), and uses the camera calibration method to calculate the pixel value of the pupil diameter in step 4 to obtain the real value of the pupil diameter, and displays it on the display screen (7). The specific steps of the camera calibration method are: According to the pixel value of the pupil diameter in step 4, the distance between the farthest two pixels is M pixels. The distance sensor (6) measures the distance L1 from the camera module (4) lens to the pupil. It is deduced that the actual distance between the farthest two pixels is S1. That is, the calculation formula of the pupil diameter S1 is: S1=M×s×L1 (1) Where: s is the camera calibration coefficient; In step 5, the camera calibration coefficient s is calculated as follows: It is known that the focal length of the lens is f, the distance between the calibration plate and the camera module (4) lens is L, the distance between any two points on the calibration plate is S, and the camera module (4) measures the distance between the two points on the calibration plate to be N pixels, then the distance represented by N pixels is A, then: A=(S×f) / L (2) The camera calibration coefficient s, that is, the actual distance of each pixel when the distance from the calibration plate to the camera module (4) lens is a unit distance, is: s=A / (N×L) (3) Substituting formula (2) into formula (3), the calculation formula of the camera calibration coefficient s is obtained as follows: s=(S×f) / (L 2 ×N) (4)。 2. The measuring method of a portable pupil diameter measuring instrument according to claim 1, characterized in that: The base block (3) is arranged at the left and right lens installation positions of the eyeglass frame (1); the camera module (4), the lighting system (5), the distance sensor (6) and the display screen (7) are respectively provided in pairs; the two camera modules (4), the two lighting systems (5), the two distance sensors (6) and the two display screens (7) are respectively arranged in the left and right parts of the base block (3); the symmetrically arranged camera modules (4), the lighting system (5) and the distance sensors (6) are directly opposite to the eyes of the user when in use.

3. The measuring method of a portable pupil diameter measuring instrument according to claim 2, characterized in that: The lighting system (5) is a ring-shaped light source, and the lighting system (5) is arranged around the corresponding camera module (4).

4. The measuring method of a portable pupil diameter measuring instrument according to claim 3, characterized in that: A crank mechanism (18) is also provided in the structural plate (13), and the crank mechanism (18) is connected to the slider (14) and the handle (15) respectively. The crank mechanism (18) comprises a first connecting rod (18a) having one end hinged on the structural plate (13) and a second connecting rod (18b) having one end hinged on the slider (14). The first connecting rod (18a) and the second connecting rod (18b) are hinged, and the first connecting rod (18a) is hinged on the handle (15), so that when the handle (15) moves, the slider (14) is driven to move a greater distance through the crank mechanism (18); The structural plate (13) is provided with a latch (19), the eyeglass frame (1) is provided with a pin hole (20), the latch (19) is detachably arranged in the pin hole (20), and both sides of the structural plate (13) are in close contact with the eyeglass frame (2).

5. A measuring method of a portable pupil diameter measuring instrument according to any one of claims 1 to 4, characterized in that: A wireless module (21) is also provided in the base block (3); the wireless module (21) is connected to the controller (8); and the power supply (9) is connected to the wireless module (21).

6. The measuring method of a portable pupil diameter measuring instrument according to claim 1, characterized in that: In step 2, the method for calling the human eye artificial neural network model is specifically as follows: The human eye artificial neural network model is based on a convolutional neural network model. When in use, the controller (8) takes the image of the user's eye as input, obtains the eye pattern on the image after calculation, and locates and selects the region of interest ROI containing the iris.

7. A measuring method of a portable pupil diameter measuring instrument according to claim 6, characterized in that: In step 3, the image enhancement algorithm is specifically: automatically adjusting the contrast, histogram equalization, statistical square map enhancement, and image smoothing and sharpening the photos taken by the camera module (4) through the controller (8).

Citation Information

Patent Citations

  • Wearable pupil light reflex measurement equipment

    CN104545787A

  • Pupil measuring apparatu

    CN205514527U

  • Medical pen type torch of formula of directly surveying

    CN208475002U

  • Eyelid function corrector

    CN106726115A

  • Eye-control man-machine interaction system and method

    CN107145226A