Automatic image combination method and device for ophthalmic medical device

By calculating the center coordinates of the pupil and driving the light source to move, the problems of low manual imaging accuracy and poor accuracy of existing ophthalmic medical devices are solved, and automatic and accurate imaging is achieved, improving the treatment effect and user experience.

CN114795650BActive Publication Date: 2024-11-12ARTHEIA TECH (SUZHOU) CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202210470180.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-04-28
Publication Date
2024-11-12
Estimated Expiration
2042-04-28

AI Technical Summary

Technical Problem

The existing ophthalmic medical devices need to manually adjust the light source position before treatment to achieve imaging, resulting in low imaging accuracy and difficulty for users to ensure accuracy, and it is impossible to automatically judge the eccentricity of the center of the eyes and the light source.

Method used

The dual cameras are used to obtain the user's left and right eye pictures respectively, calculate the center coordinates and offset values ​​of the pupil, and drive the light source to move to the combined image position in the horizontal and vertical directions to achieve automatic combined image.

Benefits of technology

It improves the user experience and treatment effect during the treatment process, ensures that the light source is accurately aligned with the center of the pupil, and can automatically combine even if the user sits in a wrong position.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114795650B_ABST
    Figure CN114795650B_ABST
Patent Text Reader

Abstract

The present invention discloses an automatic image combination method and device for an ophthalmic medical device. The medical device includes a body, an image acquisition unit, at least two light sources that can be movably arranged on the body, a computing processing unit, and an execution unit. The image acquisition unit includes at least two cameras fixedly arranged on the body. Since the ophthalmic medical device of the present invention adopts dual cameras to respectively collect left and right eye images, the left and right eye pupil center coordinates can be accurately calculated by processing and calculating the left and right eye images, and then transmitted to the motor of the execution unit. The motor drives the light source to move in the horizontal and / or vertical direction to match the user's pupil center position. Even if the user is not sitting upright, automatic and accurate image combination can still be achieved, thereby solving the technical problem that the ophthalmic medical device in the prior art cannot determine whether the user is correctly combined and cannot automatically combine images, greatly improving the user's treatment experience and treatment effect.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to an automatic image combination method and device for an ophthalmic medical device. Background Art

[0002] The light energy source achieves medical or health-care effects on the eyes by emitting light of a preset wavelength range to the eyes. In practical applications, the light energy source can be used for eye diseases such as myopia, amblyopia, macular degeneration (AMD), diabetic retinopathy, and glaucoma. As the incidence of myopia among young people in my country has increased year by year, studies have shown that when the wavelength of the laser emitted by the light energy source is preset to be within the laser wavelength range that can be used to treat or care for myopia, when the light energy emitted by the light energy source of this wavelength is applied to the eyes of myopic patients, it can induce the retina to produce and release dopamine, which can slow down and inhibit the development of myopia.

[0003] Existing ophthalmic medical devices that use light to illuminate the retina to treat ophthalmic diseases usually need to adjust the position of the light source to complete the image before treatment, so that the light emitted by the light source is simultaneously emitted along the optical center of the left and right pupils. At this time, the light spots seen by the user's two eyes are merged into one. Image alignment is crucial for ophthalmic medical devices, because only by image alignment can the human eye's attention be improved, and dizziness will not occur during treatment, thereby achieving a better treatment effect. At present, most ophthalmic medical devices on the market, such as light feeding devices, use manual image alignment, but manual image alignment has the following two disadvantages: First, different people have unclear perceptions of whether the image is aligned or not, resulting in too low image alignment accuracy; second, due to the user's sitting posture, it is difficult for the user to ensure that the head is placed in the center of the eye mask every time the user receives treatment, and the user cannot know whether it is aligned, resulting in the eccentricity of the center of both eyes and the light path emitted by the light source. Image alignment is impossible, so it needs to be further improved. Summary of the invention

[0004] In order to solve the technical problems in the prior art, the object of the present invention is to provide an automatic image combination method and device for an ophthalmic medical device.

[0005] To achieve one of the purposes of the above invention, an embodiment of the present invention provides an automatic image combination method for an ophthalmic medical device, wherein the medical device comprises a body, an image acquisition unit, at least two light sources movably disposed on the body, a computing processing unit, and an execution unit, wherein the image acquisition unit comprises at least two cameras fixedly disposed on the body; at least part of the light emitted by the at least two light sources is guided to the left and right eyes of a user, respectively, and the method comprises the following steps:

[0006] A: placing the at least two light sources at an initial position;

[0007] B: The at least two cameras respectively obtain left and right eye images of the user;

[0008] C: the calculation processing unit calculates the offset values ​​of the center coordinates of the left and right eye images and the center coordinates of the pupil respectively, and calculates the offset values ​​of the at least two light sources to be moved respectively according to the offset values ​​and the relative position relationship between the at least two light sources at the initial position and the at least two cameras;

[0009] D: The execution unit moves the at least two light sources to the combined image position according to the offset values ​​that the at least two light sources need to move respectively.

[0010] As a further improvement of an embodiment of the present invention, step B further includes a human eye detection step in which the at least two cameras detect whether the user has his eyes open before obtaining the left and right eye pictures of the user.

[0011] As a further improvement of an embodiment of the present invention, the computing processing unit in step C obtains the left and right eye pictures of the user, crops the human eye area pictures of the left and right eye pictures of the user, and calculates the center coordinates of the left and right eye pictures according to the parameters of the at least two cameras.

[0012] As a further improvement of an embodiment of the present invention, the computing processing unit in step C obtains the left and right eye pictures of the user, extracts multiple pupil edge points and obtains the area of ​​the fitted pupil ellipse. When it is judged that the area of ​​the fitted pupil ellipse is greater than the set value, the center coordinates of the fitted pupil ellipse are set to the pupil center coordinates.

[0013] As a further improvement of an embodiment of the present invention, when it is determined that the area of ​​the fitted pupil ellipse is less than or equal to a set value, the pupil areas of the cropped left and right eye images are subjected to distance transformation processing to obtain the approximate center coordinates of the pupil area, and the approximate center coordinates of the pupil area are set as the pupil center coordinates.

[0014] As a further improvement of an embodiment of the present invention, the parameters of the at least two cameras include camera focal length and photosensitive film size.

[0015] As a further improvement of an embodiment of the present invention, the distance change processing includes the following steps:

[0016] Obtaining initial values ​​of foreground pixels of the left and right eye images;

[0017] Obtaining initial values ​​of background pixels of the left and right eye images;

[0018] Calculating the distance difference between each of the foreground pixels and the initial value of the background pixel closest to it, and reassigning the distance difference to the foreground pixel;

[0019] The center point coordinates of the re-valued foreground pixels are calculated as the approximate center coordinates of the pupil region.

[0020] To achieve one of the purposes of the above invention, an embodiment of the present invention provides an ophthalmic medical device with automatic image combination, comprising a main body, an image acquisition unit, at least two light sources movably arranged on the main body, a computing and processing unit, and an execution unit, wherein the image acquisition unit comprises at least two cameras fixedly arranged on the main body; at least part of the light emitted by the at least two light sources is guided to the left and right eyes of the user respectively, and before automatic image combination, the at least two light sources are set at initial positions, and the at least two cameras are configured to respectively obtain left and right eye pictures of the user, and the computing and processing unit is configured to respectively calculate the center coordinates of the left and right eye pictures and the offset values ​​of the pupil center coordinates, and calculate the offset values ​​that the at least two light sources need to be moved respectively according to the offset values ​​and the relative position relationship between the at least two light sources at the initial position and the at least two cameras; the execution unit is configured to respectively move the at least two light sources to the image combination position according to the offset values ​​that the at least two light sources need to be moved respectively.

[0021] As a further improvement of an embodiment of the present invention, the image acquisition unit includes at least two fill lights, and the fill lights provide supplementary light for the at least two cameras to take pictures of the user's left and right eyes respectively.

[0022] As a further improvement of an embodiment of the present invention, the execution unit includes at least one motor, and the motor is configured to drive the at least two light sources to move in a horizontal and / or vertical direction.

[0023] Compared with the prior art, the beneficial effect of the present invention is: since the ophthalmic medical device of the present invention adopts dual cameras to collect left and right eye images respectively, the left and right eye pupil center coordinates can be accurately calculated by processing and calculating the left and right eye images, and then transmitted to the motor of the execution unit, and the motor drives the light source to move in the horizontal and / or vertical direction to match the user's pupil center position, even if the user is not sitting upright, automatic and accurate image alignment can still be achieved, thereby solving the technical problem in the prior art that the ophthalmic medical device cannot determine whether the user is correctly aligned and cannot automatically align the image, greatly improving the user's treatment experience and treatment effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 is a schematic diagram of the hardware modules of the ophthalmic medical device of the present invention;

[0025] Figure 2 This is a schematic diagram of the operation of the ophthalmic medical device of the present invention when the light source faces the user's pupil after the image is formed;

[0026] Figure 31 is a schematic diagram of a flow chart of an automatic image combination method for an ophthalmic medical device according to an embodiment of the present invention;

[0027] Figure 4 Schematic diagram of the center coordinates of the cropped image and the center coordinates of the pupil in the automatic image combination method of the present invention;

[0028] Figure 5 1 is a schematic diagram of an algorithm flow of the automatic image combination method of the present invention;

[0029] Figure 6 It is a schematic diagram of the overall structure of the ophthalmic medical device of the present invention.

[0030] Among them: 1. Ophthalmic medical device; 10. Main body; 11. Image acquisition unit; 12. Light source; 13. Computing and processing unit; 14. Execution unit; 15. Fill light; 16. Human body contact part; 21. Cropping frame; 22. Cropped image center coordinates; 23. Pupil center coordinates. DETAILED DESCRIPTION

[0031] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0032] Reference Figure 1 An ophthalmic medical device 1 with automatic image combination includes a body 10, an image acquisition unit 11, at least two light sources 12 movably arranged on the body 10, a computing unit 13, and an execution unit 14. The image acquisition unit 11 includes at least two cameras fixedly arranged on the body, such as an infrared camera. At least part of the light emitted by the at least two light sources 12 is guided to the left and right eyes of the user respectively, and can be used to treat but not limited to myopia, amblyopia, macular degeneration (AMD), diabetic retinopathy, glaucoma and other eye diseases. Taking the ophthalmic medical device 1 for treating myopia as an example, the wavelength of light emitted by the light source 12 can be 630-680nm, such as 650nm red light.

[0033] When using the ophthalmic medical device 1, the user needs to adjust the positions of the two light sources 12 according to the pupil distance of different users so that they can be used after the combination of images. Before each combination of images, the two light sources 12 are first set to the initial position, so the coordinates of the initial position are known to the calculation processing unit 13. At least two cameras are configured to obtain the left and right eye images of the user respectively, and the calculation processing unit 13 is configured to calculate the center coordinates of the left and right eye images and the offset values ​​of the pupil center coordinates respectively, and calculate the offset values ​​that the at least two light sources 12 need to move respectively according to the offset values ​​and the relative position relationship between the at least two light sources at the initial position and the at least two cameras; the execution unit 14 is configured to move the at least two light sources 12 to the combination position respectively according to the offset values ​​that the at least two light sources 12 need to move respectively.

[0034] like Figure 2 As shown, the image acquisition unit 11 includes at least two fill lights 15, which provide supplementary light for at least two cameras to take pictures of the left and right eyes of the user. The execution unit 14 includes at least one motor, which is configured to drive the at least two light sources to move in the horizontal and / or vertical direction. When the motor of the execution unit 14 receives a movement instruction, it can accurately and automatically move the two light sources to a position directly opposite to the left and right pupils of the user according to the movement instruction, so as to achieve automatic image combination, which greatly improves the user's treatment experience and treatment effect.

[0035] like Figure 3 As shown, in one embodiment provided by the present invention, an automatic image combination method for an ophthalmic medical device is provided, wherein the medical device comprises a body 10, an image acquisition unit 11, at least two light sources 12 movably disposed on the body 10, a computing processing unit 13, and an execution unit 14, wherein the image acquisition unit 11 comprises at least two cameras fixedly disposed on the body 10; at least part of the light emitted by the at least two light sources is guided to the left and right eyes of the user respectively, and the method comprises the following steps:

[0036] A: Setting the at least two light sources 12 at an initial position;

[0037] B: The at least two cameras respectively obtain left and right eye images of the user;

[0038] C: The calculation processing unit 13 calculates the offset values ​​of the center coordinates of the left and right eye images and the center coordinates of the pupil respectively, and calculates the offset values ​​of the at least two light sources to be moved respectively according to the offset values ​​and the relative position relationship between the at least two light sources 12 at the initial position and the at least two cameras;

[0039] D: The execution unit 14 moves the at least two light sources 12 to the combined image position according to the offset values ​​that the at least two light sources 12 need to move respectively.

[0040] Preferably, step B further includes a human eye detection step in which the at least two cameras detect whether the user has eyes open before obtaining the left and right eye pictures of the user.

[0041] like Figure 4 As shown, in step C, the computing processing unit obtains the left and right eye images of the user, crops the eye region images of the left and right eye images of the user, and calculates the center coordinates of the left and right eye images according to the parameters of the at least two cameras. Figure 3 As shown, in a specific embodiment, the human eye area image captured by the camera is cut into a quadrilateral cropping frame 21. The center coordinates 22 (shown by a solid triangle in the figure) of the cropping image of the cropping frame 21 can be calculated based on the length, width, pixels and camera parameters of the cropping frame 21. The camera parameters include the focal length of the camera and the size of the photosensitive film. Specifically, the focal length of the camera f = 3.6 mm, and the size of the photosensitive film is 4x3 mm.

[0042] When the user uses it for the first time, the camera collects the left and right eye image data, and calculates the pixel value (bias_left, bias_right) of the pupil center coordinates (left_x, right_x) relative to the image center (pic_center_x). The user's pupil distance (PD) can be calculated based on the camera parameters (pi×_ratio) and the distance of the subject:

[0043] bias_left=pic_center_x-left_x

[0044] bias_right=right_x-pic_center_×

[0045] bias_all=(bias_left+bias_right)

[0046] PD = d + bias_all / pix_ratio

[0047] The processing unit 13 can control the stepper motor movement corresponding to the execution unit 14 to move the left and right light sources to the center of the left and right pupils respectively according to the offset values ​​(bias_left, bias_right) of the left and right eye pupil coordinates relative to the center coordinates of the picture calculated according to the above algorithm, so that even if the user has an incorrect sitting posture when using it, the purpose of automatic and accurate image alignment can still be achieved.

[0048] In step C, the calculation processing unit 13 obtains the left and right eye images of the user, extracts multiple pupil edge points, and obtains the area of ​​the fitted pupil ellipse. When the calculation processing unit 13 determines that the area of ​​the fitted pupil ellipse is greater than the set value, the center coordinates of the fitted pupil ellipse are set to the pupil center coordinates 23. When the calculation processing unit 13 determines that the area of ​​the fitted pupil ellipse is less than or equal to the set value, the pupil area of ​​the cropped left and right eye images is subjected to distance transformation processing to obtain the approximate center coordinates of the pupil area, and the approximate center coordinates of the pupil area are set to the pupil center coordinates 23.

[0049] like Figure 5 As shown, specifically, the distance change processing includes the following steps:

[0050] Obtaining initial values ​​of foreground pixels of the left and right eye images;

[0051] Obtaining initial values ​​of background pixels of the left and right eye images;

[0052] Calculating the distance difference between each of the foreground pixels and the initial value of the background pixel closest to it, and reassigning the distance difference to the foreground pixel;

[0053] The center point coordinates of the re-valued foreground pixels are calculated as the approximate center coordinates of the pupil region.

[0054] See also Figure 6 Another embodiment of the present invention provides an ophthalmic medical device 1 having a replaceable human body contact component 16, wherein the human body contact component 16 is detachably connected to the ophthalmic medical device 1, and the human body contact component 16 is configured to have identity information that can be recognized by the ophthalmic medical device 1. The human body contact component includes a communication component that can communicate with the ophthalmic medical device 1 by wire or wirelessly, such as a near-field communication (NFC) module for transmitting user identity information. Since the human body contact component 16 (such as an eye mask on a light-feeding device that contacts the user's eyes) is detachably connected to the ophthalmic medical device 1, it can be sold separately to the user for exclusive use. Especially when multiple people in a hospital share an ophthalmic medical device, the user only needs to install his or her own human body contact component 16 to automatically identify the user, and can effectively avoid cross infection, safety and hygiene.

[0055] Specifically, the communication component can be a near field communication module, a barcode communication module or an electrical connection communication module. The near field communication module includes at least one of a WIFI communication module, a wireless radio frequency identification RFID communication module, an NFC near field communication module, a Bluetooth communication module, a wireless personal area network Zigbee communication module, a set frequency band wireless communication module (such as 433MHz), a magnetic field communication module, and an acoustic magnetic communication module. The barcode communication module can include a one-dimensional code (such as code 128, a barcode EAN for goods, a unified product code UPC), and a two-dimensional code (such as Data Matrix, QR code). The user identity information contained in the one-dimensional code or the two-dimensional code can be read by the image acquisition unit 11 in the ophthalmic medical device 1. The electrical connection communication module can include at least two electrical contacts that can be electrically connected to the ophthalmic medical device 1, and the information related to the user identity is transmitted through the opening and closing signals of the electrical contacts.

[0056] In this embodiment, the computing and processing unit 13 includes a processor and a memory, and the memory is configured to store an identity information database corresponding to the user identity information, and store one or a combination of user history usage data, user usage reports, and user configuration parameters associated with the user identity information. The user configuration parameters include at least one or a combination of the output power of the light source 12, the user's pupil distance, the treatment time, and the remaining number of treatments.

[0057] After the ophthalmic medical device 1 obtains the user identification information, the processor is configured to compare the identification information with the identification information database preset in the memory. If the identification information is consistent with the data in the identification information database, the processor obtains the user identification information corresponding to the consistent identification information. Specifically, the processor and the memory are connected and transmit data to each other. When the user uses the ophthalmic medical device 1 provided by the present invention for the first time, the parameters used by the user for the first time (such as the output power of the light source 12, the user's pupil distance, the treatment time, and the number of remaining treatments) can be stored in the memory; when the user uses it again, the user only needs to connect the replaceable human body contact component 16 to the ophthalmic medical device 1, and the near field communication NFC module on the human body contact component 16 and the identification unit on the ophthalmic medical device 1 realize near field communication data transmission. After the processor obtains the identification information bound to the user and confirms the user identification information, it can automatically retrieve the user configuration parameters used last time that match the user, such as the output power of the light source 12, the user's pupil distance, the treatment time, and the number of remaining treatments.

[0058] The ophthalmic medical device 1 also includes a display unit, which can be an LED display screen. When the processor obtains the user identification information, the display unit displays the user configuration parameters used by the user last time. The user can control the machine operation parameters of the ophthalmic medical device 1 by pressing physical buttons or touching the screen on the display unit. Specifically, the operation parameters include whether to operate the ophthalmic medical device 1, the operating time of the ophthalmic medical device 1, the spatial distance between the light source and the human eye when the user is in use, and adjusting the output power of the light source 12 according to the user's own situation during operation.

[0059] In this embodiment, the end of the replaceable human body contact component 16 that contacts the human body is made of silicone or other soft materials, so that the user has a more comfortable experience when using the ophthalmic medical device 1; the other end of the human body contact component 16 is matched with the ophthalmic medical device 1. In a possible implementation, the human body contact component 16 has a guide structure when matched with the ophthalmic medical device 1, such as the human body contact component 16 can be guided by a slide groove or an overall shape or other commonly used guide structures. In this embodiment, the human body contact component 16 is matched and positioned with the ophthalmic medical device 1 by magnetic attraction. In other alternative embodiments, the matching and positioning method can also be achieved by a convex buckle or other buckle method, which is not limited here.

[0060] Furthermore, the replaceable human body contacting component 16 includes a heating element and / or a cooling element, and the user can set it according to his / her own preference when using the ophthalmic medical device 1 of the present invention, while providing a better experience for the user.

[0061] In other embodiments, the camera on the ophthalmic medical device 1 can be used not only for image formation but also for obtaining eye image information, such as information on whether the user opens their eyes and uses it correctly, information on the diameter of the user's pupil, information on the gaze angle of the user's pupil, information on the position of the user's pupil, information for identifying the user, information on the effective use time of the user, information on the total light power received by the user's eyes, and information on the user's pupil distance, among one or more combinations thereof, that is, through algorithm processing to correct irregular user usage such as closing the eyes during use, to ensure the therapeutic effect of the user's use process.

[0062] In other embodiments of the present invention, the ophthalmic medical device further includes a light distribution component and a light detector for detecting light intensity. The light distribution component guides at least a portion of the light emitted by the light energy source to the light detector to detect the intensity of the emitted light emitted by the light energy source. The light distribution component guides another portion of the light emitted by the light energy source to the user's eyes. The reflected light guided to the user's eyes enters the image acquisition unit 11 through the light distribution component to obtain eye image information. Furthermore, the light source 12 is an LED light source or a laser light source. A portion of the light waves emitted by the LED light source or the laser light source is received by the light detector through the light distributor. The light distributor receives another portion of the light waves emitted by the light source 12 by the user's eyes and the light reflected by the eyes is reflected on the image acquisition unit 11 through the light distribution component. This embodiment greatly reduces the size of the ophthalmic medical device by improving the optical path, making the overall structure lighter and more convenient for users, especially young users.

[0063] In other embodiments of the present invention, the ophthalmic medical device 1 also includes a communication unit, and the communication unit is configured to transmit data wirelessly or wired with other devices. The communication unit includes at least one or a combination of a mobile base station communication module, a Bluetooth communication module, and a wifi communication module. Specifically, the ophthalmic medical device 1 can realize data interconnection or sharing functions through base station communication and other methods. Users can understand their usage status and personal trial reports through the data shared by the communication module. The communication unit is configured to transmit data wirelessly or wired with the communication unit of another ophthalmic medical device 1 to realize shared data, which can be applied to the use scenario where doctors remotely obtain user usage data and other data in the hospital.

[0064] It should be understood that although this specification is described according to implementation modes, not every implementation mode contains only one independent technical solution. This description of the specification is only for the sake of clarity. Those skilled in the art should regard the specification as a whole. The technical solutions in each implementation mode may also be appropriately combined to form other implementation modes that can be understood by those skilled in the art.

[0065] The series of detailed descriptions listed above are only specific descriptions of feasible implementation methods of the present invention. They are not intended to limit the scope of protection of the present invention. Any equivalent implementation methods or changes that do not deviate from the technical spirit of the present invention should be included in the scope of protection of the present invention.

Claims

1. An automatic image combination method for an ophthalmic medical device, characterized in that: The medical device comprises a body, an image acquisition unit, at least two light sources movably disposed on the body, a computing processing unit, and an execution unit, wherein the image acquisition unit comprises at least two cameras fixedly disposed on the body; at least part of the light emitted by the at least two light sources is guided to the left and right eyes of the user, respectively, and the method comprises the following steps: A: placing the at least two light sources at an initial position; B: The at least two cameras respectively obtain left and right eye images of the user; C: the calculation processing unit calculates the offset values ​​of the center coordinates of the left and right eye images and the center coordinates of the pupil respectively, and calculates the offset values ​​of the at least two light sources to be moved respectively according to the offset values ​​and the relative position relationship between the at least two light sources at the initial position and the at least two cameras; D: the execution unit moves the at least two light sources to the combined image position according to the offset values ​​that the at least two light sources need to be moved respectively; In step C, the computing processing unit obtains the left and right eye images of the user, crops the human eye area images of the left and right eye images of the user, and calculates the center coordinates of the left and right eye images according to the parameters of the at least two cameras; In step C, the computing unit extracts a plurality of pupil edge points after acquiring the left and right eye images of the user and acquires the area of ​​the fitted pupil ellipse. When the computing unit determines that the area of ​​the fitted pupil ellipse is less than or equal to a set value, the distance transformation process is performed on the pupil areas of the cropped left and right eye images to obtain the approximate center coordinates of the pupil area, and the approximate center coordinates of the pupil area are set as the pupil center coordinates. When it is determined that the area of ​​the fitted pupil ellipse is greater than the set value, the center coordinates of the fitted pupil ellipse are set as the pupil center coordinates; The distance transformation process comprises the following steps: Obtaining initial values ​​of foreground pixels of the left and right eye images; Obtaining initial values ​​of background pixels of the left and right eye images; Calculating the distance difference between each of the foreground pixels and the initial value of the background pixel closest to it, and reassigning the distance difference to the foreground pixel; The coordinates of the center point of the foreground pixel after calculation and re-assignment are the approximate center coordinates of the pupil area.

2. The automatic image combination method of an ophthalmic medical device according to claim 1, characterized in that: In step B, before obtaining the left and right eye pictures of the user, the at least two cameras also include a human eye detection step of detecting whether the user has his eyes open.

3. The automatic image combination method of an ophthalmic medical device according to claim 2, characterized in that: The parameters of the at least two cameras include camera focal length and photosensitive film size.

4. An automatic image combination ophthalmic medical device, characterized in that: The device comprises a body, an image acquisition unit, at least two light sources movably arranged on the body, a computing and processing unit, and an execution unit, wherein the image acquisition unit comprises at least two cameras fixedly arranged on the body; at least part of the light emitted by the at least two light sources is guided to the left and right eyes of the user respectively, and the at least two light sources are arranged at initial positions before automatic image combination, and the at least two cameras are configured to respectively obtain left and right eye images of the user, and the computing and processing unit is configured to respectively calculate the center coordinates of the left and right eye images and the offset values ​​of the center coordinates of the pupils, and calculate the offset values ​​of the at least two light sources to be moved respectively according to the offset values ​​and the relative positional relationship between the at least two light sources at the initial positions and the at least two cameras; The execution unit is configured to move the at least two light sources to the combined image position according to the offset values ​​that the at least two light sources need to be moved respectively; after the calculation processing unit obtains the left and right eye pictures of the user, it crops the human eye area pictures of the left and right eye pictures of the user and calculates the center coordinates of the left and right eye pictures according to the parameters of the at least two cameras; after the calculation processing unit obtains the left and right eye pictures of the user, it extracts multiple pupil edge points and obtains the area of ​​the fitted pupil ellipse. When the calculation processing unit determines that the area of ​​the fitted pupil ellipse is less than or equal to the set value, the pupil area of ​​the cropped left and right eye pictures is subjected to distance transformation processing to obtain the approximate center coordinates of the pupil area, and the approximate center coordinates of the pupil area are set as the pupil center coordinates. When it is determined that the area of ​​the fitted pupil ellipse is greater than the set value, the center coordinates of the fitted pupil ellipse are set as the pupil center coordinates; the distance transformation processing includes the following steps: obtaining the initial values ​​of the foreground pixels of the left and right eye pictures; obtaining the initial values ​​of the background pixels of the left and right eye pictures; The distance difference between each foreground pixel and the initial value of the background pixel closest to it is calculated, and the distance difference is reassigned to the foreground pixel; the center point coordinates of the reassigned foreground pixel are calculated as the approximate center coordinates of the pupil area.

5. The automatic image combination ophthalmic medical device according to claim 4, characterized in that: The image acquisition unit includes at least two fill lights, which provide supplementary light for the at least two cameras to take pictures of the left and right eyes of the user respectively.

6. The automatic image combination ophthalmic medical device according to claim 4, characterized in that: The execution unit includes at least one motor, and the motor is configured to drive the at least two light sources to move in a horizontal and / or vertical direction.

Citation Information

Patent Citations

  • Device and method for processing images

    CN101587586A

  • Iris locating method and apparatus

    CN107844736A

  • Method and device for adjusting light source module by identifying image features

    CN114099985A

  • Rapid positioning method for pupils of old people

    CN114202795A

  • Method and device for adaptively adjusting position of light energy source of medical device

    CN114272519A