Eye-controlled intelligent integrated measurement and control device and eye-control method thereof

Abstract

The present invention provides an eye-controlled intelligent integrated measurement and control device and its eye-control method. The device includes a protection unit host; a camera unit for photographing the eyes to obtain eye image information; an iris recognition system for extracting iris features from the received eye image information to generate iris information and store it in an iris system database; the iris recognition system is further configured to perform security verification on the received eye image information and output a verification result; and an eye control unit, based on the received verification result, generates position information that is fed back to the protection unit host, which then executes the eye-control operation. The application of the present invention can resolve safety hazards and other issues in the prior art caused by touch or electrostatic misoperation. Without requiring contact with the product, the risk of accidental device contact can be effectively reduced, thereby improving the product's market competitiveness.

Description

Technical Field

[0001] The present invention relates to the field of measurement and control technology, and in particular to an eye-controlled intelligent integrated measurement and control device and an eye-control method using the device. Background Art

[0002] With the widespread adoption of smart grids in power systems, intelligent integrated measurement and control units (IMUs) are increasingly being deployed in primary high-voltage equipment. These units not only improve the measurement accuracy of these devices but also enhance their intelligent control capabilities. Conventional IMUs are typically operated via on-device buttons or touchscreen LCDs. When operating primary equipment with high voltage, these units can easily malfunction due to touch or static electricity, posing a significant safety hazard.

[0003] Currently, the known technology for detecting eye movements is to extract characteristic parts (such as the corners of the eyes, pupils, etc.) from the user's eye images, establish reference coordinates for these characteristic parts, and measure the displacement of each characteristic part. This is actually the concept of precise positioning.

[0004] In the field of human-computer interaction, eyes serve as another important channel for information exchange, and line of sight reflects the direction of human attention. Therefore, applying line of sight to the field of human-computer interaction has the characteristics of naturalness, directness, and interactivity, and has attracted much attention. Therefore, how to realize an integrated measurement and control unit based on the movement of the human eye is a technical problem that needs to be solved urgently. Summary of the Invention

[0005] In order to overcome the shortcomings of the existing technology, the purpose of the present invention is to provide an eye-controlled intelligent integrated measurement and control device and method for controlling an intelligent integrated measurement and control unit based on the movements of the human eye. The system and method can solve the safety hazards and other problems caused by operational touch or electrostatic misoperation in the existing technology. Without the need for contact, the risks caused by accidental touching of the device can be effectively reduced, thereby improving the market competitiveness of the product.

[0006] In order to solve the above problems, the technical solutions adopted by the present invention are as follows:

[0007] An eye-controlled intelligent integrated measurement and control device comprises: a protection unit host;

[0008] A camera unit, used for photographing the eyes to obtain eye image information;

[0009] An iris recognition system extracts iris features from the received eye image information to generate iris information and stores it in an iris system database;

[0010] The iris recognition system is also used to perform security verification on the received eye image information and output a verification result;

[0011] When the eye control unit receives the correct verification result, it generates position information based on the face image captured by the camera unit and feeds it back to the protection unit host, which then performs the eye control operation.

[0012] A further solution is that the iris recognition system includes a first data processing module, an iris system database, and a first communication module. The iris recognition system communicates with the camera unit, the eye control unit, and the protection unit host through the first communication module. The iris system database is used to store iris information and identity information corresponding to the iris information. The first data processing module is used to execute:

[0013] The received eye image information is subjected to image preprocessing, feature extraction and feature matching to form an iris code which is stored in the iris system database.

[0014] A further solution is that the eye control unit includes a second data processing module and a second communication module. The eye control unit communicates with the camera unit, the iris recognition system, and the protection unit host through the second communication module. The second data processing module is used to execute:

[0015] Obtaining the position information of the gaze point of the human eye on the protection unit host;

[0016] Detect whether the human eye makes a preset action, and when it is detected that the human eye makes a preset action, send the current position information of the current human eye's gaze point on the protection unit host to the protection unit host.

[0017] A further solution is that the protection unit host further includes a shielding shell, and a plurality of accommodating spaces are located within the shielding shell to accommodate the camera unit, the iris recognition system and the eye control unit.

[0018] An eye control method for an eye-controlled intelligent integrated measurement and control device is applied to the above-mentioned eye-controlled intelligent integrated measurement and control device to perform human eye control operations. The method comprises the following steps: sending an iris information entry instruction to an iris recognition system via a protection unit host; the iris recognition system obtains high-definition image data collected by a camera unit, performs image preprocessing and feature extraction operations on the image data, thereby generating iris information, and storing the iris information in an iris system database;

[0019] The eye control function is enabled, and the eye control unit polls the status of the camera unit. If the eye control unit recognizes similar facial information multiple times in a row, it sends the image information to the iris recognition system. The iris recognition system compares the information with the data in the iris system database after image preprocessing and feature extraction. If the information matches, the iris recognition system will feedback the verification result to the eye control unit and the protection unit host. The eye control unit enters the working state, generates position information from the initial data recognized, and feeds it back to the protection unit host. The protection unit host executes the eye control operation;

[0020] Among them, the eye control unit generates a position control signal corresponding to the current human eye position information according to a pre-stored position control correspondence table corresponding to the protection unit host, and sends the position control signal to the protection unit host for the protection unit host to perform corresponding eye control operations.

[0021] A further solution is that, after the iris recognition system passes verification, the eye control unit uses the camera unit to collect the inclination characteristics of the user's eye position, the position of the center of the eyebrows and the position of the nose tip from the camera in real time, and maintains real-time communication with the protection unit host;

[0022] After the protection unit host receives the verification pass information, it confirms the user information by matching the local database, and the protection unit host display screen outputs the verification pass schematic interface. When the verification and binding with the user are completed, the verification pass schematic interface disappears and enters the eye control mode.

[0023] A further solution is that in the eye control mode, the eye control unit monitors the user's eye position information, eyebrow position and nose tip position captured by the camera unit in real time, detects the angle of offset between each position point and the camera unit, enters the tracking mode, and thus determines the position information of the gaze point of the human eye on the protection unit host. The eye control unit feeds back the calculated position information to the protection unit host, thereby realizing eye control operation.

[0024] A further solution is that if the position of the gaze point is detected to be within the display screen, the protection unit host moves the cursor according to the received position information; if the position of the gaze point is detected not to be within the display screen, the eye control unit enters a standby state and re-enters the tracking mode within a predetermined time.

[0025] A further solution is that in tracking mode, the cursor of the protection unit host display screen will follow the user's line of sight. When the user selects an option and focuses his eyes on the option, the cursor of the protection unit host display screen will move to the option. When it detects that the user closes his eyes for 1 second to confirm the information, the protection unit host will execute a key operation.

[0026] A further solution is that when the verification prompt interface pops up on the display screen, the eye control unit detects whether the user closes their eyes for 1 second. If so, a position message is sent to the protection unit host to confirm that the human eye position is at the icon of the verification prompt interface. The protection unit host then exchanges data with the eye control unit to achieve eye position correction.

[0027] When the verification pass prompt interface disappears, a cursor appears on the screen, and the eye control unit enters tracking mode, tracking the centerline position of the user's eyes in real time. Every time the centerline position angle deviates by 5 minutes, the eye control unit transmits position data to the protection unit host, and the protection unit host updates the cursor position. If the user closes their eyes to confirm the information at this time, the eye control unit transmits an execution signal to the protection unit host, and the protection unit host executes a left mouse button operation, which is regarded as a confirmation;

[0028] The cursor moves within the display screen following the gaze point. When the gaze point moves away from the display screen, the eye control unit recognizes that the graphic is out of range and will enter standby mode, pausing recognition. When the pause time exceeds the preset time, the connection is disconnected and the iris recognition mark becomes invalid.

[0029] It can be seen that compared with the existing technology, the present invention provides an eye-controlled intelligent comprehensive measurement and control device and method thereof. By shooting the user's eyes with a camera, the eye image can be obtained, the eye image can be analyzed by the iris recognition system, the eye image can be processed with feature values, and the iris feature map can be compared with the data in the iris system database to confirm whether the operation and maintenance personnel is a legitimate user; when the eye control unit detects the movement of the human eye, the eye control unit tracks the movement trajectory of the human eye through the camera to realize the mouse function, and sends the corresponding position control signal to the protection unit host for the protection unit host to perform the corresponding eye control operation. For example, the user blinking is equivalent to clicking the left mouse button, and there is no need to contact the device, avoiding various safety hazards caused by operational touch or static electricity misoperation.

[0030] The present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1 This is a schematic diagram of an embodiment of an eye-controlled intelligent integrated measurement and control device of the present invention.

[0032] Figure 2 The present invention is a flowchart of an eye control method embodiment of an eye control type intelligent integrated measurement and control device.

[0033] Figure 3 This is a flow chart for entering iris information in an embodiment of an eye control method for an eye-controlled intelligent integrated measurement and control device of the present invention.

[0034] Figure 4 It is a specific flow chart of an embodiment of an eye control method of an eye-controlled intelligent integrated measurement and control device of the present invention. DETAILED DESCRIPTION

[0035] An embodiment of an eye-controlled intelligent integrated measurement and control device:

[0036] See also Figure 1 The present invention provides an eye-controlled intelligent comprehensive measurement and control device, comprising:

[0037] Protection unit host 1, the protection unit host is the main carrier of high-voltage microcomputer protection, and the LCD screen of the host can provide an eye-controlled operation schematic interface.

[0038] The camera unit 2 is used to photograph the eyes to obtain eye image information.

[0039] The iris recognition system 3 extracts iris features from the received eye image information to generate iris information and stores the information in the iris system database.

[0040] The iris recognition system 3 is also used to perform security verification on the received eye image information and output a verification result.

[0041] When the eye control unit 4 receives a correct verification result, it generates position information based on the face image captured by the camera unit 2 and feeds it back to the protection unit host 1, and the protection unit host 1 performs the eye control operation.

[0042] In this embodiment, the iris recognition system 3 includes a first data processing module 31, an iris system database, and a first communication module. The iris recognition system 3 communicates with the camera unit 2, the eye control unit 4, and the protection unit host 1 respectively through the first communication module. The iris system database is used to store iris information and identity information corresponding to the iris information. The first data processing module 31 is used to perform:

[0043] The received eye image information is subjected to iris image acquisition, image preprocessing, feature extraction and feature matching to form an iris code which is stored in the iris system database.

[0044] In this embodiment, the eye control unit 4 includes a second data processing module and a second communication module. The eye control unit 4 communicates with the camera unit 2, the iris recognition system 3, and the protection unit host 1 through the second communication module. The eye control unit 4 is used to collect the output of the infrared camera, interact with the data processing module of the iris recognition system 3, and interact with the input and output module of the protection unit. The second data processing module is used to perform:

[0045] Obtaining the position information of the gaze point of the human eye on the protection unit host 1;

[0046] Detect whether the human eye makes a preset action, and when it is detected that the human eye makes a preset action, send the current position information of the current gaze point of the human eye on the protection unit host 1 to the protection unit host 1.

[0047] In this embodiment, the protection unit host 1 further includes a shielding shell, and a plurality of accommodating spaces within the shielding shell for accommodating the camera unit 2 , the iris recognition system 3 and the eye control unit 4 .

[0048] The eye control unit 4 of this embodiment can be a device with a camera function, such as a CCD. Optionally, the eye control unit 4 of this embodiment can also obtain a real-time image of the human eye through the above-mentioned camera unit 2, and obtain the real-time movement status of the human eye based on the real-time image of the human eye.

[0049] The camera unit 2 of this embodiment is an infrared camera, which is arranged on the protection unit host 1 and is used to emit infrared light to the human eye, form light reflection points in the two pupils of the human eye, and capture the human eye image to obtain eye image information.

[0050] In this embodiment, the second data processing module includes an image processing module and a position calculation module. The image processing module is used to establish an image coordinate system for eye image information and process the eye image information to obtain the coordinate positions of the two pupil centers and the light reflection points in the image coordinate system; the position calculation module is used to obtain the position information of the gaze point of the human eye on the display screen of the protection unit host 1 through a cross-ratio invariant algorithm based on the coordinates of the two pupil centers and the light reflection points in the image coordinate system.

[0051] The protection unit host 1 of this embodiment includes an input and output module, a relay protection logic module, a display screen, etc., which are used to control information confirmation and data synchronization, and host computer control input, identification or information modification.

[0052] An embodiment of an eye-control method of an eye-controlled intelligent integrated measurement and control device:

[0053] This method is applied to the above-mentioned eye-controlled intelligent integrated measurement and control device to perform human eye control operations, such as Figure 2 As shown, the method includes the following steps:

[0054] Step S1: The protection unit host 1 sends an iris information entry instruction to the iris recognition system 3. The iris recognition system 3 obtains the high-definition image data collected by the camera unit 2, and performs image preprocessing and feature extraction operations on the image data to generate iris information, which is stored in the iris system database.

[0055] In step S2, the eye control function is enabled, and the eye control unit 4 polls the status of the camera unit 2. If the eye control unit 4 recognizes similar facial information multiple times in a row, the image information is sent to the iris recognition system 3. The iris recognition system 3 compares the information with the data in the iris system database after image preprocessing and feature extraction operations.

[0056] If the information matches, step S3 is executed, and the iris recognition system 3 feeds back the verification result to the eye control unit 4 and the protection unit host 1. The eye control unit 4 enters the working state, generates a position information from the recognized initial data and feeds it back to the protection unit host 1, and the protection unit host 1 performs the eye control operation.

[0057] Among them, the eye control unit 4 generates a position control signal corresponding to the current human eye position information according to a pre-stored position control correspondence table corresponding to the protection unit host 1, and sends the position control signal to the protection unit host 1 for the protection unit host 1 to perform the corresponding eye control operation.

[0058] When the iris recognition system 3 passes the verification, the eye control unit 4 collects the inclination characteristics of the user's eye position, the position of the center of the eyebrows and the position of the nose tip from the camera in real time through the camera unit 2, and maintains real-time communication with the protection unit host 1;

[0059] After the protection unit host 1 receives the verification pass information, it confirms the user information by matching the local database, and the protection unit host 1 display screen outputs the verification pass schematic interface. When the verification and binding with the user are completed, the verification pass schematic interface disappears and enters the eye control mode.

[0060] In the eye control mode, the eye control unit 4 monitors the user's eye position information, eyebrow position and nose tip position captured by the camera unit 2 in real time, detects the angle of offset between each position point and the camera unit 2, and enters the tracking mode to determine the position information of the gaze point of the human eye on the protection unit host 1. The eye control unit 4 feeds back the calculated position information to the protection unit host 1, thereby realizing the eye control operation.

[0061] If the position of the gaze point is detected to be within the display screen, the protection unit host 1 moves the cursor according to the received position information; if the position of the gaze point is detected not to be within the display screen, the eye control unit 4 enters the standby state and re-enters the tracking mode within a predetermined time.

[0062] In tracking mode, the cursor on the display screen of the protection unit host 1 will follow the user's line of sight. When the user selects an option, he will focus his eyes on the option. At this time, the cursor on the display screen of the protection unit host 1 will move to the option. When it is detected that the user closes his eyes for 1 second to confirm the information, the protection unit host 1 will perform a key operation.

[0063] When the verification interface pops up on the display, the eye control unit 4 monitors whether the user has closed their eyes for one second. If so, it sends a position message to the protection unit 1 to confirm that the user's eye position is at the icon on the verification interface. The protection unit 1 then exchanges data with the eye control unit 4 to achieve eye position correction. Blinking is an innate reflex and is unavoidable. A period of eye closure of more than 800ms, or approximately one second, is required to be considered a left-click operation.

[0064] Specifically, when the operator's eye is focused on different locations on the display screen of the protection unit 1, the position of the pupil in the processed eye image varies. Analysis reveals that the point where the pupil is mapped to the corneal plane moves in the corneal plane, and the point where the eye is focused on the display screen of the protection unit 1 also moves accordingly. The corneal plane is a two-dimensional plane that maps the surface of the eyeball to a preset position based on the eye image. The points where the pupil is mapped to the corneal plane and the point where the eye is focused on the display screen of the protection unit 1 are calibrated one by one through induction and statistical calculation. This statistical calculation yields a corresponding relationship between the position where the pupil is mapped to the corneal plane and the position where the eye is focused on the display screen of the protection unit 1. This corresponding relationship can be a formula or function. After calibration, an eye image is acquired and processed to determine the position where the pupil is mapped to the corneal plane. Based on this corresponding relationship, the position of the eye's focus on the display screen of the protection unit 1 can be determined.

[0065] When the verification pass prompt interface disappears, a cursor appears on the display screen, and the eye control unit 4 enters the tracking mode, tracking the centerline position of the user's human eye position in real time. When the centerline position angle deviates by 5 minutes, the eye control unit 4 transmits the position data to the protection unit host 1, and the protection unit host 1 updates the cursor position. If the user closes his eyes to confirm the information at this time, the eye control unit 4 transmits an execution signal to the protection unit host 1, and the protection unit host 1 executes a left mouse button operation, which is regarded as a confirmation;

[0066] The cursor moves within the display screen following the gaze point position. When the gaze point moves away from the display screen, the eye control unit 4 can recognize that the graphic is out of range and will enter the standby state and suspend recognition. When the pause time exceeds the predetermined time, the current connection is disconnected and the iris recognition mark becomes invalid.

[0067] In this embodiment, if Figure 3As shown, before performing the eye control operation, the iris information of the operation and maintenance personnel is also selected to be entered through the protection unit host 1. First, the operation and maintenance personnel visually look at the infrared camera according to the prompt to determine whether the iris feature code is successfully collected. If so, the green light around the infrared camera will light up and the operator information will be entered; if not, the red light around the infrared camera will light up, and the iris feature code will be collected again to determine whether it is successfully collected. If so, the iris code will be stored in the iris system database. If the storage is successful, the record information will pop up. If the storage fails, the record failure will pop up.

[0068] The cursor in this embodiment is an eye-controlled mouse, which includes a processing chip and a USB interface for connecting to the protection unit host 1. The processing chip connects to the protection unit host 1 via the USB interface and is used to map the user's eye movement trajectory to computer-related operations. Blinking is equivalent to clicking the left mouse button. This eye-controlled mouse solves the problem that traditional methods cannot meet the user's needs for human-computer interaction.

[0069] Before performing the eye control operation, the cursor position input operation can also be set. When the operation and maintenance personnel's eyes stay on the protection unit host 1 for a preset time and keep the gaze point position information unchanged, they perform at least one blink action, that is, the gaze point position information of the human eye on the protection unit host 1 does not change within the preset time, then the control input setting operation of the cursor position can be customized according to the needs of the user; if you want to enter numbers, after clicking the input control, an 11-key keyboard will pop up on the screen, and the numbers 0-9 and the "backspace" operation can be entered through a single machine.

[0070] Specifically, during equipment commissioning, operators use the eye-controlled intelligent integrated measurement and control device to enter their iris information, which is then stored in the iris system database as a basis for identity verification. After completing the entry, the eye-control function is enabled through the touchscreen settings. Operators operate the eye-controlled intelligent integrated measurement and control device using the eye-control unit 4. They simply stand 1-1.5 meters away from the device and gaze at the infrared camera. When the iris recognition system 3 passes verification, a pop-up screen indicating a pass (e.g., "Passed") appears on the display screen. The operator then blinks once, and the screen disappears. The eye-control unit 4 then follows the operator's gaze and communicates with the protection unit host 1. The mouse on the touchscreen follows the operator's gaze. To select an option, the operator focuses their gaze on the option. The mouse on the display then moves to the option, blinks, and the protection unit host 1 performs a left-click operation, confirming the selection. If the operator completes their operation and looks away from the LCD screen, the eye-control unit 4 exits after 5 seconds.

[0071] Therefore, the iris recognition system 3 and the eye control unit 4 are an inseparable whole. After the iris recognition system 3 identifies the operator as a specific operator, the eye control unit 4 identifies both eyes and, based on the distance between the eyes and the infrared camera, calculates the operator's gaze location. This location information is then transmitted to the protection unit host 1 via an interface. Based on this location information and the blinking action, the protection unit host 1 performs the corresponding operation. For example, this can control the opening and closing of circuit breakers on the primary side of a high-voltage switchgear cabinet or set secondary equipment settings.

[0072] In practical applications, such as Figure 4 As shown, the eye control method provided in this embodiment includes:

[0073] Iris entry stage: First, the user operates the protection unit host 1 and uses the function of entering iris information. At this time, the protection unit host 1 sends an instruction to enter the iris information into the iris system database to the iris recognition system 3 through the communication interface. The iris recognition system 3 obtains the high-definition image data collected by the infrared camera through the communication interface of the eye control unit 4, and then performs image preprocessing, deletes redundant information outside the eyes, and performs image smoothing, edge detection, image separation and other operations.

[0074] Then, the feature extraction operation is performed. The data processing module of the iris recognition system 3 extracts unique feature points from the separated iris image through a feature extraction algorithm. The data processing module uses iris imaging and two-dimensional Gabor waves to filter and draw them into phasors. The phasor information includes direction and spatial frequency (image content) as well as image position. The iris code is drawn using this phasor information and stored in the iris system database.

[0075] During the iris authentication phase, eye control unit 4 polls the camera status. If it recognizes a similar face multiple times in a row, it proactively sends the image information to iris recognition system 3. Iris recognition system 3 performs image preprocessing and feature extraction, then compares the data with the database module. If there is no match, the result is fed back to eye control unit 4. If the information matches, iris recognition system 3 feeds the result back to eye control unit 4 and protection unit host 1. Upon receiving the information, eye control unit 4 goes into operation and sends the initial recognized data to protection unit host 1. Upon receiving the information, protection unit host 1 matches the local database, confirms the operator's information, and then pops up a "Pass Indication" window.

[0076] Among them, the eye control unit 4 monitors the positions of the two eyes of the operation and maintenance personnel, as well as the positions of the eyebrows and the tip of the nose captured by the infrared camera. The eye control unit 4 will monitor the positions of these four points, detect the angle of offset between each position point and the infrared camera, and thus determine the position where the operation and maintenance personnel are looking. The data processing module of the eye control unit 4 will feed back the calculated position information to the protection unit host 1, thereby realizing eye control operation.

[0077] Based on the above principle, the operation and maintenance personnel's eye movement will not affect the eye control unit 4. When the "pass gesture" pops up on the interface, the operation and maintenance personnel can move their eyes to the "pass gesture" and then blink. At this time, the eye control unit 4 monitors the blinking action and sends a position information to the protection unit host 1, thinking that it is now at the "pass gesture" icon. Then the protection unit host 1 and the eye control unit 4 exchange data and correct the position. At the same time, the "pass gesture" disappears and the eye control mouse appears. After the eye control mouse appears, the eye control unit 4 enters the tracking mode and tracks the centerline position of the operator's eyes in real time. For every 5-minute deviation of the centerline angle, the eye control unit 4 transmits data to the protection unit host 1, and the protection unit host 1 updates the eye control mouse position. If the operation and maintenance personnel closes their eyes for 1 second at this time, the eye control unit 4 will also transmit a signal to the protection unit host 1. After receiving this signal, the protection unit host 1 performs a left mouse button operation, which is regarded as a confirmation.

[0078] At this time, the eye-controlled mouse follows the gaze within the range of the 10.1-inch display screen. When the gaze moves away from the display screen, the eye control unit 4 can recognize that the graphic is out of range and suspend recognition. After the pause time exceeds 5 seconds, the connection is disconnected and the iris recognition mark becomes invalid. If you want to control the eye again, you need to re-authenticate.

[0079] It can be seen that compared with the existing technology, the present invention provides an eye-controlled intelligent comprehensive measurement and control device and method thereof. By shooting the user's eyes with a camera, the eye image can be obtained, and the eye image can be analyzed by the iris recognition system 3, and the eye image can be processed with feature values. The iris feature map is compared with the data in the iris system database to confirm whether the operation and maintenance personnel is a legitimate user; when the eye control unit 4 detects the movement of the human eye, the eye control unit 4 tracks the movement trajectory of the human eye through the camera to realize the mouse function, and sends the corresponding position control signal to the protection unit host 1 for the protection unit host 1 to perform the corresponding eye control operation. For example, the user blinking is equivalent to clicking the left mouse button, and there is no need to contact the device, avoiding various safety hazards caused by operational touch or electrostatic misoperation.

[0080] The above embodiments are only preferred embodiments of the present invention and cannot be used to limit the scope of protection of the present invention. Any non-substantial changes and replacements made by technicians in this field on the basis of the present invention fall within the scope of protection required by the present invention.

Claims

1. An eye-controlled intelligent integrated measurement and control device, characterized in that: include: Protection unit host; A camera unit, used for photographing the eyes to obtain eye image information; An iris recognition system extracts iris features from the received eye image information to generate iris information and stores it in an iris system database; The iris recognition system is also used to perform security verification on the received eye image information and output a verification result. When the iris recognition system passes the verification, the eye control unit uses the camera unit to collect the inclination characteristics of the user's eye position, the position of the center of the eyebrows, and the position of the tip of the nose from the camera in real time, and maintains real-time communication with the protection unit host. The eye control unit, when receiving a correct verification result, generates position information based on the face image captured by the camera unit and feeds it back to the protection unit host, which then performs the eye control operation; The eye control unit includes a second data processing module and a second communication module. The eye control unit communicates with the camera unit, the iris recognition system, and the protection unit host through the second communication module. The second data processing module is used to perform: Obtaining the position information of the gaze point of the human eye on the protection unit host; Detecting whether the human eye makes a preset action, and when detecting that the human eye makes a preset action, sending the current position information of the current human eye's gaze point on the protection unit host to the protection unit host; Among them, the second data processing module includes an image processing module and a position calculation module. The image processing module is used to establish an image coordinate system for eye image information and process the eye image information to obtain the coordinate positions of the two pupil centers and the light reflection points in the image coordinate system; the position calculation module is used to obtain the position information of the human eye's gaze point on the protection unit host display screen through the cross-ratio invariant algorithm based on the coordinates of the two pupil centers and the light reflection points in the image coordinate system.

2. The device according to claim 1, characterized in that: The iris recognition system includes a first data processing module, an iris system database, and a first communication module. The iris recognition system communicates with the camera unit, the eye control unit, and the protection unit host through the first communication module. The iris system database is used to store iris information and identity information corresponding to the iris information. The first data processing module is used to execute: The received eye image information is subjected to image preprocessing, feature extraction and feature matching to form an iris code which is stored in the iris system database.

3. The device according to claim 1, characterized in that: The protection unit host further comprises a shielding shell, and a plurality of accommodating spaces within the shielding shell for accommodating the camera unit, the iris recognition system and the eye control unit.

4. An eye control method for an eye-controlled intelligent integrated measurement and control device, characterized in that: The method is applied to an eye-controlled intelligent integrated measurement and control device as claimed in any one of claims 1 to 3 to perform human eye control operations, and the method comprises the following steps: The protection unit host sends an iris information entry instruction to the iris recognition system. The iris recognition system obtains the high-definition image data collected by the camera unit, and performs image preprocessing and feature extraction operations on the image data to generate iris information, which is stored in the iris system database. The eye control function is enabled, and the eye control unit polls the status of the camera unit. If the eye control unit recognizes similar facial information multiple times in a row, it sends the image information to the iris recognition system. The iris recognition system compares the information with the data in the iris system database after image preprocessing and feature extraction. If the information matches, the iris recognition system will feedback the verification result to the eye control unit and the protection unit host. The eye control unit enters the working state, generates position information from the initial data recognized, and feeds it back to the protection unit host. The protection unit host executes the eye control operation; Among them, the eye control unit generates a position control signal corresponding to the current human eye position information according to a pre-stored position control correspondence table corresponding to the protection unit host, and sends the position control signal to the protection unit host for the protection unit host to perform corresponding eye control operations.

5. The method according to claim 4, characterized in that: After the protection unit host receives the verification pass information, it confirms the user information by matching the local database, and the protection unit host display screen outputs the verification pass schematic interface. When the verification and binding with the user are completed, the verification pass schematic interface disappears and enters the eye control mode.

6. The method according to claim 5, characterized in that: In the eye control mode, the eye control unit monitors the user's eye position information, eyebrow position and nose tip position captured by the camera unit in real time, detects the angle of offset between each position point and the camera unit, and enters the tracking mode to determine the position information of the human eye's gaze point on the protection unit host. The eye control unit feeds back the calculated position information to the protection unit host, thereby realizing eye control operation.

7. The method according to claim 6, characterized in that: If the position of the gaze point is detected to be within the display screen, the protection unit host moves the cursor according to the received position information; if the position of the gaze point is detected not to be within the display screen, the eye control unit enters the standby state and re-enters the tracking mode within a predetermined time.

8. The method according to claim 7, wherein: In tracking mode, the cursor on the protection unit host display screen will follow the user's line of sight. When the user selects an option and focuses his eyes on it, the cursor on the protection unit host display screen will move to that option. When it detects that the user closes his eyes for 1 second to confirm the information, the protection unit host will execute a key operation.

9. The method according to claim 8, characterized in that: When the verification pass interface pops up on the display screen, the eye control unit monitors whether the user closes their eyes for 1 second. If so, it sends a position message to the protection unit host to confirm that the human eye position is at the icon of the pass interface. The protection unit host then exchanges data with the eye control unit to achieve eye position correction. When the verification pass prompt interface disappears, a cursor appears on the screen, and the eye control unit enters tracking mode, tracking the centerline position of the user's eyes in real time. Every time the centerline position angle deviates by 5 minutes, the eye control unit transmits position data to the protection unit host, and the protection unit host updates the cursor position. If the user closes their eyes to confirm the information at this time, the eye control unit transmits an execution signal to the protection unit host, and the protection unit host executes a left mouse button operation, which is regarded as a confirmation; The cursor moves within the display screen following the gaze point. When the gaze point moves away from the display screen, the eye control unit recognizes that the graphic is out of range and will enter standby mode, pausing recognition. When the pause time exceeds the preset time, the connection is disconnected and the iris recognition mark becomes invalid.

Images