Operation method and system, medium and computing equipment

Abstract

The invention discloses an operation method and system, a medium and computing equipment. The operation method comprises the following steps: acquiring a current local iris image of a user; determining a current sight focus of the user based on the current local iris image; and if the user has the blinking action, sending an operation instruction to the second terminal based on the action information of the blinking action and the current sight focus. According to the embodiment of the invention, the current local iris image of the user is collected based on the first terminal, the current sight focus of the user is determined based on the current local iris image, and the blinking action of the user is matched, so that the control operation of the second terminal is realized, and the whole interaction process is rapid and convenient.

Description

Technical Field

[0001] The present application relates to the field of interactive systems, and in particular to an operating method, system, medium and computing device. Background Art

[0002] At present, more and more smart terminals appear in people's daily lives, such as smart bracelets, smart glasses, smart phones, laptops, etc. Smart glasses can be worn directly on the user's eyes to intuitively display the pictures on the screen to the user. Therefore, smart bracelets, smart phones, laptops and other terminals can be communicated and connected with smart glasses, and smart glasses can be used to control smart bracelets, smart phones, laptops and other terminals to give users a better user experience.

[0003] Based on this, the current method is to set physical buttons on the smart glasses and perform control operations through the physical buttons; another method is to control through a voice system. Based on these two methods, it is inconvenient to control other terminals through smart glasses.

[0004] The above contents are only used to assist in understanding the technical solution of the present application and do not constitute an admission that the above contents are prior art. Summary of the invention

[0005] The main purpose of this application is to provide an operating method, system, medium and computing device, aiming to solve the problem mentioned in the background technology that the current methods of controlling other terminals through smart glasses are relatively inconvenient.

[0006] To achieve the above object, the present application provides an operation method, which is applied to a first terminal, the first terminal is communicatively connected with a second terminal, the first terminal includes a display device, and the first terminal is worn on the user's eyes. The operation method includes:

[0007] Acquire a current partial iris image of the user;

[0008] Determining a current sight focus of the user based on the current partial iris image;

[0009] If the user has a blinking action, an operation instruction is sent to the second terminal based on the action information of the blinking action and the current sight focus.

[0010] In the embodiment of the present application, the step of obtaining the current partial iris image of the user includes:

[0011] The image of the user's eyeball in a preset area is captured from a fixed direction to obtain the current local iris image.

[0012] In the embodiment of the present application, determining the current sight focus of the user based on the current partial iris image includes:

[0013] Based on the current local iris image, acquiring target image features;

[0014] The current sight focus of the user is determined based on a matching relationship between a preset iris feature and a sight focus, and the target image feature.

[0015] In the embodiment of the present application, the matching relationship between the preset iris feature and the display screen is obtained in the following manner:

[0016] When the user's eyes scan the boundary of the display area of ​​the display device, the iris of the user in the preset area is collected from the fixed direction to obtain a plurality of boundary iris images;

[0017] Acquire an iris region image enclosed by the multiple boundary iris images;

[0018] Dividing the iris region image into grids according to a preset size to obtain a plurality of iris grid images;

[0019] Obtaining iris grid image features of each iris grid image;

[0020] Dividing the display area into grids according to the number of the iris grid images to obtain a plurality of display grids;

[0021] Obtaining the center coordinates of each of the display grids;

[0022] Matching each of the iris grid image features with the center coordinates of each of the display grids to obtain a matching relationship between the preset iris features and the sight focus;

[0023] The mutually matching iris grid image features and the center coordinates of the display grid represent that when the user's line of sight is focused on the center coordinates, the iris features of the current local iris image obtained are the iris grid image features that match the center coordinates.

[0024] In the embodiment of the present application, the determining the current sight focus of the user based on the matching relationship between the preset iris feature and the sight focus and the target image feature includes:

[0025] Matching and obtaining target grid image features identical to the target image features from each of the iris grid image features;

[0026] Based on the target grid image feature, determining target coordinates in the display area that match the target grid image feature;

[0027] Based on the target coordinates, the current sight focus of the user is determined.

[0028] In the embodiment of the present application, the blinking action is determined based on the following method:

[0029] If the signal strength of the current partial iris image drops below a preset threshold within a preset time period and then recovers, it is determined that the user has performed a blinking action.

[0030] In the embodiment of the present application, before sending the operation instruction to the second terminal, the operation method further includes:

[0031] Determine whether a preset wake-up instruction is received;

[0032] If the preset wake-up instruction is received, sending an operation instruction to the second terminal based on the action information of the blinking action and the current sight focus;

[0033] After sending the operation instruction to the second terminal, the operation method further includes:

[0034] Determine whether a preset sleep instruction is received. If the preset sleep instruction is received, stop sending an operation instruction to the second terminal based on the action information of the blinking action and the current sight focus.

[0035] The present application also proposes an operating system, which is applied to a first terminal, the first terminal is communicatively connected with a second terminal, the first terminal includes a display device, and the first terminal is worn on the user's eyes. The operating system includes:

[0036] A collection module, used to obtain a current partial iris image of the user;

[0037] A processing module, configured to determine a current sight focus of the user based on the current partial iris image;

[0038] It is determined whether the user has a blinking action. If the user has a blinking action, an operation instruction is sent to the second terminal based on the action information of the blinking action and the current sight focus.

[0039] In the embodiment of the present application, the acquisition module is also used for:

[0040] The image of the user's eyeball in a preset area is captured from a fixed direction to obtain the current local iris image.

[0041] In the embodiment of the present application, the processing module is also used for:

[0042] Based on the current partial iris image, acquiring a target image feature of the current partial iris image;

[0043] The current sight focus of the user is determined based on a matching relationship between a preset iris feature and a sight focus, and the target image feature.

[0044] In the embodiment of the present application, the matching relationship between the preset iris feature and the sight focus is obtained in advance through the following initialization configuration:

[0045] When the user's eyes scan the boundary of the display area of ​​the display device, based on the acquisition module, the user's iris in the preset area is acquired from the fixed direction to obtain a plurality of boundary iris images;

[0046] Acquire an iris region image enclosed by the multiple boundary iris images;

[0047] Dividing the iris region image into grids according to a preset size to obtain a plurality of iris grid images;

[0048] Acquire iris grid image features of each of the iris grid images;

[0049] Dividing the display area into grids according to the number of the iris grid images to obtain a plurality of display grids;

[0050] Obtaining the center coordinates of each of the display grids;

[0051] Matching each of the iris grid image features with the center coordinates of each of the display grids to obtain a matching relationship between the preset iris features and the sight focus;

[0052] The mutually matching iris grid image features and the center coordinates of the display grid represent that when the user's line of sight is focused on the center coordinates, the iris features of the current local iris image obtained are the iris grid image features that match the center coordinates.

[0053] In the embodiment of the present application, the processing module is also used for:

[0054] A target grid image feature identical to the target image feature is obtained by matching the features of each iris grid image;

[0055] Based on the target grid image feature, determining target coordinates in the display area that match the target grid image feature;

[0056] Based on the target coordinates, the current sight focus of the user is determined.

[0057] In the embodiment of the present application, the processing module is further configured as follows:

[0058] If the signal strength of the current partial iris image drops below a preset threshold within a preset time period and then recovers, it is determined that the user has performed a blinking action.

[0059] In the embodiment of the present application, before sending the operation instruction to the second terminal, the processing module is further configured to:

[0060] Determine whether a preset wake-up instruction is received;

[0061] If the preset wake-up instruction is received, sending an operation instruction to the second terminal based on the action information of the blinking action and the current sight focus;

[0062] After sending the operation instruction to the second terminal, the processing module is further used to:

[0063] Determine whether a preset sleep instruction is received. If the preset sleep instruction is received, stop sending an operation instruction to the second terminal based on the action information of the blinking action and the current sight focus.

[0064] The present application also proposes a storage medium on which a computer program is stored. When the computer program is executed by a processor, the above method is implemented.

[0065] The present application also proposes a computing device, which includes a processor, and the processor is used to implement the above method when executing a computer program stored in a memory.

[0066] In the embodiment of the present application, the current local iris image of the user is collected based on the first terminal, the current visual focus of the user is determined based on the current local iris image, and then the control operation of the second terminal is realized in conjunction with the user's blinking action. The entire interaction process is fast and convenient. BRIEF DESCRIPTION OF THE DRAWINGS

[0067] Figure 1 is a step diagram of an operation method in one embodiment of the present application;

[0068] Figure 2 is a schematic diagram of the structure of smart glasses in one embodiment of the present application;

[0069] Figure 3a It is a schematic diagram of an infrared camera acquiring a user target pupil image at a certain moment in an embodiment of the present application;

[0070] Figure 3b is a schematic diagram of an infrared camera acquiring a user target pupil image at another moment in an embodiment of the present application;

[0071] Figure 3c is a schematic diagram of an infrared camera acquiring a user target pupil image at another moment in an embodiment of the present application;

[0072] Figure 4a is a schematic diagram of a display area of ​​a display device of a first terminal in an embodiment of the present application;

[0073] Figure 4b Focus the user's attention on Figure 4a The area S1 in the figure is a schematic diagram of the infrared camera acquiring the user's pupil image;

[0074] Figure 4c Focus the user's attention on Figure 4a The area S2 in the figure is a schematic diagram of the infrared camera acquiring the user's pupil image;

[0075] Figure 4d Focus the user's attention on Figure 4a Area S3 in the figure is a schematic diagram of the infrared camera acquiring the user's pupil image;

[0076] Figure 4e Focus the user's attention on Figure 4a Area S4 in FIG. 1 is a schematic diagram of the infrared camera acquiring the user's pupil image;

[0077] Figure 5a is a schematic diagram of grid division of a display area of ​​a display device of a first terminal in an embodiment of the present application;

[0078] Figure 5b is a schematic diagram of a pupil area image of a user in an embodiment of the present application;

[0079] Figure 5c yes Figure 5b An enlarged schematic diagram of the pupil area image in FIG.

[0080] Figure 6 is a schematic diagram of the structure of an operating system in an embodiment of the present application;

[0081] Figure 7 It is a structural schematic diagram of a storage medium of the present application;

[0082] Figure 8 It is a structural schematic diagram of a computing device of the present application. DETAILED DESCRIPTION

[0083] The principles and spirit of the present application will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are provided only to enable those skilled in the art to better understand and implement the present application, and are not intended to limit the scope of the present application in any way. On the contrary, these embodiments are provided to make the present application more thorough and complete, and to fully convey the scope of the present application to those skilled in the art.

[0084] Those skilled in the art know that the embodiments of the present application can be implemented as a device, system, equipment, method or computer program product. Therefore, the present application can be specifically implemented in the following forms, namely: complete hardware, complete software (including firmware, resident software, microcode, etc.), or a combination of hardware and software.

[0085] According to the implementation manner of the present application, an operating method, system, medium and computing device are proposed.

[0086] It should be understood herein that any number of elements in the drawings is for illustration rather than limitation, and any naming is only for distinction rather than having any limiting meaning.

[0087] The principles and spirit of the present application are explained in detail below with reference to several representative implementations of the present application.

[0088] Exemplary Methods

[0089] like Figure 1 As shown, in an embodiment of the present application, an operation method is proposed, which is applied to a first terminal, the first terminal is communicatively connected with a second terminal, the first terminal includes a display device, and the first terminal is worn on the user's eyes.

[0090] The first terminal may be a smart glasses, which are worn on the user's eyes, and the second terminal may be a smart terminal such as a smart bracelet, a smart watch, a smart phone, a tablet computer, a laptop computer, etc. The second terminal is connected to the first terminal in communication, and the first terminal may receive a display image sent by the second terminal and display it on a display device of the first terminal, wherein the display image sent by the second terminal may be displayed in front of the user through a display device (physical display screen) on the first terminal, or may be displayed in front of the user through VR (Virtual Reality) technology, so that the image displayed by the second terminal may be displayed on the first terminal (such as smart glasses) for the user to watch.

[0091] In addition, the communication between the first terminal and the second terminal can be achieved based on WiFi Direct (wireless connection system). The first terminal can serve as the data receiving end of WiFi Direct, and the connection parameters of WiFi Direct can be stored in advance on the NFC (Near Field Communication) chips of the first terminal and the second terminal. When the first terminal and the second terminal are close to each other, the display screen of the second terminal can be transmitted to the first terminal in real time, and then displayed on the display device on the first terminal.

[0092] The specific process of establishing a communication connection is as follows:

[0093] The NFC and WiFi Direct functions of the first terminal and the second terminal are turned on, and the device parameters of WiFi Direct (WiFi Direct name and Mac address) are stored in the simulated NFC of the first terminal and the second terminal. The first terminal and the second terminal transfer parameters to each other after they are close to each other. The second terminal is simulated as an NFC card with WiFi Direct link data, and the first terminal is simulated as a card reader and obtains the connection information of the second terminal. The second terminal, as the sender, initiates a connection request to the first terminal. After the user confirms and establishes the connection on the second terminal, the display screen of the second terminal can be transmitted to the first terminal via WiFi Direct.

[0094] By using this communication method, the first terminal and the second terminal can quickly and easily establish a connection during use, and the information exchange delay between them is low.

[0095] After the first terminal and the second terminal establish a communication connection, the operation method can be used to send an operation instruction to the second terminal through the first terminal, such as Figure 1 As shown, in the embodiment of the present application, the operation method includes the following steps:

[0096] Step S100: Acquire the current partial iris image of the user.

[0097] like Figure 2 As shown, Figure 2 This is a structural diagram when the first terminal is a smart pair of glasses, wherein the smart pair of glasses is provided with a collection module, which can collect the user's eye information, such as taking photos and videos of the user's eyes.

[0098] For example, in one embodiment, Figure 2 As shown, the acquisition module may include an infrared transmitter and an infrared receiver, wherein the infrared transmitter may be an infrared LED light source, and the infrared receiver may be an infrared camera. The infrared transmitter and the infrared receiver may be installed on the side of the smart glasses close to the user's eyes. The infrared transmitter may emit infrared rays to the user's eyeballs, and the infrared rays may be reflected after irradiating the user's eyes, and the reflected infrared rays may be received by the infrared receiver. It should be noted that in Figure 2 In the smart glasses shown, the infrared LED light source and the infrared camera are both arranged on the right eye side. In other embodiments, they may also be arranged on the left eye side.

[0099] In an embodiment of the present application, the acquisition module can perform image acquisition of the user's eyeball in a preset area from a fixed direction to obtain the current local iris image. As shown in Figure 3, Figure 3 is a schematic diagram of the infrared signal received by the infrared receiver during the rotation of the user's eyeball, wherein the infrared transmitter always transmits infrared signals to the user's eyeball, and the infrared receiver always receives infrared signals reflected from a fixed area (preset area) from a fixed direction. Taking the infrared receiver as an infrared camera as an example, after the smart glasses are worn on the user's eyes, the smart glasses and the user's head remain relatively still, the infrared camera always faces one direction, and the area where it receives infrared rays remains unchanged, that is, the focal length remains unchanged. During the rotation of the eyeball, the infrared camera always receives the infrared signal reflected by the eyeball in a fixed direction and at a fixed focal length.

[0100] As shown in Figure 3, Figure 3a The middle eyeball faces straight ahead. Figure 3b The middle eyeball turns to the left. Figure 3c The eyeball rotates to the right. During the rotation of the eyeball, the eyeball moves relative to the infrared camera. Therefore, when the eyeball rotates, the infrared signal reflected by the eyeball received by the infrared camera will also change. For example, Figure 3a , 3b In 3 and 3c, the eyes look in different directions respectively, and the areas of the eyes that reflect infrared light and enter the infrared camera are different at the three moments.

[0101] As can be seen from FIG3, when the eyeball looks at different directions, the area of ​​the eyeball that reflects infrared rays and enters the infrared camera is different. In the human eye, the circular iris located between the black pupil and the white sclera has different texture features at different positions, such as spots, filaments, stripes, etc. The iris at each position is unique, and the irises of different people are also unique. Therefore, in the embodiment of the present application, the infrared camera can be directed toward the user's iris area. When the user's eyeball rotates, the position where the user's iris reflects the red line outside the infrared receiver changes, and the infrared signal received by the infrared camera also changes accordingly, so that the focus of the user's current line of sight can be determined based on the current local iris image taken by the infrared camera, that is, the following step S200: Based on the current local iris image, determine the current focus of the user's line of sight.

[0102] When the infrared camera is installed on the smart glasses, its installation direction and position have been preset so that when the smart glasses are worn on the user's eyes, the infrared camera is facing the direction of the position of the iris area of ​​the user's eyeball. After the user wears the smart glasses, the infrared camera on the smart glasses can receive the infrared signal reflected by the user's eyeball iris, and the infrared camera has also been pre-set with a focal length. Therefore, in step S100, after the user wears the smart glasses, the infrared camera can collect the user's current local iris image during the user's eyeball rotation. The current local iris image is the iris image that the infrared camera can capture when the user's eyeball is focused on the current sight focus; when the user rotates his eyeball to change the sight focus, the position of the iris relative to the infrared camera changes, and the area of ​​the iris that reflects the infrared signal and enters the infrared camera also changes, so the current local iris image captured by the infrared camera will also change accordingly.

[0103] In the embodiment of the present application, after obtaining the current partial iris image, the current sight focus of the user can be determined based on the following steps S210-S220:

[0104] Step S210: Based on the current partial iris image, a target image feature of the current partial iris image is acquired.

[0105] In the embodiment of the present application, after the current partial iris image of the user is captured by the infrared camera, the target image features can be obtained based on the current partial iris image, which can be specifically performed based on the image processing model. For example, the image recognition model can be one or more pre-prepared neural network models with different structures, and the convolutional neural network can be used to extract a spatial vector graph for the input current partial iris image, and the extracted spatial vector graph is the target image feature of the current partial iris image.

[0106] Step S220: Determine the current sight focus of the user based on the matching relationship between the preset iris feature and the sight focus and the target image feature.

[0107] In the embodiment of the present application, the matching relationship between the preset iris feature and the sight focus may be initialized in advance, specifically including the following steps S221 to S227:

[0108] Step S221: when the user's eyes scan the boundary of the display area of ​​the display device, the user's irises in a preset area are collected from a fixed direction to obtain a plurality of boundary iris images.

[0109] like Figure 4a-4e As shown, Figure 4ais the display screen of the smart glasses (taking the display device as an example), S1, S2, S3, and S4 are the four corners of the display area edge of the display screen. After the user wears the smart glasses, calibration is first performed. The user's line of sight scans the edge of the display area of ​​the display screen, for example, from S1 to S2, then to S3, then to S4, and finally back to S1. When the user's line of sight focuses on the position of S1, such as Figure 4b As shown in , the infrared camera obtains the iris image of t1; when the user's line of sight is focused on position S2, as shown in Figure 4c As shown in , the infrared camera obtains the iris image of t2; when the user's line of sight is focused on position S3, as shown in Figure 4d As shown in FIG. 1 , the infrared camera obtains the iris image of t3; when the user's line of sight is focused on position S4, as shown in FIG. Figure 4e As shown in , the infrared camera obtains the iris image of t4; when the user's sight is focused on position S1 again, as shown in Figure 4a As shown, the infrared camera acquires the iris image of t1 again.

[0110] It can be seen that when the user is viewing the display area of ​​the display screen, t1, t2, t3, and t4 are the outermost boundary iris images that the infrared camera can capture. When the user focuses on other positions in the display area, the iris image captured by the infrared camera must be within the area enclosed by t1, t2, t3, and t4. Therefore, the area enclosed by t1, t2, t3, and t4 is the area that the infrared camera can capture.

[0111] Step S222: Acquire an iris region image enclosed by the multiple boundary iris images.

[0112] In step S221, four boundary images t1, t2, t3, and t4 are obtained, and the enclosed area thereof is the iris area image. In the embodiment of the present application, after the four boundary images t1, t2, t3, and t4 are determined, the coordinates of the four boundary images can be further determined, such as obtaining the lower left corner coordinates of t1, the lower right corner coordinates of t2, the upper right corner coordinates of t3, and the upper left corner coordinates of t4, respectively, and then obtaining an eyeball image including the above t1, t2, t3, and t4, and cutting the eyeball image according to the above coordinates to obtain the iris area image.

[0113] Step S223: Divide the iris region image into grids according to a preset size to obtain a plurality of iris grid images.

[0114] like Figure 5a-5c As shown, Figure 5b is a schematic diagram of a user's eyeball, where Figure 5bThe grid area in is the iris area image obtained in step S222, and each grid obtained by grid division according to a preset size represents an iris grid image.

[0115] like Figure 5c As shown, Figure 5c for Figure 5b An enlarged view of each grid in the embodiment of the present application is shown in FIG. 1 . In the embodiment of the present application, the iris area image is divided into 5*11 grids, that is, there are a total of 55 iris grid images.

[0116] Step S224: Acquire iris grid image features of each of the iris grid images.

[0117] In the embodiment of the present application, after the iris region image is determined and divided into iris grid images, the iris grid image features of each iris grid image can be obtained using an image recognition model, such as Figure 5c As shown, it is assumed that the iris grid image features of the 55 iris grid images are N1-N55 respectively.

[0118] Step S225: Divide the display area into grids according to the number of the iris grid images to obtain a plurality of display grids.

[0119] In step S223, the iris region image is divided into 5*11 grids, a total of 55 grids. Therefore, in the embodiment of the present application, the display region can be divided into 5*11 grids, such as Figure 5a shown.

[0120] Step S226: Obtain the center coordinates of each of the display grids.

[0121] In step S225, the display area of ​​the display screen is divided into 5*11 display grids, and in step S226, the center coordinates of each display grid can be obtained respectively, such as Figure 5a As shown, assuming that the center points of each display grid are M1-M55, the center coordinates of each display grid are the coordinates of each point M1-M55.

[0122] Step S227: Matching each of the iris grid image features with the center coordinates of each of the display grids to obtain a matching relationship between the preset iris features and the sight focus. The mutually matching iris grid image features and the center coordinates of the display grid represent that when the user's sight focus is on the center coordinate, the iris features of the current local iris image obtained are the iris grid image features that match the center coordinate.

[0123] When the user's line of sight is focused on the 1st grid in the 1st row of the display area, the infrared camera can obtain the 11th iris grid image in the 5th row of the iris area image, and the image recognition model can recognize the iris grid image feature N1. Therefore, the coordinates of the iris grid image feature N1 match those of M1; when the user's line of sight is focused on the 11th grid in the 1st row of the display area, the infrared camera can obtain the 1st iris grid image in the 5th row of the iris area image, and the image recognition model can recognize the iris grid image feature N11. Therefore, the coordinates of the iris grid image feature N11 match those of M11; and so on, the iris grid image features N1-N55 match the coordinates of M1-M55, respectively.

[0124] After the above steps S221-227, the matching relationship between the preset iris features and the sight focus can be obtained, that is, the matching relationship between each grid image feature in N1-N55 and each point in M1-M55. After obtaining the matching relationship, the current sight focus of the user can be determined through the following steps S228-S230:

[0125] Step S228: From each of the iris grid image features, a target grid image feature that is identical to the target image feature is matched.

[0126] After the infrared camera obtains the user's current partial iris image, the target image features of the current partial iris image are obtained using the image recognition model. At this time, an iris grid feature that is the same as the target image feature can be matched from each iris grid feature in N1-N55. Assuming that the target image feature at the current moment is the same as N38, then N38 is the target grid image feature.

[0127] Step S229: Based on the target grid image feature, determine the target coordinates in the display area that match the target grid image feature.

[0128] The center coordinates matching N38 are the coordinates of M38, that is, the target coordinates are the coordinates of M38.

[0129] Step S229: Determine the current visual focus of the user based on the target coordinates.

[0130] The target coordinates are the coordinates of M38, so it can be known that the user's line of sight is currently focused on the display area centered on M38.

[0131] Step S300: If the user has a blinking action, an operation instruction is sent to the second terminal based on the action information of the blinking action and the current sight focus.

[0132] In the embodiment of the present application, the user's blinking action can be determined based on the following method:

[0133] If the intensity of the infrared signal received by the infrared receiver drops below the preset threshold within a preset time period and then recovers, it is determined that the user has blinked. The infrared LED light source continuously transmits infrared signals to the user's eyeballs. If the user does not blink, the infrared camera will continue to receive infrared signals reflected by the user's eyeballs, and the intensity of the infrared signal can be stabilized within a certain range; when the user blinks, the eyelids cover the eyeballs, and the eyelids can absorb infrared signals, so the infrared signals are basically not reflected, or only part of the infrared signals are reflected. At this time, the infrared camera can receive a significantly weaker infrared signal; when the user opens his eyes, the intensity of the infrared signal reflected by the eyeballs returns to a normal level. Therefore, an intensity threshold of the infrared signal can be set. If the intensity of the infrared signal received by the infrared camera is lower than the threshold within a preset time period (such as lower than the threshold within 0.1 seconds), it means that the user has blinked, and the eyelids were closed for 0.1 seconds when blinking. In addition, it should be noted that, assuming that the preset time period is set to 0.1 seconds, if the intensity of the infrared signal received by the infrared camera is lower than the threshold for more than 0.1 seconds, it is not determined as a blinking action, but is determined as an eye-closing action. In addition, the length of the preset time period and the intensity threshold of the infrared signal can be determined based on the length of the user's daily blinking time and the intensity of the infrared signal reflected by the eyeball in the normal open eye state.

[0134] In addition, for the user, the blinking action may be an unconscious blinking of the user, rather than the user intending to control the second terminal by blinking. In order to avoid misoperation of the second terminal due to unconscious blinking action, before sending the operation instruction to the second terminal, in the embodiment of the present application, the operation method further includes:

[0135] Determine whether a preset wake-up instruction is received;

[0136] If the preset wake-up instruction is received, an operation instruction is sent to the second terminal based on the action information of the blinking action and the current sight focus. Among them, a wake-up module can be set on the smart glasses, for example, the wake-up module can be set on the glasses leg of the smart glasses. The wake-up module can be in the form of a physical button or a touch-sensitive form. When the user wants to send an operation instruction to the second terminal based on the blinking action, the physical button can be pressed or the touch-sensitive area can be touched. When the wake-up module receives the wake-up instruction, the user's blinking action will be regarded as an instruction to operate the second terminal, thereby avoiding erroneous operations caused by unconscious blinking of the user.

[0137] In addition, in order to avoid erroneous operations caused by unconscious blinking of the user, in the embodiment of the present application, after sending the operation instruction to the second terminal, the operation method further includes:

[0138] Determine whether a preset sleep instruction is received. If the preset sleep instruction is received, stop sending an operation instruction to the second terminal based on the action information of the blinking action and the current sight focus.

[0139] Among them, in the embodiment of the present application, after the user completes the operation on the second terminal, he can press the physical button again, or touch the sensing area, that is, send a sleep command to the second terminal. When the wake-up module receives the sleep command, the user's blinking movement will be regarded as an unconscious blinking movement, and no operation command will be sent to the second terminal.

[0140] It should be noted that the display screen sent by the second terminal to the first terminal can be a document, video, picture, etc., so when the user's line of sight is focused on the end of the document on the current display screen, a page turning or sliding down instruction can be sent through a blinking action, realizing automatic page turning based on the user's line of sight, eliminating user operations; when the user's line of sight is focused on the fast forward or fast rewind button in the progress bar of the video on the current display screen, a fast forward or fast rewind instruction can be sent through a blinking action, and the line of sight is automatically fast forwarded or rewinded based on the user's line of sight. In the embodiment of the present application, the operation instruction sent to the second terminal based on the user's line of sight focus and the blinking action is implemented according to the operation button on the display screen at the position of the user's line of sight focus, such as closing, switching, zooming in or out, that is, the instruction to perform the relevant operation is sent to the second terminal based on what the operation button displayed at the line of sight focus is.

[0141] In another embodiment, misoperation can also be avoided by using the number of blinks as an operation instruction. For example, blinking twice or three times within a preset time can be set to represent a user's blinking with operational awareness. Assuming that the preset number of blinks is two, when the intensity of the infrared signal appears twice in a row within the preset time period, it is first lower than the threshold range and then returns to normal intensity, it is judged that the user has blinked twice in a row, and it is a blinking action with operational awareness, and an operation instruction is sent to the second terminal. Among them, the length of the preset time period can be set according to the time period of a single eye of the user. For example, if a single blink of the user takes 0.1 seconds, then the preset time period can be set to 0.25 seconds, that is, if the user is detected to blink twice within 0.25 seconds, it is judged that the user is blinking with operational awareness.

[0142] In addition, it should be noted that the above embodiment is described by dividing the display area and the iris area image into 55 grids, where the 55 grids are only for the convenience of explanation, and do not mean that only 55 grids can be divided. The size of the grid can represent the accuracy of the operation. The smaller the grid, the more accurate the control operation based on the user's visual focus. Therefore, in other embodiments, the display area and the iris area image can also be divided into grids at the pixel level.

[0143] In another embodiment of the present application, before the user operates the second terminal based on the first terminal, the user may also be subjected to iris verification to determine the user's identity, as follows:

[0144] First, during the initialization phase, users can record and store their iris features based on the infrared camera. During subsequent use, iris authentication is performed before each use. The authentication process is as follows:

[0145] The iris image of the user is obtained based on the infrared camera. It should be noted that the iris image obtained at this time is not limited to the preset area size, but the complete iris image of the user can be obtained by adjusting the focal length of the infrared camera.

[0146] After obtaining the user's iris image, the image recognition model is used to obtain the iris features of the iris image and compare them with the iris features pre-entered in the initialization phase. If they are consistent, the user identity verification is successful, otherwise the verification fails.

[0147] In the embodiment of the present application, the current local iris image of the user is collected based on the first terminal, the current visual focus of the user is determined based on the current local iris image, and then the control operation of the second terminal is realized in conjunction with the user's blinking action. The entire interaction process is fast and convenient.

[0148] Exemplary Devices

[0149] like Figure 6 As shown, this exemplary embodiment proposes an operating system 100, which is applied to a first terminal, the first terminal is communicatively connected with a second terminal, the first terminal includes a display device, and the first terminal is worn on the user's eyes. The operating system 100 includes:

[0150] The acquisition module 110 is used to acquire the current partial iris image of the user;

[0151] A processing module 120, configured to determine a current sight focus of the user based on the current partial iris image;

[0152] It is determined whether the user has a blinking action. If the user has a blinking action, an operation instruction is sent to the second terminal based on the action information of the blinking action and the current sight focus.

[0153] In the embodiment of the present application, the acquisition module 110 is also used for:

[0154] The image of the user's eyeball in a preset area is captured from a fixed direction to obtain the current local iris image.

[0155] In the embodiment of the present application, the processing module 120 is further used for:

[0156] Based on the current partial iris image, acquiring a target image feature of the current partial iris image;

[0157] The current sight focus of the user is determined based on a matching relationship between a preset iris feature and a sight focus, and the target image feature.

[0158] In the embodiment of the present application, the matching relationship between the preset iris feature and the sight focus is obtained in advance through the following initialization configuration:

[0159] When the user's eyes scan the boundary of the display area of ​​the display device, based on the acquisition module 110, the user's iris in the preset area is acquired from the fixed direction to obtain a plurality of boundary iris images;

[0160] Acquire an iris region image enclosed by the multiple boundary iris images;

[0161] Dividing the iris region image into grids according to a preset size to obtain a plurality of iris grid images;

[0162] Acquire iris grid image features of each of the iris grid images;

[0163] Dividing the display area into grids according to the number of the iris grid images to obtain a plurality of display grids;

[0164] Obtaining the center coordinates of each of the display grids;

[0165] Matching each of the iris grid image features with the center coordinates of each of the display grids to obtain a matching relationship between the preset iris features and the sight focus;

[0166] The mutually matching iris grid image features and the center coordinates of the display grid represent that when the user's line of sight is focused on the center coordinates, the iris features of the current local iris image obtained are the iris grid image features that match the center coordinates.

[0167] In the embodiment of the present application, the processing module 120 is further used for:

[0168] A target grid image feature identical to the target image feature is obtained by matching the features of each iris grid image;

[0169] Based on the target grid image feature, determining target coordinates in the display area that match the target grid image feature;

[0170] Based on the target coordinates, the current sight focus of the user is determined.

[0171] In the embodiment of the present application, the processing module 120 is further configured to:

[0172] If the signal strength of the current partial iris image drops below a preset threshold within a preset time period and then recovers, it is determined that the user has performed a blinking action.

[0173] In the embodiment of the present application, before sending the operation instruction to the second terminal, the processing module 120 is further configured to:

[0174] Determine whether a preset wake-up instruction is received;

[0175] If the preset wake-up instruction is received, sending an operation instruction to the second terminal based on the action information of the blinking action and the current sight focus;

[0176] After sending the operation instruction to the second terminal, the processing module 120 is further used for:

[0177] Determine whether a preset sleep instruction is received. If the preset sleep instruction is received, stop sending an operation instruction to the second terminal based on the action information of the blinking action and the current sight focus.

[0178] In the embodiment of the present application, the current local iris image of the user is collected based on the first terminal, and the processing module 120 is used to determine the current visual focus of the user based on the current local iris image, and then the user's blinking action is combined to realize the control operation of the second terminal. The whole interaction process is fast and convenient.

[0179] Exemplary Media

[0180] After introducing the method, medium and system of the exemplary embodiments of the present application, next, reference is made to Figure 7 For a description of the computer-readable storage medium of the exemplary embodiment of the present application, please refer to Figure 7, the computer-readable storage medium shown is a CD 70, on which a computer program (i.e., a program product) is stored. When the computer program is executed by the processor, it will implement the steps recorded in the above method implementation, for example, obtaining the current local iris image of the user; based on the current local iris image, determining the current line of sight focus of the user; if the user has a blinking action, then based on the action information of the blinking action and the current line of sight focus, sending an operation instruction to the second terminal; the specific implementation method of each step will not be repeated here.

[0181] It should be noted that examples of the computer-readable storage medium may also include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), and

[0182] Memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other optical or magnetic storage media are not listed here one by one.

[0183] Exemplary Computing Devices

[0184] After introducing the methods, systems, and media of the exemplary embodiments of the present application, reference is now made to Figure 8 A computing device according to an exemplary embodiment of the present application.

[0185] Figure 8 A block diagram of an exemplary computing device 80 suitable for implementing embodiments of the present application is shown. The computing device 80 may be a computer system or a server. Figure 8 The computing device 80 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0186] like Figure 8 As shown, the components of the computing device 80 may include, but are not limited to: one or more processors or processing units 801, a system memory 802, and a bus 803 connecting different system components (including the system memory 802 and the processing unit 801).

[0187] The computing device 80 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by the computing device 80, including volatile and non-volatile media, removable and non-removable media.

[0188] The system memory 802 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 8021 and / or cache memory 8022. The computing device 70 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, the ROM 8023 may be used to read and write non-removable, non-volatile magnetic media ( Figure 8 is not shown in the Figure 8 As shown in FIG. 8 , a disk drive for reading and writing a removable non-volatile disk (e.g., a "floppy disk") and an optical disk drive for reading and writing a removable non-volatile optical disk (e.g., a CD-ROM, a DVD-ROM, or other optical media) can be provided. In these cases, each drive can be connected to bus 803 via one or more data medium interfaces. System memory 802 may include at least one program product having a set (e.g., at least one) of program modules that are configured to perform the functions of each embodiment of the present application.

[0189] A program / utility 8025 having a set (at least one) of program modules 8024 may be stored, for example, in system memory 802, and such program modules 8024 include, but are not limited to: operating system 100, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment. Program modules 8024 generally perform the functions and / or methods of the embodiments described herein.

[0190] The computing device 80 may also communicate with one or more external devices 804 (e.g., a keyboard, a pointing device, a display, etc.). Such communication may be performed via an input / output (I / O) interface. Furthermore, the computing device 80 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) via a network adapter 806. Figure 8 As shown, the network adapter 806 communicates with other modules (such as the processing unit 801, etc.) of the computing device 80 via the bus 803. It should be understood that although Figure 8 Not shown, other hardware and / or software modules may be used in conjunction with computing device 80 .

[0191] The processing unit 801 executes various functional applications and data processing by running the program stored in the system memory 802, for example, obtaining the current partial iris image of the user; determining the current sight focus of the user based on the current partial iris image; if the user has a blinking action, sending an operation instruction to the second terminal based on the action information of the blinking action and the current sight focus; the specific implementation of each step is not repeated here. It should be noted that although several units / modules or sub-units / sub-modules of the facial recognition device are mentioned in the above detailed description, this division is only exemplary and not mandatory. In fact, according to the implementation of the present application, the features and functions of two or more units / modules described above can be concretized in one unit / module. Conversely, the features and functions of one unit / module described above can be further divided into multiple units / modules to be concretized.

[0192] In the description of the present application, it should be noted that the terms "first", "second" and "third" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance.

[0193] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described systems, systems and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0194] In the several embodiments provided in the present application, it should be understood that the disclosed devices, systems and methods can be implemented in other ways. The system embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of the system or unit can be electrical, mechanical or other forms.

[0195] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0196] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0197] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computing device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0198] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present application, which are used to illustrate the technical solutions of the present application, rather than to limit them. The protection scope of the present application is not limited thereto. Although the present application is described in detail with reference to the above-described embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-described embodiments within the technical scope disclosed in the present application, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

[0199] In addition, although the operations of the method of the present application are described in a specific order in the drawings, this does not require or imply that the operations must be performed in this specific order, or that all the operations shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps.

[0200] Through the above description, the embodiments of the present application provide at least the following technical solutions, but are not limited thereto:

[0201] 1. An operation method, applied to a first terminal, the first terminal is in communication connection with a second terminal, the first terminal includes a display device, and the first terminal is worn on the user's eyes, the operation method comprising:

[0202] Acquire a current partial iris image of the user;

[0203] Determining a current sight focus of the user based on the current partial iris image;

[0204] If the user has a blinking action, an operation instruction is sent to the second terminal based on the action information of the blinking action and the current sight focus.

[0205] 2. In the operating method of technical solution 1, the step of obtaining the current partial iris image of the user comprises:

[0206] The image of the user's eyeball in a preset area is captured from a fixed direction to obtain the current local iris image.

[0207] 3. The operating method according to technical solution 1 or 2, wherein determining the current sight focus of the user based on the current partial iris image comprises:

[0208] Based on the current local iris image, acquiring target image features;

[0209] The current sight focus of the user is determined based on a matching relationship between a preset iris feature and a sight focus, and the target image feature.

[0210] 4. In the operating method according to any one of technical solutions 1 to 3, the matching relationship between the preset iris feature and the display screen is obtained by:

[0211] When the user's eyes scan the boundary of the display area of ​​the display device, the iris of the user in the preset area is collected from the fixed direction to obtain a plurality of boundary iris images;

[0212] Acquire an iris region image enclosed by the multiple boundary iris images;

[0213] Dividing the iris region image into grids according to a preset size to obtain a plurality of iris grid images;

[0214] Obtaining iris grid image features of each iris grid image;

[0215] Dividing the display area into grids according to the number of the iris grid images to obtain a plurality of display grids;

[0216] Obtaining the center coordinates of each of the display grids;

[0217] Matching each of the iris grid image features with the center coordinates of each of the display grids to obtain a matching relationship between the preset iris features and the sight focus;

[0218] The mutually matching iris grid image features and the center coordinates of the display grid represent that when the user's line of sight is focused on the center coordinates, the iris features of the current local iris image obtained are the iris grid image features that match the center coordinates.

[0219] 5. The operating method according to any one of technical solutions 1 to 4, wherein determining the current sight focus of the user based on the matching relationship between the preset iris feature and the sight focus and the target image feature comprises:

[0220] Matching and obtaining target grid image features identical to the target image features from each of the iris grid image features;

[0221] Based on the target grid image feature, determining target coordinates in the display area that match the target grid image feature;

[0222] Based on the target coordinates, the current sight focus of the user is determined.

[0223] 6. According to any one of technical solutions 1 to 5, the blinking action is determined based on the following method:

[0224] If the signal strength of the current partial iris image drops below a preset threshold within a preset time period and then recovers, it is determined that the user has performed a blinking action.

[0225] 7. According to any one of technical solutions 1 to 6, before sending the operation instruction to the second terminal, the operation method further includes:

[0226] Determining whether a preset wake-up instruction is received, and if the preset wake-up instruction is received, sending an operation instruction to the second terminal based on the action information of the blinking action and the current sight focus;

[0227] After sending the operation instruction to the second terminal, the operation method further includes:

[0228] Determine whether a preset sleep instruction is received. If the preset sleep instruction is received, stop sending an operation instruction to the second terminal based on the action information of the blinking action and the current sight focus.

[0229] 8. An operating system, applied to a first terminal, the first terminal is communicatively connected with a second terminal, the first terminal includes a display device, the first terminal is worn on the user's eyes, and the operating system includes:

[0230] A collection module, used to obtain a current partial iris image of the user;

[0231] A processing module, configured to determine a current sight focus of the user based on the current partial iris image;

[0232] It is determined whether the user has a blinking action. If the user has a blinking action, an operation instruction is sent to the second terminal based on the action information of the blinking action and the current sight focus.

[0233] 9. In the operating system according to technical solution 8, the acquisition module is further used for:

[0234] The image of the user's eyeball in a preset area is captured from a fixed direction to obtain the current local iris image.

[0235] 10. In the operating system according to technical solution 8 or 9, the processing module is further used for:

[0236] Based on the current partial iris image, acquiring a target image feature of the current partial iris image;

[0237] The current sight focus of the user is determined based on a matching relationship between a preset iris feature and a sight focus, and the target image feature.

[0238] 11. In the operating system according to any one of technical solutions 8 to 10, the matching relationship between the preset iris feature and the sight focus is obtained in advance through the following initialization configuration:

[0239] When the user's eyes scan the boundary of the display area of ​​the display device, based on the acquisition module, the user's iris in the preset area is acquired from the fixed direction to obtain a plurality of boundary iris images;

[0240] Acquire an iris region image enclosed by the multiple boundary iris images;

[0241] Dividing the iris region image into grids according to a preset size to obtain a plurality of iris grid images;

[0242] Acquire iris grid image features of each of the iris grid images;

[0243] Dividing the display area into grids according to the number of the iris grid images to obtain a plurality of display grids;

[0244] Obtaining the center coordinates of each of the display grids;

[0245] Matching each of the iris grid image features with the center coordinates of each of the display grids to obtain a matching relationship between the preset iris features and the sight focus;

[0246] The mutually matching iris grid image features and the center coordinates of the display grid represent that when the user's line of sight is focused on the center coordinates, the iris features of the current local iris image obtained are the iris grid image features that match the center coordinates.

[0247] 12. In the operating system according to any one of technical solutions 8 to 11, the processing module is further used for:

[0248] A target grid image feature identical to the target image feature is obtained by matching the features of each iris grid image;

[0249] Based on the target grid image feature, determining target coordinates in the display area that match the target grid image feature;

[0250] Based on the target coordinates, the current sight focus of the user is determined.

[0251] 13. In the operating system according to any one of technical solutions 8 to 12, the processing module is further configured to:

[0252] If the signal strength of the current partial iris image drops below a preset threshold within a preset time period and then recovers, it is determined that the user has performed a blinking action.

[0253] 14. In the operating system according to any one of technical solutions 8 to 13, before sending the operation instruction to the second terminal, the processing module is further used to:

[0254] Determine whether a preset wake-up instruction is received;

[0255] If the preset wake-up instruction is received, sending an operation instruction to the second terminal based on the action information of the blinking action and the current sight focus;

[0256] After sending the operation instruction to the second terminal, the processing module is further used to:

[0257] Determine whether a preset sleep instruction is received. If the preset sleep instruction is received, stop sending an operation instruction to the second terminal based on the action information of the blinking action and the current sight focus.

[0258] 15. A storage medium having a computer program stored thereon, characterized in that when the computer program is executed by a processor, the method described in any one of technical solutions 1-7 is implemented.

[0259] 16. A computing device, characterized in that: the computing device includes a processor, and the processor is used to implement the method described in any one of Technical Solutions 1-7 when executing a computer program stored in a memory.

Claims

1. An operation method, applied to a first terminal, the first terminal is in communication connection with a second terminal, the first terminal includes a display device, and the first terminal is worn on the user's eyes, the operation method comprising: Acquire a current partial iris image of the user; Determining a current sight focus of the user based on the current partial iris image; If the user has a blinking action, an operation instruction is sent to the second terminal based on the action information of the blinking action and the current sight focus.

2. The operating method according to claim 1, wherein obtaining the current partial iris image of the user comprises: The image of the user's eyeball in a preset area is captured from a fixed direction to obtain the current local iris image.

3. The operating method according to claim 1, wherein determining the current sight focus of the user based on the current partial iris image comprises: Based on the current local iris image, acquiring target image features; The current sight focus of the user is determined based on a matching relationship between a preset iris feature and a sight focus, and the target image feature.

4. The operating method according to claim 2, wherein the matching relationship between the preset iris feature and the display screen is obtained by: When the user's eyes scan the boundary of the display area of ​​the display device, the iris of the user in the preset area is collected from the fixed direction to obtain a plurality of boundary iris images; Acquire an iris region image enclosed by the multiple boundary iris images; Dividing the iris region image into grids according to a preset size to obtain a plurality of iris grid images; Obtaining iris grid image features of each iris grid image; Dividing the display area into grids according to the number of the iris grid images to obtain a plurality of display grids; Obtaining the center coordinates of each of the display grids; Matching each of the iris grid image features with the center coordinates of each of the display grids to obtain a matching relationship between the preset iris features and the sight focus; The mutually matching iris grid image features and the center coordinates of the display grid represent that when the user's line of sight is focused on the center coordinates, the iris features of the current local iris image obtained are the iris grid image features that match the center coordinates.

5. An operating system, applied to a first terminal, the first terminal is communicatively connected with a second terminal, the first terminal includes a display device, the first terminal is worn on the user's eyes, and the operating system includes: A collection module, used to obtain a current partial iris image of the user; A processing module, configured to determine a current sight focus of the user based on the current partial iris image; It is determined whether the user has a blinking action. If the user has a blinking action, an operation instruction is sent to the second terminal based on the action information of the blinking action and the current sight focus.

6. The operating system according to claim 5, wherein the acquisition module is further used for: The image of the user's eyeball in a preset area is captured from a fixed direction to obtain the current local iris image.

7. The operating system according to claim 5, wherein the processing module is further configured to: Based on the current partial iris image, acquiring a target image feature of the current partial iris image; The current sight focus of the user is determined based on a matching relationship between a preset iris feature and a sight focus, and the target image feature.

8. The operating system according to claim 6, wherein the matching relationship between the preset iris feature and the sight focus is obtained in advance through the following initialization configuration: When the user's eyes scan the boundary of the display area of ​​the display device, based on the acquisition module, the user's iris in the preset area is acquired from the fixed direction to obtain a plurality of boundary iris images; Acquire an iris region image enclosed by the multiple boundary iris images; Dividing the iris region image into grids according to a preset size to obtain a plurality of iris grid images; Acquire iris grid image features of each of the iris grid images; Dividing the display area into grids according to the number of the iris grid images to obtain a plurality of display grids; Obtaining the center coordinates of each of the display grids; Matching each of the iris grid image features with the center coordinates of each of the display grids to obtain a matching relationship between the preset iris features and the sight focus; The mutually matching iris grid image features and the center coordinates of the display grid represent that when the user's line of sight is focused on the center coordinates, the iris features of the current local iris image obtained are the iris grid image features that match the center coordinates.

9. A storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 4 is implemented.

10. A computing device, characterized in that: The computing device comprises a processor, and the processor is configured to implement the method according to any one of claims 1 to 4 when executing a computer program stored in a memory.

Images