Equipment control method and device, electronic equipment and storage medium

Abstract

The invention relates to an equipment control method and device, electronic equipment and a storage medium, and relates to the technical field of electronic information, and the method comprises the following steps: obtaining target iris information of a user, the target iris information comprising a complete shape or an incomplete shape of an iris of the user; and correcting the target iris information to obtain a target shape of the iris of the user, the target shape including a complete shape of the iris. And under the condition that the target shape represents that the sight line of the user directly looks at the acquisition device of the equipment, obtaining a target eye action of the user. And controlling the equipment according to the target eye action. The target iris information is corrected to obtain the complete shape of the iris, whether the sight line of the user directly views the acquisition device can be accurately detected according to the complete shape of the iris, and when the sight line of the user directly views the acquisition device of the equipment, the equipment is controlled according to the target eye action of the user, so that the equipment can be flexibly and accurately controlled.

Description

Technical Field

[0001] The present disclosure relates to the field of electronic information technology, and in particular to a device control method, device, electronic device and storage medium. Background Art

[0002] With the rapid development of science and technology, air conditioners have been widely used in people's daily lives. In related technologies, large movements are usually required to control the air conditioner. For example, remote control requires picking up the remote control and aiming it at the air conditioner, pressing the corresponding control button, and voice control requires making a sound. In environments that need to be kept quiet, such as at night and in baby rooms, remote control or voice control has low flexibility, which reduces the user experience. Summary of the invention

[0003] In order to overcome the problems existing in the related art, the present disclosure provides a control method and apparatus for a device, an electronic device and a storage medium.

[0004] According to a first aspect of an embodiment of the present disclosure, a method for controlling a device is provided, the method comprising:

[0005] Acquire target iris information of a user, wherein the target iris information includes a complete shape or an incomplete shape of an iris of the user;

[0006] Modifying the target iris information to obtain a target shape of the user's iris, wherein the target shape includes a complete shape of the iris;

[0007] In the case where the target shape represents the user's line of sight looking directly at the acquisition device of the device, obtaining the target eye movement of the user;

[0008] The device is controlled according to the target eye movement.

[0009] Optionally, the correcting the target iris information to obtain the target shape of the iris includes:

[0010] Extracting iris lines at the location of the iris in the eye area from the target iris information;

[0011] The iris lines are corrected to obtain the target shape.

[0012] Optionally, the method further comprises:

[0013] The sight direction of the user is determined according to the target shape.

[0014] Optionally, determining the sight direction of the user according to the target shape includes:

[0015] When the target shape is circular, determining that the user's line of sight is directly looking at the acquisition device; or,

[0016] When the target shape is non-circular, it is determined that the user's line of sight is not directly looking at the acquisition device.

[0017] Optionally, when the target shape represents that the user's sight is looking directly at a collection device of the device, acquiring the target eye movement of the user includes:

[0018] When the target iris information matches the preset iris information and the target shape indicates that the user's line of sight is looking directly at the acquisition device, the target eye movement is acquired.

[0019] Optionally, controlling the device according to the target eye movement comprises:

[0020] When the target eye movement matches the preset eye movement and the holding time of the target eye movement is greater than or equal to the preset time, a control operation corresponding to the target eye movement is performed.

[0021] Optionally, the method further comprises:

[0022] determining the position of the user's eyes;

[0023] The step of obtaining the target iris information of the user includes:

[0024] Acquire target eyeball information of the user according to the position of the eyeball, wherein the target eyeball information includes target white of eye information and target iris information;

[0025] The target iris information is extracted from the target eyeball information.

[0026] According to a second aspect of an embodiment of the present disclosure, a control device for a device is provided, the device comprising:

[0027] A first acquisition module is configured to acquire target iris information of a user, wherein the target iris information includes a complete shape or an incomplete shape of an iris of the user;

[0028] a correction module, configured to correct the target iris information to obtain a target shape of the user's iris, wherein the target shape includes a complete shape of the iris;

[0029] A second acquisition module is configured to acquire a target eye movement of the user when the target shape represents that the user's line of sight is looking directly at the acquisition device of the device;

[0030] A control module is configured to control the device according to the target eye movement.

[0031] Optionally, the correction module includes:

[0032] An extraction submodule, configured to extract iris lines at the location of the iris in the eye area from the target iris information;

[0033] The correction submodule is configured to correct the iris lines to obtain the target shape.

[0034] Optionally, the device further comprises:

[0035] The first determination module is configured to determine the sight direction of the user according to the target shape.

[0036] Optionally, the first determining module is configured to:

[0037] When the target shape is circular, determining that the user's line of sight is directly looking at the acquisition device; or,

[0038] When the target shape is non-circular, it is determined that the user's line of sight is not directly looking at the acquisition device.

[0039] Optionally, the second acquisition module is configured to:

[0040] When the target iris information matches the preset iris information and the target shape indicates that the user's line of sight is looking directly at the acquisition device, the target eye movement is acquired.

[0041] Optionally, the control module is configured to:

[0042] When the target eye movement matches the preset eye movement and the holding time of the target eye movement is greater than or equal to the preset time, a control operation corresponding to the target eye movement is performed.

[0043] Optionally, the device further comprises:

[0044] A second determination module is configured to determine the position of the user's eyeball;

[0045] The acquisition submodule is configured as follows:

[0046] Acquire target eyeball information of the user according to the position of the eyeball, wherein the target eyeball information includes target white of eye information and target iris information;

[0047] The target iris information is extracted from the target eyeball information.

[0048] According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

[0049] a memory having a computer program stored thereon;

[0050] A processor is used to execute the computer program in the memory to implement the steps of the method described in the first aspect of the embodiment of the present disclosure.

[0051] According to a fourth aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided, on which computer program instructions are stored. When the program instructions are executed by a processor, the steps of the method described in the first aspect of the embodiment of the present disclosure are implemented.

[0052] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0053] The present disclosure first obtains the target iris information of the user, and corrects the target iris information to obtain the target shape of the user's iris, wherein the target iris information includes the complete shape or incomplete shape of the user's iris, and the target shape includes the complete shape of the iris. When the target shape represents that the user's line of sight is directly looking at the acquisition device, the user's target eye movement is obtained, and the device is controlled according to the target eye movement. The present disclosure obtains the complete shape of the iris by correcting the target iris information, and can accurately detect whether the user's line of sight is directly looking at the acquisition device according to the complete shape of the iris, and when the user's line of sight is directly looking at the acquisition device of the device, the device is controlled according to the user's target eye movement, and the device can be flexibly and accurately controlled.

[0054] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0056] Figure 1 The figure is a flow chart of a method for controlling a device according to an exemplary embodiment.

[0057] Figure 2 is based on Figure 1 A schematic diagram of an iris shape shown in an embodiment.

[0058] Figure 3 The figure is a flowchart of another method for controlling a device according to an exemplary embodiment.

[0059] Figure 4 is based on Figure 3 A schematic diagram of correcting the shape of an iris is shown in an embodiment.

[0060] Figure 5 is based on Figure 3 A schematic diagram of another method of correcting the shape of an iris is shown in an embodiment.

[0061] Figure 6 The figure is a flowchart of another method for controlling a device according to an exemplary embodiment.

[0062] Figure 7 is based on Figure 6 The embodiment shows three views of an eyeball structure.

[0063] Figure 8 is based on Figure 6 A schematic diagram of another iris shape shown in an embodiment.

[0064] Fig. 9 The figure is a flowchart of another method for controlling a device according to an exemplary embodiment.

[0065] Fig.10 The invention is a block diagram of a control device of a device according to an exemplary embodiment.

[0066] Fig.11 The invention is a block diagram of a control device of another apparatus according to an exemplary embodiment.

[0067] Fig.12 The invention is a block diagram of a control device of another apparatus according to an exemplary embodiment.

[0068] Fig.13 The invention is a block diagram of a control device of another apparatus according to an exemplary embodiment.

[0069] Fig.14 It is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0070] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0071] Figure 1 is a flow chart of a method for controlling a device according to an exemplary embodiment. Figure 1 As shown, the method includes the following steps.

[0072] In step S101, target iris information of a user is obtained.

[0073] In step S102, the target iris information is corrected to obtain the target shape of the user's iris, where the target shape includes the complete shape of the iris.

[0074] For example, the devices in the embodiments of the present disclosure may be different types of devices such as air conditioners, mobile phones, tablet computers, desktop computers, intelligent robots, etc. The embodiments of the present disclosure do not limit the specific types of devices.

[0075] After detecting that the user has entered the recognition area of ​​the device, the target iris information of the user can be obtained through the acquisition device of the device. The acquisition device may be an image acquisition device (such as a camera), an infrared acquisition device, etc. For example, when the acquisition device is an image acquisition device, the target iris information may be image information, and when the acquisition device is an infrared acquisition device, the target iris information may be thermal map information. In some embodiments, the acquisition device may include an image acquisition device and an infrared acquisition device. First, the ambient light intensity of the environment where the user device is located can be obtained. When the ambient light intensity is greater than a preset light intensity threshold, the target iris information can be obtained through the image acquisition device. When the ambient light intensity is less than or equal to the preset light intensity threshold, the target iris information can be obtained through the infrared acquisition device to ensure that the user's iris information can be accurately obtained both during the day and at night.

[0076] The target iris information includes the iris information collected by the collection device of the device. The iris information collected by the collection device may be the complete shape of the user's iris or the incomplete shape of the iris. Figure 2 , Figure 2 The middle ellipse is the eyelid part when the eyes are open. When looking at an object with eyes open, different facial orientations will cause the iris to be blocked by the eyelid. The target iris information collected by the acquisition device may only be part of the iris information. The complete shape of the iris cannot be directly obtained based on the target iris information. Therefore, the target iris information can be corrected to obtain the complete shape of the iris, and the user's line of sight direction can be determined based on the complete shape of the iris.

[0077] In some embodiments, in order to ensure recognition accuracy, the iris lines at the position of the iris in the eye area can be first extracted from the target iris information, and then the iris lines can be extracted from the target iris information. Figure 2 The obtained iris lines can be arcs of the outer contour circle of the black area within the elliptical area. Then the iris lines are corrected to obtain the target shape.

[0078] In other embodiments, the target iris information may be corrected first to obtain the corrected iris information, and then the outer contour of the corrected iris information may be extracted as the target shape. The corrected iris information is the information of the complete iris obtained by completing the target iris information. For example, if the target iris information is a part of a circular iris, the corrected iris information may be a complete circular iris; if the target iris information is a part of an ellipse, the corrected iris information may be a complete ellipse. For example, an iris information correction model may be pre-trained, and after the target iris information is obtained, the target iris information may be input into the iris information correction model to obtain the corrected iris information output by the iris information correction model.

[0079] In step S103, when the target shape represents that the user's line of sight is looking directly at the acquisition device of the device, the target eye movement of the user is obtained.

[0080] For example, when the user's line of sight is directly looking at the acquisition device of the device, the complete shape of the iris obtained after the target iris information collected by the acquisition device is corrected is a circle, and when the user's line of sight is not directly looking at the acquisition device, the complete shape of the iris obtained after the target iris information collected by the acquisition device is corrected is non-circular, for example, it can be an ellipse. Therefore, when the target shape is a circle, it can be determined that the user's line of sight is directly looking at the acquisition device, and when the target shape is an ellipse, it can be determined that the user's line of sight is not directly looking at the acquisition device.

[0081] If the user's line of sight is directly looking at the acquisition device, the user's target eye movement can be further obtained. If the user's line of sight is not directly looking at the acquisition device, the user's target iris information can continue to be obtained until the user's line of sight is directly looking at the acquisition device, and then the user's target eye movement is obtained.

[0082] In step S104, the device is controlled according to the target eye movement.

[0083] In other embodiments, the user may pre-set a preset control instruction according to preference. If the user does not set a preset control instruction, the default control instruction may be used as the preset control instruction. After acquiring the target eye movement, the target eye movement may be matched with the preset control instruction. If the match is successful, the control operation corresponding to the target eye movement may be executed. If the match fails, no control operation may be executed, and the execution may be restarted from step S101.

[0084] Taking the device as an air conditioner as an example, the preset control instructions may include: under the premise that both eyes are looking directly at the display screen, if you blink your left eye and keep your right eye still, the temperature will decrease by 1°C; if you blink your right eye and keep your left eye still, the temperature will increase by 1°C. If the target eye action is: blink your left eye and keep your right eye still, the temperature of the air conditioner can be reduced by 1°C; if the target eye action is: blink your right eye and keep your left eye still, the temperature of the air conditioner can be increased by 1°C; if the target eye action is: blink your right eye and keep your left eye still, no control operation may be performed.

[0085] In summary, the present disclosure first obtains the target iris information of the user, and corrects the target iris information to obtain the target shape of the user's iris, wherein the target iris information includes the complete shape or incomplete shape of the user's iris, and the target shape includes the complete shape of the iris. In the case where the target shape represents that the user's line of sight is directly looking at the acquisition device of the device, the target eye movement of the user is obtained, and the device is controlled according to the target eye movement. The present disclosure obtains the complete shape of the iris by correcting the target iris information, and can accurately detect whether the user's line of sight is directly looking at the acquisition device according to the complete shape of the iris, and when the user's line of sight is directly looking at the acquisition device of the device, the device is controlled according to the user's target eye movement, and the device can be flexibly and accurately controlled.

[0086] Figure 3 is a flow chart of another device control method according to an exemplary embodiment. Figure 3 As shown, step S102 can be implemented by the following steps.

[0087] In step S1021, iris lines at the position of the iris in the eye area are extracted from the target iris information.

[0088] In step S1022, the iris lines are corrected to obtain the target shape.

[0089] In some embodiments, the target center of the iris line can be determined based on the curvature of the iris line, and the distance between the intersection of the iris line and the eyelid and the center of the circle is used as the target radius. Then, an arc can be drawn with the target center as the center and the target radius as the radius to complete the portion outside the iris line and obtain the target shape. If the actual shape of the iris is a circle, then the target shape is a circle that is the same as the actual shape of the iris. If the actual shape of the iris is non-circular, such as an ellipse or a straight line, then the target shape is an irregular shape. Accordingly, when the target shape is a circle, it can be determined that the user's line of sight is directly looking at the collection device. When the target shape is a non-circular shape, it can be determined that the user's line of sight is not directly looking at the collection device.

[0090] Reference Figure 4 , Figure 4The dotted ellipse in the figure is the eyelid. Figure 4 The solid lines in (a) are the extracted iris lines. Figure 4 The solid line in (b) is the completed target shape. If the target shape is irregular, it can be determined that the user's line of sight is not directly looking at the collection device. Figure 5 , Figure 5 The dotted ellipse in the figure is the eyelid. Figure 5 The solid lines in (a) are the extracted iris lines. Figure 5 The solid line in (b) is the completed target shape, and the target shape is a circle, so it can be determined that the user's line of sight is directly looking at the acquisition device.

[0091] In other embodiments, the iris lines can be input into a preset trained shape restoration model, and the shape restoration model can correct the iris lines according to the curvature and position of the iris lines, and output a complete target shape. For example, if the iris lines are part of a circle, the target shape can be a complete circle, and if the iris lines are part of an ellipse, the target shape can be a complete ellipse. If the target shape is a circle, it can be determined that the user's line of sight is directly looking at the collection device, and if the target shape is non-circular, it can be determined that the user's line of sight is not directly looking at the collection device.

[0092] Figure 6 is a flow chart of another device control method according to an exemplary embodiment. Figure 6 As shown, the method may further include the following steps.

[0093] In step S105, the user's sight direction is determined according to the target shape.

[0094] For example, Figure 7 It is a three-view diagram of the eyeball structure. Figure 7 As shown, the black area A is the iris (including the pupil), and the white area B is the white of the eye. No matter from which direction or in which way the user looks at the collection device, for example Figure 8 In the cases of straight-looking eyes, right-squinting eyes, looking up eyes, and looking down eyes, as long as the user's sight is directly looking at the acquisition device, the complete iris shape obtained after correcting the collected target iris information is circular. Correspondingly, if the user's sight is not directly looking at the acquisition device, the complete iris shape obtained after correcting the collected target iris information is non-circular. Therefore, the target shape of the iris can be determined by the user's target iris information, and the user's sight direction can be further determined based on the target shape of the iris. When the target shape is circular, it can be determined that the user's sight is directly looking at the acquisition device, and when the target shape is non-circular, it can be determined that the user's sight is not directly looking at the acquisition device.

[0095] According to some embodiments of the present disclosure, one implementation of step S103 may be:

[0096] When the target iris information matches the preset iris information and the target iris information indicates that the user's line of sight is looking directly at the acquisition device, the target eye movement is acquired.

[0097] For example, the collection device can be used to detect in real time whether a user enters the recognition range of the device. When it is detected that the user enters the recognition range, it can be detected whether the eye control function is activated for the first time. If the eye control function is activated for the first time, the user's sample iris information and sample eye movements can be collected, and each sample eye movement can be associated with the control function corresponding to the sample eye movement.

[0098] In some embodiments, sample iris information and sample eye movements of at least one user may be collected, and all collected sample iris information may be used as preset iris information, and all collected sample eye movements may be used as preset eye movements.

[0099] In other embodiments, when collecting the user's sample eye movements, a voice prompt message may be issued so that the user performs corresponding eye movements according to the prompt message, thereby collecting the user's eye movements as sample eye movements. The prompt message may be generated according to a control instruction, and the control instruction may be a default control instruction, or the user may customize it according to their own preferences. Taking the device as an air conditioner as an example, the control instruction may be: under the premise that both eyes are looking directly at the display screen, blink the left eye and keep the right eye still for 1 second, the temperature will drop by 1°C, blink the right eye and keep the left eye still for 1 second, the temperature will rise by 1°C. Correspondingly, the prompt message may be "look directly at the display screen, blink the left eye and keep the right eye still for 1 second, blink the right eye and keep the left eye still for 1 second".

[0100] If the eye control function is not turned on for the first time, the step of collecting sample iris information and sample eye movements can be skipped, the user's target iris information is obtained, and the target iris information is compared with the preset iris information to determine whether the target iris information matches the preset iris information. If the similarity between the target iris information and the preset iris information is greater than or equal to the first preset similarity threshold, it can be considered that the target iris information matches the preset iris information; if the similarity between the target iris information and the preset iris information is less than the first preset similarity threshold, it can be considered that the target iris information does not match the preset iris information.

[0101] If the target iris information matches the preset iris information, and the target iris information indicates that the user's line of sight is looking directly at the collection device, the target eye movement is further acquired. If the following three situations occur, the step of acquiring the target eye movement may not be performed, and the execution starts again from step S101. Situation 1: The target iris information does not match the preset iris information, and the target iris information indicates that the user's line of sight is looking directly at the collection device; Situation 2: The target iris information matches the preset iris information, and the target iris information indicates that the user's line of sight is not looking directly at the collection device; Situation 3: The target iris information does not match the preset iris information, and the target iris information indicates that the user's line of sight is not looking directly at the collection device.

[0102] According to some other embodiments of the present disclosure, an implementation of step S104 may be:

[0103] When the target eye movement matches the preset eye movement and the holding time of the target eye movement is greater than or equal to the preset time, a control operation corresponding to the target eye movement is performed.

[0104] For example, after obtaining the user's target eye movement, it is possible to determine whether the target eye movement matches the preset control instruction based on the degree of match between the target eye movement and the preset eye movement, as well as the duration of the target eye movement, and trigger the corresponding control operation when the target eye movement matches the preset control instruction.

[0105] In some embodiments, the target eye movement can be compared with the preset eye movement to determine whether the target eye movement matches the preset eye movement. If the similarity between the target eye movement and the preset eye movement is greater than or equal to the second preset similarity threshold, it can be considered that the target eye movement matches the preset eye movement. If the similarity between the target eye movement and the preset eye movement is less than the second preset similarity threshold, it can be considered that the target eye movement does not match the preset eye movement. The holding time of the target eye movement can also be obtained. If the target eye movement matches the preset eye movement, and the holding time of the target eye movement is greater than or equal to the preset time, it can be determined that the target eye movement matches the preset control instruction, so as to execute the control operation corresponding to the target eye movement.

[0106] Taking the preset control instruction of "under the premise that both eyes are looking directly at the display screen, blink the left eye and keep the right eye still for 1s, the temperature will drop by 1°C, blink the right eye and keep the left eye still for 1s, the temperature will rise by 1°C" as an example, if the target eye action is: both eyes look directly at the display screen, blink the left eye and keep the right eye still for 1s, then the temperature can be lowered by 1°C; if the target eye action is: both eyes look directly at the display screen, blink the right eye and keep the left eye still for 1s, then the temperature can be raised by 1°C; if the target eye action is: both eyes look directly at the display screen, blink the right eye and keep the left eye still for 1s, then the temperature can be raised by 1°C; if the target eye action is: both eyes look directly at the display screen, blink the right eye and keep the left eye still for 0.5s, then the control operation may not be performed; if the target eye action is: both eyes look directly at the display screen and both eyes blink at the same time, then the control operation may not be performed.

[0107] Fig. 9 is a flow chart of another device control method according to an exemplary embodiment. Fig. 9 As shown, the method also includes:

[0108] In step S106 , the position of the user's eyeball is determined.

[0109] Accordingly, step S101 can be implemented by the following steps:

[0110] In step S1011, target eye information of the user is obtained according to the position of the eye.

[0111] In step S1012, target iris information is extracted from the target eyeball information.

[0112] For example, when it is detected that the user has entered the recognition range of the device, the user's head can be first located by the acquisition device, and then the user's eyes can be further located to determine the position of the user's eyeballs. In some embodiments, the user's target eyeball information can be obtained based on the position of the user's eyeballs, wherein the target eyeball information can include target eye white information and target iris information. Since the color difference and temperature difference between the iris and the eye white are large, whether the target eyeball information is image information collected by the image acquisition device or thermal map information collected by the infrared acquisition device, the target eye white information and the target iris information can be accurately and effectively separated, thereby extracting the target iris information from the target eyeball information.

[0113] In summary, the present disclosure first obtains the target iris information of the user, and corrects the target iris information to obtain the target shape of the user's iris, wherein the target iris information includes the complete shape or incomplete shape of the user's iris, and the target shape includes the complete shape of the iris. In the case where the target shape represents that the user's line of sight is looking directly at the acquisition device, the target eye movement of the user is obtained, and the device is controlled according to the target eye movement. The present disclosure obtains the complete shape of the iris by correcting the target iris information, and can accurately detect whether the user's line of sight is looking directly at the acquisition device according to the complete shape of the iris, and when the user's line of sight is looking directly at the acquisition device of the device, the device is controlled according to the user's target eye movement, and the device can be flexibly and accurately controlled.

[0114] Fig.10 is a block diagram of a control device of a device according to an exemplary embodiment. Fig.10 As shown, the device 200 includes:

[0115] The first acquisition module 201 is configured to acquire target iris information of the user, where the target iris information includes the complete shape or incomplete shape of the user's iris.

[0116] The correction module 202 is configured to correct the target iris information to obtain the target shape of the user's iris, where the target shape includes the complete shape of the iris.

[0117] The second acquisition module 203 is configured to acquire the user's target eye movement when the target shape represents that the user's line of sight is looking directly at the acquisition device.

[0118] The control module 204 is configured to control the device according to the target eye movement.

[0119] Fig.11 is a block diagram of a control device of another device according to an exemplary embodiment. Fig.11 As shown, the correction module 202 includes:

[0120] The extraction submodule 2021 is configured to extract iris lines at the position of the iris in the eye area from the target iris information.

[0121] The correction submodule 2022 is configured to correct the iris lines to obtain a target shape.

[0122] Fig.12 is a block diagram of a control device of another device according to an exemplary embodiment. Fig.12 As shown, the device 200 also includes:

[0123] The first determination module 205 is configured to determine the user's sight direction according to the target shape.

[0124] In some embodiments, the first determination module 205 is configured to:

[0125] When the target shape is circular, it is determined that the user's line of sight is directly looking at the collection device. Or,

[0126] When the target shape is non-circular, it is determined that the user's line of sight is not directly looking at the acquisition device.

[0127] In some other embodiments, the second acquisition module 203 is configured to:

[0128] When the target iris information matches the preset iris information and the target shape indicates that the user's line of sight is looking directly at the acquisition device, the target eye movement is acquired.

[0129] In some other embodiments, the control module 204 is configured to:

[0130] When the target eye movement matches the preset eye movement and the holding time of the target eye movement is greater than or equal to the preset time, a control operation corresponding to the target eye movement is performed.

[0131] Fig.13 is a block diagram of a control device of another device according to an exemplary embodiment. Fig.13 As shown, the device 200 also includes:

[0132] The second determination module 206 is configured to determine the position of the user's eyeball.

[0133] Accordingly, the first acquisition module 201 is configured as follows:

[0134] The target eyeball information of the user is obtained according to the position of the eyeball, and the target eyeball information includes target white of eye information and target iris information.

[0135] Extract target iris information from target eyeball information.

[0136] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0137] In summary, the present disclosure first obtains the target iris information of the user, and corrects the target iris information to obtain the target shape of the user's iris, wherein the target iris information includes the complete shape or incomplete shape of the user's iris, and the target shape includes the complete shape of the iris. In the case where the target shape represents that the user's line of sight is looking directly at the acquisition device, the target eye movement of the user is obtained, and the device is controlled according to the target eye movement. The present disclosure obtains the complete shape of the iris by correcting the target iris information, and can accurately detect whether the user's line of sight is looking directly at the acquisition device according to the complete shape of the iris, and when the user's line of sight is looking directly at the acquisition device of the device, the device is controlled according to the user's target eye movement, and the device can be flexibly and accurately controlled.

[0138] The present disclosure also provides a computer-readable storage medium having computer program instructions stored thereon, and when the program instructions are executed by a processor, the steps of the control method of the device provided by the present disclosure are implemented.

[0139] Fig.14 3 is a block diagram of an electronic device according to an exemplary embodiment. For example, the electronic device 300 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0140] Reference Fig.14 , the electronic device 300 may include one or more of the following components: a processing component 302 , a memory 304 , a power component 306 , a multimedia component 308 , an audio component 310 , an input / output interface 312 , a sensor component 314 , and a communication component 316 .

[0141] The processing component 302 generally controls the overall operation of the electronic device 300, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 302 may include one or more processors 320 to execute instructions to complete all or part of the steps of the control method of the above device. In addition, the processing component 302 may include one or more modules to facilitate the interaction between the processing component 302 and other components. For example, the processing component 302 may include a multimedia module to facilitate the interaction between the multimedia component 308 and the processing component 302.

[0142] The memory 304 is configured to store various types of data to support operations on the electronic device 300. Examples of such data include instructions for any application or method operating on the electronic device 300, contact data, phone book data, messages, pictures, videos, etc. The memory 304 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0143] The power supply component 306 provides power to the various components of the electronic device 300. The power supply component 306 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 300.

[0144] The multimedia component 308 includes a screen that provides an output interface between the electronic device 300 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 308 includes a front camera and / or a rear camera. When the electronic device 300 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0145] The audio component 310 is configured to output and / or input audio signals. For example, the audio component 310 includes a microphone (MIC), and when the electronic device 300 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 304 or sent via the communication component 316. In some embodiments, the audio component 310 also includes a speaker for outputting audio signals.

[0146] The input / output interface 312 provides an interface between the processing component 302 and the peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0147] The sensor assembly 314 includes one or more sensors for providing various aspects of status assessment for the electronic device 300. For example, the sensor assembly 314 can detect the open / closed state of the electronic device 300, the relative positioning of components, such as the display and keypad of the electronic device 300, and the sensor assembly 314 can also detect the position change of the electronic device 300 or a component of the electronic device 300, the presence or absence of user contact with the electronic device 300, the orientation or acceleration / deceleration of the electronic device 300, and the temperature change of the electronic device 300. The sensor assembly 314 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 314 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 314 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0148] The communication component 316 is configured to facilitate wired or wireless communication between the electronic device 300 and other devices. The electronic device 300 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 316 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 316 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0149] In an exemplary embodiment, the electronic device 300 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to execute the control methods of the above-mentioned devices.

[0150] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 304 including instructions, and the instructions can be executed by a processor 320 of an electronic device 300 to complete the control method of the device. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0151] In another exemplary embodiment, a computer program product is also provided. The computer program product includes a computer program executable by a programmable device, and the computer program has a code portion for executing the control method of the above-mentioned device when executed by the programmable device.

[0152] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the present disclosure. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered as exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0153] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method for controlling a device, characterized in that: The method comprises: Acquire target iris information of a user, wherein the target iris information includes a complete shape or an incomplete shape of an iris of the user; Correcting the target iris information to obtain a target shape of the iris, wherein the target shape includes a complete shape of the iris; In the case where the target shape represents the user's line of sight looking directly at the acquisition device of the device, obtaining the target eye movement of the user; The device is controlled according to the target eye movement.

2. The method according to claim 1, characterized in that The correcting the target iris information to obtain the target shape of the iris includes: Extracting iris lines at the location of the iris in the eye area from the target iris information; The iris lines are corrected to obtain the target shape.

3. The method according to claim 1, characterized in that The method further comprises: The sight direction of the user is determined according to the target shape.

4. The method according to claim 3, characterized in that Determining the user's sight direction according to the target shape includes: When the target shape is circular, determining that the user's line of sight is directly looking at the acquisition device; or, When the target shape is non-circular, it is determined that the user's line of sight is not directly looking at the acquisition device.

5. The method according to claim 1, characterized in that In the case where the target shape represents that the user's line of sight is looking directly at the acquisition device of the device, obtaining the target eye movement of the user includes: When the target iris information matches the preset iris information and the target shape indicates that the user's line of sight is looking directly at the acquisition device, the target eye movement is acquired.

6. The method according to claim 1, characterized in that The controlling the device according to the target eye movement comprises: When the target eye movement matches the preset eye movement and the holding time of the target eye movement is greater than or equal to the preset time, a control operation corresponding to the target eye movement is performed.

7. The method according to any one of claims 1 to 6, characterized in that The method further comprises: determining the position of the user's eyes; The step of obtaining the target iris information of the user includes: Acquire target eyeball information of the user according to the position of the eyeball, wherein the target eyeball information includes target white of eye information and target iris information; The target iris information is extracted from the target eyeball information.

8. A control device for an equipment, characterized in that: The device comprises: A first acquisition module is configured to acquire target iris information of a user, wherein the target iris information includes a complete shape or an incomplete shape of an iris of the user; a determination module configured to modify the target iris information to obtain a target shape of the user's iris, wherein the target shape includes a complete shape of the iris; A second acquisition module is configured to acquire a target eye movement of the user when the target shape represents that the user's line of sight is looking directly at the acquisition device of the device; A control module is configured to control the device according to the target eye movement.

9. An electronic device, characterized in that: include: a memory having a computer program stored thereon; A processor, configured to execute the computer program in the memory to implement the steps of the method according to any one of claims 1 to 7.

10. A computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the program instructions are executed by a processor, the steps of the method described in any one of claims 1 to 7 are implemented.

Images