Method for detecting eye activity of a spectacle user

Abstract

Embodiments of the present disclosure generally relate to methods for detecting eye activity of a user of eyewear. In one embodiment, a method for detecting activity of a first eye of a user using eyewear includes acquiring, by a controller, first electrostatic charge variation signals indicative of a difference between electrostatic charge variations detected by a first electrode and a second electrode; verifying, by the controller, a presence of one or more blink patterns in the first electrostatic charge variation signals, each blink pattern being indicative of a respective click or a respective blink, the click being a voluntary blink of the first eye and the blink being an involuntary blink of the first eye; determining, by the controller, whether a first condition is verified for each blink pattern when the first electrostatic charge variation signals have the one or more blink patterns; detecting, by the controller, the respective blink when the first condition is not verified; and detecting, by the controller, the respective click when the first condition is verified.

Description

[0001] Cross-references to related applications

[0002] This application claims the benefit of Italian application No. 1020210000027866, filed on October 29, 2021, which is incorporated herein by reference. Technical Field

[0003] This invention relates to a method for detecting eye activity in eyeglass users. In particular, it relates to a detection method based on the use of electrodes configured to detect changes in electrostatic charge generated by eye movement. The invention also relates to eyeglasses including electrodes and a control unit configured to implement the detection method, and a computer program product thereof. Background Technology

[0004] As is well known, electrooculography (EOG) is a technique used to measure the angular-retinal potential (CRP) that exists between the anterior part (e.g., including the cornea) and the posterior part (e.g., including the retina) of the human eye. In fact, the eye acts as a dipole, with the anterior pole at the cornea being positive and the posterior pole at the retina being negative.

[0005] EOG is a commonly used measurement method because CRP is higher than the potentials involved in electroencephalography (EEG signals), and because the eyes are located outside the skull and therefore there are no skeletal structures to attenuate the generated electrical signals. To measure eye movements, pairs of electrodes are placed around the eyes and in contact with the facial skin; for example, a pair of electrodes is placed above and below the eyes, and a pair of electrodes is placed on the left and right sides of the eyes.

[0006] More specifically, changes in corneal pulse rate (CRP) detected by electrodes are generated as the eye rotates around its own center of rotation (e.g., substantially at the center of the same eyeball). Specifically, when the eyelids close, the cornea moves in one direction, and when the eyelids open, the cornea moves in the opposite direction, generating CRP changes that are clearly identifiable and correlated with blinking. The signal generated by blinking typically has a low frequency, for example, between about 1 Hz and about 13 Hz.

[0007] Blinking has been shown to be associated with a person's psychological state, particularly cognitive states such as relaxation or attention. For example, inter-blink interval (IEBI) is a known and reliable biomarker that indicates the degree to which a person is focused on an activity that requires visual attention, such as watching a movie or performing physical labor. Summary of the Invention

[0008] Eye movement detection (such as blinking) can be associated with applications aimed at determining a user's attention level, risks arising from sleep and fatigue, visual impairment, or neurodegenerative diseases, or more simply, automatically activating functions in mobile and portable devices. In fact, eye movement detection is relevant to applications such as smart glasses, where understanding the wearer's gaze direction is crucial, as is acquiring user-provided commands (e.g., blinking). For example, eye tracking can activate advanced functions for adjusting camera lens focus or quick-read functions such as zooming and panorama operation.

[0009] However, this known measurement technique has the following problems: measurement noise caused by 50Hz or 60Hz AC power in the measurement environment; noise generated by head and body movements during measurement; artifacts in measurement caused by the operation of electrical equipment near the electrodes; and measurement errors caused by the electrodes sliding on the skin due to facial or neck muscle contractions or due to sweat and eyelid blinking.

[0010] The embodiments provide a method, glasses, and computer program product for detecting eye activity of glasses users that overcomes the shortcomings of the prior art. Attached Figure Description

[0011] To better understand the present invention, preferred embodiments are now described with reference to the accompanying drawings, which are non-limiting examples, in which:

[0012] Figure 1 This is a perspective view of a pair of glasses including a first electrostatic charge change sensor according to one embodiment;

[0013] Figure 2 It is shown schematically. Figure 1 A diagram of the frame of the glasses;

[0014] Figure 3 The illustration schematically shows the user's eye in three different positions, as exemplarily shown. Figure 1 Two electrodes in one of the first electrostatic charge change sensors;

[0015] Figure 4 These are perspective views of different embodiments of eyeglasses including a first electrostatic charge change sensor and a second electrostatic charge change sensor;

[0016] Figure 5 According to one embodiment, it is used for detection Figure 1 A flowchart illustrating the methods of eye activity for users of eyeglasses;

[0017] Figures 6-9 and Figure 13 Through Figure 1 and Figure 4The electrical signal graphs acquired by the first and second electrostatic charge change sensors; and

[0018] Figures 10-12 It is used for detection Figure 1 or Figure 4 The corresponding block diagrams of the methods for the eye activities of eyeglass users and other embodiments. Detailed Implementation

[0019] Figure 1 A pair of glasses 10 (not shown) that can be worn on a user's face is illustrated. Specifically, the glasses 10 includes a frame 12 (optional) having a first support portion 12a and a second support portion 12b (e.g., ring-shaped), which respectively support and / or accommodate a first lens 14a and a second lens 14b. For example, the glasses 10 may be prescription glasses or sunglasses, or smart glasses.

[0020] The glasses 10 also includes a main control unit 21 and one or more first electrostatic charge change sensors, which are electrically coupled to the main control unit 21 and fixed to the frame 12, and are thus positioned near the user's eyes when the user wears the glasses 10.

[0021] According to an exemplary embodiment, the main control unit 21 (such as a microprocessor, microcontroller, or dedicated computing unit) includes a processing unit 21a and a data storage unit 21b (such as a memory, e.g., non-volatile memory) coupled to each other, the data storage unit 21b being used to store acquired data. For example, the main control unit 21 is integrated into the frame 12.

[0022] The following examples are considered and as follows Figure 1 In the illustrated embodiment, a first left electrostatic charge change sensor and a first right electrostatic charge change sensor (e.g., supported by a first support portion 12a and a second support portion 12b) are exemplary considerations. Figure 1 (as shown by the corresponding reference numerals 20a and 20b); however, the number of first electrostatic charge change sensors may be smaller (e.g., only the first left electrostatic charge change sensor 20a) or larger (e.g., two or more first electrostatic charge change sensors for each of the support portions 12a and 12b).

[0023] In particular, such as Figure 2 As shown, each first electrostatic charge change sensor 20a, 20b includes a sensor control unit 15 and two or more electrodes spaced apart from each other, fixed to the frame 12, and electrically coupled to the sensor control unit 15. In the embodiments exemplified below, as Figure 1 and Figure 2As shown, an exemplary consideration is given to the first and second electrodes of each first electrostatic charge change sensor, indicated by corresponding reference numerals 22a and 22b; however, the number of electrodes in each first electrostatic charge change sensor 20a, 20b may be greater (e.g., four electrodes).

[0024] In use, each electrode 22a, 22b detects the corresponding change in electrostatic charge caused by the user's eye movement, as described below, and generates a corresponding detection signal S indicating the aforementioned change in electrostatic charge. R .

[0025] In detail, each electrode 22a, 22b may have a metallic surface, or be completely covered by a dielectric material, or even have a metallic surface disposed beneath the housing of the glasses 10. In any case, during use, each electrode 22, 22b is electrostatically coupled to the environment in which the glasses 10 is located, more specifically to the user's eye closest to the aforementioned electrodes 22a, 22b, in order to detect changes in the induced electrostatic charge.

[0026] According to one embodiment, each electrode 22a, 22b is integrated into the housing of the glasses 10 and includes, for example, conductive tracks formed on or within a semiconductor material wafer included in the glasses 10. According to different embodiments, each electrode 22a, 22b is a metallic element present in the glasses 10. Optionally, when considering possible use of the glasses 10 in humid environments (more specifically, underwater), each electrode 22a, 22b is inserted into a waterproof housing, or in any case shielded by one or more protective layers to prevent direct contact between the electrodes 22a, 22b and water or humidity: in this case, the waterproof housing or one or more protective layers are made of a material (e.g., a dielectric or insulating material, such as plastic) such that it does not shield against static charges generated by the user's eyes that need to be acquired by the electrodes 22a, 22b. As those skilled in the art will appreciate, other embodiments are also possible, such that the electrodes 22a, 22b are electrostatically coupled to the user's eyes during use.

[0027] Furthermore, according to an exemplary embodiment, the sensor control unit 15 (e.g., a microprocessor, microcontroller, or dedicated computing unit) includes the following components coupled to each other: an interface unit 17 (optional and of a known type) electrically coupled to electrodes 22a and 22b to interface electrodes 22a and 22b with the sensor control unit 15 (e.g., the interface unit 17 includes an amplifier circuit and / or an analog-to-digital converter (ADC), not shown); and a corresponding processing unit 16 for processing the detection signal S acquired through electrodes 22a and 22b (and optionally processed through the interface unit 17). R; and a corresponding data storage unit 18 (e.g., a memory, such as a non-volatile memory) for storing the acquired data. For example, the sensor control unit 15 is integrated into the corresponding electrostatic charge change sensors 20a, 20b.

[0028] Specifically, each sensor control unit 15 is configured to process (in a manner known per se, e.g., by amplification and conversion to digital) the corresponding detection signal S acquired through electrodes 22a and 22b. R And generate the corresponding first static charge change signal S Q,1 The first static charge change signal S Q,1 The detection signal S acquired through the first electrode 22a and the second electrode 22b indicates R The difference between them. In particular, the first static charge change signal S Q,1 It is a digital type and indicates the difference between the changes in static charge detected by electrodes 22a and 22b.

[0029] According to one embodiment, the first electrode 22a and the second electrode 22b of each first electrostatic charge change sensor 20a, 20b are spaced apart from each other. Specifically, the electrodes 22a and 22b have a first mutual distance D1 and are, for example, arranged on corresponding opposite ends of corresponding support portions 12a, 12b (e.g., they are diametrically opposite to each other relative to the corresponding annular support portions 12a, 12b). For example, the first electrode 22a and the second electrode 22b are aligned with each other along a first axis 19, which connects the first lens 14a and the second lens 14b (e.g., connecting the centers, such as the centroids, of the lenses 14a, 14b).

[0030] In other words, such as Figure 3 As shown, the arrangement of the first electrode 22a and the second electrode 22b enables them to detect the movement of the user's eyes when the user wears glasses 10 (e.g., ...). Figure 3 As indicated by reference numeral 30 in the accompanying drawings, it includes the eyelid and the eyeball extending within the orbit, and, for example, the opposite side facing the cornea ( Figure 3 (Referring to 30a in the attached figure), and more specifically, the opposite side facing the pupil.

[0031] according to Figure 4 In the illustrated embodiment, the glasses 10 further include one or more second electrostatic charge change sensors, which are similar to the first electrostatic charge change sensors 20a and 20b, and therefore will not be described further. Exemplary considerations are given below, and as... Figure 4 In the illustrated embodiment, a second left electrostatic charge change sensor and a second right electrostatic charge change sensor, respectively carried by a first lens 14a and a second lens 14b, are exemplary considerations (e.g., Figure 1(as indicated by the corresponding reference numerals 20c and 20d); however, the number of second electrostatic charge change sensors can be smaller or larger.

[0032] Instead of the first electrode 22a and the second electrode 22b, each of the second electrostatic charge change sensors 20c, 20d includes a third electrode 22c and a fourth electrode 22d, respectively, which are spaced apart from and similar to the first electrode 22a and the second electrode 22b (and therefore will not be described in detail). Specifically, the third electrode 22c and the fourth electrode 22d are radially inward relative to the centers of the corresponding lenses 14a, 14b relative to the first electrode 22a and the second electrode 22b. For example, the third electrode 22c and the fourth electrode 22d have a second mutual distance D2 less than a first mutual distance D1, and are, for example, fixed to the corresponding lenses 14a, 14b so as to face the user's eye 30 when the user wears the glasses 10. For example, the third electrode 22c and the fourth electrode 22d are aligned with each other along a first axis 19 and with the first electrode 22a and the second electrode 22b, such that the third electrode 22c and the fourth electrode 22d are sandwiched between the first electrode 22a and the second electrode 22b. In other words, as... Figure 4 As shown, when the user wears glasses 10, the third electrode 22c and the fourth electrode 22d are arranged to detect the movement of the eye 30, for example, one facing the caruncle and the other facing the other end of the eye 30 relative to the caruncle. In this embodiment, similar to what was previously described for the first electrode 22a and the second electrode 22b, each sensor control unit 15 is also configured to process (in a manner known per se, e.g., by amplification and conversion to digital) the corresponding detection signal S acquired by the third electrode 22c and the fourth electrode 22d. R And generate a detection signal S indicating the signal obtained through the third electrode 22c and the fourth electrode 22d. R The corresponding second electrostatic charge change signal S between the differences Q,2 Specifically, the second static charge change signal S Q,2 It is a digital type and indicates the difference between the changes in static charge detected by the third electrode 22c and the fourth electrode 22d.

[0033] Generally, since the eye 30 operates as an electric dipole, with a positive pole at the cornea 30a and a negative pole at the retina (e.g., ... Figure 3As shown by reference numeral 30b in the attached figure, the movement of the eye 30 generates changes in the electric field in the environment surrounding the eye 30, and these changes in the electric field cause changes in induced static charge detectable by electrodes 22a and 22b (and by electrodes 22c and 22d, if any). Since electrodes 22a and 22b (and by electrodes 22c and 22d, if any) are physically and electrically separated from each other, they are at different distances relative to the cornea 30a and the retina 30b, and therefore detect static charge changes that are different from each other. This allows for differential detection of static charge changes, as described below. This allows for the detection of both eye movement and the user's eyelash blink (or eyelid blink) without blinking, since it has been shown that each blink corresponds to a corresponding static charge change indicating a blink.

[0034] More specifically, it has been confirmed that these movements of the eye 30 during blinking occur in each of the first electrostatic charge change signals S. Q,1 Two corresponding peaks are generated during a blink period lasting less than approximately 50 ms, these peaks having relative signs with respect to the baseline of the signal. Specifically, by exemplarily considering a zero baseline, a first positive peak and a second negative peak may be present depending on the direction of eye movement 30 and the positions of the first electrode 22a and the second electrode 22b, and vice versa. These first and second consecutive peaks during the blink period define a blink scheme (or pattern) indicating a blink (voluntary or involuntary, as better discussed below). Examples of such blink patterns are shown in... Figures 6-7C This is provided in [the document], and is described in a better way below.

[0035] Conversely, without fully closing the eyelids, the movement of the eye 30 is related to the second electrostatic charge change signal S. Q,2 Corresponding peaks are generated, and these peaks separate from each other over time. Specifically, the second electrostatic charge change signal S is generated based on the direction of eye movement 30 and the positions of the third electrode 22c and the fourth electrode 22d. Q,2 Such a peak value can be relative to the second static charge change signal S Q,2 The corresponding baseline is positive or negative (the latter is also called a valley) (for example, here it is assumed to be equal to 0). The second electrostatic charge change signal S Q,2 Examples of such peaks in Figure 9 This is provided in [the document], and is described in a better way below.

[0036] In use, the main control unit 21 implements the method 50 for detecting the activity (i.e., movement or state) of the user's eyes 30.

[0037] An embodiment of detection method 50 is as follows: Figure 5 As shown, and now we will discuss it.

[0038] The detection method 50 is executed iteratively to update information about the user's eye activity 30 in real time. For simplicity, the iteration of the detection method 50, also known as the current iteration, is described below.

[0039] In step S10 of detection method 50, the first static charge change signal S is acquired by the first static charge change sensors 20a and 20b. Q,1 In the following text, the first static charge change signal S acquired by the first left static charge change sensor 20a is described. Q,1 Use the figure label S. Q,1a This indicates that the first static charge change signal S obtained by the first right static charge change sensor 20b... Q,1 Use the figure label S. Q,1b This indicates that, specifically, the first static charge change signal S is acquired through a rolling buffer. Q,1a S Q,1b Specifically, in each iteration, the first static charge change signal S is acquired within the corresponding time window. Q,1a S Q,1b For example, the predefined duration of this time window is equal to a time window period longer than the blink time (e.g., equal to several thousand ms, for example, between approximately 900 ms and approximately 2500 ms, for example, equal to 1800 ms); in other words, at each iteration, the first static charge change signal S with a duration equal to the time window period is considered. Q,1a S Q,1b In each iteration, each first static charge change signal S Q,1a S Q,1b The oldest sample was deleted, and each first static charge change signal S Q,1a S Q,1b New samples are stored in the buffer.

[0040] More specifically, in the current iteration, the detection signal S of the first electrode 22a and the second electrode 22b of the first electrostatic charge change sensors 20a and 20b is generated. R And according to the detection signal S R Calculate the corresponding first static charge change signal S Q,1a S Q,1b (In particular, each first static charge change signal S) Q,1a S Q,1b The detection signal S of the first electrode 22a and the second electrode 22b of the corresponding first electrostatic charge change sensors 20a and 20b is equal to or proportional to the detection signal S of the first electrode 22a and the second electrode 22b of the corresponding first electrostatic charge change sensors 20a and 20b. R (Differences).

[0041] In step S12 (optional and immediately following step S10), the first static charge change signal S... Q,1a and SQ,1b Filtering is performed to remove any contribution from alternating current that may be present in the environment surrounding the glasses 10. In fact, if present, the alternating current generates a corresponding change in static charge in the environment, which can be detected by the first static charge change sensors 20a and 20b at the alternating current frequency (i.e., 50Hz or 60Hz, depending on the country) in the first static charge change signal S. Q,1a S Q,1b The corresponding peak is generated in the frequency domain for detection. Specifically, the filter performed can be a low-pass filter with a cutoff frequency lower than a first threshold frequency (e.g., equal to about 25 Hz), a band-pass filter with a lower cutoff frequency higher than a second threshold frequency (lower than the first threshold frequency and, for example, equal to about 1 Hz) and a higher cutoff frequency lower than the second threshold frequency and, for example, equal to 20 Hz, or a notch filter with a lower cutoff frequency lower than the second threshold frequency and, for example, equal to 20 Hz and a higher cutoff frequency higher than a third threshold frequency (greater than the first threshold frequency and, for example, equal to about 80 Hz).

[0042] In step S14 (optional and immediately following step S12), the first static charge change signal S is processed. Q,1a and S Q,1b To remove their offset, and in detail subtract their corresponding baseline (i.e., reference value, which is not necessarily constant over time, corresponding to the first electrostatic charge change signal S) from each of them. Q,1a and S Q,1b This is generated around it; for example, the average value). In this way, the first electrostatic charge change signal S can then be considered. Q,1a and S Q,1b The change relative to the zero baseline, without taking into account its possible offset.

[0043] In step S16, which follows step S14, the first electrostatic charge change signal S is processed in a manner known per se. Q,1a and S Q,1b This is used to identify any peak value (i.e., a positive peak or a negative peak, the latter also referred to as a trough). Specifically, in step S16, the first electrostatic charge change signal S is identified. Q,1a and S Q,1b The number of peaks (if any), and for each peak, the corresponding maximum value and the corresponding time position (or moment) of that maximum value. Further details regarding the identification pattern of these peaks can be found in the Italian patent document identified by the applicant's reference number 102021000012665. Alternatively, consider the first electrostatic charge change signal S. Q,1a and S Q,1b The portion of the signal containing values ​​greater than a threshold (e.g., a predefined value, such as approximately 200 LSB or equal to the corresponding first static charge change signal S within the considered time window) Q,1a SQ,1b (Approximately 10% of the maximum value).

[0044] In step S18, which follows step S16, the first static charge change signal S is determined. Q,1a and S Q,1b Whether the blinking pattern condition is verified. Specifically, determine whether it is in the first electrostatic charge change signal S. Q,1a and S Q,1b At least one blinking pattern was detected in at least one of the signals. In other words, the first electrostatic charge change signal S was determined. Q,1a and S Q,1b Is the sum of the number of blink patterns non-zero?

[0045] If the blink pattern condition fails to pass validation (i.e., the above sum equals zero), the current iteration of detection method 50 ends, and the method returns to step S10 to process the first electrostatic charge change signal S in a subsequent time window. Q,1a and S Q,1b .

[0046] If the condition for the blinking pattern is verified (i.e., the sum of the above is greater than zero), the detection method 50 proceeds to step S20.

[0047] In step S20, immediately following step S18, the first electrostatic charge change signal S detected in the current iteration is verified. Q,1a and S Q,1b Whether the blinking pattern indicates the first condition of the user's eye 30 (i.e., whether a voluntary blink has occurred, hereinafter also referred to as an eye click or more simply a click). More specifically, for the first electrostatic charge change signal S Q,1a and S Q,1b For each pair of consecutive blink patterns, the first condition is verified if the relative time distance between the two blink patterns is greater than a first threshold period (the first threshold period is less than the time window period and greater than the blink period) (e.g., it is equal to several hundred milliseconds, for example, between approximately 100 ms and approximately 800 ms, and for example, equal to 500 ms). For example, the relative time distance between reference points of the two blink patterns is calculated similarly to the reference click time distance described below. Therefore, when verifying the first condition, a click is detected in the current iteration.

[0048] Step S22 following step S20 is a decision block, which is used to verify whether the first condition was detected in step S20.

[0049] In this embodiment, if the first condition fails to pass verification (i.e., no click is detected), the detection method 50 proceeds to step S24.

[0050] If the first condition is verified (i.e., a click is detected), the detection method 50 proceeds to step S32.

[0051] Step S24 involves a second condition for the user's eyes 30 (i.e., involuntary blinking, hereinafter also referred to as eye blinking or more simply blinking). Generally, the duration of a blink is shorter than the duration of a click because it occurs involuntarily and involves both eyes simultaneously (unlike a click performed with only one eye). In this embodiment, the first and second conditions are interchangeable, and therefore, the second condition is detected when the first condition is not detected.

[0052] In step S24, the known type of IEBI ("blink interval") parameter is therefore determined based on the first electrostatic charge change signal S. Q,1a and S Q,2a In particular, based on the first electrostatic charge change signal S Q,1a and S Q,1b The peak value is used for calculation. The IEBI parameter indicates the blink frequency of the user's eye over 30 seconds, specifically indicating the average distance between consecutive blinks over a predefined time period (e.g., 1 minute).

[0053] In particular, Figure 6 The first static charge change signal S is shown in the time window of the current iteration. Q,1a and S Q,1b And the first electrostatic charge change signal S that limits blinking Q,1a S Q,1b Two blinking patterns. Specifically, each blink is caused by a first blinking pattern P1 (exemplarily S) from one of the first electrostatic charge change signals. Q,1a ) and another first electrostatic charge change signal, the second blink pattern P2 (in this case, S) Q,1b The definition is as follows: A blink pattern P1 and a blink pattern P2 are separated by a distance less than a first threshold time interval. For example, the maximum value M of the first peak of the first blink pattern P1 and the second blink pattern P2 under consideration. K1 and M K2 (exist Figure 6 The time position t is indicated by the reference numerals K1 and K2 in the attached diagram. MK1 and t MK2 The first time interval T1 between each other is less than the first threshold period.

[0054] More specifically, the IEBI parameter indicates the average of the relative distances (not shown, hereinafter also referred to as blink time distances) calculated between two consecutive blinks over a predetermined time period, and more specifically, the average of the relative distances between corresponding reference points of the two consecutive blinks. For example, each reference point could be the maximum value M of the first peak (K1 and K2) or the second peak (K3 and K4) of the first blink pattern (P1) or the second blink pattern (P2) of the blink. K1 M K2 M K3 M K4 Time position t MK1 t MK2 t MK3 or t MK4 For example, the blink time distance used to calculate the IEBI parameter can be the maximum value M of the first peak K1 of the first blink pattern P1 of two consecutive blinks. K1 Time position t MK1 The distance between them.

[0055] Specifically, the IEBI parameter is updated in each iteration of verifying the second condition. For example, in the first iteration of detection method 50 (e.g., i = 1), the IEBI parameter is set to a predefined value (e.g., equal to 5s), and in each subsequent iteration (e.g., i = N) after a blink is detected, the IEBI parameter is recalculated based on its own value in the immediate preceding iteration (e.g., i = N-1) and the blink time distance calculated in the current iteration (e.g., i = N).

[0056] In step S26, immediately following step S24, it is determined whether the IEBI parameter condition passes verification in order to determine the user's attention (or concentration) state. Specifically, it is verified whether the IEBI parameter is greater than the IEBI threshold indicating the user's threshold attention level (e.g., between approximately 3 seconds and approximately 12 seconds, for example, equal to approximately 8 seconds).

[0057] If the IEBI parameter condition is validated (i.e., the IEBI value is greater than the IEBI threshold), then the user's first eye activity 30 is detected (step S28). The first eye activity 30 indicates the user's first attention state, which corresponds to the user's low (or relatively low) attention level.

[0058] If the IEBI parameter condition fails validation (i.e., the IEBI value is lower than or equal to the IEBI threshold), then a second activity of the user's eyes 30 is detected (step S30). The second activity of the eyes 30 indicates the user's second attention state, which corresponds to the user's high (or relatively high) attention level.

[0059] It is clear that the terms “high” and “low” used in this specification are not absolute, but relative to each other and related to the ongoing activity (where the distinction is given by the IEBI threshold).

[0060] In step S32, based on the first static charge change signal S Q,1a and S Q,1b In particular, based on the first electrostatic charge change signal S Q,1a and S Q,1b The peak value is used to calculate the first static charge change signal S. Q,1a and S Q,1b The relative distance between two consecutive detected clicks (hereinafter also referred to as click time distance).

[0061] In particular, Figures 7A-7C The first static charge change signal S in the current time window is shown respectively. Q,1a and S Q,1b And the first static charge change signal S that limits the two corresponding clicks. Q,1a S Q,1b Two blinking patterns. Specifically, each click is triggered by a first electrostatic charge change signal S. Q,1a and S Q,1b One of the corresponding blinking patterns (in Figures 7A-7C (e.g., represented by P4) defines the blink pattern P4, where the blink pattern P4 is defined by the immediately preceding blink pattern (e.g., in...). Figures 7A-7C The distance (represented by P3) is greater than the first threshold time period. For example, the maximum value M of the first peak K5 and K6 of the considered blink pattern P4. K5 and M K6 Time position t MK5 With t MK6 The time interval T2 between the immediately preceding blink pattern P3 and the time position of the next blink pattern P4 is greater than the first threshold period. The blink pattern P4 that is considered last can be the previous blink pattern P3. Figure 7A S in Q,1a and Figure 7B S in Q,1b It may be part of the same first electrostatic charge change signal as the previous blinking pattern P3, or it may be a first electrostatic charge change signal that is different from the previous blinking pattern P3. Figure 7C In, for example S Q,1b Part of ).

[0062] More specifically, the click time distance is limited to the corresponding reference points of the last two detected clicks ( Figures 7A-7CBetween P3 and P4 in the above. Each reference point can be, for example, the maximum value M of the first peak (K5 and K6) or the second peak (K7 and K8) of the two blink patterns P3 and P4 that define the last two consecutive clicks. K5 M K6 M K7 M K8 Time position t MK5 , t MK6 , t MK7 or t MK8 For example, the click time interval can be consistent with the second time interval T2.

[0063] In step S34, immediately following step S32, it is determined whether the condition of the click time distance passes verification in order to determine the click pattern of the user's eye 30. Specifically, it is verified whether the click time distance is less than the click threshold distance indicating the threshold level of the double-click indicator (greater than a first threshold period, for example, between about 200ms and about 1s, and for example equal to about 700ms) (which will be better described below).

[0064] If the click time distance condition is verified (i.e., the click time distance is less than the click threshold distance), then a third activity of the user's eye 30 is determined (step S36). This third activity indicates the aforementioned double-click, which corresponds to two voluntary clicks that approach each other over time, such as... Figure 8A As shown, an exemplary reference is the first electrostatic charge change signal S. Q,1a In other words, double-clicking is performed using two blinking modes, with a corresponding click time interval between these two modes (in...). Figure 8A The distance (represented by the attached figure T2') is less than the click threshold distance (also known as the second threshold period).

[0065] If the click time distance condition fails validation (i.e., the click time distance is greater than or equal to the click threshold distance), then a fourth activity of the user's eye 30 is determined (step S38). The fourth activity indicates a click, i.e., a voluntary click isolated over time, such as... Figure 8B As shown, an exemplary reference is the first electrostatic charge change signal S. Q,1a More specifically, the click is performed via a blink pattern, which is the time distance between the blink pattern of the previous click and the blink pattern of the previous click (in...). Figure 8B The time period marked "T2" in the attached figure is greater than the second threshold.

[0066] according to Figure 10 One embodiment of the detection method 50 shown includes several additional steps (generally indicated by reference numeral S40) between steps S22 and S24.

[0067] Furthermore, in this embodiment, not only the first static charge change signal S Q,1a and S Q,1b Perform the above steps S10-S16, and process the second electrostatic charge change signal S acquired by the third electrode 22c and the fourth electrode 22d of the second electrostatic charge change sensors 20c and 20d. Q,2a and S Q,2b The above steps are also performed. Specifically, for the second static charge change signal S... Q,2a and S Q,2b Step S16 is performed to detect its possible peak value (positive or negative), similar to the previously described method for detecting the first static charge change signal S. Q,1a and S Q,1b The blinking pattern in the eyes. Specifically, Figure 9 The second electrostatic charge change signal (exemplarily S here) is shown. Q,2a An example is shown, where two peaks K9 and K are illustrated. 10 These two peaks are isolated from each other over time and do not define any blinking pattern. For example, peak K9 is positive (i.e., the corresponding maximum value M). K9 Greater than 0, that is, the second static charge change signal S Q,2a (baseline), peak K 10 It is negative (i.e., the corresponding maximum value M). K10 Less than 0, i.e., the second static charge change signal S Q,2a (baseline).

[0068] In step S40a, which follows step S22 and is between step S22 and step S24, the second electrostatic charge change signal S acquired in the current iteration through the third electrode 22c and the fourth electrode 22d is verified. Q,2a and S Q,2b Whether to indicate the third state of the user's eye 30. More specifically, the third condition indicates the movement of the eyeball in the orbital cavity of the eye 30 without the eyelids being fully closed; in other words, the third condition is related to the rotation of the eyeball, which does not require the eyelids to be closed (i.e., the contact between the upper and lower eyelids of each eye 30). If each second electrostatic charge change signal S Q,2a S Q,2b The presence of at least one single peak is identified in the data, thus verifying the third condition. This single peak is relative to the second electrostatic charge change signal S. Q,2a S Q,2b The other peaks are isolated over time and are not part of any blinking pattern. Specifically, the second electrostatic charge change signal S... Q,2a S Q,2b The single peak is in the first electrostatic charge change signal S Q,1a S Q,1bThe peak value without a corresponding substance (i.e., the first electrostatic charge change signal S) Q,1a S Q,1b Second static charge change signal S Q,2a S Q,2b The time position of the single peak has no peak value.

[0069] If the third condition fails to pass verification (i.e., no movement of eye 30 is detected without the eyelids being fully closed), the detection method 50 proceeds to step S24 as described above, because the second condition has been verified (i.e., blinking has been detected).

[0070] If the third condition is verified (i.e., eye movement 30 is detected without the eyelids being fully closed), the detection method 50 proceeds to step S40b. Optionally, this method can also be performed simultaneously with steps S24 and S40b.

[0071] In step S40b following step S40a, relative to the second static charge change signal S Q,2a S Q,2b The corresponding second electrostatic charge change signal S in one or more single peaks detected in the middle Q,2a S Q,2b The baseline detection orientation, as described above, indicates the corresponding eye movements of eye 30 when the eyelids are not fully closed. Specifically, an example is considered using only one second electrostatic charge change signal S. Q,2a S Q,2b If there is only one peak, in step S40b, verify whether the peak is positive (i.e., whether the corresponding maximum value is greater than the baseline, which is considered to be zero here in consideration of step S14) or negative (i.e., whether the corresponding maximum value is lower than the baseline, which is considered to be zero here in consideration of step S14).

[0072] Step S40c, following step S40b, is a determination step, in which the determination is made for the second electrostatic charge change signal S. Q,2a S Q,2b Each detected single peak, exemplarily, corresponds to whether the fourth condition of the predefined orientation (e.g., positive orientation) of the single peak passes verification.

[0073] If the fourth condition passes the verification (i.e., the single peak is positive), the detection method 50 proceeds to step S40d.

[0074] If the fourth condition fails the verification (i.e., the single peak is negative), the detection method 50 proceeds to step S40e.

[0075] If the fourth condition is verified, a fifth activity of the user's eye 30 is determined (step S40d). The fifth activity indicates a first movement of the eye 30. For example, the first movement corresponds to a movement of the cornea 30a from right to left relative to the user's viewpoint, and / or a movement of the cornea 30a from the third electrode 22c to the fourth electrode 22d of the second left electrostatic charge change sensor 20c; however, the orientation of the first movement obviously depends on the position of the third electrode 22c and the fourth electrode 22d relative to the eye 30, and therefore may also correspond to, for example, a movement of the cornea 30a from left to right.

[0076] If the fourth condition fails verification, a sixth activity of the user's eye 30 is determined (step S40e). The sixth activity indicates a second movement of the eye 30. In particular, the second movement is relative to the first movement; in other words, it is performed in a direction opposite to the first movement. For example, the second movement corresponds to a movement of the cornea 30a from left to right, and / or a movement of the cornea 30a from the fourth electrode 22d to the third electrode 22c; however, the orientation of the second movement obviously depends on the position of the third electrode 22c and the fourth electrode 22d relative to the eye 30, and therefore can also correspond to, for example, a movement of the cornea 30a from right to left.

[0077] Figure 11 Another embodiment of the detection method 50 is shown.

[0078] In this embodiment, the detection method 50 includes additional steps S03-S07 prior to step S10, and the glasses 10 further includes one or more accelerometers (not shown) and one or more gyroscopes (not shown). The use of accelerometers and gyroscopes is exemplarily referred to below, although a greater number of accelerometers and / or gyroscopes can be similarly considered. Specifically, the accelerometers and gyroscopes are fixed to the glasses 10 (e.g., fixed to support portions 12a and / or 12b) and configured to detect possible movements of the user's head (e.g., lateral rotation and forward or backward bending of the head relative to the torso).

[0079] In step S03, the main control unit 21 acquires one or more angular velocity signals S indicating the corresponding angular velocity measured by the gyroscope via the gyroscope. ω These one or more angular velocities are generated by the motion of the user's head (e.g., relative to the user's torso).

[0080] In step S05, which is performed simultaneously with step S03, for example, the main control unit 21 acquires one or more linear acceleration signals S indicating the corresponding linear acceleration measured by the accelerometer via the accelerometer. acc These one or more linear accelerations are generated by the motion of the user's head (e.g., relative to the torso).

[0081] In step S07, based on the angular velocity signal S ω and linear acceleration signal S acc Determine if the fifth condition passes verification. The fifth condition is determined when no user head movement is detected. This is based on the angular velocity signal S. ω and linear acceleration signal S acc The determination of head movements is performed in a manner known per se (e.g., through machine learning techniques), and therefore is not described in detail in this paper; however, details of this aspect can be found in the article “Absolute Orientation for Head-Tracking Using Gyroscope, Accelerometer, and Camera” (Fisher, EE 267-Virtual Reality-Stanford University-2018).

[0082] If the fifth condition fails to pass verification (i.e., head movement is detected), the detection method 50 ends and steps S10-S38 are not executed (e.g., the method returns to step S03).

[0083] If the fifth condition is verified (i.e., no head movement is detected (it is not moving)), then detection method 50 proceeds to step S10 and then executes... Figure 5 or Figure 10 The steps are shown.

[0084] According to an embodiment not shown, Figure 5 , Figure 10 and Figure 11 The detection method 50 further includes the following steps: controlling one or more functions of the same glasses 10 or a device (not shown) (e.g., a smart TV or smart home appliance) external to and operatively coupled to the glasses 10, based on the detected eye 30 activity. For purely illustrative and non-limiting purposes, the device's functions may include: providing an audible alarm or activating the device's standby mode when a first activity (low user attention level) is detected, opening a folder or document, or selecting options for the device via third and fourth activities (single and double clicks), and scrolling the text of a document via fifth and sixth activities (movement of the eye 30 without blinking).

[0085] Because electrodes 22a-22d are close to the eye 30, the aforementioned glasses 10 and detection method 50 allow for high-precision detection of eye movement 30. Specifically, eye activity can be detected, indicating the user's attention level, single and double clicks, and eye movement 30 without blinking.

[0086] Because of the accelerometer and gyroscope, the possibility of performing detection method 50 only when the user's head is not moving avoids erroneous detection of eye movements that are actually caused by head movements. Furthermore, the fact that electrodes 22a-22d are carried by the glasses 10 and do not come into contact with the user's facial skin prevents detection errors caused by the electrodes sliding on the skin (e.g., when the skin is wet or sweaty).

[0087] Detection method 50 requires less computing resources to implement, and therefore minimizes the power consumption required.

[0088] Finally, it is apparent that modifications and variations can be made to the invention described and illustrated herein without departing from the scope of the invention as defined in the appended claims. For example, the described embodiments can be combined with each other to obtain other solutions.

[0089] Steps S24-S38 (and steps S40a-S40e, if any) may be optional. Typically, if the first condition is not determined in step S22, a blink is detected, and if the first condition is determined in S22, a click is detected. For example, if the first condition is not determined in step S22, a blink signal (not shown) is generated using a first value (e.g., 0) indicating that a blink has been detected; conversely, if the first condition is determined in step S22, a blink signal is generated with a second value (e.g., 1) indicating that a click has been detected. For example, the blink signal may be used to control one or more functions of the glasses 10 or the device, similar to those previously described. After the blink signal is generated, steps S24-S38 (and steps S40a-S40e, if any) may optionally be performed as described above.

[0090] The glasses 10 may also include a single control unit coupled to the electrodes 22a-22d. For purely illustrative purposes, this control unit may include a main control unit 21 and a sensor control unit 15, or it may be the main control unit 21 and the sensor control unit 15 may be absent; in these cases, the actions previously described with reference to the sensor control unit 15 of the charge change sensors 20a, 20b are performed by this control unit.

[0091] Although the case of performing detection method 50 by processing overlapping time windows (rolling buffers) has been previously described, the previous description is also applied in a similar manner to the case where the time windows are consecutive and do not overlap.

[0092] Furthermore, the number of electrostatic charge change sensors can be greater than previously considered. Specifically, the glasses may include one or more third electrostatic charge change sensors (not shown, similar to the second electrostatic charge change sensors 20c and 20d), each second electrostatic charge change sensor including a corresponding pair of electrodes (not shown, e.g., a fifth electrode and a sixth electrode) for improving the detection of the fifth and sixth activities. For example, the fifth and sixth electrodes are spaced apart from electrodes 22a-22d, radially inward relative to the centers of the first electrode 22a and the second electrode 22b relative to the centers of the corresponding lenses 14a, 14b, separated from each other by a second mutual distance D2, and fixed to the corresponding lenses 14a, 14b to face the user's eyes 30 when the user wears the glasses 10. Specifically, the fifth and sixth electrodes are angularly equidistant from the centers of the third electrode 22c and the fourth electrode 22d relative to the centers of the corresponding lenses 14a, 14b. For example, the fifth and sixth electrodes are aligned with each other along a second axis (not shown) orthogonal to the first axis, such that they are arranged in an intersecting manner relative to the third electrode 22c and the fourth electrode 22d, wherein the center of this intersection corresponds to the center of the respective lenses 14a, 14b (and thus to the center of the eye 10, for example, at the position of the pupil when the user's gaze is directed in a direction orthogonal to the face). In this way, the movement of the eye 30 without blinking can be detected more efficiently and accurately. Similar to that already described for the third electrode 20c and the fourth electrode 20d, for each third electrostatic charge change sensor, the corresponding sensor control unit 15 is configured to process the corresponding detection signal S acquired through the fifth and sixth electrodes. R And generate a corresponding second static charge change signal, which indicates the difference between the detection signals obtained by the fifth electrode and the sixth electrode, and thus indicates the difference between the static charge changes detected by the fifth electrode and the sixth electrode.

[0093] Furthermore, the glasses 10 may include only one first electrostatic charge change sensor (hereinafter exemplarily considered as the first left electrostatic charge change sensor 20a). In this case, the detected information pertains only to one of the user's eyes 30 (i.e., the eye 30 with the first left electrostatic charge change sensor 20a facing it). However, the information acquired regarding involuntary activities of one eye (e.g., blinking and eye movements without fully closing the eyelids) can also be considered for the other eye in the same way, since involuntary eye movements (blinking and eye movements without blinking) are generally substantially synchronous and dual. This consideration does not apply to voluntary eye movements (e.g., clicking) intentionally performed by the user with only one eye.

[0094] Figure 12An embodiment of the detection method 50 is shown, corresponding to the case where only the first left static charge change sensor 20a is present. Specifically, when only the first left static charge change sensor 20a is present, the detection method 50 is similar to the previously described method (in... Figure 12 In the middle, for reference Figure 5 The steps shown, although it is obvious, also apply to the above. Figure 10 and Figure 11 (Example).

[0095] However, unlike the embodiments discussed above, in Figure 12 In this process, steps S10-S16 only apply to the first static charge change signal S. Q,1a implement.

[0096] Furthermore, the determination of the first condition (in the previous step S20, in Figure 12 The replacement of the reference S20' with the new reference S20' is based on the unique first static charge change signal S. Q,1a This is carried out. More specifically, in the current iteration, if there exists a first static charge change signal S... Q,1a If a blinking pattern (whose duration is greater than the click threshold period (e.g., between approximately 10ms and 40ms, such as approximately 20ms)) is detected, then the first condition is validated (i.e., a click is detected). For example, Figure 13 The blinking pattern (denoted by reference numeral P5) is shown, which has a blinking pattern at time position t. MK11 With maximum value M K11 The first peak K 11 and at time position t MK12 The second peak K with the maximum value 12 For purely illustrative and non-limiting purposes, the duration can be a quantity, such as the first peak K of blink pattern P5. 11 Second peak K 12 The maximum value M K11 and M K12 Time position t MK11 With t MK12 The distance between (in) Figure 13 (represented by the numeral T3' in the attached diagram), or the first peak K of the blink pattern P5. 11 Second peak K 12 Interest value J K11 and J K12 Time position t JK11 With t JK12 The distance between (in) Figure 13 (In the attached figure, T3 is used to indicate this). For example, the value of interest J K11 and J K12 The first static charge change signal S Q,1aPoints, which have predefined values ​​(e.g., the corresponding peak value K). 11 K 12 The maximum value M K11 M K12 10% of the total), and its time position t JK11 t JK12 At the corresponding peak K 12 K 11 The maximum value T K11 T K12 Time position t MK11 and t MK12 Before and after. As a result, when the duration T3' and T3" of the blink pattern P5 are greater than the click threshold period, the first condition is verified (i.e., a click is detected).

[0097] Furthermore, in this embodiment, in step S24, the IEBI parameter is determined as the average blink time distance over a predetermined time period, and each blink time distance is defined in the first electrostatic charge change signal S. Q,1a It is calculated between two consecutive blink patterns, with each blink pattern limited to the corresponding blink.

[0098] Although the invention has been described with reference to illustrative embodiments, this specification is not intended to be limiting. Referring to this specification, those skilled in the art will clearly understand various modifications and combinations of the illustrative embodiments and other embodiments of the invention. Therefore, the appended claims cover any such modifications or embodiments.

Claims

1. A method for non-contactly detecting the activity of a user's primary eye while wearing glasses, the method comprising: A first electrostatic charge change signal is acquired without contact via the first and second electrodes of the first electrostatic charge change sensor of the glasses. The first electrostatic charge change signal indicates the difference between the electrostatic charge changes detected by the first and second electrodes. The glasses include a first electrostatic charge change sensor to acquire the first electrostatic charge change signal. The first and second electrodes are fixed to the frame of the glasses and spaced apart from each other. Each electrode faces the first eye. Each of the first and second electrodes is configured to be electrostatically coupled to the first eye without physical contact with the user to detect the corresponding electrostatic charge change generated by blinking of the first eye. The first static charge change signal is obtained from the first static charge change sensor at the controller; The controller verifies the existence of one or more blinking patterns in the first electrostatic charge change signal, each blinking pattern indicating a corresponding click or a corresponding blink, wherein the click is a voluntary blink of the first eye and the blink is an involuntary blink of the first eye; When the first electrostatic charge change signal has one or more blinking patterns, the controller determines whether the first condition passes verification for each blinking pattern; When the first condition fails to pass verification, the controller detects the corresponding blink; as well as When the first condition is verified, the controller detects the corresponding click.

2. The method according to claim 1, further comprising: When the first condition fails validation: The controller determines the interblink interval (IEBI) parameter, which indicates the blink frequency, based on one or more blink patterns of the first electrostatic charge change signal. The controller verifies whether the IEBI parameter is greater than the IEBI threshold. When the IEBI parameter is greater than the IEBI threshold, detect a first activity of the first eye that is related to the user's lower level of attention; and When the IEBI parameter is not greater than the IEBI threshold, a second activity of the first eye that is related to the user's higher level of attention is detected.

3. The method according to claim 2, wherein determining the IEBI parameter when the first condition fails verification includes: Calculate the blink time distance between two consecutive blink patterns of the first electrostatic charge change signal, where each blink pattern defines a corresponding blink.

4. The method according to claim 2, wherein determining the IEBI parameter when the first condition fails verification includes: Calculate the blink time distance between two pairs of consecutive blink patterns of the first static charge change signal and another first static charge change signal, wherein each pair of blink patterns of the first static charge change signal and the other first static charge change signal defines a corresponding blink.

5. The method according to claim 2, The glasses include a first lens facing the first eye. The glasses include a second electrostatic charge change sensor comprising a third and a fourth electrode spaced apart from each other. The second electrostatic charge change sensor faces the first eye and is configured to detect a corresponding change in electrostatic charge generated by eye movement of the first eye in the absence of blinking. The first and second electrodes are radially outward relative to the third and fourth electrodes and relative to the center of the first lens. The controller is also coupled to the third electrode and the fourth electrode, and The method further includes: The controller acquires a second electrostatic charge change signal through the third electrode and the fourth electrode, the second electrostatic charge change signal indicating the difference between the electrostatic charge changes detected by the third electrode and the fourth electrode; When the first condition is verified, the controller verifies the presence of one or more single peaks in the second electrostatic charge change signal, each single peak being a corresponding peak of the second electrostatic charge change signal that is not part of any blinking pattern, and indicating the corresponding movement of the eyeball of the first eye in the absence of blinking of the first eye; When one or more single peaks are not present in the second static charge change signal, the IEBI parameter is determined; When one or more single peaks exist in the second static charge change signal, determine the orientation of each single peak relative to the baseline of the second static charge change signal; For each of the one or more single peaks in the second electrostatic charge change signal, verify whether the orientation is a predefined orientation; For each of the one or more single peaks in the second electrostatic charge change signal, when the corresponding orientation is the predefined orientation, a fifth activity of the first eye that indicates the first movement of the first eye is detected; as well as For each of the one or more single peaks in the second electrostatic charge change signal, when the corresponding orientation is not the predefined orientation, a sixth activity of the first eye that indicates the second movement of the first eye relative to the first movement is detected.

6. The method of claim 1, further comprising, when the first condition passes verification: The controller determines the corresponding click time distance between clicks in a pair of clicks based on the blinking pattern of the first electrostatic charge change signal for each pair of detected consecutive clicks; The controller verifies whether the click time distance is less than the click threshold distance for each click time distance; When the click time distance is less than the click threshold distance, a third activity of the first eye, indicating a double-click of the first eye, is detected; as well as When the click time distance is not less than the click threshold distance, a fourth activity of the first eye, indicating the click of the first eye, is detected.

7. The method of claim 1, wherein verifying the presence of the one or more blinking patterns in the first electrostatic charge change signal comprises: For each blink pattern, a first peak and a second peak are identified during the blink period, the first peak and the second peak having opposite signs to each other relative to the baseline of the first electrostatic charge change signal and forming the blink pattern.

8. The method of claim 1, wherein detecting the blink includes generating a blink signal having a first value indicating the blink detection, and wherein detecting the click includes generating the blink signal having a second value indicating the click detection.

9. The method according to claim 1, wherein acquiring the first static charge change signal comprises: The corresponding detection signals are obtained through the first electrode and the second electrode, and each detection signal indicates the change of static charge on the corresponding first electrode or the corresponding second electrode. as well as Calculate the difference between the detected signals, including at least one of the following: Filtering the differences between the detected signals; and Remove the offset of the difference between the detection signals.

10. The method of claim 1, wherein the glasses further comprises at least one accelerometer and at least one gyroscope coupled to the controller, and The method further includes: The controller acquires one or more angular velocity signals indicating the corresponding angular velocity related to the movement of the user's head via the at least one gyroscope; One or more linear acceleration signals, indicating a corresponding linear acceleration related to the movement of the user's head, are acquired by the controller and through the at least one accelerometer; as well as The controller verifies the existence of the user's head movement based on the one or more angular velocity signals and the one or more linear acceleration signals.

11. The method of claim 1, wherein the first condition is verified when the corresponding blinking pattern has a duration greater than the click threshold period.

12. The method of claim 1, wherein the glasses further comprises an additional first electrostatic charge change sensor, the additional first electrostatic charge change sensor comprising respective first electrodes and respective second electrodes spaced apart from each other, the additional first electrostatic charge change sensor facing the user's second eye and configured to detect a corresponding electrostatic charge change generated by blinking of the second eye, the controller further coupled to the first electrodes and the second electrodes of the additional first electrostatic charge change sensor, the method further comprising: An additional first static charge change signal is acquired by the controller and through the first and second electrodes of the additional first static charge change sensor, the additional first static charge change signal indicating the difference between the static charge changes detected by the first and second electrodes of the additional first static charge change sensor; The controller verifies the presence of one or more corresponding blink patterns in the additional first electrostatic charge change signal; and Wherein, for each pair of consecutive blinking patterns of the first electrostatic charge change signal and / or the other first electrostatic charge change signal, the relative time distance between the blinking patterns in a pair of blinking patterns is greater than a first threshold period, the first condition is verified.

13. The method of claim 1, further comprising controlling one or more functions of the glasses or one or more functions of a device operatively coupled to the glasses based on detected activity of the first eye.

14. A pair of eyeglasses, comprising: frame; Lens, attached to the frame; A first electrostatic charge change sensor includes a first electrode and a second electrode spaced apart from each other, the first electrode and the second electrode being fixed to the frame and facing the user's first eye, each of the first electrode and the second electrode being configured to be electrostatically coupled to the first eye without physical contact with the user, in order to detect a corresponding electrostatic charge change generated by blinking of the first eye; as well as The controller, coupled to the first electrode and the second electrode, is configured to: A first static charge change signal is acquired without contact between the first electrode and the second electrode of the first static charge change sensor, and the first static charge change signal indicates the difference between the static charge changes detected by the first electrode and the second electrode; Verify the existence of one or more blinking patterns in the first electrostatic charge change signal, each blinking pattern indicating a corresponding click or a corresponding blink, wherein the click is a voluntary blink of the first eye and the blink is an involuntary blink of the first eye; When the first electrostatic charge change signal has one or more blinking patterns, for each blinking pattern, determine whether the first condition passes verification; If the first condition fails to pass verification, a corresponding blink is detected; as well as When the first condition is verified, the corresponding click is detected.

15. The eyeglasses according to claim 14, further comprising: A second electrostatic charge change sensor includes a third and a fourth electrode spaced apart from the first and second electrodes. The second electrostatic charge change sensor faces the user's first eye and is configured to detect a corresponding change in electrostatic charge generated by eye movement of the first eye in the absence of blinking. The first and second electrodes of the first electrostatic charge change sensor are radially outward relative to the third and fourth electrodes of the second electrostatic charge change sensor and relative to the center of the first lens. The controller is also coupled to the third and fourth electrodes of the second electrostatic charge change sensor.

16. The eyeglasses of claim 15, further comprising: A third electrostatic charge change sensor includes a fifth and a sixth electrode spaced apart from the first, second, third, and fourth electrodes. The third electrostatic charge change sensor faces the first eye and is configured to detect corresponding electrostatic charge changes generated by eye movement of the first eye in the absence of blinking. The fifth and sixth electrodes are radially inward relative to the first and second electrodes and relative to the center of the first lens, and are angularly rotated about the center of the first lens relative to the third and fourth electrodes. The controller is also coupled to the fifth and sixth electrodes of the third electrostatic charge change sensor.

17. The eyeglasses of claim 14, further comprising: An additional first electrostatic charge change sensor includes a corresponding first electrode and a corresponding second electrode spaced apart from each other, the additional first electrostatic charge change sensor facing the user's second eye and configured to detect a corresponding electrostatic charge change generated by blinking of the second eye, the controller also being coupled to the first electrode and the second electrode of the additional first electrostatic charge change sensor.

18. A non-transitory computer-readable medium loadable into a controller of user-wearable glasses, wherein the glasses include a first electrostatic charge change sensor, the first electrostatic charge change sensor including a first electrode and a second electrode, the first electrode and the second electrode being spaced apart from each other and fixed to the frame of the glasses, facing a first eye of the user, each of the first electrode and the second electrode being configured to be electrostatically coupled to the first eye without physical contact with the user to detect a corresponding electrostatic charge change generated by blinking of the first eye, the controller being coupled to the first electrode and the second electrode of the first electrostatic charge change sensor, wherein the computer-readable medium includes instructions for performing the following methods when executed by the controller: A first static charge change signal is acquired without contact between the first electrode and the second electrode, the first static charge change signal indicating the difference between the static charge changes detected by the first electrode and the second electrode; The first static charge change signal is obtained from the first static charge change sensor at the controller; The controller verifies the existence of one or more blinking patterns in the first electrostatic charge change signal, each blinking pattern indicating a corresponding click or a corresponding blink, wherein the click is a voluntary blink of the first eye and the blink is an involuntary blink of the first eye; When the first electrostatic charge change signal has one or more blinking patterns, the controller determines whether the first condition passes verification for each blinking pattern; When the first condition fails verification, the controller detects the corresponding blink; and When the first condition is verified, the controller detects the corresponding click.

Images