Electronic equipment and method for disabling functionality

Abstract

An electronic equipment (100) communicatively connected to a gaze-tracking device (120), an input device (110) and a display device (130), the electronic equipment (100) comprising processing circuitry (404), wherein the processing circuitry (404) is configured to obtain, from the input device (110), pointer information comprising pointing area information pertaining to at least one pointing area (142) comprised in a User Interface, UI, (140) displayed by the display device (130), obtain, from the gaze-tracking device (120), gaze information comprising at least one gaze area information pertaining to at least one gaze area (146) comprised in the UI (140), and in response to the processing circuitry (404) detecting that the pointer information meets a pointer condition associated with a target area (144) and that the gaze information meets a first gaze condition associated with the target area (144): disable a functionality associated with the target area (144). The pointer condition comprises at least part of the pointer information matching a pointer pattern and the first gaze condition comprises at least part of the gaze condition matching a first gaze pattern. Together, these two patterns indicate that the user intends to disable the functionality of the target area.

Description

[0001] P111908W001

[0002] 1

[0003] ELECTRONIC EQUIPMENT AND METHOD FOR DISABLING FUNCTIONALITY

[0004] TECHNICAL FIELD

[0005] The present disclosure relates to electronic equipment and a method performed by the electronic equipment. A related computer program and a computer readable storage medium are also disclosed.

[0006] BACKGROUND

[0007] A hot corner functionality provides access to tasks and functions belonging to a Ul (User Interface) without requiring clicks or keyboard shortcuts, by e.g. reaching with an input device, a target area of a User Interface (Ul) displayed in a corner of a display device such as a screen. A “hot corner” is a feature in modem GUI (Graphical User lnterface)-based operating system of which an example is described in (https: / / support.apple.com / en-gb / guide / mac-help / mchlp3000 / mac). Apple 2024 [retrieved on 2024-08-26]), where e.g., moving a pointer to the target area in the GUI triggers an action. The action may relate to starting an application, or any system control actions such as activating a screensaver, locking a screen, or clearing all GUI objects on the screen.

[0008] Existing eye-tracking systems analyze the gaze vector of each eye of a user using a device.

[0009] Such an eye-tracking system is described on the webpage (https: / / www.tobii.com / learn-and-support / get-started / what-is-eye-tracking .[retrieved on 2024-08-26]) referring to an eye-tracking system converting eye movements into data streams that contain information such as pupil position, the gaze vector for each eye and the gaze point of the user.

[0010] US20130145304 A1 discloses a data processing system connected to a display, a camera for tracking eye movement and a mouse receiving user selections. The data processing system tracks the location of the cursor relative to the display and the user gaze which includes a record of the user gaze at a given time. By comparing the position of the user gaze with the position of the cursor at a given time the data processing system detects whether the user selection was unintentional, and if it was P111908W001

[0011] 2 it does not enable the functionality associated with the area which the user has selected.

[0012] US2023359273 A1 relates to a method for initiating an action based on detecting that an eye gaze direction of user is approximately oriented towards a target area.

[0013] A challenge arises if the user intends to interact with an III object, such as an III element, that resides in the target area related to the hot corner functionality using the pointer as the action relating to the hot corner functionality gets triggered. Hence, there is a need for an improved and more user friendly operation relating to the hot corner functionality.

[0014] SUMMARY

[0015] An object of the invention is to enable improved user interaction, e.g., with a user interface (Ul).

[0016] A first aspect of the invention relates to an electronic equipment communicatively connected to a gaze-tracking device, an input device and a display device. The electronic equipment comprises processing circuitry, this processing circuitry is configured to obtain, from the input device, pointer information comprising pointing area information pertaining to at least one pointing area comprised in a User Interface, Ul, displayed by the display device. The pointer information is pertaining to at least one pointer interaction of a user with the Ul. The processing circuitry is also configured to obtain, from the gaze-tracking device, gaze information comprising gaze area information pertaining to at least one gaze area comprised in the Ul. The gaze information is pertaining to at least one gaze interaction of the user with the Ul. The processing circuitry is configured to disable a functionality associated with the target area in response to the processing circuitry detecting that the pointer information meets a pointer condition associated with a target area and that the gaze information meets a first gaze condition associated with the target area. The pointer condition comprises at least part of the pointer information matching a pointer pattern and the first gaze condition comprises at least part of the gaze condition matching a first gaze pattern. Together, these two patterns indicate that the user intends to disable the functionality of the target area. The target area is a portion of the Ul. P111908W001

[0017] 3

[0018] A second aspect of the invention relates to a method performed by an electronic equipment, which comprises obtaining, from the input device, pointer information comprising pointing area information pertaining to at least one pointing area comprised in a User Interface, III, displayed by the display device. The pointer information is pertaining to at least one pointer interaction of a user with the III. The method comprises obtaining, from the gaze-tracking device, gaze information comprising gaze area information pertaining to at least one gaze area comprised in the III. The gaze information is pertaining to at least one gaze interaction of the user with the III. The method comprises disabling a functionality associated with the target area in response to detecting that the pointer information meets a pointer condition associated with a target area and that the gaze information meets a first gaze condition associated with the target area. The pointer condition comprises at least part of the pointer information matching a pointer pattern and the first gaze condition comprises at least part of the gaze condition matching a first gaze pattern. Together this two patterns indicate that the user intends to disable the functionality of the target area. The target area is a portion of the III.

[0019] A third aspect of the invention relates to a computer program comprising instructions which, when executed on processing circuitry of an electronic equipment, cause the processing circuitry of the electronic equipment to carry out the method according to the second embodiment or any embodiment therein.

[0020] A fourth aspect of the invention relates to a tangible, non-volatile computer readable medium comprising instructions that, when executed on processing circuitry of an electronic equipment, cause the processing circuitry of the electronic equipment to carry out the method according to the second embodiment or any embodiment therein.

[0021] The solution presented herein addresses the above-mentioned challenges of interacting with III objects, such as with at least one III element that resides in the target area. For example, contrary to triggering a functionality, wherein triggering is based solely on the pointer area overlapping with the target area, the solution presented herein takes the gaze area of the user into account for e.g. triggering a functionality in addition to the pointer area. In this fashion, accidental triggering of the “hot corner” -‘functionality when the user intends to perform a different function of the P111908W001

[0022] 4

[0023] III is minimized. Therefore, the solution presented herein enables an improved user experience when interacting with the III.

[0024] BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 is a schematic diagram illustrating an example setup.

[0026] Figure 2 is a flowchart illustrating a method performed by an electronic equipment.

[0027] Figure 3 is a flowchart illustrating exemplary embodiments of the method performed by the electronic equipment.

[0028] Figure 4 illustrates a block diagram illustrating embodiments of the electronic equipment.

[0029] DETAILED DESCRIPTION

[0030] Figure 1 shows a schematic diagram illustrating an example setup of an environment in which embodiments presented herein can be applied. Figure 1 illustrates an electronic equipment 100, an input device 110, a gaze-tracking device 120, a display device 130, a User Interface (III) 140 and a user 150 stylized in the form of an eye. The III 140 is displayed using the display device 130. The user 150 interacts with the III 140 using the input device 110. At least one pointing area 142, a target area 144, at least one gaze area 146 is comprised in the III 140. The user 150 may be gazing at the III 140. The electronic equipment 100 is communicatively connected with the input device 110, the gaze-tracking device 120, and the display device 130 such as via external and / or internal entities using wired communications, e.g., based on Ethernet, and / or wireless communications, e.g., Wi-Fi, and / or a cellular network corresponding to one or a combination of 5G cellular networks, LTE, LTE-advanced, UMTS, or any other current or future wireless network, such as a future 3GPP 6G network. Optionally, the electronic equipment 100 may comprise at least one of: the input device 110, the gaze-tracking device 120, and the display device 130, i.e. the input device 110, the gaze-tracking device 120, and the display device 130 may be integrated into the electronic equipment 100. P111908W001

[0031] 5

[0032] The electronic equipment 100 may correspond to a computing device capable of processing data, performing calculations or tasks based on software. The computing device may thus be a personal computer (PC) such as a portable PC or desktop PC, a communication device such as a phone or a tablet, an augmented reality (AR), virtual reality (VR), or an extended reality (XR)-based device, a server, a wearable device, a gaming console, a vehicle, and / or an Internet of Things (loT) device.

[0033] The input device 110 may correspond to a human machine interface (HMI) device that allows the user 150 to provide input. In an example, the user 150 may input spatial data such as continuous and / or multi-dimensional data using the input device 110. The input device 110 is e.g. a pointer device such as a computer mouse, a touchscreen, a touchpad, a light pen, an optical trackpad, a game controller, a wearable HMI such as smart gloves, a gyroscopic mouse, a pointing stick and / or a trackball. Alternatively, or additionally the input device 110 may be an interacting device such as a webcam, a keyboard, an image scanner, and / or a microphone. In an example the input device 110 may correspond to more than one input device. In the example the input device 110 may correspond to at least one pointer device and at least one interacting device, e.g. a wearable HMI and a microphone; a webcam and a game controller; a touchscreen (being both a pointer and an interactive device in one), a keyboard and an image scanner. Alternatively, the input device 110 may correspond to more than one pointer device. For example, the input device 110 may correspond to a computer mouse, a pointing stick or a track ball. In an alternative example, the input device 110 may correspond to a touchscreen or a trackball- In an alternative example, the input device 110 may correspond to a touchpad and a gyroscopic mouse. Alternatively, the input device 110 may correspond to more than one interacting device. For example, the input device 110 may correspond to a webcam and a keyboard. In an alternative example, the input device 110 may correspond to a microphone and a webcam. In an alternative example, the input device 110 may corresponds to an image scammer, a microphone and a keyboard. The input device 110 which is communicatively connected to the electronic equipment 100 may obtain pointer information relating to the pointing area 142 in the III 140. In an example, the input device 110 may measure the pointer information. Alternatively, or additionally, the input device 110 may retrieve input data and P111908W001

[0034] 6 compute the input data for obtaining the pointer information. The input device 110 may transmit the pointer information to the electronic equipment 100.

[0035] The gaze-tracking device 120 may correspond to a device for measuring eye positions and / or eye movements, such as the point of gaze and optionally analyzing the eye positions and eye movements. The gaze-tracking device 120 may be an eye-attached tracking device, a wearable eye tracking device such as eye-tracking glasses or a virtual reality (VR) and / or augmented reality (AR) eye-tracking device, an optical tracking device such as a video-based eye-tracking device, an infraredbased eye tracking device and / or an electric potential measurement device such as an Electrooculography (EOG)-based eye tracker device and / or Electroretinography (ERG)-based device. The gaze-tracking device 120 being communicatively connected to the electronic equipment 100 may obtain gaze information relating to the gaze area 146 in the III 140. In an example, the gaze-tracking device 120 may measure the gaze information. Alternatively, or additionally, the gaze-tracking device 120 may retrieve input data and compute the input data for obtaining the gaze information. The gaze-tracking device 120 may transmit the gaze information to the electronic equipment 100.

[0036] The display device 130 may correspond to an output device for outputting visual information such as displaying the III 140. The display device 130 may be a video device, a non-video device, a three dimensional (3D) based device and / or a static media device. The video device may be a display such as a Liquid-crystal display (LCD) or light-emitting diode (LED) display. The non-video device may be a Vacuum fluorescent display (VFD), a segment-based display and / or a Light-emitting electrochemical cell (LEC) based display. The 3D based device may be a hologrambased display, a volumetric display and / or a fog display. The static media device may be a movie projector, a transparency-based display, a laser beam based display. The Ul 140 may be displayed using the display device 130. In an example, the display device 130 being communicatively connected to the electronic equipment is receiving the pointer information from the electronic equipment and outputs such and displays at least part of the pointer information in the Ul, e.g. in form of a cursor, marker and / or a Ul element. P111908W001

[0037] 7

[0038] The III element may relate to a basic building block of the III such as buttons, fields and / or text fields. An III object may comprise at least one III element along with logic and behavior and relates to e.g. a visual appearance of the III element, a class of the III element, the behavior of the III elements and methods associated with III elements.

[0039] Figure 2 is a flowchart illustrating a method 200 performed by the electronic equipment 100, as shown in Figure 1 and described in the text thereto.

[0040] The method 200 comprises a first step 210 where the electronic equipment 100 obtains from the input device 110 pointer information relating to at least one pointing area 142 comprised in the III 140. The electronic equipment 100 obtains in a step 220 gaze information from the gaze-tracking device 120.

[0041] The at least one gaze area 146 and the at least one pointing area 142 may correspond to at least one area comprised in the III 140. The at least one gaze area information and the at least one portion area information are e.g. coordinates within the III 140, and / or data corresponding to pointer- or eye-movement and / or pointer or eye-position. The at least one gaze area 146 is e.g. pertaining to at least one part of the III 140 at which the user 150 is gazing at during the at least one gaze interaction. The at least one part of the III 140 at which the user 150 is gazing at may be obtained by the gaze-tracking device 120. In an example, when the user 150 is gazing at the III, the at least one gaze area corresponds to the area that the gaze tracking device 120 detects, e.g. recognizes, as the area within the III that the user 150 is looking at. The information obtained by the gaze-tracking device 120 may correspond to the gaze information. For example, the at least one gaze interaction corresponds to the user 150 gazing at the III 140. The at least one pointing area 142 is e.g. pertaining to at least one part of the III 140 with which the user 150 is interacting with during the at least one pointer interaction. For example, the pointer interaction corresponds to moving, touching or interacting with the input device 110. The at least one part of the III 140 with which the user 150 is interacting with may be obtained by the input device 110. In an example, when the user 150 is interacting with the III, the at least one pointing 142 area corresponds to the area that the input device 110 detects, e.g. recognizes, as the area within the III that the user 150 may interact with. The outcome of the obtaining by the input device 110 may correspond P111908W001

[0042] 8 to the pointer information. For example, the user 150 may move a mouse, or touch a touchscreen for providing pointer information.

[0043] The at least one gaze interaction and / or the at least one pointer interaction may correspond to an interaction, e.g. determined by the input device 110 and / or by the gaze-tracking device 120, and / or to an interaction during a period of time relating to the user gaze and a pointer interaction via which the user 150 is interacting with the III 140.

[0044] The pointer information or gaze information pertains to the at least one pointer interaction or gaze interaction of the user 150 with the III 140. The pointer information or gaze information may comprise the at least one pointing area information or the at least one gaze area information, at least one time stamp corresponding to the at least one pointing area 142 or to the at least one gaze area 146, and / or at least one velocity and / or acceleration information corresponding to the at least one pointing area 142 or the at least one gaze area 146.

[0045] Referring, to Figure 2, the electronic equipment disables in a step 230 a functionality associated with the target area 144 in response to detecting that the pointer information meets a pointer condition associated with the target area 144 and that the gaze information meets a first gaze condition associated with the target area 144. The target area 144 is e.g. a pre-defined and / or user-defined portion of the III 140 and is e.g. a hot corner area. The target area information may pertain to the target area 144. The target area information is e.g. coordinates within the III 140, and / or data corresponding to the pre-defined and / or user-defined portion of the III. The target area 144 may be located anywhere in the III 140 such as in an up-right or up-left placement, down-right or down-left placement, a corner, and / or a placement associated to an III 140 element in the III 140. In an example the target area 144 comprises more than one target areas 144.

[0046] The functionality associated to the target area 144 is e.g. a hot corner functionality such as triggering, starting and / or initiating an action such as a starting an application, locking a screen, starting a screen saver, displaying a III object, triggering a shortcut, changing a III object. P111908W001

[0047] 9

[0048] The pointer condition may comprise that at least part of the at least one pointing area 142 overlaps with the target area 144. In an example, the user 150 may touch, interact with, or move a curser to the target area 144 for the pointer condition to be fulfilled via the input device 110. The first gaze condition may comprise that at least part of the at least one gaze area 146 overlaps with the target area 144. In an example, the user 150 may gaze at the target area 144 for the first gaze condition to be fulfilled, wherein the gaze interaction is obtained by the gaze-tracking device 120. The second gaze condition may comprise that at least part of the at least one gaze area 146 is outside from the target area 144. In an example, the user 150 may gaze outside of the target area 144 for the second gaze condition to be fulfilled. Alternatively, or additionally, the pointer condition may comprise that at least part of the pointer information matches a pointer pattern, the first gaze condition may comprise that at least part of the gaze information matches a first gaze pattern, and / or the second gaze condition may comprise that at least part of the gaze information matches a second gaze pattern.

[0049] The pointer pattern, the first gaze pattern and the second gaze pattern is e.g. at least one interrelated pattern related to pointer information and / or gaze information in correlation with the target area 144, at least one time period of pointer information and / or gaze information in correlation with the target area 144, at least one velocity and / or acceleration information corresponding to the pointer information and / or gaze information in correlation with the target area 144. The pointer pattern, first gaze pattern and the second gaze pattern may be indicative of whether the user 150 intends to enable or disable the functionality associated to the target area 144. Optionally, the pointer pattern, the first gaze pattern and the second gaze pattern correspond to at least one preconfigured pattern, preconfigured by the user 150. Alternatively, the pointer pattern, the first gaze pattern and the second gaze pattern correspond to at least one machine learning pattern set up by a machine learning model. The machine learning model may be trained using predetermined pointer information and / or predetermined gaze information. The at least one machine learning pattern may be continuously updated based on the at least one pointer information and / or the gaze information and the determining steps 220 and 240. In an example, the pointer pattern matches with pointer information for enabling the functionality. In the example, the first gaze pattern matched with gaze information for P111908W001

[0050] 10 disabling the functionality and the second gaze pattern matches with gaze information for enabling the functionality.

[0051] The solution presented herein addresses the above-mentioned challenges of interacting with III objects, such as with at least one III element that resides in the target area 144. Usually, there is a functionality associated with the target area 144 which is triggered when the pointer reaches the target area 144. According to the example solution the pointer may be used and moved to the target area 144 without the functionality being triggered. Further, the solution presented herein enables an improved user experience when interacting with the Ul 140.

[0052] By obtaining the pointer information in step 210, the electronic equipment 100 is enabled to determine if the pointer information is meeting the pointer condition. By obtaining the gaze information in step 220, the electronic equipment 100 may determine if the gaze information is meeting the first gaze condition or a second gaze condition. The electronic equipment 100 disables the functionality associated with the target area 144 if the pointer information meets the pointer condition and the gaze information meets the first gaze condition. Thus, the electronic equipment may improve a user interaction with the Ul 140. In an example, the user 150 intends to interact with the target area without enabling the functionality. In the example, the user e.g. moves, touches and / or interacts with the target area 144 via the input device 110. In prior solutions, such pointer interaction with the target area 144 would trigger the functionality, contrary to the intent of the user 150. By disabling the functionality in response to detecting that the pointer information meets a pointer condition associated with the target area 144 and that the gaze information meets a first gaze condition associated with the target area 144, the user 150 may interact with the target area 144 without enabling the functionality, as the user intended. Thus, the solution presented herein may improve the user experience interacting with the Ul 140.

[0053] Figure 3 is a flowchart illustrating exemplary embodiments 300 of the method 200 performed by the electronic equipment 100, as shown in Figure 2. Figure 3 refers to the electronic equipment 100, the input device 110, the gaze-tracking device 120, the display device 130, the Ul 140, and the user 150 as shown in Figure 1 and described in the text relating thereto. P111908W001

[0054] 11

[0055] Step 302 comprises obtaining 302, by the electronic equipment 100 from the input device 110, the pointer information. Step 302 may correspond to step 210 of method 200. Obtaining may comprise receiving the pointer information via a message such as an input event message. Obtaining 302 may also comprise requesting the pointer information from the input device 110. In the example of the input device 110 being comprised by the electronic equipment 100, the obtaining of pointer information in step 302 means retrieving the pointer information from the input device 110.

[0056] An optional step 304 comprises, detecting 304, by the electronic equipment 100, that the pointer information meets the pointer condition associated with the target area. In an example, the step 302 of obtaining and / or the step 304 of detecting is performed in response to a step 306 of obtaining the gaze information. Alternatively, or additionally, the step 302 of obtaining and / or the step 304 of detecting is performed in response to a step 308 and / or a step 310 of detecting that the gaze information meets the first gaze condition or the second gaze condition. In that example, the power consumption may advantageously be improved in comparison to an example of performing the step 306 and / or step 308 or 310 in response to step 302 and / or 304. In another example, the step 304 and the step 306 may be performed simultaneously.

[0057] Optionally, step 304 may comprise a step 304a of detecting, by the electronic equipment 100, that at least part of the at least one pointing area 142 overlaps with the target area 144. Detecting at step 304a that at least part of the at least one pointing area 142 overlaps with the target area 144 may comprise detecting, by the electronic equipment 100, that at least part of the pointing area information is comprised in the target area information. In an example, detecting at step 304a comprises detecting that at least the majority of the at least one pointing area 142 comprised in the pointer information overlaps with the target area 144. Alternatively, or additionally, detecting 304a may comprise detecting that all of the at least one pointing area 142 overlaps with the target area 144. In an example the at least one pointing area 142 is overlapping and / or intersecting with the target area 144.

[0058] Alternatively, or in addition to step 304a, detecting 304 may comprise an optional step 304b of detecting by the electronic equipment 100, that at least part of the pointer information matches the pointer pattern. In an example, detecting at step P111908W001

[0059] 12

[0060] 304b that at least part of the pointer information matches the pointer pattern may comprise detecting that a rate of change of the pointer information matches the pointing pattern.

[0061] Optionally, detecting at step 304 comprises detecting at step 304c by the electronic equipment 100, that the pointer condition is met for the pointer time period. The pointer time period is a time period during which the pointer condition is met.

[0062] Detecting at step 308c may comprise comparing pointer time period to a pointer time threshold, wherein comparing comprises e.g. exceeding, staying below, or meeting the pointer time threshold. Detecting 304c may enable improvement of the user interaction with the III 140, e.g. in case at least part of the at least one pointing area 142 unintentionally overlaps with the target area 144 or at least part of the pointer information unintentionally matches with the pointer pattern through unintentional pointer movements by the user 150. Step 304c may be performed in response to step 304a and / or 304c.

[0063] At step 306 the electronic equipment 100 obtains gaze information from the gazetracking device 120. Step 306 may correspond to step 220 of method 200. Obtaining 306 may comprise receiving, by the electronic equipment 100, the gaze information via a message such as an input event message. Obtaining gaze information at step 306 may comprise requesting, by the electronic equipment 100, gaze information from the gaze-tracking device 120. In the example of the gaze-tracking device 120 being comprised in the electronic equipment 100, step 306 comprises retrieving, by the electronic equipment 100, gaze information from the gaze-tracking device 120.

[0064] An optional step 308 comprises detecting, by the electronic equipment 100, that the gaze information meets the first gaze condition.

[0065] Optionally, detecting at step 308 may comprise a step 308a of detecting by the electronic equipment 100, that at least a part of the at least one gaze area 146overlaps with the target area 144. Detecting at step 308a that at least a part of the at least one gaze area 146 overlaps with the target area 144 may comprise detecting, by the electronic equipment 100, that at least part of the gaze area information is comprised in the target area information. In an example, detecting 308a comprises detecting, by the electronic equipment 100, that at least the majority P111908W001

[0066] 13 of the at least one gaze area 146 comprised in the gaze information overlaps with the target area 144. Alternatively, or additionally, detecting 308a may comprise detecting by the electronic equipment 100, that all of the at least one gaze area 146 overlaps with the target area 144. In an example the at least one gaze area 146 is overlapping and / or intersecting with the target area 144.

[0067] Alternatively, or additionally to the step 308a, detecting at step 308 may comprise an optional step 308b of detecting, by the electronic equipment 100, that at least part of the gaze information matches the first gaze pattern. In an example, detecting 308b may comprise detecting that a rate of change of the gaze information matches the first gaze pattern. Detecting at step 304b and / or detecting at step 308b may advantageously improve an individual user experience in case the user 150 repeatably gazes at the target area 144 while still intending to enable the functionality associated to the target area 144.

[0068] Optionally, detecting at step 308 may comprise a step 308c of detecting, by the electronic equipment 100, that the first gaze condition is met for the first gaze time period. The first gaze time period is a time period during which the first gaze condition is met. Detecting at step 308c may comprise comparing the first gaze time period to a first gaze time threshold, wherein comparing comprises e.g. exceeding, staying below, or meeting the first gaze time threshold. In an example, detecting at step 308c may comprise detecting by the electronic equipment 100, that second gaze condition is met for the second gaze time period, wherein detecting may comprise comparing the second gaze time period to a second gaze time threshold. The second gaze time period is a time period during which the second gaze condition is met. In an example, comparing comprises exceeding, staying below or meeting the second gaze time threshold. Detecting at step 308c may enable improvement of the user interaction with the III 140, e.g. in case at least part of the at least one gaze area 146 is unintentionally precluded, by the user 150, from the target area 144 or at least part of the gaze information matches unintentionally of the user 150 the second gaze pattern. The step 308c may be performed in response to step 308a and / or 308c.

[0069] An optional step 310 comprises a step 310 of detecting, by the electronic equipment 100, that the gaze information meets the second gaze condition. P111908W001

[0070] 14

[0071] Optionally, detecting at step 310 may comprise a step 310a of detecting, by the electronic equipment 100, that at least part of the at gaze information is precluded from the target area 144. Detecting at step 310a that at least part of the at least one gaze area 146 is outside of the target area 144 may comprise detecting, by the electronic equipment 100, that at least part of the gaze area information is precluded from the target area information. In an example, detecting 310a comprises detecting that at least the majority of the at least one gaze area 146 comprised in the gaze information is precluded from the target area 144. Alternatively, or additionally, detecting at step 310a may comprise detecting that all of the at least one gaze area 146 is outside of the target area 144. In an example the at least one gaze area 146 is overlapping and / or intersecting with the target area 144.

[0072] Alternatively, or additionally to the step 310a, detecting at step 310 may comprise an optional step 310b of detecting, by the electronic equipment 100, that at least part of the gaze information matches the second gaze pattern. In an example, detecting at step 310b may comprise that a rate of change of the gaze information matches the second gaze pattern. The rate of change of the pointer information and the rate of change of the first and second gaze information may be predefined by the user 150 or detected by the machine learning model. Detecting at step 310b may advantageously improve an individual user experience, in case the user 150 is not gazing at the target area 144 while still intending to disable the functionality associated to the target area 144.

[0073] Optionally, detecting at step 310 may comprise a step 310c of detecting, by the electronic equipment 100, that the second gaze condition is met for the second gaze time period. Detecting at step 310c may comprise comparing the second gaze time period to the first gaze time threshold or a third gaze time threshold. In an example comparing comprises exceeding, staying below, or meeting the first gaze time threshold or the third gaze time threshold. In an example, detecting at step 310c may comprise detecting, by the electronic equipment 100, that first gaze condition is met for the first gaze time period, wherein detecting may comprise comparing the second gaze time period to the second gaze time threshold or a fourth gaze time threshold. In the example, comparing comprises e.g. exceeding, staying below or meeting the second gaze time threshold or a fourth gaze time threshold. The first, second, third P111908W001

[0074] 15 or fourth gaze time threshold may be predefined by the user 150 or detected by the machine learning model. Detecting at step 310c may enable improvement of the user interaction with the III 140, e.g. in case at least part of the at least one gaze area 146 unintentionally overlaps with the target area 144 or at least part of the gaze information unintentionally matches he first gaze pattern of the user 150. Step 310c may be performed in response to step 310a and / or 310c.

[0075] Step 312 comprises, disabling, by the electronic equipment 100, the functionality associated with the target area 144 in response to the processing circuitry 404 detecting that the pointer information meets a pointer condition associated with a target area 144 and that the gaze information meets a first gaze condition associated with the target area 144. Step 312 may correspond to step 230 of method 200. In an example, disabling at step 312 comprises detecting if the functionality associated with the target area 144 is enabled or disabled. In the example, in case the electronic equipment 100 detects that the functionality is enabled, the functionality is disabled.

[0076] An alternative step to 312 is an optional step 314, wherein the step 314 comprises enabling, by the electronic equipment 100, the functionality associated with the target area 144 in response to detecting at step 310 that the second condition is met. In an example, enabling at step 314 comprises detecting, by the electronic equipment 100, if the functionality associated with the target area 144 is enabled or disabled. In the example, in case the electronic equipment 100 detects that the functionality is disabled, the functionality is enabled.

[0077] In a first embodiment, the electronic equipment 100 is a portable PC comprising the gaze-tracking device 120 being two or more user-facing cameras, the input device 110 being the touchpad, and the display device 130 being the display of the portable PC displaying the III 140. The functionality is the hot corner functionality and the target area 144 is the hot corner.

[0078] In the first embodiment, the steps 302, 304a, 306, 308a and 312 are performed by the electronic equipment 100.

[0079] In the first embodiment, the step 302 comprises the user 150 inputting pointer information using the input device 110, by moving a cursor in the III 140 inside the target area 144. The electronic equipment 100 is detecting the input and displays the P111908W001

[0080] 16 pointing area 142 based on the pointer information comprising the pointing area information using a mouse marker such as a cursor in the III 140.

[0081] In the first embodiment, the step 304 comprises detecting, by the electronic equipment 100, that the pointing area 142 overlaps with the target area 144. Thus, the electronic equipment 100 determines that the pointer condition is met.

[0082] In the first embodiment, the step 306 comprises obtaining, by the electronic equipment 100, the gaze information in response to determining that the pointer condition is met. Obtaining comprises retrieving the gaze information comprising the gaze area 146 from the webcam and analyzing the gaze information by the electronic equipment 100.

[0083] In the first embodiment, the step 308a comprises detecting, by the electronic equipment 100, that the gaze area 146 overlapa with the target area 144. Thus, the electronic equipment 100 is determining that the gaze information meets the first gaze condition. In step 308 the electronic equipment 100, thus may detect that the user 150 does not intend to enable the functionality but intendsto reach a III object with the mouse marker located in the target area 144 instead.

[0084] In the first embodiment, step 312 comprises disabling the functionality in response to determining that the gaze area 246 overlaps with the target area 144. Disabling the functionality comprises blocking the hot corner functionality.

[0085] A second embodiment is similar to the first embodiment, wherein step 310c and 314 are performed instead of steps 308a and 312.

[0086] In the second embodiment, the step 310c comprises detecting that the gaze area 146 overlaps with the target area 144 for the first gaze time period staying below the first gaze time threshold. Additionally step 310c comprises detecting that the gaze area 146 is outside of the target area 144 for the second gaze time period exceeds the second gaze time period threshold. The electronic equipment 100 thus detects that the gaze information meets the second gaze condition. In the step 310c, the electronic equipment 100 may thus detect that the user 150 intends to enable the functionality but shortly gazes to the target area 144 to move the mouse marker into the target area 144. P111908W001

[0087] 17

[0088] In the second embodiment, the functionality is enabled in response to step 310c.

[0089] A third embodiment is similar as the second embodiment, wherein steps 304c, 308c and 312 are performed instead of steps 304a, 310c and 314. Further, the electronic equipment 100 is a communication device such as a mobile phone or tablet, the display device 130 is the display of the communication device, the input device 110 is a touchscreen of the communication device and the gaze-tracking device 120 corresponds to a front camera of the communication device.

[0090] In the third embodiment, step 304c comprises detecting that the at least one pointing area 142 overlaps with the target area 144 for the pointer time period exceeding a pointer time threshold.

[0091] In the third embodiment, step 308c comprises detecting that the at least one gaze information matches the first gaze pattern for the first gaze time period, wherein the first gaze time period exceeds the first gaze time threshold.

[0092] In response to step 308c, step 312 is performed by the electronic equipment 100.

[0093] In a fourth embodiment, the electronic equipment 100 is XR glasses comprising the eye-tracking device comprising components such as near-infrared light modules, camera sensors and processors and the display. The input device 110 are gloves which the user 150 is wearing. The III 140 is displayed by the XR glasses and corresponds to the field of view. The target area 144 is a III element displayed and the functionality is starting an application.

[0094] In the fourth embodiment, the steps 306, 308a, 308b, 302, 304b, and 312 are performed.

[0095] In the fourth embodiment, the step 308b comprises detecting that the gaze information matches the first gaze pattern. The first gaze pattern matched to the gaze information for disabling the functionality. The gaze information thus corresponds to a user individual eye movement pattern intending to disable the functionality.

[0096] In response to step 308b, the electronic equipment 100 retrieves pointer information from the gloves in step 302. P111908W001

[0097] 18

[0098] In the fourth embodiment, the step 308a comprises detecting that the at least one pointing area is at least partly overlapping with the target area 144. The electronic equipment 100 thus detects that the user 150 may hover at least one of the gloves in the target area 144.

[0099] In the fourth embodiment, the step 308b comprises detecting that the pointer information matches the pointer pattern, wherein the pointer pattern corresponds to the pointer information for disabling the functionality. The pointer information thus corresponds to a user individual pointer movement pattern intending to disable the functionality. The electronic equipment 100 detects that the pointer condition is met and performs step 312 in response to meeting the pointer condition and the first gaze pattern.

[0100] A fifth embodiment is similar to the fourth embodiment, wherein instead of step 308b, the step 310b is performed, wherein instead of step 312, step 314 is performed in response to step 310b, wherein the pointer pattern corresponds to a pointer information for enabling the functionality. The pointer information thus corresponds to a user individual pointer movement pattern intending to enable the functionality.

[0101] In a sixth embodiment, the steps as described in Figure 3 and / or as described in the first to fifth embodiment are performed wherein the target area 144 corresponds to at least one target area 144 and the functionality associated to the target area 144 corresponds to at least one functionality associated to the at least one target area 144.

[0102] Figure 4 illustrates a block diagram illustrating embodiments of the electronic equipment 100 in further detail. In practice, steps 210 to 250 of the method 200 performed by the electronic equipment 100 are performed by the processing circuitry

[0103] 404, embodied as one or more processors and / or microprocessors arranged to execute a computer program 401 that is downloaded to a computer program product

[0104] 405, here in the form of a suitable computer readable storage medium 402 associated with the microprocessor. The computer readable storage medium 402 may be a memory, such as a random access memory (RAM) or a read-only memory (ROM), or a tangible non-volatile computer readable storage medium, such as flash memory or a hard disk drive, or any combination thereof. The computer program 401 P111908W001

[0105] 19 comprises computer-executable instructions stored or downloaded to the computer readable storage medium 402 and are executable by the processing circuitry 404. Alternatively, the computer program 401 may be transferred to the computer readable storage medium 402 using a suitable computer program product, such as a memory stick or in a memory of an electronic equipment 100. Thus, the computer program 401 may be stored in any suitable manner in the computer program product. The processing circuity 404 is arranged to cause the electronic equipment 100 to carry out the steps 210 to 250 of method 200 in accordance with any of the of the described embodiments for steps 210 to 250. The processing circuitry 404 is in one embodiment one or more general-purpose processors wherein each one of the general purpose processors includes one or more cores, but may alternatively be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a complex programmable logic device (CPLD), etc. An I / O interface 403 is provided for communicating with external and / or internal entities using wired communications, e.g., based on Ethernet, and / or wireless communications, e.g., Wi-Fi, and / or a cellular network corresponding to one or a combination of 5G cellular networks, LTE, LTE-advanced, UMTS, or any other current or future wireless network, such as a future 3GPP 6G network, as long as the principles described below are applicable.

Claims

P111908W00120CLAIMS1 . An electronic equipment (100) communicatively connected to a gazetracking device (120), an input device (110) and a display device (130), the electronic equipment (100) comprising processing circuitry (404), wherein the processing circuitry (404) is configured to: obtain, from the input device (110), pointer information comprising pointing area information pertaining to at least one pointing area (142) comprised in a User Interface, III, (140) displayed by the display device (130), wherein the pointer information is pertaining to at least one pointer interaction of a user (150) with the III (140), obtain, from the gaze-tracking device (120), gaze information comprising gaze area information pertaining to at least one gaze area (146) comprised in the III (140), wherein the gaze information is pertaining to at least one gaze interaction of the user (150) with the III (140); and in response to the processing circuitry (404) detecting that the pointer information meets a pointer condition associated with a target area (144) and that the gaze information meets a first gaze condition associated with the target area (144), wherein the target area (144) is a portion of the III (140): disable a functionality associated with the target area (144), wherein the pointer condition comprises at least part of the pointer information matching a pointer pattern, the first gaze condition comprises at least part of the gaze condition matching a first gaze pattern, the pointer information and the first gaze pattern being indicative that the user 150 intends to disable the functionality associated with the target area (144).

2. Electronic equipment (100) according to any of the previous claims, wherein the pointer condition additionally comprisesP111908W00121 at least part of the at least one pointing area (142) overlapping with target area (144).

3. Electronic equipment (100) according to claim 1 or 2, wherein the first gaze condition additionally comprises: at least part of the at least one gaze area (146) overlapping with the target area (144).

4. Electronic equipment (100) according to claim 1 or 2, wherein in response to detecting that the pointer information meets the pointer pattern associated with the target area (144) and that a second gaze condition matches a second gaze pattern, the processing circuit (404) is configured to enable the functionality associated with the target area (144).

5. Electronic equipment (100) wherein the second gaze condition additionally comprises at least part of the at least one gaze area (146) being outside of the target area (144).

6. Electronic equipment (100) according to any of the previous claims, wherein the processing circuitry (404) is further configured to detect that the pointer information meets the pointer condition for a pointer time period.

7. Electronic equipment (100) according to any of the previous claims, wherein the processing circuitry (404) is further configured to detect that the gaze information meets the first gaze condition or a second gaze condition for a first gaze time period and / or for a second gaze time-period.

8. Electronic equipment (100) according to any of the previous claims, wherein the electronic equipment (100) comprises at least one of: the input device (110); the gaze-tracking device (120); the display device (130); andP111908W00122 a computer readable storage medium (402).

9. A method performed by an electronic equipment (100), wherein the method comprises: obtaining (210), from an input device (110), pointer information comprising pointing area information pertaining to at least one pointing area (142) comprised in a User Interface, III, (140) displayed by a display device (130), wherein the pointer information is pertaining to at least one pointer interaction of a user (150) with the III (140); obtaining (220), from a gaze-tracking device (120), gaze information comprising gaze area information pertaining to at least one gaze area (146) comprised in the III (140), wherein the gaze information is pertaining to at least one gaze interaction of the user (150) with the III (140); and in response to detecting (304, 308) that the pointer information meets a pointer condition associated with a target area (144) and that the gaze information meets a first gaze condition associated with the target area (144), wherein the target area (144) is a portion of the III (140): disabling (230) a functionality associated with the target area (144), wherein the pointer condition comprises at least part of the pointer information matching a pointer pattern, the first gaze condition comprises at least part of the gaze condition matching a first gaze pattern, the pointer information and the first gaze pattern being indicative that the user 150 intends to disable the functionality associated with the target area (144).P111908W0012310. The method according to claim 9, wherein the pointer condition additionally comprises at least part of the at least one pointing area (142) overlapping with the target area (144).11 . The method according to claim 9 or 10, wherein the first gaze condition additionally comprises at least part of the at least one gaze area (146) overlapping with the target area (144).

12. The method according to claim 9 or 10, wherein in response to detecting (204, 310) that the pointer information meets the pointer pattern associated with the target area (144) and that a second gaze condition matches a second gaze pattern, the processing circuit (404) is configured to enable the functionality associated with the target area (144).

13. The method according to claim 9 or 10, wherein the second gaze condition additionally comprises at least part of the at least one gaze area (146) being outside of the target area (144).

14. The method according to any of claims 9 to 13, wherein detecting (304) that the pointer information meets the pointer condition comprises: detecting (304c) that the pointer condition is met for a pointer time period.

15. The method according to any of claims 9 to 14, wherein detecting (308, 310) that the gaze information meets the first gaze condition or a second gaze condition comprises: detecting (308c) that the first gaze condition is met for a first gaze time period; and / or detecting (310c) that the second gaze condition is met for a second gaze time period16. Electronic equipment (100) according to any one of claims 1 to 8, configured to perform the method according to any of claims 9 to 15.P111908W0012417. A computer program (401 ) comprising instructions which, when executed on processing circuitry (404) of an electronic equipment (100), cause the processing circuitry (404) of the electronic equipment (100) to carry out the method according to any one of claims 9 to 15.

18. A tangible, non-volatile computer readable medium (402) comprising instructions that, when executed on processing circuitry (404) of an electronic equipment (100), cause the processing circuitry (404) of the electronic equipment (100) to carry out the method according to any one of claims 9 to 15.

Images