Gaze interaction system for head mounted wearable device

Abstract

Systems and methods are provided for gaze-based interaction with augmented reality content output by a head mounted wearable device including display capability and processing / computing capability. Head tracking allows for hands-free, gesture based interaction with content, object selection, and shift of focus amongst selectable objects, providing for hands-free, heads-up user interaction with augmented reality content output by the head mounted wearable device in a relatively natural, and discreet, manner.

Description

GAZE INTERACTION SYSTEM FOR HEAD MOUNTED WEARABLE DEVICEFIELD

[0001] This relates, in general, to a head mounted wearable device, and in particular, to a gaze based interaction system for a head mounted wearable device.BACKGROUND

[0002] Wearable computing devices can include, for example, head mounted display devices including smart glasses and the like, arm / wrist / hand worn devices including smart watches, smart bracelets / bands, smart rings, smart pendants and the like, headphones / ear buds, and other such devices. Users can interact with content made available by wearable computing devices, can capture and / or process and / or access information using wearable computing devices, and can communicate with other external devices using the wearable computing device.SUMMARY

[0003] In a first general aspect, a computer-implemented method includes generating, by a processor of a head mounted wearable device, a user interface including a plurality of selectable elements; outputting, by a display device of the head mounted wearable device, the user interface in a display area within a field of view of a user of the head mounted wearable device; associating the plurality of selectable elements of the user interface with a corresponding plurality of selection areas of the display area, wherein each of the plurality of selection areas borders at least one other of the plurality of selection areas such that the plurality of selection areas occupy substantially all of the display area; tracking a head gaze associated with the head mounted wearable device; detecting a movement of the head gaze; and shifting a user focus, from a first selectable element to a second selectable element of the plurality of selectable elements of the user interface in response to a determination that the movement of the head gaze corresponds to a gaze input for selection of the second selectable element. Implementations can include one or more of the following features, in particular a combination of any two or more of the following features.

[0004] In some implementations, the plurality of selection areas extend in a first directioncorresponding to a first axis, from a first end portion to a second end portion of the display area, and the plurality of selection areas are sequentially arranged in a second direction corresponding to a second axis, from a third end portion to a fourth end portion of the display area, with each of the plurality of selection areas bordering at least one other of the plurality of selection areas.

[0005] In some implementations, shifting the user focus includes shifting the user focus from the first selectable element to the second selectable element in response to detection of a movement of the head gaze in the second direction corresponding to the second axis; and maintaining the user focus on the first selectable element in response to detection of a movement of the head gaze in the first direction corresponding to the first axis.

[0006] In some implementations, shifting the user focus from the first selectable element to the second selectable element includes shifting the user focus from the first selectable element to the second selectable element in response to detecting that the movement of the head gaze in the second direction corresponding to the second axis is greater than or equal a set threshold distance that moves the head gaze from a first selection area to a second selection area of the plurality of selection areas, the first selection area being associated with the first selectable element, and the second selection area being associated with the second selection area.

[0007] In some implementations, the computer-implemented method includes maintaining focus on the first selectable element in response to detecting that the movement of the head gaze in the second direction corresponding to the second axis is less than the set threshold distance, such that the head gaze remains directed to the first selection area.

[0008] In some implementations, the second axis is substantially orthogonal to the first axis.

[0009] In some implementations, the plurality of selection areas are arranged in a two by two grid in the display area.

[0010] In some implementations, tracking a head gaze associated with the head mounted wearable device includes determining a movement direction and a movement distance associated with the detected movement based on position data and orientation data received from an inertial measurement unit of the head mounted wearable device; determining a termination of the detected movement based on acceleration data associated with the detected movement based on acceleration data received from the inertial measurement unit; and determining a termination point of the head gaze with respect to the plurality of selection areas in response to determining the termination point of the detected movement.

[0011] In another general aspect, a head mounted wearable device includes a display device; a gaze tracking device; at least one processor; and a non-transitory computer-readable medium storing executable instructions. The executable instructions cause the at least one processor to generate a user interface including a plurality of selectable elements; trigger output, by the display device, of the user interface in a display area defined within a field of view of a user of the head mounted wearable device; associate the plurality of selectable elements of the user interface with a corresponding plurality of selection areas of the display area, with each of the plurality of selection areas bordering at least one other of the plurality of selection areas such that the plurality of selection areas occupy substantially all of the display area; detect a movement of a head gaze associated with the head mounted wearable device; and shift a user focus, from a first selectable element to a second selectable element of the plurality of selectable elements of the user interface in response to a determination that the movement of the head gaze corresponds to a gaze input for selection of the second selectable element. Implementations can include one or more of the following features, in particular a combination of any two or more of the following features.

[0012] In some implementations the plurality of selection areas occupy at least 90% of the display area. Hence, the term “occupy substantially” can be understood as occupying at least 90% of the display area. Alternatively, the plurality of selection areas occupy all of the display area. In some implementations, the plurality of selection areas can occupy less than 90% of the display area. Tn some implementations, shifting the user focus from the first selectable element to the second selectable element comprises designating the second selectable element as an element to be selected by the user for further interaction, manipulation and the like. In some implementations, shifting the user focus from the first selectable element to the second selectable element includes changing an appearance of the second selectable element to provide an indication to the user that the second selectable element is the object of focus, to be selected by the user. In some implementations, the plurality of selection areas extend in a first direction corresponding to a first axis, from a first end portion to a second end portion of the display area, and the plurality of selection areas are sequentially arranged in a second direction corresponding to a second axis, from a third end portion to a fourth end portion of the display area, with each of the plurality of selection areas bordering at least one other of the plurality of selection areas.

[0013] In some implementations, the executable instructions cause the at least one processorto shift the user focus from the first selectable element to the second selectable element in response to detection of a movement of the head gaze in the second direction corresponding to the second axis; and maintain the user focus on the first selectable element in response to detection of a movement of the head gaze in the first direction corresponding to the first axis.

[0014] In some implementations, the executable instructions cause the at least one processor to shift the user focus from the first selectable element to the second selectable element in response to detecting that the movement of the head gaze in the second direction corresponding to the second axis is greater than or equal a set threshold distance that moves the head gaze from a first selection area to a second selection area of the plurality of selection areas, the first selection area being associated with the first selectable element, and the second selection area being associated with the second selection area.

[0015] In some implementations, the executable instructions cause the at least one processor to maintain focus on the first selectable element in response to detecting that the movement of the head gaze in the second direction corresponding to the second axis is less than the set threshold distance, such that the head gaze remains directed to the first selection area.

[0016] In some implementations, the plurality of selection areas are arranged in a two by two grid in the display area.

[0017] In some implementations, the executable instructions cause the at least one processor to track a head gaze associated with the head mounted wearable device, including determine a movement direction and a movement distance associated with the detected movement based on position data and orientation data received from an inertial measurement unit of the head mounted wearable device; determine a termination of the detected movement based on acceleration data associated with the detected movement based on acceleration data received from the inertial measurement unit; and determine a termination point of the head gaze with respect to the plurality of selection areas in response to determining the termination point of the detected movement.BRIEF DESCRIPTION OF THE DRAWINGS

[0018] FIG. 1 A illustrates example wearable devices, worn by a user in an ambient environment.

[0019] FIG. IB is a front view of an example head mounted wearable device worn by theuser in FIG 1 A.

[0020] FIG. 1C is a rear view of the example head mounted wearable device shown in FIG.IB.

[0021] FIG. ID. 3 is a block diagram of an example system for gaze interaction in an example head mounted wearable device.

[0022] FIG. 2A is a third person view of a user in an ambient environment, illustrating a field of view of the user wearing an example head mounted wearable device.

[0023] FIG. 2B illustrates a user view of the ambient environment through a lens portion of the example head mounted wearable device.

[0024] FIG. 3A is a schematic view of an example display area.

[0025] FIG. 3B illustrates an example user interface output at the example display area shown in FIG. 3 A.

[0026] FIG. 3C illustrates a tracking of user head movement.

[0027] FIGs. 3D-3F illustrate a series of user head gazes directed at the example user interface shown in FIG. 3B.

[0028] FIG. 4A is a schematic view of an example display area.

[0029] FIG. 4B illustrates an example user interface output at the example display area shown in FIG. 4A.

[0030] FIG. 4C illustrates a tracking of user head movement.

[0031] FIGs. 4D-4F illustrate a series of user head gazes directed at the example user interface shown in FIG. 4B .

[0032] FIG. 5A is a schematic view of an example display area.

[0033] FIG. 5B illustrates an example user interface output at the example display area shown in FIG. 5A.

[0034] FIGs. 5C and 5D illustrate tracking of user head movement.

[0035] FIGs. 6A-6D illustrate a series of user head gazes directed at the example user interface shown in FIG. 5B.

[0036] FIG. 7 is a flowchart of an example methodDETAILED DESCRIPTION

[0037] Wearable devices provide users with the opportunity to interact with content outputby the device, capture and / or process and / or access information, communicate with other external devices, and the like. Traditional methods of interacting with content output by a computing device may be difficult to implement and / or may be somewhat ineffective in some types of wearable devices. For example, traditional input methods such as a mouse, a keyboard, a touch input surface and the like may be impractical and / or ineffective in a wearable device due to considerations such as form factor and associated constraints on installation volume, power consumption, accessibility, practicality and the like. For example, in a head mounted wearable device in the form of, for example, smart glasses, a form factor associated with the smart glasses may render touch and / or swipe types of inputs difficult to implement due to the limited space available for a touch input surface, input devices, and the like. Even if input devices were to be incorporated into this form factor, physical separation of the input device and visual content projected in front of the user may render this type of input / interaction somewhat ineffective and / or difficult. Similarly, limited space to accommodate input surfaces on external devices operably coupled to or paired with the wearable device, alone or together with physical separation of these input surfaces from the visual content, may render these types of inputs / interactions somewhat ineffective and / or difficult. In some situations, hand gestures for interaction with visual content projected in front of the user may be somewhat awkward or uncomfortable, particularly in a social setting.

[0038] Systems and methods, in accordance with implementations described herein, provide for gaze-based interaction with content output by a wearable device. In some examples, the content is output by a head mounted wearable device including display capability and processing / computing capability. In some examples, the content is augmented reality (AR), or mixed reality (MR), or virtual reality (VR), content. In some examples, systems and methods, in accordance with implementations described herein, implement hands-free gesture based input for interaction with content output by the wearable device. In some examples, the interaction systems and methods make use of relatively natural gaze-based inputs for interaction with content output in a field of view of a user of the wearable device. Systems and methods, in accordance with implementations described herein, provide for hands-free, heads-up user interaction with content output by the wearable device in a relatively natural, and discreet, manner.

[0039] In some implementations, the gazed-based user input is based on a user head gaze,directed at a plurality of AR / VR / MR selectable elements. Tn some implementations, the plurality of selectable elements correspond to a plurality of selection areas of a display area of the wearable device. In some implementations, the plurality of selection areas are arranged contiguously along an axis of the display area, such that each of the plurality of selection areas border at least one other of the plurality of selection areas. The lack of gaps, or dead zones, or non-selection zones, within the display area and / or between selection areas eliminates ambiguity in associating a detected user head gaze with one of the plurality of selection areas and the corresponding selectable element.

[0040] FIG. 1A illustrates an example head mounted wearable device 100, worn by a user in a physical space 1000. FIG. 1A also illustrates other example wearable devices worn by the user, including another example head mounted wearable device 192 in the form of ear buds worn in one or both ears of the user, and an example arm / wrist / hand mounted wearable device 194 in the form of a smart watch. FIG. 1A also illustrates a handheld device 195 held by the user, in the form of a smart phone. In some examples, the example head mounted wearable device 100, the example head mounted wearable device 192, the example wrist mounted wearable device 194, and the handheld device 195 can communicate with each other. In some examples, the example head mounted wearable device 100, the example head mounted wearable device 192, the example wrist mounted wearable device 194, and the handheld device 195 can communicate with external resources 1100 accessible via a network 1200. Communication amongst the devices 100, 192, 194, 195 and / or with the external resources 1 100 via the network 1200, allow the devices 100, 192, 194, 195 to exchange information, to receive and transmit input and / or output, and the like. Hereinafter, systems and methods will be described with respect to the example head mounted wearable device 100, for purposes of discussion and illustration. The principles described herein can be applied to user interaction with content output by other wearable devices, including the example wearable devices and / or handheld devices shown in FIG. 1A, and other devices not explicitly shown.

[0041] FIGs. IB and 1C illustrate features of the example head mounted wearable device 100, in the form of smart glasses, shown in FIG. 1A. In particular, FIG. IB is a front view, and FIG. 1C is a rear view, of the example head mounted wearable device 100 shown in FIG. 1 A. FIG. ID is a block diagram of the example wearable device 100 shown in FIGs. 1A-1C. The features of the example wearable device 100 to be described with respect to FIGs. IB and 1C arepresented for purposes of discussion and illustration. The principles to be described herein can be applied to a wearable device including more, or fewer features and / or different combinations of features than explicitly shown and / or described herein.

[0042] The example wearable device 100, in the form of smart glasses as shown in FIGs. 1A-1C, includes a frame 102 including rim portions 103 surrounding glass portions, or lenses 107. In some examples, the lenses 107 may be corrective / prescription lenses. In some examples, the lenses 107 may be glass portions that do not necessarily incorporate corrective / prescription parameters. In some examples, a bridge portion 109 connects the rim portions 103 of the frame 102. An arm portion 130 is coupled, for example, rotatably coupled, to each rim portion 103. In some examples, the frame 102, including the rim portions 103, the bridge portion 109, and the arm portions 130 define a housing of the example wearable device 100, in which components of the example computing device are received. In some examples, one or both of the rim portions103 defines a housing of the example wearable device 100 in which components can be received. In some examples, one or both of the arm portions 130 defines a housing of the example wearable device 100 in which components can be received.

[0043] The example wearable device 100, in the form of the head mounted wearable device, or smart glasses, as shown in FIGs. IB and 1C, includes a display device 104, an audio input device 106, or microphone, an illumination device 108, a sensing system 110, a control system 112, at least one processor 114, and an outward facing image sensor 116 (for example, a camera). In some examples, the sensing system 110 includes various sensing devices, and the control system 112 includes various control system devices including, for example, the at least one processor 114 operably coupled to the components of the control system 112.

[0044] In some examples, the display device 104 outputs visual content, under the control of the control system 112, for example, at an output coupler 105, so that the visual content is visible to the user. In the example shown in FIGs. IB and 1C, the display device 104 is provided in one of the two arm portions 130, simply for purposes of discussion and illustration. Display devices104 can be provided in each of the two arm portions 130 to provide for binocular output of content. In some examples, the display device 104 is a see-through near eye display. In some examples, the display device 104 is configured to project light from a display source onto a portion of teleprompter glass functioning as a beamsplitter seated at an angle (for example, 30-45 degrees, or other angle based on the overall configuration of the wearable device 100). In someexamples, the beamsplitter generates reflection and transmission values that allow light from the display device 104 to be partially reflected while remaining light is transmitted through the beamsplitter. In some examples, this type of optic design allows a user to see both physical items in the ambient environment, for example, through the lenses 107, together with content (for example, digital images, user interface elements, virtual content, and the like) output by the display device 104. In some examples, waveguide optics may be used to depict content by the display device 104.

[0045] In some examples, the audio input device 106 detects audio signals, for processing by the at least one processor 114 as an audio input command for execution by the control system 112. In some examples, image data detected by the image sensor 116 may be processed by the at least one processor 114 for the detection of gesture inputs to be executed by the control system 112. In some examples, movements, or gestures, or changes in head / position and / or orientation detected by position and / or orientation sensors, for example, accelerometers and / or gyroscopes and / or magnetometers and the like of an inertial measurement unit (IMU) 117 may be processed as gesture inputs, or head gaze inputs, to be executed by the control system 112. Thus, in some examples, the one or more position and / or orientation sensors define a first gaze tracking system that detects and tracks head position and head movement. In some examples, touch inputs detected at a touch sensitive surface (not shown in FIGs. IB and 1C) of the frame 102 may be processed by the at least one processor 114 as a touch input command for execution by the control system 1 12.

[0046] In some examples, the wearable device 100 includes a second gaze tracking device 115 to detect and track eye gaze direction and movement. In some examples, data captured by the gaze tracking device 115 is processed by the at least one processor 114 to detect and track gaze direction and movement as a user input for execution by the control system 112. In the example shown in FIGs. IB and 1C, the gaze tracking device 115 is provided in one of the two arm portions 130, and the gaze tracking device 115 is provided in the same arm portion 130 as the display device 104, so that user eye gaze can be tracked not only with respect to objects in the physical environment, but also with respect to the content output by the display device 104. In some examples, a gaze tracking device 115 is provided in each of the two arm portions 130 to provide for gaze tracking of each of the two eyes of the user.

[0047] The example wearable device 100, in the form of the head mounted wearable device,or smart glasses, as shown in FIGs. IB and 1 C, includes an audio output device 160 (such as, for example, one or more speakers) provided, for example, in a housing defined by each of the two arm portions 130 of the frame 102, so that sound output by the audio output device 160 can be directed toward the ear of the user.

[0048] In some examples, the wearable device 100 includes a power storage device 120, such as, for example, a battery, that provides power to the components of the wearable device 100. In the example shown in FIGs. IB and 1C, the power storage device 120 is included in a housing defined by one of the arm portions 130, simply for purposes of discussion and illustration.

[0049] In some examples, some of the components of the example wearable device 100 described above define an input system that receive, or detect, or sense, inputs to be processed by the control system 112. For example, components of the sensing system and various input sensors of the example wearable device 100 may define an input system of the example wearable device. In some examples, conditions detected by the image sensor 116 and / or gaze / gestures detected by the gaze tracking device 115 and / or the IMU 117 and / or audio inputs detected by the audio input devices 106 and / or touch inputs detected at a touch input surface may be processed as inputs to be executed by the control system 112. In some examples, the display device 104, the audio output device 160, haptic devices (not shown in FIGs. IB and 1C), and other such devices, form an output system of the example wearable device 100. In some examples, one or more communication modules provide for communication and exchange of information between the example wearable device 100 and other external devices, including the external resources 1100. In some examples, one or more memory devices are accessible to the at least one processor 114 and the control system 112 for local storage of information.

[0050] FIG. 2A is a third person view of a user, wearing the example head mounted wearable device 100, in the physical space 1000. FIG. 2B illustrates a user view 1000 A of the physical space 1000, through one of the lenses 107 of the example wearable device 100, including a virtual object 200 output by the display device 104 of the example wearable device 100. In the example shown in FIGs. 2A and 2B, the virtual object 200 is output by the display device 104 such that the virtual object 200 is within a field of view of the user. In some examples, the virtual object 200 occupies substantially all of a display area 210 available for display of content output by the display device 104. In some examples, the virtual object 200 is projected in front of theuser, for example, within a three-dimensional volume in front of the user. Tn some examples, the virtual object 200 is projected as a three-dimensional object in front of the user. In some examples, the user can interact with and / or manipulate the virtual object 200. In some examples, the user can implement a user input to select the virtual object 200 and / or an element of the virtual object 200 for interaction and / or manipulation.

[0051] In some examples, the user input can be implemented through, for example, a user input at an input portion of the head mounted wearable device 100. In some examples, the user input can be implemented through a user input at an input portion of an external device that is operably coupled to, or paired with, the head mounted wearable device 100. In some situations, these types of inputs may be difficult and / or or awkward and / or somewhat inaccurate in user implementation due to, for example, a separation of and / or lack of connection between the user input and the virtual object 200. In some examples, the user input can be implemented through hand gestures that touch, or contact the virtual object 200 projected in front of the user. In some examples, the user can interact with the virtual object 200 through, for example, hand gestures directed at the virtual object 200 projected in front of the user. In some situations, this type of interaction, in which the user virtually touches or grabs or otherwise manipulates the virtual object 200, may be somewhat more intuitive and / or accurate. However, the use of hand gestures for interaction with the virtual object 200 projected in front of the user may be somewhat awkward in, for example, public and / or social situations, in which the virtual object is not visible to others. Systems and methods, in accordance with implementations described herein, provide for gaze-based interaction with content output by a wearable device, such as the example head mounted wearable device 100. Systems and methods, in accordance with implementations described herein, implement hands-free, gaze-based input for interaction with content output by the example head mounted wearable device 100 in a relatively natural, and discreet, manner.

[0052] Systems and methods, in accordance with implementations described herein, may map gaze tracking data to visual content, or virtual objects or elements, output by a display device of the wearable device, to provide for hands-free, heads-up, gesture based interaction with the content. For example, head tracking data, provided by, for example, position and / or orientation sensors of the wearable device, for example, sensors included in an inertial measurement unit (IMU) of the wearable device (i.e., gyroscope(s) and / or accelerometer(s) and / or magnetometer(s) and the like) can be correlated with content output by a display device ofthe wearable device to provide for hands-free, heads-up, gesture-based interaction with the content. In an example in which the wearable device is a head mounted wearable device, the gaze tracking data is head tracking data provided by the position and / or orientation sensors of the wearable device. In an example in which the content is a virtual object output by the display device 104 of the example head mounted wearable device 100, in which the virtual object 200 is projected outward, in front of the user as shown in FIGs. 2A and 2B, the gaze tracking data may be correlated with items or elements of the virtual object 200 such that accurate selection of an element or item or portion of the virtual object 200 does not rely on a high resolution, pointer to pixel, mapping of a user gaze to a corresponding portion of the virtual object 200.

[0053] Systems and methods, in accordance with implementations described herein, provide for gaze-based interaction virtual user interfaces including virtual elements that are selectable in response to gaze-based gestures detected by a head mounted wearable device. In some implementations, the virtual user interface and / or selection areas associated with any selectable virtual elements of the virtual user interface occupies substantially all of a display area of the display device, the display area being a designated area defined within a field of view of a user of the head mounted wearable device. In some examples, the selection areas are defined in a plurality of adjacent layers or segments within the display area, defining a one-dimensional user interface that allows for selection of one of the selectable elements in response to a detected gaze movement in a single direction with respect to the user interface. In some examples, the plurality of adjacent layers are oriented substantially vertically. In this arrangement, selection of one of the plurality of selectable elements of the user interface is detected in response to a detected head gaze movement in a horizontal direction. In some examples, the plurality of adjacent layers are arranged horizontally. In this arrangement, selection of one of the plurality of selectable elements of the user interface is detected in response to a detected head gaze movement in vertical direction. In some examples, the selection areas are arranged in a grid defined within the display area defining a two-dimensional user interface that allows for selection of one of the selectable elements in response to a detected gaze movement to a particular sector of the display area. In some examples, the user interface includes four selectable elements arranged in a two-by-two grid. In this arrangement, selection of one of the plurality of selectable elements of the user interface is detected in response to a detected head gaze movement into a particular quadrant of the display area.

[0054] Systems and methods, in accordance with implementations described herein, incorporated into the example head mounted wearable device 100 described above, allow a user to move or shift focus from one selectable virtual object or element to another by simply rotating their head in the direction of the desired virtual object or element. In some examples, when selectable objects or elements are output / visible within the field of view of the user, one of the selectable objects or elements may be the object of focus at any given time. This may allow the user to recognize in which direction to rotate their head to shift or move focus to another selectable object or element. In some examples, in which there is only one selectable object or element, that one selectable object or element may remain the object of focus, by default.

[0055] FIG. 3A is a schematic view of an example display area 300. The example display area 300 may be comparable to the display area 210 described above with respect to FIGs. 2A and 2B. That is, the display area 300 may be a designated area for the display of content output by the display device 104, within the field of view of the user wearing the example head mounted wearable device 100. As described above, the display area 300 may include a plurality of selection areas, corresponding to a plurality of selectable elements of a user interface to be displayed in the display area 300. In the example arrangement shown in FIG. 3A, the example display area 300 includes a first selection area 310, a second selection area 320, and a third selection area 330. In the example shown in FIG. 3A, the first selection area 310, the second selection area 320, and the third selection area 330 are oriented vertically (in the example orientation shown in FIG. 3A). Tn the example arrangement shown in FIG. 3A, the first selection area 310, the second selection area 320, and the third selection area 330 extend from an upper side portion 300A to a lower side portion 300B of the display area 300. In the example arrangement shown in FIG. 3 A, the first selection area 310, the second selection area 320, and the third selection area 330 are sequentially arranged from a first lateral side portion 300C to a second lateral side portion 300D of the display area 300. In the example arrangement shown in FIG. 3A, the first selection area 310, the second selection area 320, and the third selection area 330 occupy substantially all of the display area 300 designated for the output of content by the display device 104 of the example head mounted wearable device 100. In some examples, the selection areas 310, 320, 330 occupy all of the display area 300, or at least greater than 90% of the display area 300.

[0056] In some examples, a user interface, output by the display device 104 of the examplehead mounted wearable device 100, may be displayed in the display area 300. FIG. 3B illustrates an example user interface 350, displayed in the example display area 300 shown in FIG. 3A. The example user interface 350 may be generated by one or more processors of the example head mounted wearable device 100, and output in the display area 300 by the display device 104 of the example head mounted wearable device 100. In the example shown in FIG. 3B, the example user interface 350 includes a first selectable user interface element 351, displayed at a position corresponding to a portion of the first selection area 310 of the display area 300. The example user interface 350 includes a second selectable user interface element 352, displayed at a position corresponding to a portion of the second selection area 320 of the display area 300. The example user interface 350 includes a third selectable user interface element 353, displayed at a position corresponding to a portion of the third selection area 330 of the display area 300.

[0057] In the example arrangement shown in FIG. 3B, the selectable user interface elements 351, 352, 353 of the user interface 350 (respectively corresponding to the selection areas 310, 320, 330 of the display area 300) are arranged along a single axis, i.e., the Y axis. Thus, a head movement of the user in the vertical direction, i .e., along the Y axis / in the direction of the arrow D2, may be implemented to change or shift a focus on one of the selectable user interface elements 351, 352, 353 of the user interface 350.

[0058] As shown in FIG. 3C, in some examples, the system may process data from the IMU of the example head mounted wearable device 100 to determine if the user has moved their head for a distance that is greater than or equal to a set threshold distance LI , to for example release focus from a current virtual object or element, and / or trigger a change, or a shift in focus, to a desired selectable virtual object or element. In some examples, if it is determined that the movement is less than the set threshold distance, the system may maintain focus on the current virtual object. As shown in FIG. 3C, in some examples, position and / or acceleration data, for example, from the IMU of the example head mounted wearable device 100, may be taken into account not just in detecting movement, but also in detecting whether or not a detected head movement has settled on a desired selected virtual object or element at a point Pl, where acceleration of the detected movement tapers and eventually settles. In some examples, this type of data may be used to determine whether a detected head movement is an intentional move for a change or shift in focus. For example, this type of data may be taken into account to discriminate between an intentional shift of focus to another of the selectable virtual objects or elements, anda turn of the head to engage in conversation.

[0059] FIGs. 3D-3F illustrate a plurality of different user gazes, or a series of user gazes, directed at the user interface 350. The plurality of user gazes shown in FIGs. 3D-3F correspond to a plurality of different head gaze positions of the user, or gazes associated with head movement of the user, and a corresponding plurality of different gaze positions of the example head mounted wearable device 100 worn by the user. A user selection of one of the first selectable user interface element 351, the second selectable user interface element 352, or the third selectable user interface element 353 can be made, based on detection of the user gaze directed at a portion of the user interface 350 corresponding to the first, second, or third selection area 310, 320, 330 of the display area 300 in which the user interface 350 is displayed. In particular, in the example shown in FIGs. 3D-3F, one of the first selectable user interface element 351, the second selectable user interface element 352, or the third selectable user interface element 353 can be selected as the object of user focus based on a horizontal head movement (in the example orientation shown in FIGs. 3D-3F), for example, along the X axis / in the direction of the arrow DI, relative to the user interface 350 displayed in the display area 300. In this example arrangement, a vertical head movement (in the example orientation shown in FIGs. 3D-3F), for example, along the Y axis / in the direction of the arrow D2, relative to the user interface 350 does not affect the selection of one of the user interface elements 351, 352, 353, due to the vertical orientation of the first, second and third selection areas 310, 320, 330, and their sequential arrangement along a single axis, i.e., along the horizontal axis, or the X axis. Thus, the arrangement of the user interface elements 351, 352, 353 along a single axis (the horizontal axis, in the example orientation shown in FIGs. 3D-3F) allows for selection of one of the user interface elements 351, 352, 352 as the object of user focus based on head movement in the direction of the single axis.

[0060] In particular, FIG. 3D illustrates a first gaze Gl, a second gaze G2, and a third gaze G3 all having terminal end points intersecting, or corresponding to the first selection area 310 and the first selectable user interface element 351 of the user interface 350. The first gaze Gl, second gaze G2 and third gaze G3 may represent the direction of the head of the user relative to the interface elements 351, 352, 353 of the user interface 350 as the user moves, for example, sequentially moves, their head from a position associated with the first gaze Gl, to a position associated with the second gaze G2, to a position associated with the third gaze G3. In FIG. 3D,the first gaze G1 , the second gaze G2 and the third gaze G3 are at different vertical positions within the first selection area 310 associated with the first selectable user interface element 351. In FIG. 3D, the first gaze Gl, the second gaze G2 and the third gaze G3 are at different horizontal positions, but still within the first selection area 310 associated with the first selectable user interface element 351. In the example shown in FIG. 3D, selection of one of the user interface elements 351, 352, 353 of the user interface 350 is not affected by a vertical position of the user gaze. Further vertical movement of the gaze, for example, in the direction of the arrow D2, will move the gaze away from the display area 300 in which the user interface 350 is displayed, indicating the user does not intend to interact with the user interface 350. In the example shown in FIG. 3D, the first selectable user interface element 351 may be selected as the object of user focus in response to detection of any one of the first gaze Gl, the second gaze G2 or the third gaze G3, or another gaze directed to the first selection area 310 not explicitly shown. In some examples, the first selectable user interface element 351 may be selected as the object of user focus in response to detection of a gaze directed at the first selection area 310, together with a selection confirmation such as, for example, detection of a gaze directed at the first selection area 310 sustained for greater than or equal to a threshold amount of time, detection of an audible command, a gesture command, a touch input, or other such confirmation action.

[0061] As noted above, in some examples, in a situation in which multiple selectable virtual objects or elements are output in the field of view of the user, one of the selectable objects or elements may be, by default, designated as the object of focus, to provide an indication to the user of a direction in which the user should move their head in order to shift focus to another of the selectable objects or elements. In a situation in which the first selectable user interface element 351 is, by default, initially designated as the object of focus, the user may choose to move their head to shift focus to the second selectable user interface element 352 or the third selectable user interface element 353. Accordingly, continued movement of the user gaze in the horizontal direction, for example, along the X axis / in the direction of the arrow DI, may move the user gaze into the second selection area 320 corresponding to the second selectable user interface element 352 of the user interface 350, as shown in FIG. 3E.

[0062] FIG. 3E illustrates a fourth gaze G4, a fifth gaze G5, and a sixth gaze G6 all having terminal end points intersecting, or corresponding to the second selection area 320 and the second selectable user interface element 352 of the user interface 350. In FIG. 3E, the fourthgaze G4, the fifth gaze G5 and the sixth gaze G6 are at different vertical positions (i.e., different positions along the Y axis) within the second selection area 320 associated with the second selectable user interface element 352. In FIG. 3E, the fourth gaze G4, the fifth gaze G5 and the sixth gaze G6 are at different horizontal positions (i.e., different positions along the X axis), but still within the second selection area 320 associated with the second selectable user interface element 352. In the example shown in FIG. 3E, selection of one of the user interface elements 351, 352, 353 of the user interface 350 is not affected by a vertical position of the user gaze. Further vertical movement of the gaze, for example, in the direction of the arrow D2, will move the gaze away from the display area 300 in which the user interface 350 is displayed, indicating the user does not intend to interact with the user interface 350. In the example shown in FIG. 3E, the second selectable user interface element 352 may be selected as the object of user focus in response to detection of any one of the fourth gaze G4, the fifth gaze G5 or the sixth gaze G6, or another gaze directed to the second selection area 320 not explicitly shown. In some examples, the second selectable user interface element 352 may be selected as the object of user focus in response to detection of a gaze directed at the second selection area 320, together with a selection confirmation such as, for example, detection of a gaze directed at the second selection area 320 sustained for greater than or equal to a threshold amount of time, detection of an audible command, a gesture command, a touch input, or other such confirmation action.

[0063] Continued movement of the user gaze in the horizontal direction, for example, in the direction of the arrow DI , may move the user gaze into the third selection area 330 corresponding to the third selectable user interface element 353 of the user interface 350, as shown in FIG. 3F. FIG. 3F illustrates a seventh gaze G7, an eighth gaze G8, and a ninth gaze G9 all having terminal end points intersecting, or corresponding to the third selection area 330 and the third selectable user interface element 353 of the user interface 350. In FIG. 3F, the seventh gaze G7, the eighth gaze G8 and the ninth gaze G9 are at different vertical positions within the third selection area 330 associated with the third selectable user interface element 353. In FIG. 3F, the seventh gaze G7, the eighth gaze G8 and the ninth gaze G9 are at different horizontal positions, but still within the third selection area 330 associated with the third selectable user interface element 353. In the example shown in FIG. 3F, selection of one of the user interface elements 351, 352, 353 of the user interface 350 is not affected by a vertical position of the user gaze. Further vertical movement of the gaze, for example, in the direction of the arrow D2, willmove the gaze away from the display area 300 in which the user interface 350 is displayed, indicating the user does not intend to interact with the user interface 350. In the example shown in FIG. 3F, the third selectable user interface element 353 may be selected as the object of user focus in response to detection of any one of the seventh gaze G7, the eighth gaze G8 or the ninth gaze G9, or another gaze directed to the third selection area 330 not explicitly shown. In some examples, the third selectable user interface element 353 may be selected as the object of user focus in response to detection of a gaze directed at the third selection area 330, together with a selection confirmation such as, for example, detection of a gaze directed at the third selection area 330 sustained for greater than or equal to a threshold amount of time, detection of an audible command, a gesture command, a touch input, or other such confirmation action.

[0064] In the example described above with respect to FIGs. 3D-3F, the selection areas 310, 320, 330 respectively corresponding to the selectable user interface elements 351, 352, 353 occupy substantially the entirety of the available display area 300. The contiguous arrangement of the selection areas 310, 320, 330 respectively corresponding to the selectable user interface elements 351, 352, 353, i.e., the lack of gaps, or dead zones, in display area 300 / between the selectable user interface elements 351, 352, 353 / selection areas 310, 320, 330 may provide for a more positive selection action implemented by the user in the form of a head movement / head gesture, and may eliminate ambiguity in determining where the user gaze is directed (particularly given the lack of a displayed selection indicator such as a cursor), and which of the selectable user interface elements 351 , 352, 353 should be the object of user focus. The example user interface 350 includes three selectable user interface elements 351, 352, 353 corresponding to three selection areas 310, 320, 330 of the display area 300, simply for purposes of discussion and illustration. The principles described herein can be applied to a user interface including more, or fewer selectable user interface elements respectively corresponding to selection areas of a display area, particularly when applied to an arrangement in which the selectable user interface elements / corresponding selection areas of the display area are positioned in an adjacent manner / without gaps or inactive areas therebetween.

[0065] In some examples, an indicator may be output to indicate a selectable virtual object or element, such as the first selectable user interface element 351, the second selectable user interface element 352, or the third selectable user interface element 353 of the example user interface 350, that is the current object of focus. In some examples, the indicator may be, forexample, a change in appearance of the selectable virtual object or element. Tn some examples, the change in appearance may include, for example, a highlighting of the selectable virtual object or element. In some examples, the change in appearance may include, for example, an enlarging of the selectable virtual object or element.

[0066] In the example described above with respect to FIGs. 3A-3F, each of the first selection area 310, the second selection area 320, and the third selection area 330 is vertically oriented, i.e., extending along the Y axis / in the direction of the arrow D2, from the upper side portion 300A to the lower side portion 300B of the display area 300. The sequential horizontal arrangement of the first, second and third selection areas 310, 330, 330 along a single axis, for example, along the X axis / in the direction of the arrow DI, allow for selection of one of the first selectable user interface element 351, second selectable user interface element 352, or third selectable user interface element 353 based on movement of a user gaze in a single direction, i.e., a movement of a user gaze in the direction of the arrow Dl / along the X axis. Selection does not rely on, and is not impacted by, detection of movement of the user gaze in the vertical direction / direction of the arrow D2. This arrangement provides for simplified user selection of, and interaction with virtual objects output by the display device 104 of the example head mounted wearable device 100. For example, this arrangement allows for the use of head gaze, and head gaze tracking, using a relatively natural, intuitive motion, to select and / or interact with virtual objects displayed by the display device 104 of the example head mounted wearable device 100.

[0067] FIGs. 3D-3F illustrate the use gaze initiating at the bridge portion 109 of the head mounted wearable device 100, simply for purposes of discussion and illustration. The principles described herein are applicable to head mounted wearable devices in which head gaze tracking is performed from other portions of the frame of the head mounted wearable device.

[0068] In the example shown in FIGs. 3A-3F, the display area 300 is delineated by dashed lines, simply for purposes of discussion and illustration. The principles described herein are applicable to a user interface in which the edges of the display area 300 are not visually delineated / visible to the user. Similarly, in the example shown in FIGs. 3A-3F, borders or mating edges of the first selection area 310 and the second selection area 320 and the third selection area 330 of the display area 300 are delineated by dashed lines, simply for purposes of discussion and illustration. The principles described herein are applicable to a user interface in which theborders, or edges of the first selection area 310 and / or the second selection area 320 and / or the third selection area 330 are not visually delineated / visible to the user.

[0069] FIG. 4A is a schematic view of an example display area 400. The example display area 400 may be comparable to the display area 210 described above with respect to FIGs. 2A and 2B and / or to the display area 300 described above with respect to FIGs 3A-3F. That is, the display area 400 may be a designated area for the display of content output by the display device 104, within the field of view of the user wearing the example head mounted wearable device 100. The display area 400 may include a plurality of selection areas, corresponding to a plurality of selectable elements of a user interface to be displayed in the display area 400. In the example arrangement shown in FIG. 4A, the example display area 400 includes a first selection area 410, a second selection area 420, and a third selection area 430. In the example shown in FIG. 4A, the first selection area 410, the second selection area 420, and the third selection area 430 are oriented horizontally (in the example orientation shown in FIG. 4A). In the example arrangement shown in FIG. 4A, the first selection area 410, the second selection area 420, and the third selection area 430 extend from a first lateral side portion 400C to a second lateral side portion 400D of the display area 300. In the example arrangement shown in FIG. 4A, the first selection area 410, the second selection area 420, and the third selection area 430 are sequentially arranged from an upper side portion 400A to a lower side portion 400B of the display area 400. In the example arrangement shown in FIG. 4A, the first selection area 410, the second selection area 420, and the third selection area 430 occupy substantially all of the display area 400 designated for the output of content by the display device 104 of the example head mounted wearable device 100. In some examples, the selection areas 410, 420, 430 occupy all of the display area, or at least greater than 90% of the display area 400.

[0070] FIG. 4B illustrates an example user interface 450, displayed in the example display area 400 shown in FIG. 4A. The example user interface 450 may be generated by one or more processors of the example head mounted wearable device 100, and output in the display area 400 by the display device 104 of the example head mounted wearable device 100. In the example shown in FIG. 4B, the example user interface 450 includes a first selectable user interface element 451, displayed at a position corresponding to a portion of the first selection area 410 of the display area 400. The example user interface 450 includes a second selectable user interface element 452, displayed at a position corresponding to a portion of the second selection area 420of the display area 400. The example user interface 450 includes a third selectable user interface element 453, displayed at a position corresponding to a portion of the third selection area 430 of the display area 400. In the example arrangement shown in FIG. 4B, the selectable user interface elements 451, 452, 453 of the user interface 450 (respectively corresponding to the selection areas 410, 420, 430 of the display area 400) are arranged along a single axis, i.e., the Y axis. Thus, a head movement of the user in the vertical direction, i.e., along the Y axis / in the direction of the arrow D2, may be implemented to change or shift a focus on one of the selectable user interface elements 451, 452, 453 of the user interface 450.

[0071] As shown in FIG. 4C, in some examples, the system may process data from the IMU of the example head mounted wearable device 100 to determine if the user has moved their head for a distance that is greater than or equal to a threshold distance L2, to for example release focus from a current virtual object or element, and / or trigger a change, or a shift in focus, to a desired selectable virtual object or element. In some examples, if it is determined that the movement is less than the set threshold distance, the system may maintain focus on the current virtual object. As shown in FIG. 4C, in some examples, position and / or acceleration data, for example, from the IMU of the example head mounted wearable device 100, may be taken into account not just in detecting movement, but also in detecting whether or not a detected head movement has settled on a desired selected virtual object or element at a point P2, where acceleration of the detected movement tapers and eventually settles. In some examples, this type of data may be used to determine whether a detected head movement is an intentional move for a change or shift in focus. For example, this type of data may be taken into account to discriminate between an intentional shift of focus to another of the selectable virtual objects or elements, and a turn of the head to engage in conversation.

[0072] FIGs. 4D-4F illustrate a plurality of different user gazes, or a series of user gazes, directed at the user interface 450. The plurality of user gazes shown in FIGs. 4D-4F correspond to a plurality of different head gaze positions of the user, or gazes associated with head movement of the user, and a corresponding plurality of different gaze positions of the example head mounted wearable device 100 worn by the user. A user selection of one of the first selectable user interface element 451, the second selectable user interface element 452, or the third selectable user interface element 453 can be made, based on detection of the user gaze directed at a portion of the user interface 450 corresponding to the first, second, or third selectionarea 410, 420, 430 of the display area 400 in which the user interface 450 is displayed. Tn particular, in the example shown in FIGs. 4D-4F, a selection of one of the first selectable user interface element 451, the second selectable user interface element 452, or the third selectable user interface element 453 can be made in response to a vertical head movement (in the example orientation shown in FIGs. 4D-4F), for example, along the Y axis / in the direction of the arrow D2, relative to the user interface 450 displayed in the display area 400. In this example arrangement, a horizontal head movement (in the example orientation shown in FIGs. 4D-4F), for example, along the X axis / in the direction of the arrow DI, relative to the user interface 450 does not affect the selection of one of the user interface elements 451, 452, 453, due to the vertical orientation of the first, second and third selection areas 410, 420, 430, and their sequential arrangement along a single axis, i.e., along the vertical axis, or the Y axis. Thus, the arrangement of the user interface elements 451, 452, 453 along a single axis (the vertical axis, in the example orientation shown in FIGs. 4D-4F) allows for selection of one of the user interface elements 451, 452, 452 based on head movement in the direction of the single axis.

[0073] In particular, FIG. 4D illustrates a first gaze Gl, a second gaze G2, and a third gaze G3 all having terminal end points intersecting, or corresponding to the first selection area 410 and the first selectable user interface element 451 of the user interface 450. The first gaze Gl, second gaze G2 and third gaze G3 may represent the direction of the head of the user relative to the interface elements 451, 452, 453 of the user interface 450 as the user moves, for example, sequentially moves, their head from a position associated with the first gaze Gl , to a position associated with the second gaze G2, to a position associated with the third gaze G3. In FIG. 4D, the first gaze Gl, the second gaze G2 and the third gaze G3 are at different horizontal positions within the first selection area 410 associated with the first selectable user interface element 451. In FIG. 4D, the first gaze Gl, the second gaze G2 and the third gaze G3 are at different vertical positions, but still within the first selection area 410 associated with the first selectable user interface element 451. In the example shown in FIG. 4D, selection of one of the user interface elements 451, 452, 453 of the user interface 450 is not affected by a horizontal position of the user gaze. Further horizontal movement of the gaze, for example, in the direction of the arrow DI, will move the gaze away from the display area 400 in which the user interface 450 is displayed, indicating the user does not intend to interact with the user interface 450. In the example shown in FIG. 4D, the first selectable user interface element 451 may be selected as theobject of user focus in response to detection of any one of the first gaze G1 , the second gaze G2 or the third gaze G3, or another gaze directed to the first selection area 410 not explicitly shown. In some examples, the first selectable user interface element 451 may be selected as the object of user focus in response to detection of a gaze directed at the first selection area 410, together with a selection confirmation such as, for example, detection of a gaze directed at the first selection area 410 sustained for greater than or equal to a threshold amount of time, detection of an audible command, a gesture command, a touch input, or other such confirmation action.

[0074] As noted above, in some examples, in a situation in which multiple selectable virtual objects or elements are output in the field of view of the user, one of the selectable objects or elements may be, by default, designated as the object of focus, to provide an indication to the user of a direction in which the user should move their head in order to shift focus to another of the selectable objects or elements. In a situation in which the first selectable user interface element 451 is, by default, initially designated as the object of user focus, the user may choose to move their head to shift the user focus to the second selectable user interface element 452 or the third selectable user interface element 453. Accordingly, continued movement of the user gaze in the vertical direction, for example, along the Y axis / in the direction of the arrow D2, may move the user gaze into the second selection area 420 corresponding to the second selectable user interface element 452 of the user interface 450, as shown in FIG. 4E.

[0075] FIG. 4E illustrates a fourth gaze G4, a fifth gaze G5, and a sixth gaze G6 all having terminal end points intersecting, or corresponding to the second selection area 420 and the second selectable user interface element 452 of the user interface 450. In FIG. 4E, the fourth gaze G4, the fifth gaze G5 and the sixth gaze G6 are at different horizontal positions (i.e., different positions along the X axis) within the second selection area 420 associated with the second selectable user interface element 452. In FIG. 4E, the fourth gaze G4, the fifth gaze G5 and the sixth gaze G6 are at different vertical positions (i.e., different positions along the Y axis), but still within the second selection area 420 associated with the second selectable user interface element 452. In the example shown in FIG. 4E, selection of one of the user interface elements 451, 452, 453 of the user interface 450 is not affected by a horizontal position of the user gaze. Further vertical movement of the gaze, for example, in the direction of the arrow DI, will move the gaze away from the display area 400 in which the user interface 450 is displayed, indicating the user does not intend to interact with the user interface 450. In the example shown in FIG. 4E,the second selectable user interface element 452 may be selected as the object of user focus in response to detection of any one of the fourth gaze G4, the fifth gaze G5 or the sixth gaze G6, or another gaze directed to the second selection area 420 not explicitly shown. In some examples, the second selectable user interface element 452 may be selected as the object of user focus in response to detection of a gaze directed at the second selection area 420, together with a selection confirmation such as, for example, detection of a gaze directed at the second selection area 420 sustained for greater than or equal to a threshold amount of time, detection of an audible command, a gesture command, a touch input, or other such confirmation action.

[0076] Continued movement of the user gaze in the horizontal direction, for example, in the direction of the arrow D2, may move the user gaze into the third selection area 430 corresponding to the third selectable user interface element 453 of the user interface 450, as shown in FIG. 4F. FIG. 4F illustrates a seventh gaze G7, an eighth gaze G8, and a ninth gaze G9 all having terminal end points intersecting, or corresponding to the third selection area 430 and the third selectable user interface element 453 of the user interface 450. In FIG. 4F, the seventh gaze G7, the eighth gaze G8 and the ninth gaze G9 are at different horizontal positions within the third selection area 430 associated with the third selectable user interface element 453. In FIG. 4F, the seventh gaze G7, the eighth gaze G8 and the ninth gaze G9 are at different vertical positions, but still within the third selection area 430 associated with the third selectable user interface element 453. In the example shown in FIG. 4F, selection of one of the user interface elements 451, 452, 453 of the user interface 450 is not affected by a horizontal position of the user gaze. Further horizontal movement of the gaze, for example, in the direction of the arrow DI, will move the gaze away from the display area 400 in which the user interface 450 is displayed, indicating the user does not intend to interact with the user interface 450. In the example shown in FIG. 4F, the third selectable user interface element 453 may be selected as the object of user focus in response to detection of any one of the seventh gaze G7, the eighth gaze G8 or the ninth gaze G9, or another gaze directed to the third selection area 430 not explicitly shown. In some examples, the third selectable user interface element 453 may be selected as the object of user focus in response to detection of a gaze directed at the third selection area 430, together with a selection confirmation such as, for example, detection of a gaze directed at the third selection area 430 sustained for greater than or equal to a threshold amount of time, detection of an audible command, a gesture command, a touch input, or other such confirmationaction.

[0077] In the example described above with respect to FIGs. 4D-4F, the selection areas 410, 420, 430 respectively corresponding to the selectable user interface elements 451, 452, 453 occupy substantially the entirety of the available display area 400. The contiguous arrangement of the selection areas 410, 420, 430 respectively corresponding to the selectable user interface elements 451, 452, 453, i.e., the lack of gaps, or dead zones, or inactive areas in display area 400 / between the selectable user interface elements 451, 452, 453 / selection areas 410, 420, 430 may provide for a more positive selection action implemented by the user in the form of a head movement / head gesture, and may eliminate ambiguity in determining where the user gaze is directed (particularly given the lack of a displayed selection indicator such as a cursor). The example user interface 450 includes three selectable user interface elements 451, 452, 453 corresponding to three selection areas 410, 420, 430 of the display area 400, simply for purposes of discussion and illustration. The principles described herein can be applied to a user interface including more, or fewer selectable user interface elements respectively corresponding to selection areas of a display area, particularly when applied to an arrangement in which the selectable user interface elements / corresponding selection areas of the display area are positioned in an adjacent manner / without gaps or inactive areas therebetween.

[0078] In some examples, an indicator may be output to indicate a selectable virtual object or element, such as the first selectable user interface element 451, the second selectable user interface element 452, or the third selectable user interface element 453 of the example user interface 450, that is the current object of focus. In some examples, the indicator may be, for example, a change in appearance of the selectable virtual object or element. In some examples, the change in appearance may include, for example, a highlighting of the selectable virtual object or element. In some examples, the change in appearance may include, for example, an enlarging of the selectable virtual object or element.

[0079] In the example described above with respect to FIGs. 4A-4F, each of the first selection area 410, the second selection area 420, and the third selection area 430 is horizontally oriented, i.e., extending along the X axis / in the direction of the arrow DI, from the first lateral side portion 400C to the second lateral side portion 400D of the display area 300. The sequential horizontal arrangement of the first, second and third selection areas 410, 420, 430 along a single axis, for example, along the Y axis / in the direction of the arrow D2, allow for selection of one of15the first selectable user interface element 451 , second selectable user interface element 452, or third selectable user interface element 453 based on movement of a user gaze in a single direction, i.e., a movement of a user gaze in the direction of the arrow D2 / along the Y axis. Selection does not rely on, and is not impacted by, detection of movement of the user gaze in the horizontal direction / direction of the arrow DI. This arrangement provides for simplified user selection of, and interaction with virtual objects output by the display device 104 of the example head mounted wearable device 100. For example, this arrangement allows for the use of head gaze, and head gaze tracking, using a relatively natural, intuitive motion, to select and / or interact with virtual objects displayed by the display device 104 of the example head mounted wearable device 100.

[0080] FIGs. 4D-4F illustrate the use gaze initiating at the bridge portion 109 of the head mounted wearable device 100, simply for purposes of discussion and illustration. The principles described herein are applicable to head mounted wearable devices in which head gaze tracking is performed from other portions of the frame of the head mounted wearable device.

[0081] In the example shown in FIGs. 4A-4F, the display area 400 is delineated by dashed lines, simply for purposes of discussion and illustration. The principles described herein are applicable to a user interface in which the edges of the display area 400 are not visually delineated / visible to the user. Similarly, in the example shown in FIGs. 4A-4F, borders or mating edges of the first selection area 410 and the second selection area 420 and the third selection area 430 of the display area 400 are delineated by dashed lines, simply for purposes of discussion and illustration. The principles described herein are applicable to a user interface in which the borders, or edges of the first selection area 410 and / or the second selection area 420 and / or the third selection area 430 are not visually delineated / visible to the user.

[0082] FIG. 5A is a schematic view of an example display area 500. The example display area 500 may be comparable to the display area 210 described above with respect to FIGs. 2A and 2B and / or to the display area 300 described above with respect to FIGs 3A-3F and / or to the display area 400 described above with respect to FIGs. 4A-4F. That is, the display area 500 may be a designated area for the display of content output by the display device 104, within the field of view of the user wearing the example head mounted wearable device 100. The display area 500 may include a plurality of selection areas, corresponding to a plurality of selectable elements of a user interface to be displayed in the display area 500. In the example arrangement shown inFIG 5 A, the example display area 500 includes a first selection area 510, a second selection area 520, a third selection area 530 and a fourth selection area 540. In the example shown in FIG. 5A, the first selection area 510, the second selection area 520, the third selection area 530 and the fourth selection area 540 are arranged in a two by two grid. In the example arrangement shown in FIG. 5A, the arrangement of the first, second, third and fourth selection areas 510, 520, 530, 540 extends from an upper side portion 500A to a lower side portion 500B of the display area 500, and from a first lateral side portion 500C to a second lateral side portion 500D of the display area 500. In the example arrangement shown in FIG. 5A, the first selection area 510, the second selection area 520, the third selection area 530 and the fourth selection area 540 occupy substantially all of the display area 500 designated for the output of content by the display device 104 of the example head mounted wearable device 100. In some examples, the selection areas 510, 520, 530, 540 occupy all of the display area 500, or at least greater than 90% of the display area 500.

[0083] FIG. 5B illustrates an example user interface 550, displayed in the example display area 500 shown in FIG. 5 A. The example user interface 550 may be generated by one or more processors of the example head mounted wearable device 100, and output in the display area 500 by the display device 104 of the example head mounted wearable device 100. In the example shown in FIG. 5B, the example user interface 550 includes a first selectable user interface element 551, displayed at a position corresponding to a portion of the first selection area 510 of the display area 500. The example user interface 550 includes a second selectable user interface element 552, displayed at a position corresponding to a portion of the second selection area 520 of the display area 500. The example user interface 550 includes a third selectable user interface element 553, displayed at a position corresponding to a portion of the third selection area 530 of the display area 500. The example user interface 550 includes a fourth selectable user interface element 554, displayed at a position corresponding to a portion of the fourth selection area 540 of the display area 500. In the example arrangement shown in FIG. 5B, the selectable user interface elements 551, 552, 553, 554 of the user interface 550 (respectively corresponding to the selection areas 510, 520, 530, 540 of the display area 500) are arranged in a grid, and in particular a two by two grid. Thus, a head movement of the user into a particular zone (for example, a quadrant in the example of the two by two arrangement shown in FIGs. 5A and 5B) of the field of view in front of the user may trigger a change or shift a focus on one of theselectable user interface elements 551 , 552, 553, 554 of the user interface 550.

[0084] As shown in FIG. 5C, in some examples, the system may process data from the IMU of the example head mounted wearable device 100 to detect movement of the head of the user. In particular, the system may detect a head movement into a particular zone, corresponding to a particular quadrant of the user interface 550 / corresponding selectable user interface element. FIG. 5A(1) illustrates a first example trigger zone 515. A gaze detected in the first trigger zone 515 may trigger a shift of focus to the first selection area 510 corresponding to the first selectable user interface element 551 of the user interface 550. FIG. 5A(2) illustrates a second example trigger zone 525. A gaze detected in the second trigger zone 525 may trigger a shift of focus to the second selection area 520 corresponding to the second selectable user interface element 552. FIG. 5A(3) illustrates a third example trigger zone 535. A gaze detected in the third trigger zone 535 may trigger a shift of focus to the third selection area 530 and the third selectable user interface element 553. FIG. 5A(4) illustrates a fourth example trigger zone 545. A gaze detected in the fourth trigger zone 545 may trigger a shift of focus to the fourth selection area 540 and the fourth selectable user interface element 554. In some examples, the

[0085] As shown in FIG. 5D, in some examples, the system may determine if the user has moved their head for a distance, or a magnitude, that causes the user head gaze to shift from a current trigger zone, or quadrant, into a different trigger zone, or quadrant, that would release focus from a current virtual object or element, and / or trigger a change, or a shift in focus, to a desired selectable virtual object or element. As shown in FIG. 5D, in some examples, position and / or acceleration data, for example, from the IMU of the example head mounted wearable device 100, may be taken into account not just in detecting movement, but also in detecting whether or not a detected head movement has settled on a desired selected virtual object or element at a point P3, where acceleration of the detected movement tapers and eventually settles. In some examples, this type of data may be used to determine whether a detected head movement is an intentional move for a change or shift in focus. For example, this type of data may be taken into account to discriminate between an intentional shift of focus to another of the selectable virtual objects or elements, and a turn of the head to engage in conversation.

[0086] FIGs. 6A-6D illustrate a plurality of different user gazes, or a series of user gazes, directed at the user interface 550. The plurality of user gazes shown in FIGs. 6A-6D correspond to a plurality of different head gaze positions of the user, or gazes associated with headmovement of the user, and a corresponding plurality of different gaze positions of the example head mounted wearable device 100 worn by the user. A user selection of one of the first selectable user interface element 551, the second selectable user interface element 552, the third selectable user interface element 553, or the fourth selectable user interface element 554 can be made, based on detection of the user gaze directed at a portion of the user interface 550 corresponding to the first, second, third, or fourth selection area 510, 520, 530, 540 of the display area 500 in which the user interface 550 is displayed. In particular, in the example shown in FIGs. 6A-6D, a selection of one of the first selectable user interface element 551, the second selectable user interface element 552, the third selectable user interface element 553, or the fourth selectable user interface element 554 can be made in response to detection of a head movement that directs the user head gaze into the corresponding quadrant of the user interface 550.

[0087] In particular, FIG. 6A illustrates a first gaze Gl, a second gaze G2, and a third gaze G3 all having terminal end points intersecting, or corresponding to the first selection area 510 and the first selectable user interface element 551 of the user interface 550. The first gaze Gl, second gaze G2 and third gaze G3 may represent the direction of the head of the user relative to the interface elements 551, 552, 553, 554 of the user interface 550 as the user moves, for example, sequentially moves, their head from a position associated with the first gaze Gl, to a position associated with the second gaze G2, to a position associated with the third gaze G3. In FIG. 6A, the first gaze Gl, the second gaze G2 and the third gaze G3 are at different horizontal positions, and at different vertical positions, but all within the first selection area 510 associated with the first selectable user interface element 451. In the example shown in FIG. 6A, selection of one of the user interface elements 551, 552, 553, 554 of the user interface 550 is not affected by relatively small changes in the horizontal position and / or the vertical position of the user gaze. Rather, focus is maintained as long as the user gaze remains in the selection area associated with the desired quadrant of the user interface 550. In the example shown in FIG. 6A, the first selectable user interface element 551 may be selected in response to detection of any one of the first gaze Gl, the second gaze G2 or the third gaze G3, or another gaze directed to the first selection area 510 not explicitly shown. In some examples, the first selectable user interface element 551 may be selected in response to detection of a gaze directed at the first selection area 510, together with a selection confirmation such as, for example, detection of a gaze directed atthe first selection area 510 sustained for greater than or equal to a threshold amount of time, detection of an audible command, a gesture command, a touch input, or other such confirmation action.

[0088] As noted above, in some examples, in a situation in which multiple selectable virtual objects or elements are output in the field of view of the user, one of the selectable objects or elements may be, by default, designated as the object of focus, to provide an indication to the user of a direction in which the user should move their head in order to shift focus to another of the selectable objects or elements. In a situation in which the first selectable user interface element 551 is, by default, initially designated as the object of focus, the user may choose to move their head to shift focus to the second selectable user interface element 552, or the third selectable user interface element 553, or the fourth selectable user interface element 554. Accordingly, continued movement of the user gaze may move the user gaze into the second selection area 520 corresponding to the second selectable user interface element 552 of the user interface 550, as shown in FIG. 6B.

[0089] FIG. 6B illustrates a fourth gaze G4, a fifth gaze G5, and a sixth gaze G6 all having terminal end points intersecting, or corresponding to the second selection area 520 and the second selectable user interface element 552 of the user interface 550. In FIG. 6B, the fourth gaze G4, the fifth gaze G5 and the sixth gaze G6 are at different horizontal positions, and at different vertical positions, but all within the second selection area 520 associated with the second selectable user interface element 552. In the example shown in FIG. 6B, the second selectable user interface element 552 may be selected in response to detection of any one of the fourth gaze G4, the fifth gaze G5 or the sixth gaze G6, or another gaze directed to the second selection area 520 not explicitly shown. In some examples, the second selectable user interface element 552 may be selected in response to detection of a gaze directed at the second selection area 520, together with a selection confirmation such as, for example, detection of a gaze directed at the second selection area 520 sustained for greater than or equal to a threshold amount of time, detection of an audible command, a gesture command, a touch input, or other such confirmation action.

[0090] Continued movement of the user gaze may move the user gaze into the third selection area 530 corresponding to the third selectable user interface element 553 of the user interface 550, as shown in FIG. 6C. FIG. 6C illustrates a seventh gaze G7, an eighth gaze G8, and a ninthgaze G9 all having terminal end points intersecting, or corresponding to the third selection area 530 and the third selectable user interface element 553 of the user interface 550. In FIG. 6C, the seventh gaze G7, the eighth gaze G8 and the ninth gaze G9 are at different horizontal positions, and at different vertical positions, but all within the third selection area 530 associated with the third selectable user interface element 553. In the example shown in FIG. 6C, the third selectable user interface element 553 may be selected in response to detection of any one of the seventh gaze G7, the eighth gaze G8 or the ninth gaze G9, or another gaze directed to the third selection area 530 not explicitly shown. In some examples, the third selectable user interface element 553 may be selected in response to detection of a gaze directed at the third selection area 530, together with a selection confirmation such as, for example, detection of a gaze directed at the third selection area 530 sustained for greater than or equal to a threshold amount of time, detection of an audible command, a gesture command, a touch input, or other such confirmation action.

[0091] Continued movement of the user gaze may move the user gaze into the fourth selection area 540 corresponding to the fourth selectable user interface element 554 of the user interface 550, as shown in FIG. 6D. FIG. 6D illustrates a tenth gaze G10, an eleventh gaze G11, and a twelfth gaze G12 all having terminal end points intersecting, or corresponding to the fourth selection area 540 and the fourth selectable user interface element 554 of the user interface 550. In FIG. 6D, the tenth gaze G10, the eleventh gaze Gi l, and the twelfth gaze G12 are at different horizontal positions, and at different vertical positions, but all within the fourth selection area 540 associated with the fourth selectable user interface element 554. In the example shown in FIG. 6D, the fourth selectable user interface element 554 may be selected in response to detection of any one of the tenth gaze G10, the eleventh gaze G11, or the twelfth gaze G12, or another gaze directed to the fourth selection area 540 not explicitly shown. In some examples, the fourth selectable user interface element 554 may be selected in response to detection of a gaze directed at the fourth selection area 540, together with a selection confirmation such as, for example, detection of a gaze directed at the fourth selection area 540 sustained for greater than or equal to a threshold amount of time, detection of an audible command, a gesture command, a touch input, or other such confirmation action.

[0092] In the example described above with respect to FIGs. 6A-6D, the gaze movements (i.e., the first gaze G1 through the twelfth gaze G12) are described as sequentially moving fromthe first selection area 510 to the second selection area 520 to the third selection area 530 and into the fourth selection area 540, simply for purposes of discussion and illustration. The system may, in a similar manner, process user inputs and changes or shifts in focus, and user selections in response to different head / gaze movements and / or patterns of movement. For example, the system may, in a similar manner, process user inputs and changes or shifts in focus, and user selections in response to, for example, a shift in gaze from the second gaze G2 directed at the first selection area 510 / first selectable user interface element 551 to the seventh gaze G7 directed at the third selection area 530 / third selectable user interface element 553 to shift focus from the first selectable user interface element 551 to the third selectable user interface element 553. Similarly, the system may process user inputs and changes or shifts in focus, and user selections in response to, for example, a shift in gaze from the eleventh gaze G11 directed at the fourth selection area 540 to the fifth gaze G5 directed at the second selection area 520 to shift focus from the fourth selectable user interface element 554 to the second selectable user interface element 552. Any number of different movements and / or combinations of movements may be processed in this manner to shift focus from a currently selected user interface element to a desired user interface element.

[0093] In the example described above with respect to FIGs. 5A-6D, the selection areas 510, 520, 530, 540 respectively corresponding to the selectable user interface elements 551, 552, 553, 554 occupy substantially the entirety of the available display area 500. The lack of gaps, or dead zones, or inactive areas in display area 500 / between the selectable user interface elements 551 , 552, 553, 554 / selection areas 510, 520, 530, 540 may provide for a more positive selection action implemented by the user in the form of a head movement / head gesture, and may eliminate ambiguity in determining where the user gaze is directed (particularly given the lack of a displayed selection indicator such as a cursor). The example user interface 550 includes three selectable user interface elements 551, 552, 553, 554 corresponding to four selection areas 510, 520, 430, 540 of the display area 500 arranged in a two by two grid, simply for purposes of discussion and illustration. The principles described herein can be applied to a user interface including more, or fewer selectable user interface elements respectively corresponding to selection areas of a display area, particularly when applied to an arrangement in which the selectable user interface elements / corresponding selection areas of the display area are positioned in an adjacent manner / without gaps or inactive areas therebetween.

[0094] In some examples, an indicator may be output to indicate a selectable virtual object or element, such as the first selectable user interface element 551, the second selectable user interface element 552, the third selectable user interface element 553, or the fourth selectable user interface element 554 of the example user interface 550, that is the current object of focus. In some examples, the indicator may be, for example, a change in appearance of the selectable virtual object or element. In some examples, the change in appearance may include, for example, a highlighting of the selectable virtual object or element. In some examples, the change in appearance may include, for example, an enlarging of the selectable virtual object or element.

[0095] FIGs. 6A-6D illustrate the use gaze initiating at the bridge portion 109 of the head mounted wearable device 100, simply for purposes of discussion and illustration. The principles described herein are applicable to head mounted wearable devices in which head gaze tracking is performed from other portions of the frame of the head mounted wearable device.

[0096] In the example shown in FIGs. 5A-6D, the display area 500 is delineated by dashed lines, simply for purposes of discussion and illustration. The principles described herein are applicable to a user interface in which the edges of the display area 400 are not visually delineated / visible to the user. Similarly, in the example shown in FIGs. 5A-6D, borders or mating edges of the first selection area 510 and the second selection area 520 and the third selection area 530 and the fourth selection area 540 of the display area 500 are delineated by dashed lines, simply for purposes of discussion and illustration. The principles described herein are applicable to a user interface in which the borders, or edges of the first selection area 510 and / or the second selection area 520 and / or the third selection area 530 and / or the fourth selection area 540 are not visually delineated / visible to the user.

[0097] FIG. 7 is a flowchart of an example method 700, in accordance with implementations described herein. Operation of a wearable device, such as the example head mounted wearable device 100 described above, including display capability and processing / computing capability, is initiated (block 710). In a mode of operation in which content is output by a display device of the wearable device, gaze tracking may be initiated (block 720). In some examples, the gaze tracking is performed by a gaze tracking device that tracks head gaze direction and movement based on data provided by position and / or orientation sensors of the wearable device. In some examples, the gaze tracking device tracks head gaze directed at content output by the display device of the head mounted wearable device. In some examples, the content includes, for example, a virtualuser interface including a plurality of selectable objects output in a display area of the display device, with each of the plurality of selectable elements being respectively associated with a plurality of selection areas of the display area. In some examples, the plurality of selection areas / plurality of selectable elements are arranged along a single first axis. In response to a detection of gaze movement (block 730), it is determined whether a magnitude of the detected movement is greater than or equal to a set threshold. The set threshold may be indicative of a magnitude of movement that shifts the user gaze from a first selection area, or a current selection area, corresponding to a first selectable element, or a current selectable element, of the user interface, to a second selection area, or a new selection area, corresponding to a second selectable element, or a new selectable element, of the user interface (block 740). In response to the determination that the user gaze has shifted, a system focus is changed, or shifted (block 750). For example, a user focus may be shifted, from the first, or current selectable element, to the second, or new, selectable element, in response to the detected change in head gaze. In an example in which the plurality selection areas / plurality of selectable elements are arranged along the single first axis, the detected movement / change in gaze may be directed along a second axis. The process may continue until the experience is terminated (block 760).

[0098] Specific structural and functional details disclosed herein are merely representative for purposes of describing example implementations. Example implementations, however, may be embodied in many alternate forms and should not be construed as limited to only the implementations set forth herein.

[0099] The terminology used herein is for the purpose of describing particular implementations only and is not intended to be limiting of the implementations. As used herein, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes," and / or "including," when used in this specification, specify the presence of the stated features, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, and / or groups thereof.

[0100] It will be understood that when an element is referred to as being "coupled," "connected," or "responsive" to, or "on," another element, it can be directly coupled, connected, or responsive to, or on, the other element, or intervening elements may also be present. Incontrast, when an element is referred to as being "directly coupled," "directly connected," or "directly responsive" to, or "directly on," another element, there are no intervening elements present. As used herein the term "and / or" includes any and all combinations of one or more of the associated listed items.

[0101] Spatially relative terms, such as "beneath," "below," "lower," "above," "upper," and the like, may be used herein for ease of description to describe one element or feature in relationship to another element(s) or feature(s) as illustrated in the figures. It will be understood that the spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientation depicted in the figures. For example, if the device in the figures is turned over, elements described as "below" or "beneath" other elements or features would then be oriented "above" the other elements or features. Thus, the term "below" can encompass both an orientation of above and below. The device may be otherwise oriented and the spatially relative descriptors used herein may be interpreted accordingly.

[0102] It will be understood that although the terms "first," "second," etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. Thus, a "first" element could be termed a "second" element without departing from the teachings herein.

[0103] Unless otherwise defined, the terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which these concepts belong. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and / or the present specification and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

[0104] While certain features of the described implementations have been illustrated as described herein, many modifications, substitutions, changes, and equivalents will now occur to those skilled in the art. It is, therefore, to be understood that the appended claims are intended to cover such modifications and changes as fall within the scope of the implementations. It should be understood that they have been presented by way of example only, not limitation, and various changes in form and details may be made. Any portion of the apparatus and / or methods described herein may be combined in any combination, except mutually exclusive combinations. The implementations described herein can include various combinations and / or sub-combinations of the functions, components, and / or features of the different implementations described.

Claims

WHAT IS CLAIMED IS:

1. A computer-implemented method, comprising: generating, by a processor of a head mounted wearable device, a user interface including a plurality of selectable elements; outputting, by a display device of the head mounted wearable device, the user interface in a display area within a field of view of a user of the head mounted wearable device; associating the plurality of selectable elements of the user interface with a corresponding plurality of selection areas of the display area, wherein each of the plurality of selection areas borders at least one other of the plurality of selection areas such that the plurality of selection areas occupy substantially all of the display area; tracking a head gaze associated with the head mounted wearable device; detecting a movement of the head gaze; and shifting a user focus, from a first selectable element to a second selectable element of the plurality of selectable elements of the user interface in response to a determination that the movement of the head gaze corresponds to a gaze input for selection of the second selectable element.

2. The computer-implemented method of claim 1, wherein the plurality of selection areas extend in a first direction corresponding to a first axis, from a first end portion to a second end portion of the display area, and the plurality of selection areas are sequentially arranged in a second direction corresponding to a second axis, from a third end portion to a fourth end portion of the display area, with each of the plurality of selection areas bordering at least one other of the plurality of selection areas.

3. The computer-implemented method of claim 2, wherein shifting the user focus includes: shifting the user focus from the first selectable element to the second selectable element in response to detection of a movement of the head gaze in the second direction corresponding to the second axis; andmaintaining the user focus on the first selectable element in response to detection of a movement of the head gaze in the first direction corresponding to the first axis.

4. The computer-implemented method of claim 3, wherein shifting the user focus from the first selectable element to the second selectable element includes: shifting the user focus from the first selectable element to the second selectable element in response to detecting that the movement of the head gaze in the second direction corresponding to the second axis is greater than or equal a set threshold distance that moves the head gaze from a first selection area to a second selection area of the plurality of selection areas, the first selection area being associated with the first selectable element, and the second selection area being associated with the second selection area.

5. The computer-implemented method of claim 4, further comprising maintaining focus on the first selectable element in response to detecting that the movement of the head gaze in the second direction corresponding to the second axis is less than the set threshold distance, such that the head gaze remains directed to the first selection area.

6. The computer-implemented method of claim 2, wherein the second axis is substantially orthogonal to the first axis.

7. The computer-implemented method of any of claims 1 to 6, wherein the plurality of selection areas are arranged in a two by two grid in the display area.

8. The computer-implemented method of any of claims 1 to 7, wherein tracking a head gaze associated with the head mounted wearable device includes: determining a movement direction and a movement distance associated with the detected movement based on position data and orientation data received from an inertial measurement unit of the head mounted wearable device; determining a termination of the detected movement based on acceleration data associated with the detected movement based on acceleration data received from the inertial measurement unit; anddetermining a termination point of the head gaze with respect to the plurality of selection areas in response to determining the termination point of the detected movement.

9. A head mounted wearable device, including: a display device; a gaze tracking device; at least one processor; and a non-transitory computer-readable medium storing executable instructions that cause the at least one processor to: generate a user interface including a plurality of selectable elements; trigger output, by the display device, of the user interface in a display area defined within a field of view of a user of the head mounted wearable device; associate the plurality of selectable elements of the user interface with a corresponding plurality of selection areas of the display area, with each of the plurality of selection areas bordering at least one other of the plurality of selection areas such that the plurality of selection areas occupy substantially all of the display area; detect a movement of a head gaze associated with the head mounted wearable device; and shift a user focus, from a first selectable element to a second selectable element of the plurality of selectable elements of the user interface in response to a determination that the movement of the head gaze corresponds to a gaze input for selection of the second selectable element.

10. The head mounted wearable device of claim 9, wherein the plurality of selection areas extend in a first direction corresponding to a first axis, from a first end portion to a second end portion of the display area, and the plurality of selection areas are sequentially arranged in a second direction corresponding to a second axis, from a third end portion to a fourth end portion of the display area, with each of the plurality of selection areas bordering at least one other of the plurality of selection areas.1 1 . The head mounted wearable device of claim 10, wherein the executable instructions cause the at least one processor to: shift the user focus from the first selectable element to the second selectable element in response to detection of a movement of the head gaze in the second direction corresponding to the second axis; and maintain the user focus on the first selectable element in response to detection of a movement of the head gaze in the first direction corresponding to the first axis.

12. The head mounted wearable device of claim 11, wherein the executable instructions cause the at least one processor to: shift the user focus from the first selectable element to the second selectable element in response to detecting that the movement of the head gaze in the second direction corresponding to the second axis is greater than or equal a set threshold distance that moves the head gaze from a first selection area to a second selection area of the plurality of selection areas, the first selection area being associated with the first selectable element, and the second selection area being associated with the second selection area.

13. The head mounted wearable device of claim 12, wherein the executable instructions cause the at least one processor to maintain focus on the first selectable element in response to detecting that the movement of the head gaze in the second direction corresponding to the second axis is less than the set threshold distance, such that the head gaze remains directed to the first selection area.

14. The head mounted wearable device of any of claims 9 to 13, wherein the plurality of selection areas are arranged in a two by two grid in the display area.

15. The head mounted wearable device of any of claims 9 to 14, wherein the executable instructions cause the at least one processor to track a head gaze associated with the head mounted wearable device, including: determine a movement direction and a movement distance associated with the detected movement based on position data and orientation data received from an inertial measurementunit of the head mounted wearable device; determine a termination of the detected movement based on acceleration data associated with the detected movement based on acceleration data received from the inertial measurement unit; and determine a termination point of the head gaze with respect to the plurality of selection areas in response to determining the termination point of the detected movement.

Images