DETERMINATION OF HEAD TURN BASED ON ROUTE TRACKING

Abstract

Some examples of the disclosure relate to a method performed on an electronic device configured to track a first vector indicating an orientation of the electronic device. In some examples, the electronic device tracks a second vector indicating a predicted motion path of the electronic device. In some examples, the device detects a difference between the first and second vectors. In some examples, and according to a finding that one or more first criteria are satisfied, the electronic device determines the difference as a head rotation input and performs an action according to the head rotation input.

Description

CROSS-REFERENCE TO RELATED REGISTRATIONS

[0001] This application claims priority over U.S. Preliminary Patent Application No. 63 / 699,731, filed on September 26, 2024, and U.S. Patent Application No. 19 / 312,729, filed on August 28, 2025, the entire disclosure of which is incorporated herein by reference for all purposes. AREA OF REVELATION

[0002] This generally refers to systems and methods for determining head rotation based on route tracking. BACKGROUND OF THE REVELATION

[0003] Some computer graphics environments provide two-dimensional and / or three-dimensional environments in which at least some objects displayed to a user are virtual and generated by a computer. For example, computer graphics environments often present multiple content items as a scrollable list. Providing efficient methods for scrolling a scrollable list in a computer graphics environment can improve the user experience. SUMMARY OF THE REVELATION

[0004] Some examples of the disclosure relate to a method for detecting head rotation based on route tracking. In some examples, a method is performed on the electronic device, which is in contact with one or more displays and one or more input devices. In some examples, the electronic device uses the one or more input devices to track a first vector that indicates an orientation of the electronic device. In some examples, the electronic device uses the one or more input devices to track a second vector that is different from the first vector and indicates a predicted path of movement of the electronic device. In some examples, the device detects a difference between the first and the second vector.In some examples, and in accordance with the finding that one or more first criteria are met, the electronic device determines the difference as a head rotation input. In some examples, the one or more first criteria include a criterion that is met if the difference between the first vector and the second vector is greater than a threshold. In some examples, the electronic device performs an action according to the head rotation input that meets one or more second criteria. In some examples, and in accordance with the finding that one or more first criteria are not met, the electronic device refrains from determining the difference as a head rotation input and from performing the action.

[0005] The complete descriptions of these examples are included in the drawings and the detailed description, and it is understood that this summary does not in any way limit the scope of the revelation. BRIEF DESCRIPTION OF THE DRAWINGS

[0006] For a better understanding of the various examples described herein, please refer to the detailed description below, along with the accompanying drawings. The same reference numerals throughout the drawings often refer to corresponding parts. Fig. Figure 1 illustrates an electronic device that represents an augmented reality environment, according to some examples from the revelation. Fig. Figures 2A to 2B illustrate block diagrams of an exemplary architecture for an electronic device according to some examples of the disclosure. Fig. 3A shows a user wearing a head-mounted device and its display, while the user looks forward in a three-dimensional environment, according to some examples of the revelation. Fig. 3B shows the same user as in Fig. 3A, now, however, with a rotation of the head and the corresponding change of the display on the device mounted on the head, according to some examples of the disclosure. Fig. Figure 4A shows a user wearing a head-mounted device while moving straight ahead in a three-dimensional environment, and the display on the device; the user's head is aligned with the direction in which his body is facing, according to some examples of disclosure. Fig. 4B shows the same user as Fig. 4A, which is now moving in a different direction than the direction in which the device and the user's head are pointing according to some examples of the disclosure. Fig. 5A shows an example of a user wearing a head-mounted device and running a curve according to some examples from the disclosure. Fig. Figure 5B shows the actual running trajectory compared to the predicted running trajectory. Fig. 5A according to some examples from the Revelation. Fig. 5C shows the same user as Fig. 5A, who is running around a corner, however, according to some examples from the Revelation, a head movement input is detected at the end of the running curve. Fig. 6A and Fig. Section 6B illustrates exemplary actions that are performed on the head-worn device when a head rotation input is detected, as described in some examples in the disclosure. Fig. 7 and Fig. 8 illustrate exemplary procedures for determining head rotation based on route tracking according to some examples from the revelation. DETAILED DESCRIPTION

[0007] The following description of examples refers to the accompanying drawings, which form part of this document and illustrate specific examples that can be implemented. It should be understood that other examples may be used and structural modifications made without affecting the scope of protection of the disclosed examples.

[0008] Some examples of the disclosure are directed to a method. In some examples, a method is performed on the electronic device, which is in contact with one or more displays and one or more input devices. In some examples, the electronic device, using the one or more input devices, tracks a first vector that specifies an orientation of the electronic device. In some examples, the electronic device, using the one or more input devices, tracks a second vector that differs from the first vector and specifies a predicted motion path of the electronic device. In some examples, the device detects a difference between the first and the second vector.In some examples, and in accordance with the finding that one or more first criteria are met, the electronic device determines the difference as a head rotation input. In some examples, the one or more first criteria include a criterion that is met if the difference between the first vector and the second vector is greater than a threshold. In some examples, the electronic device performs an action according to the head rotation input that meets one or more second criteria. In some examples, and in accordance with the finding that one or more first criteria are not met, the electronic device refrains from determining the difference as a head rotation input and from performing the action.

[0009] Fig. Figure 1 illustrates an electronic device 101 that presents an augmented reality (XR) environment (e.g., a computer-generated environment that optionally includes representations of physical and / or virtual objects) according to some examples of the disclosure. In some examples, as in Fig. As shown in Figure 1, the electronic device 101 is a head-mounted display or other head-mounted device configured to be worn on the head of a user of the electronic device 101. Examples of the electronic device 101 are given below with reference to the architecture of the block diagram from Figure 1. Fig. 2A described. As in Fig. As shown in Figure 1, the electronic device 101 and the table 106 are located in a physical environment. The physical environment can include physical features such as a physical surface (e.g., floor, walls) or a physical object (e.g., table, lamp, etc.). In some embodiments, the electronic device 101 is configured to detect and / or acquire images of the physical environment, including the table 106 (illustrated in the field of view of the electronic device 101).

[0010] In some examples, such as in Fig. As shown in Figure 1, the electronic device 101 includes one or more internal image sensors 114a oriented towards the user's face (e.g., eye-tracking cameras, which are described below in relation to Fig. (described in sections 2A to 2B). In some examples, internal image sensors 114a are used for eye tracking (e.g., to detect the user's gaze). Internal image sensors 114a are optionally arranged in the left and right areas of the display 120 to enable eye tracking of the user's left and right eyes. In some examples, the electronic device 101 also includes external image sensors 114b and 114c, which are directed outwards from the user to detect and / or capture the physical environment of the electronic device 101 and / or movements of the user's hands or other body parts.

[0011] In some examples, the display 120 has a user-visible field of view (e.g., which may or may not correspond to the field of view of the external image sensors 114b and 114c). Since display 120 is optionally part of a head-mounted device, its field of view is optionally the same as, or similar to, the user's eye field of view. In other examples, the field of view of display 120 is smaller than the user's eye field of view. In some examples, the electronic device 101 is an optically transparent device, in which display 120 is a transparent or translucent display through which parts of the physical environment are directly viewed. In some examples, display 120 is contained within a transparent lens and overlaps all or part of the transparent lens.In other examples, the electronic device is a video passthrough device, where the display 120 is an opaque display configured to show images of the physical environment captured by the external image sensors 114b and 114c. Although only a single display 120 is shown, it is understood that display 120 also includes a stereo display pair.

[0012] In some examples, the electronic device 101 is configured in response to a trigger to display a virtual object 104 in the XR environment, which is defined by a Fig. The illustrated cube is shown, which does not exist in the physical environment but is displayed positioned on the tabletop of the real table 106 (or a representation thereof) in the XR environment. Optionally, the virtual object 104 can be displayed on the surface of the table 106 in the XR environment via the display 120 of the electronic device 101 in response to the detection of the flat surface of the table 106 in the physical environment 100.

[0013] It is understood that virtual object 104 is a representative virtual object, and one or more different virtual objects (e.g., of different dimensions, such as two-dimensional or other three-dimensional virtual objects) can be enclosed and rendered within a three-dimensional XR environment. For example, the virtual object can represent an application or a user interface displayed in the XR environment. In some examples, the virtual object can represent content corresponding to the application and / or displayed via the user interface in the XR environment. In some examples, virtual object 104 is optionally configured to be interactive and responsive to user input (e.g., air gestures such as pinch air gestures, tap air gestures, and / or touch air gestures), allowing a user to virtually touch, tap, move, rotate, or otherwise interact with virtual object 104.

[0014] In some examples, the electronic device 101 is configured to communicate with a second electronic device, for example, a companion device. As in Fig. As shown in Figure 1, electronic device 101 is, for example, connected to electronic device 160. In some examples, electronic device 160 corresponds to a mobile electronic device, such as a smartphone, tablet computer, smartwatch, or other electronic device. Examples of electronic device 160 are given below with reference to the architecture block diagram from Figure 1. Fig. 2 described. In some examples, electronic device 101 and electronic device 160 are assigned to the same user. In Fig. For example, electronic device 101 is positioned (e.g., mounted) on a user's head, and electronic device 160 is positioned near electronic device 101, for instance, in the user's hand 103 (e.g., hand 103 is holding electronic device 160), and electronic device 101 and electronic device 160 are linked to the same user account (e.g., the user is logged into the user account on both electronic device 101 and electronic device 160). Further details regarding the communication between electronic device 101 and electronic device 160 are given below with reference to the Fig. 2A to 2B provided.

[0015] In some examples, displaying an object in a three-dimensional environment involves interaction with one or more user interface objects within that environment. For instance, initiating the display of the object in the three-dimensional environment might involve interaction with one or more virtual options / affordances displayed within that environment. In some examples, when the display of an object in the three-dimensional environment is initiated, the gaze of a user of the electronic device is tracked as input to identify one or more virtual options / affordances available for selection. The gaze might, for example, be used to identify one or more virtual options / offers to be selected using a further selection input. In some examples, a virtual option orA virtual offering is selected using hand tracking input, which is captured via an input device communicating with the electronic device. In some examples, objects displayed in the three-dimensional environment are moved and / or reoriented in the three-dimensional environment in accordance with the motion input captured by the device.

[0016] The following description outlines an electronic device that communicates with a display generation component and one or more input devices. It is understood that the electronic device optionally communicates with one or more other physical user interface devices, such as a touch-sensitive surface, a physical keyboard, a mouse, a joystick, a hand tracking device, an eye tracking device, a stylus, etc. Furthermore, as described above, it is understood that the described electronic device, the display, and the touch-sensitive surface are optionally distributed among two or more devices.Therefore, as used in this disclosure, information displayed on or by the electronic device is optionally used to describe information output by the electronic device for display on a separate display device (touch-sensitive or not). Similarly, as used in this disclosure, input received by the electronic device (e.g., touch input received on a touch-sensitive surface of the electronic device or touch input received on the surface of an input pen) is optionally used to describe input received on a separate input device from which the electronic device receives input information.

[0017] The device typically supports a variety of applications, such as one or more of the following: a drawing application, a presentation application, a word processing application, a website creation application, a disc authoring software development application, a spreadsheet application, a gaming application, a telephone application, a video conferencing application, an email application, an instant messaging application, a training support application, a photo management application, a digital camera application, a digital video camera application, an internet browsing application, a digital music playback application, a television channel browsing application, and / or a digital video playback application.

[0018] Fig. Figures 2A to 2B illustrate block diagrams of exemplary architectures for electronic devices 201 and 260 according to some embodiments of the disclosure. In some examples, the electronic device 201 and / or the electronic device 260 include one or more electronic devices. For example, the electronic device 201 is a portable device, an accessory device communicating with another device, or a head-mounted display, etc. In some examples, the electronic device 201 corresponds to the one described above with reference to Fig. 1 electronic device 101 described above. In some examples, the electronic device 260 corresponds to the one described above with reference to Fig. 1 described electronic device 160.

[0019] As in Fig. As illustrated in Figure 2A, the electronic device 201 optionally includes various sensors, such as one or more hand tracking sensors 202, one or more location sensors 204A, one or more image sensors 206A (optionally the internal image sensors 114a and 114c in Fig. 1 accordingly), one or more touch-sensitive surfaces 209A, one or more motion and / or orientation sensors 210A, one or more eye-tracking sensors 212, one or more microphones 213A or other audio sensors, one or more body-tracking sensors (e.g., upper body and / or head-tracking sensors), one or more display-generating components 214A, optionally the display 120 in Fig. 1 accordingly, one or more loudspeakers 216A, one or more processors 218A, one or more memory units 220A and / or communication switching logic 222A. One or more communication buses 208A are optionally used for communication between the aforementioned components of the electronic device 201. In addition, the electronic device 260 includes, as in Fig. 2B shows, optionally one or more location sensors 204B, one or more image sensors 206B, one or more touch-sensitive surfaces 209B, one or more orientation sensors 210B, one or more microphones 213B, one or more display generating components 214B, one or more loudspeakers 216B, one or more processors 218B, one or more memories 220B, and / or communication circuits 222B. One or more communication buses 208B are optionally used for communication between the aforementioned components of the electronic device 260. The first electronic devices 201 and 260 are optionally configured to communicate between the two devices via a wired or wireless connection (e.g., via the communication circuits 222A, 222B). As shown in Fig. As specified in 2A, the electronic device 260 functions, for example, as an accompanying device to the electronic device 201.

[0020] The 222A and 222B communication switching logic optionally includes switching logic for communicating with electronic devices and networks such as the Internet, intranets, wired and / or wireless networks, cellular networks, and wireless local area networks (LANs). The 222A and 222B communication switching logic also optionally includes switching logic for communicating using near-field communication (NFC) and / or short-range communication such as Bluetooth®.

[0021] The one or more processors 218A, 218B include one or more general-purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some examples, the memory 220A, 220B is a non-transitory, computer-readable storage medium (e.g., flash memory, random-access memory, or other volatile or non-volatile memory or storage) that stores computer-readable instructions configured to be executed by one or more processors 218A, 218B to perform the techniques, processes, and / or procedures described below. In some examples, the memory 220A and / or 220B may include more than one non-transitory, computer-readable storage medium. A non-transitory, computer-readable storage medium can be any medium (e.g.,(with the exception of a signal), which can contain or store tangible computer-executable instructions for use by, or in connection with, the instruction execution system, instruction execution device, or instruction execution apparatus. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transient computer-readable storage medium. The non-transient computer-readable storage medium may include, but is not limited to, magnetic, optical, and / or semiconductor storage. Examples of such storage include magnetic disks, optical disks based on Compact Disc (CD), Digital Versatile Disc (DVD), or Blu-ray technologies, and persistent semiconductor storage such as flash memory, solid-state drives, and the like.

[0022] In some examples, one or more display generating components 214A, 214B include a single display (e.g., a liquid crystal display (LCD), organic light-emitting diode (OLED), or other types of displays). In some examples, one or more display generating components 214A, 214B include multiple displays. In some examples, one or more display generating components 214A, 214B may include a touch-enabled display (e.g., a touchscreen), a projector, a holographic projector, a retinal projector, a transparent or translucent display, etc. In some examples, the devices 201 and 260 include one or more touch-sensitive surfaces 209A and 209B for receiving user input such as typing, swiping, or other gestures.In some examples, the one or more display generating components 214A, 214B and the one or more touch-sensitive surfaces 209A, 209B form touch-sensitive displays (e.g., a touchscreen integrated into or located outside of the electronic devices 201 and 260, which communicates with the electronic devices 201 and 260).

[0023] The electronic devices 201 and 260 optionally include one or more image sensors 206A and 206B. The one or more image sensors 206A and 206B optionally include one or more visible light image sensors, such as CCD (charge-coupled device) sensors and / or CMOS (complementary metal-oxide semiconductor) sensors, which can be operated to obtain images of physical objects from the real environment. The one or more image sensors 206A and 206B also optionally include one or more infrared (IR) sensors, such as a passive or an active IR sensor, for detecting infrared light from the real environment. For example, an active IR sensor includes an IR emitter for emitting infrared light into the real environment.The one or more image sensors 206A, 206B optionally include one or more cameras configured to detect movement of physical objects in the real-world environment. The one or more image sensors 206A, 206B optionally also include one or more depth sensors configured to detect the distance of physical objects from the electronic device 201, 260. In some examples, information from one or more depth sensors can enable the device to identify objects in the real-world environment and distinguish them from other objects in the real-world environment. In some examples, one or more depth sensors can enable the device to determine the texture and / or topography of objects in the real-world environment.

[0024] In some examples, the electronic device 201 uses CCD sensors, event cameras, and depth sensors in combination to detect the physical environment around the electronic device 201, 260. In some examples, the one or more image sensors 206A, 206B include a first image sensor and a second image sensor. The first and second image sensors work together and are optionally configured to capture different information about physical objects in the real environment. In some examples, the first image sensor is a visible light image sensor, and the second image sensor is a depth sensor. In some examples, the electronic device 201, 260 uses one or more image sensors 206A, 206B to detect the position and orientation of the device 201, 260 and / or the one or more display generating components 214A, 214B in the real environment.For example, the electronic device 201, 260 uses one or more image sensors 206A, 206B to track the position and orientation of one or more display generating components 214A, 214B relative to one or more solid objects in the real environment.

[0025] In some examples, the electronic devices 201 and 260 include one or more microphones 213A, 213B, or other audio sensors. The electronic device 201 optionally uses the one or more microphones 213 to detect sound from the user and / or from the user's real-world environment. In some examples, the one or more microphones 213A, 213B include an array of microphones (a plurality of microphones) that optionally work together to identify ambient noise or to localize the sound source in the real-world environment.

[0026] The electronic devices 201 and 260 include one or more location sensors 204A and 204B, respectively, for detecting the location of the electronic device 201A and / or one or more display generation components 214A, and the location of the electronic device 260 and / or one or more display generation components 214B, respectively. The one or more position sensors 204A, 204B may include a GPS (Global Positioning System) receiver that receives data from one or more satellites and enables the electronic devices 201, 260 to determine the device's absolute position in the physical world.

[0027] The electronic devices 201 and 260 each include one or more orientation sensors 210A and 210B, respectively, for detecting the orientation and / or movement of the electronic device 201 and / or one or more display generation components 214A, and the orientation and / or movement of the electronic device 260 and / or one or more display generation components 214B. For example, the electronic device 201, 260 uses one or more orientation sensors 210A, 210B to track changes in the position and / or orientation of the electronic device 201, 260 and / or the one or more display generation components 214A, 214B, as with respect to physical objects in the real environment. The one or more orientation sensors 210A, 210B optionally include one or more gyroscopes and / or one or more accelerometers.

[0028] In some examples, the electronic device 201 includes one or more hand tracking sensors 202 and / or one or more eye tracking sensors 212 (and / or one or more other body tracking sensors, such as leg, torso, and / or head tracking sensors). The one or more hand tracking sensors 202 are configured to track the position / location of one or more sections of the user's hands and / or movements of one or more sections of the user's hands in relation to the cross-reality environment relative to the one or more display-generating components 214A and / or relative to another defined coordinate system.The one or more eye-tracking sensors 212 are configured to track the position and movement of a user's gaze (eyes, face, or generally the head) with respect to the real world or the cross-reality environment and / or relative to the one or more display-generating components 214A. In some examples, one or more hand-tracking sensors 202 and / or one or more eye-tracking sensors 212 are implemented together with one or more display-generating components 214A. In some examples, the one or more hand-tracking sensors 202 and / or the one or more eye-tracking sensors 212 are implemented separately from the one or more display-generating components 214A. Alternatively, in some examples, the electronic device 201 does not include one or more hand-tracking sensors 202 and / or one or more eye-tracking sensors 212.In some such examples, the one or more display generating component(s) 214A of the electronic device 260 can be used to provide an augmented reality environment and to use input and other data collected by one or more other sensors (e.g., the one or more location sensors 204A, one or more image sensors 206A, one or more touch-sensitive surfaces 209A, one or more motion and / or orientation sensors 210A, and / or one or more microphones 213A or other audio sensors) of the electronic device 201 as input and data that are processed by the one or more processors 218B of the electronic device 260. Additionally or alternatively, the electronic device 201 optionally includes no other components. Fig. 2B components shown, such as location sensors 204B, image sensors 206B, touch-sensitive surfaces 209B, etc. In some such examples, the one or more display generating components 214A can be used by the electronic device 260 to provide an augmented reality environment, and the electronic device 260 uses input and other data acquired as input via the one or more motion and / or orientation sensors 210A (and / or one or more microphones 213A) of the electronic device 201.

[0029] In some examples, one or more hand tracking sensors 202 (and / or other one or more body tracking sensors, such as leg, torso, and / or one or more head tracking sensors) can use one or more image sensors 206 (e.g., one or more IR cameras, three-dimensional cameras, depth cameras, etc.) that capture three-dimensional information from the real world, including one or more body parts (e.g., hands, legs, or torso of a human user). In some examples, the hands can be resolved with sufficient resolution to distinguish fingers and their respective positions.In some examples, one or more image sensors 206A are positioned relative to the user to define a field of view for the one or more image sensors 206A and an interaction space in which the finger / hand position, orientation, and / or movement detected by the image sensors are used as input (e.g., to distinguish it from a user's stationary hand or other people's hands in the real-world environment). Tracking fingers / hands for input (e.g., gestures, touch, taps, etc.) can be advantageous because such tracking does not require the user to touch, hold, or wear any kind of beacon, sensor, or other device.

[0030] In some examples, the one or more eye-tracking sensors include at least one eye-tracking camera (e.g., infrared cameras (IR cameras)) and / or light sources (e.g., IR light sources, such as LEDs) that emit light toward a user's eyes. The eye-tracking cameras may be directed toward a user's eyes to receive reflected IR light from the light sources directly or indirectly from the eyes. In some examples, both eyes are tracked separately by respective eye-tracking cameras and light sources, and a gaze / view can be determined from tracking both eyes. In some examples, one eye (e.g., a dominant eye) is tracked by one or more respective eye-tracking cameras / light sources.

[0031] The electronic devices 260 and 201 are not related to the components and configuration of Fig. The electronic device 201 is limited to 2A to 2B, but may include fewer, different, or additional components in several configurations. In some examples, the electronic device 201 may be implemented among several electronic devices (e.g., as a system). In some of these examples, each (or several) electronic device(s) may include one or more of the components discussed above, such as various sensors, one or more display generating components, one or more loudspeakers, one or more processors, one or more memories, and / or communication switching logic. A person or persons who use the electronic device 201 and / or the electronic device 260 shall be referred to herein as the user(s) of the device.

[0032] Attention now turns to example systems and methods for determining head rotation input. In some examples, electronic devices receive input from the user to perform actions on the electronic devices. Input can include gestures such as touch gestures on a touch-sensitive surface or other gestures performed with body parts. As non-restrictive examples, hand gestures or head rotations of a user can be used and / or detected as input. For example, if a user is wearing a head-mounted device, the yaw rotation of the user's head can be used as input to control the scrolling of content on a user interface.Another example: If a user is wearing a head-mounted device, the yaw rotation of the user's head can be used as input to control a non-display function, such as controlling music playback (e.g., volume, play / pause, fast forward / rewind, skip forward / backward). Although head rotation is primarily described in terms of the head's yaw rotation, it is not limited to this. In some examples, pitch or roll rotation can be used as input to control the operation of the head-mounted device or another device that communicates with the head-mounted device. In some examples, head movement, as used here, refers to the rotational movement of the user's head (e.g., around the user's neck) relative to the user's upper body in the three-dimensional environment.

[0033] One challenge when using head movements as input is distinguishing between intentional and unintentional head movements. For example, the natural movement of the head (e.g., while stationary) can be differentiated from an intentional head movement based on one or more criteria. For instance, the magnitude of the movement (e.g., defined as rotation angle), the direction of the movement (e.g., defined as yaw rotation), and / or the speed of the movement (e.g., defined as angular velocity within a threshold range of angular velocities) can be used to distinguish an intentional head movement from an unintentional one. Distinguishing between intentional and unintentional head movements can be even more complex when dealing with locomotion within an environment (often simply referred to as movement).For example, if the user is walking in a three-dimensional environment, unintentional head rotation may increase compared to rotation when the user is stationary, and / or a non-linear locomotion path may result in head rotations. Furthermore, when walking, the user's entire body (e.g., including head and / or torso) or parts thereof changes direction, which can cause an absolute head rotation (without considering the effects of locomotion on the body) to be misinterpreted as an intentional head rotation, even if the user's head remains unchanged relative to their torso. Consequently, locomotion can increase the likelihood that an unintentional head rotation will be incorrectly interpreted as an intended input.To improve performance, the system and method for determining whether head rotation is intentional or unintentional can take locomotion into account (e.g., to filter out head movements caused by locomotion). For example, the movement path can be determined and / or used to predict a motion vector. Head movement can be determined using the predicted motion vector, for example, by comparing the forward vector of a head-worn device with the predicted motion vector.Using the difference between the forward vector of a head-mounted device and the predicted motion vector, instead of a previous forward vector of the head-mounted device, to detect a head rotation input or the absence thereof can improve performance. This is because the predicted motion vector accounts for unintentional head rotation resulting from movement relative to the previous forward vector of the head-mounted device. The reduced frequency of unintentional head movements being interpreted as input for a head rotation can enhance the user experience by reducing unintentional inputs that could lead to unintended actions on the electronic device.

[0034] In some examples, the electronic device described herein may be any device whatsoever, including a head-worn device. For example, the electronic device may be either electronic device 201 or 260. In some examples, the electronic device includes one or more displays, which may be any type of display described herein, including a touchscreen display capable of receiving user input. Furthermore, in some examples, the electronic device includes one or more input devices. Some non-restrictive examples include a touchscreen display, a microphone, a camera, a controller, or the like, and are defined in relation to the Fig. 1 and Fig. 2 mentioned.

[0035] In Fig. 3A and Fig. Figure 3B shows a top view of the user 301 wearing an electronic device 101 (e.g., a head-worn device), as well as the display 120 of the electronic device 101. The electronic device 101 optionally displays a three-dimensional environment 300 via the display 120. The three-dimensional environment 300 optionally includes representations of physical objects in the physical environment of the electronic device 101 that are within the device's field of view from the current perspective of the electronic device 101. As shown in Fig. As shown in Figure 3A, the physical environment of the electronic device 101 includes, for example, the door 304 and the houseplant 302. Accordingly, in some examples, the three-dimensional environment 300 includes a representation of the door 304 and a representation of the houseplant 302, which correspond to computer-generated representations (e.g., images) of the door 304 and the houseplant that were captured by the image sensors 114b and 114c (e.g., cameras of the electronic device 101), or transparent representations that are visible through a transparent part of the display 120. Fig. In 3A, user 301 stands still and looks straight ahead; his head is aligned with the position of his body. For example, the forward direction of the user's head is aligned with the forward direction of the user's torso (e.g., a vector perpendicular to a line through the user's shoulders). On the other hand, illustrates Fig. 3B the upper body of user 301, who is still looking forward (e.g. as in Fig. 3A) and is stationary, but with a head rotation to the right in the top view, and the new, updated view of the three-dimensional environment 300 via the display device 120, which is based on an updated viewing angle of the electronic device 101 as a result of the head rotation.

[0036] In some examples, the electronic device 101 tracks a first vector 310, which contains information about an orientation of the electronic device 101 using one or more input devices. An orientation of the electronic device 101 can be defined as a reference frame of the electronic device to determine which direction in the environment is "front" relative to the electronic device 101. In some examples, as in the top view in Fig. 3A and Fig. As indicated in Figure 3B, the first vector 310 can be defined as extending away from a center of the viewpoint of the electronic device 101, such as the center of the display 120. In some examples, the determination of the first vector is independent of the view direction of the user 301 (e.g., the direction in which the user 301 is looking). In some examples, the electronic device 101 can track the first vector 310 by means of one or more input devices, such as a camera or other input device mentioned herein. In a non-restrictive example, the camera or other input device detects a change or movement of the first vector 310 by detecting a movement of the physical objects in the three-dimensional environment 300 relative to the electronic device 101.The movement of the physical objects indicates a new direction, which is now considered the forward direction for the head-mounted device. In some examples, the first vector 310 in the three-dimensional environment 300 points forward relative to the electronic device 101. For example, if the electronic device 101 is a head-mounted device, as shown in the top view in . Fig. As shown in Figure 3A, the electronic device 101 and the user 301 are aligned when the user 301 is stationary and facing forward. Fig. 3A the orientation of the electronic device 101 is represented by the first vector 310, as described above in a similar manner.

[0037] However, if a user 301 turns their head in the yaw direction and their upper body remains stationary, as shown in the top view in Fig. As shown in Figure 3B, the orientation of the electronic device 101 changes in the direction in which the user's head 301 is now pointing. Thus, the first vector 310 of the electronic device 101 is updated according to the updated orientation of the electronic device 101. The rotation of the user's head 301 causes the overall orientation of the electronic device 101 to change, since its forward direction with respect to the three-dimensional environment 300 is now different than previously detected. As shown in Figure 120 in Figure 3B, the orientation of the electronic device 101 changes in the direction in which the user's head 301 is now pointing. Fig. 3A and Fig. 3B visually indicates a change in display 120, i.e., a change in the first vector 310. In Fig. For example, while the user 301 is standing still and viewing the three-dimensional environment 300 via the display 120, one or more real objects, such as a door 304 (e.g., a physical door) or a houseplant 302, are visible in the field of view of the three-dimensional environment 300 from the current viewing angle of the electronic device 101. These objects are recognized as present by the device attached to the head (e.g., the electronic device 101). When the user 301 turns their head and keeps their body still, the display 120 updates the view of the three-dimensional environment 300, causing the door 304 and the houseplant 302 to be moved / shifted to different positions relative to the updated viewpoint of the electronic device 101.In some examples, the updated display of the door 304 and the houseplant 302 in the three-dimensional environment 300, with respect to the updated viewpoint of the electronic device 101, visually indicates a rotation of the user's head 301 in the yaw direction and / or corresponds to this rotation and thus to a change or movement of the first vector 310. As indicated above, in the examples of . Fig. 3A and Fig. 3B, when the rotation of the head, and thus the first vector 310, is tracked, the body orientation (e.g., the orientation of the upper body) of the user 301 remains the same. However, as explained below, it is difficult to capture the body orientation, or the direction in which the user's body (e.g., the upper body) is pointing, and simultaneously track the head movement.

[0038] Fig. 4A and Fig. Figure 4B shows, for example, user 401 and display 120 while user 401 moves. In Fig. 4A shows the head of user 401 facing in the same direction in which the body of user 401 is moving. Fig. 4B shows the head of user 401 pointing in a different direction than the direction in which the user's body is moving (optionally illustrating a rotation of user 401's head during movement).

[0039] In some examples, the electronic device 101 also tracks a second vector 402, distinct from the first vector 310, using one or more input devices. The second vector 402 indicates a predicted path for the electronic device 101. The predicted path of the electronic device 101 corresponds to a prediction of the direction in which the user 401 will next move (e.g., within a certain time interval after the current time, such as 0.05, 0.15, 0.25, 0.5, 1, 2, 5, etc. seconds in the future). In a non-restrictive example, a head-mounted device uses a camera or general tracking functions to capture a path of the user 401's movement and, based on the captured path, predict the direction in which the user 401 will next move.In some examples, to track the predicted motion, previous position frames of the user 401 moving relative to the three-dimensional environment 300, as captured by the electronic device 101 (e.g., the user's previous motion path), are extrapolated and applied to the current motion frame of the electronic device 101 (e.g., the user's current motion path). Further information on how the predicted motion vector, or second vector 402, is tracked is given below in reference to... Fig. 5A provided. In some examples, both the first vector 310 and the second vector 402 have the same origin (e.g., reference point). For example, in Fig. 4A and Fig. In 4B, both the first vector 310, which specifies the orientation of the electronic device 101, and the second vector 402, which specifies the predicted motion, originate from the head center of the user 401 (e.g., the center of the viewpoint of the electronic device 101). In some examples, the origin of both vectors is the center of gravity of the user 401. Furthermore, in some examples, a vector encoder is used to generate the first vector 310 and the second vector 402. In some examples, both vectors can be tracked using accelerometers, cameras, or similar devices.

[0040] Tracking a predicted movement of the user 401 allows the electronic device 101 to compare the second vector 402 with the first vector 310, which contains information about the orientation of the electronic device 101. For example, in Fig. 4A and Fig. Figure 4B shows the second vector 402, which contains information about a predicted path of the electronic device 101. In both scenarios, the user 401 moves continuously along a straight path, so the second vector 402 points in the direction of the movement. Fig. In 4A, the first vector 310 and the second vector 402 point in the same direction, indicating that the user's head 401 points in the same direction as the user's body 301 is moving. Fig. In 4B, however, the first vector 310 and the second vector 402 exhibit a yaw direction difference (e.g., vector differences 404 and 406) because the user 401 is moving in one direction, but their head is turned / oriented in a different direction that deviates from the predicted path. Vector differences 404 and 406 represent the yaw difference between the first vector 310 and the second vector 402, with vector difference 404 in Fig. 4A shows a small, almost non-existent change in yaw compared to the larger change (e.g., greater distance between the vectors) caused by the vector difference 406 in Fig. 4B is shown.

[0041] In some examples, the electronic device 101 detects a difference between the first vector 310 and the second vector 402. This difference is illustrated by the vector differences 404 and 406 shown in the figures. The difference occurs when the first vector 310 and the second vector 402 point in different directions. In some examples, the difference is an angular distance between the vectors in the yaw direction. In another example, the difference includes a positional difference between the first vector 310 and the second vector 402 relative to the display 120 (e.g., relative to a center of the display 120). Fig. In 4A, for example, the first vector 310 and the second vector 402 are individualized to emphasize that no difference is perceived between the first vector 310 and the second vector 402, since the user 401 is moving in the same direction as their head is pointing. Fig. However, in 4B the first vector 310 and the second vector 402 are shown, between which, due to the rotation of the head, there is a distinct angular difference 406 (e.g. in direction), characterized by the arc that produces an angle measurement between them.

[0042] In some examples, the difference between the first vector 310 and the second vector 402 is detected when a movement of the viewpoint of the electronic device 101 is detected. The viewing angle of the electronic device 101 (e.g., the viewpoint of the user 401) determines which content is visible on the display 120 and generally indicates a location and direction relative to the three-dimensional environment 300. The viewpoint of each user, as described here, is indicated by a corresponding viewpoint on the display 120. When the viewing angle changes, the view of the three-dimensional environment on the display 120 also changes. In some examples, this shift in the viewing angle of the electronic device 101 indicates a rotation of the head and optionally leads to a renewed detection of the difference between the first vector 310 and the second vector 402.In some examples, a difference between the first vector 310 and the second vector 402 is detected when the difference exceeds a threshold. In some examples, the difference between the first vector 310 and the second vector 402 indicates that the user 401 has turned their head because the detected head orientation (e.g., indicated by the first vector 310) no longer matches the predicted path (e.g., indicated by the second vector 402).

[0043] In some examples, the electronic device 101 determines the difference between the first vector 310 and the second vector 402 as a rotation of the head caused by the user turning their neck relative to their upper body when one or more first criteria are met. The one or more first criteria are conditions that must be met for the electronic device 101 to confirm that the determined difference between the vectors corresponds to a rotation of the user's head 401 and not to an accidental head movement (e.g., a headbutt or jerk) or a rotation of the user's body (e.g., of the head and upper body). In some examples, the one or more first criteria include a criterion that is met when there is a yaw shift at the point of view that corresponds to a rotation by a threshold value, such as a threshold angle.In some examples, the threshold angle is a yaw angle threshold. In some examples, one or more of the first criteria include a criterion that is met if the threshold difference between the first vector 310 and the second vector 402 is detected in conjunction with a specific time interval (e.g., to filter out excessively fast or slow head rotation). In some examples, one or more of the first criteria include a criterion that is met if the difference between the first vector 310 and the second vector 402 indicates a velocity greater than a velocity threshold (e.g., the angular velocity).In some examples, the one or more initial criteria include the evaluation of a time threshold, an angular velocity threshold, a distance threshold, an angle threshold, an acceleration threshold, or another suitable measurement to distinguish between unintentional and intentional head movement. The thresholds are optionally determined in the electronic device 101 (e.g., during calibration, during manufacturing, etc.) or are manually set for the electronic device 101 by the user 401 (or another user or developer) or based on a user calibration.

[0044] If one or more of the first criteria are met, the electronic device 101 determines the difference as the head rotation input. Inputting a head rotation to an electronic device 101 can trigger an action according to the user's head rotation. In some examples, inputting a head rotation, similar to touch or key input, causes the electronic device 101 to make or provide an instruction to perform an operation. Non-limiting examples include inputting a head rotation that can cause scrolling (e.g., vertical scrolling of a user interface using tilt rotation, horizontal scrolling of a user interface using yaw rotation), selection or deletion (e.g., tilting up or down), rotation (e.g., according to a roll input), and other possibilities.In some examples, the input of a head rotation causes the electronic device 101 to perform various actions on the display 120. As described herein, some of the actions can control displayed user interfaces, but other actions can be independent of any displayed user interface (e.g., volume control, media playback control, etc.). In some examples, the electronic device 101 does not recognize the difference between the first vector 310 and the second vector 402 as a head rotation if one or more of the first criteria are not met.

[0045] Fig. Figure 4A illustrates an example where one or more of the first criteria are not met. In this example, the difference between the first vector 310 and the second vector 402 is less than the threshold angle, or the first vector 310 and the second vector 402 are parallel (e.g., within an offset of 1 degree, 5 degrees, etc., if they do not have the same directions). Thus, the yaw angle difference between the first vector 310 and the second vector 402 is less than the threshold angle and does not meet at least this criterion (and therefore not one or more of the first criteria). The electronic device 101 determines that the difference does not correspond to a head rotation by the user 401, and no head rotation input is detected. When a head rotation input is not detected, the electronic device refrains from performing any action associated with a head rotation input.

[0046] Examples of failure to meet one or more of the first criteria include, without limitation, a shift in the viewing angle failing to meet a threshold (e.g., less than the threshold angular rotation in the yaw direction with respect to the difference between the first vector 310 and the second vector 402), a certain duration of head rotation failing to meet a minimum threshold time (e.g., the head rotation is too fast or too slow to be determined as intentional, such as a quick glance in another direction or a small, rapid head shake), a finding that more head movements in any direction are detected (e.g., head movements in the pitch and roll direction and / or off-axis rotations detected with a magnitude greater than the yaw direction), or the failure to meet any other appropriate criterion.For example, if the threshold of the angular rotation in the yaw direction relative to the difference between the first vector 310 and the second vector 402 is less than a threshold of 5 degrees, then one or more of the first criteria are not met. In some examples, one or more of the first criteria are met if the threshold angular rotation in the yaw direction relative to the difference between the first vector 310 and the second vector 402 is greater than a threshold of 5 degrees. Another example is that if the electronic device 101 detects irregular head movements such as rapid accelerations, movements in multiple or opposite directions within a short period of time, then one or more of the optional criteria are not met.

[0047] In some examples, if the electronic device 101 detects a motion signature of an intentional head movement without irregular movements, optionally one of the criteria is met. In some examples described herein, the failure to detect a head rotation input refers to the fact that certain inputs are not detected and / or that no corresponding actions based on the head rotation are performed on the electronic device 101. For example, although no head rotation input is detected for the specific performance of an operation on the electronic device 101, the head rotation of the user 301 is nevertheless generally (e.g., passively) detected on the electronic device 101 for various purposes, such as minor changes to the viewpoint associated with the display, maintaining the content in a particular locking configuration, etc.

[0048] As opposed to Fig. 4A illustrates Fig. 4B is an example where one or more of the first criteria are met. In particular, one or more of the first criteria are met if a difference between the first vector 310 and the second vector 402 is greater than the angle threshold. In this example, the directional difference between the first vector 310 and the second vector 402 is noticeably larger, and the yaw angle difference is greater than the threshold angle value (e.g., 15 degrees, 30 degrees, 45 degrees, etc.). Thus, the electronic device 101 determines that the difference corresponds to a head rotation by the user 401, and a head rotation input is detected.Since one or more of the first criteria are met, including the criterion that is met because the difference between the first vector 310 and the second vector 402 is greater than the threshold angle value, the head rotation input is recognized and causes the electronic device to perform an action associated with the head rotation input.

[0049] In some examples, fulfilling one or more of the first criteria without restriction includes a shift in the viewing angle exceeding a certain threshold, a certain duration of head rotation exceeding a minimum threshold, detection of no further head movement in any direction (e.g., a sharp head movement and no small random movements), or something similar. Furthermore, in some examples, the one or more first criteria include a criterion that is fulfilled when an angular velocity is greater than a threshold value for the angular velocity.

[0050] In some examples, one or more initial criteria include a criterion based on whether the difference between the first vector 310 and the second vector 402 indicates that a user is driving around a corner or curve. Fig. Figures 5A-5C illustrate the movement sequence of a user of the electronic device 101 who moves around a corner 502 in the three-dimensional environment 500. Fig. 5A The user of the electronic device 101 moves his head when he turns the corner, but the user's head remains in approximately the same position / orientation in relation to his body, so an input for a head rotation is not detected. Fig. Figure 5B shows the motion curve with information on the predicted path. Fig. 5A, showing both the actual path 504 and the predicted path (e.g., as a solid line). In Fig. 5C the user of the electronic device 101 moves his head while turning the corner, so that the electronic device 101 detects a rotation of the head at the end of the driving curve.

[0051] In some examples, the electronic device 101 tracks the vectors while the user drives around a corner or curve. When moving along a curved path, the user's head and body (e.g., torso) rotate in the same direction over a certain period of time, which means that the head rotation is not recognized as input for head rotation (e.g., because one or more of the first criteria are not met). The movement is not due to a rotation of the head, but rather to the user's movement / location in the three-dimensional environment 500. As in Fig. Figure 5A shows snapshots of users of the electronic device 101 (e.g., user 501a, user 501b, user 501c, and user 501d) as they move around corner 502 in the three-dimensional environment 500 while carrying the electronic device 101. User 501a represents the starting position of the user of the electronic device 101, and user 501d represents the final position of user 501. Since the head of the user of the electronic device 101 starts and ends in the same position, no difference is determined between the first vector 310 and the second vector 402, and thus no input of head rotation is detected.

[0052] In some examples, the predicted motion vector, or second vector 402, takes into account the unintentional rotation of the head due to movement relative to the previous forward vector of the device attached to the head. In some examples, the second vector 402 can predict and / or detect when the user of the electronic device 101 drives around corner 502. As in Fig. As shown in Figure 5B, a dotted line representing the actual motion path 504 of the user of the electronic device 101 is compared with the predicted motion path of the user of the electronic device 101, represented by the solid line / curve and tracked by the second vector 402. When the user of the electronic device 101 begins to move around corner 502, the predicted path includes a second vector 402 pointing in a direction that coincides with the curved path. In some examples, the electronic device 101 has one or more cameras to track the actual motion path 504 around corner 502. For example, to track the predicted path, past frames of the user's actual motion path (504) are extrapolated and applied to the current frame of motion, which is then used to predict the next frame of motion.This predicted curved movement is then used and compared with the head orientation of the user 501, which corresponds to the first vector 310. Since the electronic device 101 is configured to detect that the user of the electronic device 101 is moving along a curved path and / or around a corner 502, and because the user of the electronic device 101 started and finished the movement in the same orientation relative to the predicted path, one or more of the first criteria are not met; therefore, no input for a head rotation is detected.

[0053] In some examples, differences occur between the first vector 310 and the second vector 402 when it is detected that the user of the electronic device 101 is driving around a corner or curve, as with each snapshot / position of the user of the electronic device 101 in Fig. 5A-5C. In some examples, the tangent of the travel trajectory is measured to determine how much the user of the electronic device 101 has rotated their body. For example, if corner 502 or the curve traversed by the user of the electronic device 101 is wide, the predicted travel trajectory (e.g., the long solid line in Fig. 5B) be a long, curved end. In some examples, the first one or more criteria may include a criterion that is met when the slope of the motion curve reaches or exceeds a threshold slope. Furthermore, in some examples, the electronic device 101 begins measuring a motion curve of the user of the electronic device 101 when the display of the electronic device 101 begins to change its viewing angle. In some examples, the electronic device 101 continuously tracks the motion curve. In some examples, the electronic device 101 tracks the curve when motion is detected (e.g., when the user walks) and stops tracking when motion ceases (e.g., when the user stands still or sits).

[0054] In some examples, no head rotation input is detected when the user of the electronic device 101 drives around a corner or curve because a criterion based on a specific duration of head rotation has not been met. In some examples, the first one or more criteria may include a criterion that is met if the duration of the head rotation is less than a time threshold. In some examples, the first one or more criteria include a criterion that is met if the position of the user's head has changed relative to the orientation of their body. In some examples, the first one or more criteria may include a criterion that is met if the speed of the user of the electronic device 101 is greater than a speed threshold.In some examples, one or more of the first criteria may include a criterion that is met if the acceleration of the user of electronic device 101 is greater than an acceleration threshold. For example, if the threshold speed for meeting the criterion is 5 mph and the user of electronic device 101 is traveling at 4 mph, no head turn input will be detected. Furthermore, a head turn will be detected if the threshold for meeting the criterion is 5 mph and the user of electronic device 101 is traveling at 10 mph.

[0055] Fig. Figure 5C shows an example of a head rotation input. Since the user's head orientation in the end position of the user of the electronic device 101 (e.g., represented by user 501d) differs from the starting position or the previous position of the user of the electronic device 101 (e.g., represented by user 501a), one or more of the first criteria are met. In some examples, the electronic device 101 recognizes a head rotation input when one or more of the first criteria are met, including a criterion based on a difference between vectors 310d and 402d.

[0056] In some examples, the electronic device 101 provides a user interface that can interact via head rotation input. The user interface is displayed via one or more displays on the electronic device and can be any user interface or computing device described herein. In some examples, the determination of whether one or more of the first criteria are met is made during the display of the electronic device's user interface. In some examples, the action further includes interacting with the user interface using the head rotation input as input to the user interface.

[0057] In some examples, if the difference between the vectors is determined to correspond to a head rotation, the electronic device 101 performs an action according to the head rotation input that satisfies one or more secondary criteria on the user interface. Performing an action on the electronic device 101 includes any action that causes a change in the display of a user interface or an element of the user interface via the display 120 of the electronic device 101.In some examples, without limitation, performing the action includes scrolling content on the display 120, moving a digital object displayed on the display 120, changing the audio track playing on the electronic device 101, selecting an icon displayed on the display 120, changing the application displayed on the electronic device 101, exiting an application, turning off the electronic device 101, or the like. For example, show... Fig. 6A and Fig. 6B Example actions that are executed on the electronic device 101 when the head rotation input is detected and one or more second criteria are met. However, the action is not executed if the difference between the vectors is not determined to be the head rotation input or if the head rotation input does not meet the one or more second criteria. In some examples, the electronic device 101 refrains from executing the action if it is determined that the difference is not a head rotation.

[0058] In some examples, one or more of the second criteria must be met in order to perform the action on the display 120 of the electronic device 101. In some examples, one or more of the first criteria must be met for the electronic device 101 to determine whether the head movement is an input for a head turn, and one or more of the second criteria must be met for the electronic device 101 to perform an action in response to the detected input for a head turn. One or more second criteria may be included in the one or more first criteria described herein; however, the head turn input must meet these criteria in order to perform an action on the display 120.For example, fulfilling one or more second criteria requires that one or more first criteria be fulfilled, but fulfilling one or more first criteria does not require that one or more second criteria be fulfilled. In some examples, the one or more second criteria include a criterion that is fulfilled if the difference between the first vector 310 and the second vector 402 is greater than the threshold. The one or more second criteria include, for example, a criterion that is fulfilled if an angular velocity is greater than a threshold for angular velocity. In some examples, the one or more second criteria include a criterion that is fulfilled if the detected head rotation input or the difference between vectors reaches a minimum yaw rotation threshold.In another example, without restriction, the one or more second criteria include a criterion that is met if the head rotation input meets a minimum time threshold. Another example includes a criterion that is met if the input head rotation is recognized as a rotation in a specific direction (e.g., a head rotation to the left or a head rotation to the right in the yaw direction).

[0059] In some examples, the electronic device 101 prompts the user to confirm the head rotation input using one or more acoustic, visual, and / or haptic output devices, and the action is carried out in accordance with the received confirmation. In some examples, the user receives a pop-up message on the display 120 asking whether the head rotation input was intentional. User input (e.g., touches, air gestures, or verbal commands) is provided by the user for confirmation. In some other examples, a sound is played from one or more audio output devices, or a haptic signal is emitted from one or more haptic output devices of the electronic device 101 to alert the user that they must confirm the head rotation input.In some examples, this confirmation is one of the criteria of one or more second criteria that are met when the confirmation input is received to perform the action.

[0060] Fig. 6A and Fig. Figure 6B shows exemplary actions that can be performed on the electronic device 101 as a result of the head rotation input. The upper electronic device 101 in the figures shows the display 120 before the action is performed, while the lower electronic device 101 shows the display 120 after the action has been performed.

[0061] In Fig. Figure 6A shows the upper display 120 showing the scrollable content 608 in the three-dimensional environment of the electronic device 101. When a head rotation input is determined and one or more of the second criteria are met, the scrollable content 608 (e.g., the alphabet) is scrolled or moved in the same direction as the head rotation input. For example, if the user interface displays an alphabetical, horizontal list, a rightward head rotation in the yaw direction can cause the list to scroll to the left, as shown in the lower display 120 of the electronic device 101 in Figure 6A. Fig. 6A shown.

[0062] In Fig. Figure 6B shows the upper display 120, a media application in the three-dimensional environment of the electronic device 101. The media application includes any type of media application, including but not limited to a music application, a video application, a podcast application, a television application, or something similar. In some examples, the action performed by the electronic device 101 includes changing the playback from a first media element to a second media element that is different from the first media element, or from a first playback position within the first media element to a second playback position that is different from the first playback position within the first media element. As shown, the media application (e.g., Music) is currently playing a first media element 610 (e.g., a music track).When an input for a head rotation is detected and one or more of the second criteria are met, the electronic device 101 switches the first medium 610 to the second medium 612. The manner in which the medium is switched depends optionally on the input direction of the head rotation. For example, if the display device 120 switches the first medium 610 to... Fig. 6A and a head rotation in the right yaw direction is detected, then the electronic device 101 performs the action of switching to playback and display of the second medium 612, as shown in the lower user interface of Fig. 6B shown. In some examples, when the rotation of the head in the left yaw direction is detected, the user interface switches the medium of a music track to the previously played music track / medium (e.g., display and initiation of playback of a medium that, from the perspective of the electronic device 101, is spatially to the left of the first medium 610).

[0063] Fig. Figure 7 illustrates a flowchart that demonstrates an example procedure for determining the rotation of the head based on tracking according to some examples of the disclosure. In some examples, the process 700 begins at an electronic device that communicates with one or more displays and one or more input devices. In some examples, the electronic device is optionally a head-mounted display that resembles or is equivalent to an electronic device (e.g., the electronic device 101 of Fig. 1 and the electronic device 260 of Fig. 2) As in Fig. As shown in Figure 7, in some examples at Figure 702, the electronic device (e.g., the electronic device 101) tracks a first vector (e.g., the first vector 310) using one or more input devices. Fig. 3A), which indicates an orientation of the electronic device, and a second vector (e.g. the second vector 402 in Fig. 4A), which differs from the first vector and indicates a predicted path for the movement of the electronic device. In some examples, the first vector indicates the forward direction of the electronic device. In some examples, tracking the second vector involves determining a predicted path using a variety of positions, as in Fig. 5A-5C shown. In some examples, the electronic device detects a difference between the first vector and the second vector at 704. As shown in Fig. As shown in Figure 4B, for example, an angle difference (e.g., the vector differences 404 and 406 of Fig. 4A-4B) between the first and second vectors is shown. In some examples, the difference between the first and second vectors is captured along the yaw axis. In some examples, this difference helps determine whether a user has intentionally turned their head or not. Further, with reference to Fig. In some examples, at 706, the criterion is determined according to a stipulation that one or more first criteria are satisfied, including a criterion that is satisfied if the difference between the first vector and the second vector is greater than a threshold, and the difference is determined as input for a head turn. In some examples, the criterion is not satisfied if the difference between the first vector and the second vector is less than or equal to the threshold, where the threshold is a yaw angle threshold. In some examples, one or more first criteria include a criterion that is satisfied if an angular velocity is greater than a threshold for the angular velocity.

[0064] Furthermore, with reference to Fig. 7 In some examples at 706, when the deviation is determined to be a head rotation input, the electronic device performs an action according to the head rotation input that satisfies one or more second criteria, as in Fig. 6A-6B. In some examples, the one or more second criteria include a criterion that is satisfied if the difference between the first vector and the second vector is greater than the threshold, and / or a criterion that is satisfied if an angular velocity is greater than an angular velocity threshold. In some examples, at 708, based on a determination that one or more of the first criteria are not satisfied, the difference is not taken as input for head rotation, and the action is not performed. In some examples, the action is to change the playback from a first medium to a second medium that is different from the first medium, or from a first playback position within the first medium to a second playback position that is different from the first playback position within the first medium, as in Fig. 6B is shown. In some examples, the action includes scrolling the content of a user interface on the display, as in Fig. 6A shown. Finally, in some examples, process 700 includes an electronic device that prompts the user to confirm the head rotation input using one or more acoustic, visual, or haptic devices, with the action being carried out in accordance with the confirmation received.

[0065] It is understood that Process 700 is an example and that more, fewer, or different operations can be performed in the same or a different sequence. Furthermore, the operations described above in Process 700 can optionally be performed by executing one or more functional modules in an information processing unit, such as general-purpose processors (e.g., as in Fig. 2 described) or application-specific chips, and / or by other components of Fig. 2 implemented.

[0066] Fig. Figure 8 illustrates a flowchart that demonstrates an example procedure for determining the rotation of the head based on tracking according to some examples of the disclosure. In some examples, the process 800 begins at an electronic device that communicates with one or more displays and one or more input devices. In some examples, the electronic device is optionally a head-mounted display that resembles or is equivalent to an electronic device (e.g., the electronic device 101 of Fig. 1 and the electronic device 260 of Fig. 2) As in Fig. As shown in Figure 8, in some examples, steps 802-808 of Procedure 800 are the same as steps 702-708 of Procedure 700. However, Procedure 800 includes some additional steps. In some examples, at step 810, the electronic device presents a user interface via one or more displays, which can be interacted with by input of head rotation. In some examples, at step 812, the determination that one or more initial criteria are met occurs during the presentation of the user interface. Finally, in some examples, as shown in Figure 8, Fig. 6A-6B, the action includes interacting with the user interface using head rotation as input to the user interface.

[0067] It is understood that Process 800 is an example and that more, fewer, or different operations can be performed in the same or a different sequence. Furthermore, the operations described above in Process 800 can optionally be performed by executing one or more functional modules in an information processing unit, such as general-purpose processors (e.g., as in Fig. 2 described) or application-specific chips, and / or by other components of Fig. 2 implemented.

[0068] Therefore, according to the foregoing, some examples of disclosure are directed towards a procedure.The method comprises, in the case of an electronic device comprising one or more displays and one or more input devices, tracking a first vector indicating an orientation of the electronic device and a second vector, distinct from the first vector and indicating a predicted path of the electronic device, using the one or more input devices; after determining that one or more first criteria are met, including a criterion that is met if a difference between the first vector and the second vector is greater than a threshold, determining the difference as a head rotation input and performing an action in accordance with the head rotation input; and after determining that one or more first criteria are not met, omitting the determination of the difference as a head rotation input and performing the action.

[0069] Additionally or alternatively, in some examples, the method further includes the display of a user interface that can interact via head rotation input, through which one or more displays are shown. The determination of whether one or more of the first criteria are met is performed during the display of the user interface. The action includes interacting with the user interface by using the head rotation input as input for the user interface. Additionally or alternatively, in some examples, the first vector is an indication of the forward direction of the electronic device. Additionally or alternatively, in some examples, tracking the second vector includes determining a predicted path using a plurality of positions. Additionally or alternatively, in some examples, the difference between the first vector and the second vector along a yaw axis is detected.Additionally or alternatively, in some examples, the criterion is not met if the difference between the first vector and the second vector is less than or equal to the threshold. Additionally or alternatively, in some examples, the threshold is a yaw angle threshold. Additionally or alternatively, in some examples, one or more of the first criteria include a criterion that is met if an angular velocity is greater than an angular velocity threshold. Additionally or alternatively, in some examples, the action consists of changing the playback from a first media element to a second media element that is different from the first media element, or from a first playback position within the first media element to a second playback position that is different from the first playback position within the first media element.Additionally or alternatively, in some examples, the action includes scrolling the content of a user interface on one or more displays. Additionally or alternatively, in some examples, the procedure further includes prompting a user to confirm the head rotation input using one or more auditory, visual, or haptic devices. The action is then executed based on the confirmation received.

[0070] Some examples of the disclosure relate to an electronic device comprising: one or more processors; a working memory; and one or more programs stored in the working memory and configured to be executed by the one or more processors, the one or more programs containing instructions for carrying out one of the above-mentioned procedures.

[0071] Some examples of the disclosure relate to a non-transitory, computer-readable storage medium that stores one or more programs, wherein the one or more programs comprise instructions which, when executed by one or more processors of an electronic device, cause the electronic device to perform one of the above-mentioned procedures.

[0072] Some examples of the disclosure relate to an electronic device comprising one or more processors, memory, and means for carrying out one of the foregoing methods.

[0073] Some examples of the disclosure relate to an information processing device for use in an electronic device, the information processing device comprising means for carrying out one of the methods disclosed above.

[0074] The foregoing description was provided for the purpose of explanation with reference to specific examples. However, the preceding illustrative discussions are neither intended to be exhaustive nor to limit revelation to the exact forms revealed. In light of the foregoing teachings, many modifications and variations are possible. The examples were chosen and described to best explain the principles of revelation and their practical application, thus enabling other professionals to make the best possible use of revelation and the various examples described, with different modifications, as appropriate for their intended particular use.

[0075] Although examples of this disclosure have been fully described with reference to the accompanying drawings, it should be noted that numerous changes and modifications are apparent to the person skilled in the art. Such changes and modifications are to be understood as included within the scope of the examples of this disclosure as defined by the appended claims. QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] US 63 / 699,731

[0001] US 19 / 312,729

[0001]

Claims

[1] Procedure, encompassing: in an electronic device comprising one or more displays and one or more input devices: Determine, using one or more input devices, a first vector specifying an orientation of the electronic device, and a second vector that differs from the first vector and specifies a predicted motion path of the electronic device; based on a finding that one or more first criteria are met, including a criterion that is met if a difference between the first vector and the second vector is greater than a threshold, determining the difference as a head turn input and performing an action according to the head turn input that meets one or more second criteria; and Based on a finding that one or more of the first criteria are not met, the determination of the difference as a head turn input is waived, and the action is waived. [2] Method according to claim 1, further comprising: Presenting a user interface via one or more displays that can be interacted with via head rotation input, wherein the determination that one or more of the first criteria are met occurs during the presentation of the user interface and the action includes interacting with the user interface using head rotation input as input for the user interface. [3] Method according to one of claims 1 to 2, wherein the first vector specifies a forward direction of the electronic device. [4] Method according to any one of claims 1 to 3, wherein determining the second vector includes determining a predicted motion path using a plurality of positions. [5] Method according to any one of claims 1 to 4, wherein the difference between the first vector and the second vector is measured along a yaw axis. [6] Method according to any one of claims 1 to 5, wherein the criterion is not met if the difference between the first vector and the second vector is less than or equal to the threshold. [7] Method according to any one of claims 1 to 6, wherein the threshold is an angle yaw threshold. [8] Method according to any one of claims 1 to 7, wherein one or more first criteria include a criterion which is satisfied if an angular velocity of the electronic device is greater than an angular velocity threshold. [9] Method according to any one of claims 1 to 8, wherein the action includes changing the playback from a first media element to a second media element that differs from the first media element, or from a first playback position within the first media element to a second playback position within the first media element that differs from the first playback position. [10] Method according to any one of claims 1 to 8, wherein the action comprises scrolling content of a user interface on one or more displays. [11] Method according to any one of claims 1 to 10, further comprising: Prompting a user to confirm the head rotation input using one or more audio, visual or haptic output devices, with the execution of the action also being consistent with the confirmation received. [12] Method according to any one of claims 1 to 11, wherein one or more second criteria include a criterion which is satisfied if the head rotation input is at least one yaw threshold. [13] Electronic device comprising: one or more advertisements; one or more input devices; one or more processors; non-transitory storage; and one or more programs, wherein the one or more programs are stored in memory and configured to be executed by the one or more processors, wherein the one or more programs include instructions for carrying out a method according to claims 1 to 12. [14] Non-transitory computer-readable storage medium storing one or more programs, wherein the one or more programs comprise instructions which, when executed by an electronic device having one or more processors and a display, cause the electronic device to perform one of the methods according to any one of claims 1 to 12.

Images