System and method for scrolling content
By detecting the user's head yaw and rotation, the electronic device automatically scrolls the user interface content and displays elements, solving the problem of unnatural user interface operation in a 3D environment and improving the user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-09-25
- Publication Date
- 2026-03-27
AI Technical Summary
In existing computer graphics environments, user interface scrolling is not natural or intuitive enough, especially in 3D environments, where users find it difficult to directly control the scrolling of content and the display of multiple user interface elements by moving their heads.
By detecting the user's head yaw movement and head rotation, the electronic device automatically scrolls through the content in the user interface and shows or hides user interface elements, using a flexible model and a locked orientation mechanism to simulate the natural behavior of the user's head movement.
It enables natural control of content scrolling and display of user interface elements in a 3D environment through head movement, improving the intuitiveness and ease of operation of the user experience.
Smart Images

Figure CN121742735A_ABST
Abstract
Description
Cross Reference to Related Applications
[0001] This application claims the benefit of U.S. Provisional Patent Application No. 63 / 700,597, filed September 27, 2024, and U.S. Patent Application No. 19 / 319,464, filed September 4, 2025, the entire disclosures of which are incorporated herein by reference for all purposes. TECHNICAL FIELD
[0002] The present disclosure generally relates to systems and methods for scrolling computer-generated content. BACKGROUND
[0003] Some computer graphics environments provide two-dimensional and / or three- dimensional environments in which at least some objects displayed for viewing by a user are virtual and generated by a computer. For example, multiple content items are often presented as a scrollable list in a computer graphics environment. SUMMARY
[0004] An electronic device can display a user interface that includes content that is vertically scrollable in the user interface. While displaying the user interface that includes the content, the electronic device can detect a first input that corresponds to a request to scroll the content, where the first input includes a yaw movement of a head of a user of the electronic device. In response to detecting the yaw movement of the head of the user of the electronic device, the electronic device can vertically scroll the content in the user interface in accordance with the yaw movement of the head of the user.
[0005] An electronic device can display a user interface of an application. While displaying the user interface of the application, the electronic device can detect a first input that corresponds to a request to display a plurality of user interface elements, where the first input includes a first head rotation of a head of a user of the electronic device about a first axis associated with the head. In response to detecting the first head rotation of the head of the user of the electronic device about the first axis, the electronic device can display the plurality of user interface elements. The plurality of user interface elements can be scrollable in response to a second head rotation of a second input that is different from the first input.
[0006] A thorough description of these examples is provided in the detailed description and in the accompanying drawings below, and it is understood that the summary is not meant to limit the scope of the present disclosure in any way. BRIEF DESCRIPTION OF DRAWINGS
[0007] For a better understanding of the various examples described herein, reference should be made to the Detailed Description below and the accompanying drawings in which like reference numerals refer to corresponding parts throughout the figures. The drawings described herein are intended for illustrative purposes, and are not meant to limit the scope of the present disclosure.
[0008] FIG. 1An electronic device presenting an extended reality environment is illustrated in accordance with some examples of the present disclosure.
[0009] FIG. 2A-2B A block diagram of an example architecture for an electronic device is illustrated in accordance with some examples of the present disclosure.
[0010] FIG. 3A-3K As a whole, an electronic device is illustrated in accordance with some examples of the present disclosure to vertically scroll content in a user interface in response to detecting a yaw movement of a head of a user of the electronic device.
[0011] FIG. 3L As a whole, a method for vertically scrolling content in a user interface in response to detecting a yaw movement of a head of a user of an electronic device is illustrated in accordance with some examples of the present disclosure.
[0012] FIG. 4A-4T As a whole, an electronic device is illustrated in accordance with some examples of the present disclosure to detect and respond to an input corresponding to a request to display one or more user interface elements, where the input includes a head rotation of a user of the electronic device.
[0013] FIG. 4U As a whole, a method for displaying a plurality of user interface elements in response to detecting a head rotation of a user of an electronic device is illustrated in accordance with some examples of the present disclosure.
[0014] FIG. 5A-5F As a whole, an electronic device is illustrated in accordance with some examples of the present disclosure to display different amounts of a user interface in accordance with different amounts of head rotation of a user of the electronic device. DETAILED DESCRIPTION
[0015] An electronic device can display (e.g., in a two-dimensional environment or a three-dimensional environment) a user interface that includes content that is vertically scrollable in the user interface. While displaying the user interface that includes the content, the electronic device can detect a first input corresponding to a request to scroll the content, where the first input includes a yaw movement of a head of a user of the electronic device. In response to detecting the yaw movement of the head of the user of the electronic device, the electronic device can vertically scroll the content in the user interface in accordance with the yaw movement of the head of the user.
[0016] An electronic device can display a user interface of an application (e.g., in a two-dimensional environment or a three-dimensional environment). While displaying the user interface of the application, the electronic device can detect a first input corresponding to a request to display a plurality of user interface elements, where the first input includes a first head rotation of a head of a user of the electronic device about a first axis associated with the head. In response to detecting the first head rotation of the head of the user of the electronic device about the first axis, the electronic device can display the plurality of user interface elements. The plurality of user interface elements can be scrollable in response to a second head rotation of a second input different from the first input.
[0017] Note that, in some examples, detecting a head movement of the user of the electronic device includes detecting a movement of the electronic device that corresponds to a movement of the head of the user of the electronic device. For example, detecting an upward pitch movement of the head of the user of the electronic device can include detecting a rotation of the electronic device that corresponds to the upward pitch movement of the head of the user of the electronic device.
[0018] In some examples, a three-dimensional object is displayed in a particular orientation in a computer-generated three-dimensional environment that controls one or more behaviors of the three-dimensional object (e.g., as the three-dimensional object moves within the three-dimensional environment). In some examples, the orientation in which the three-dimensional object is displayed in the three-dimensional environment is selected by a user of the electronic device or automatically selected by the electronic device. For example, when initiating a presentation of the three-dimensional object in the three-dimensional environment, the user can select a particular orientation of the three-dimensional object, or the electronic device can automatically select an orientation of the three-dimensional object (e.g., based on a type of the three-dimensional object).
[0019] In some examples, a three-dimensional object can be displayed in a body-locked orientation, a head-locked orientation, a world-locked orientation, or a tilt-locked orientation in a three-dimensional environment, as described below.
[0020] As used herein, an object displayed in a body-locked orientation in a three-dimensional environment has a distance and orientation offset relative to a portion of a user’s body (e.g., the user’s torso). Alternatively, in some examples, a body-locked object has a fixed distance from the user, while the orientation of the content is not referenced to any portion of the user’s body (e.g., can be displayed in the same basic direction relative to the user regardless of head and / or body movement). Additionally or alternatively, in some examples, a body-locked object can be configured to always keep gravity or the horizon (e.g., perpendicular to gravity) aligned, such that changes in the head and / or body in the roll direction will not move the body-locked object within the three-dimensional environment. Instead, translational movement in either configuration will reposition the body-locked object within the three-dimensional environment to maintain the distance offset.
[0021] As used herein, an object that is displayed in a head-locked orientation in a three- dimensional environment has a distance and orientation offset relative to a user’s head. In some examples, as the user’s head moves (as the user’s point of view changes), the head-locked object moves within the three-dimensional environment. For example, when an object (e.g., virtual content) is head-locked and in accordance with detecting head movement, the electronic device 101 optionally displays the object moving within the three-dimensional environment in accordance with the user’s head movement, optionally in order to maintain (e.g., lock) the object’s position on the display 120 and the object’s distance relative to the user’s head. In another example, when head-locked, the object is locked to (e.g., displayed via) a first set of pixels on the display 120 (e.g., a predetermined number or area of pixels) and is not locked to (e.g., not displayed via) a second set of pixels, such that the object is maintained on the display 120 via the first set of pixels even when the user moves the user’s head. In yet another example, when head-locked, movement of the display 120 optionally results in movement of the object relative to the physical environment of the electronic device 101. In some examples, when an object is head-locked, the behavior of the object is head-locked (elastically), such as described below.
[0022] For example, when the object is head-locked (with elasticity), the electronic device 101 optionally causes the object to visually behave according to an elasticity model as head-locked content. In some examples, the elasticity model will physically embody user interactions in the virtual environment such that the interactions are governed by physical laws, such as laws related to springs. For example, a user’s head position and / or head orientation optionally corresponds to a position of a first end of a spring (e.g., simulating that the first end of the spring is attached to the object), and the object optionally corresponds to a mass attached to a second end of the spring different from (e.g., opposite) the first end of the spring. When the head position and / or orientation is a first head position and / or first head orientation corresponding to a first position of the first end of the spring, and the object corresponds to the mass attached to the second end of the spring, the electronic device 101 optionally detects a head movement (e.g., a head rotation) from the first head position and / or first head orientation to a second head position and / or second head orientation. In response to detecting the head rotation, the electronic device 101 optionally models a deformation of the spring (e.g., according to an amount of head rotation and / or a speed of head rotation), and moves the object according to a release of energy due to movement of the spring toward an equilibrium position (e.g., a stable equilibrium position) relative to the second head position and / or second head orientation. The speed at which the object follows the head rotation is optionally a function of a distance between a position of the object when the electronic device detects the head rotation and a position of the object corresponding to a relaxed position (e.g., an equilibrium position) of the spring, the latter position optionally being a position of the object relative to a new viewpoint of the user caused by the head rotation that is the same as a position of the object relative to a viewpoint of the user prior to detecting the head rotation. In some examples, the speed of the first virtual content decreases as the object moves toward the relaxed position in response to the head rotation. In some examples, the user’s head rotates a first amount for a first amount of time, and the movement of the object to its new position relative to the new viewpoint of the user is performed for a second amount of time that is greater than the first amount of time. As such, when the object is head-locked (with elasticity), in response to detecting a head movement, the electronic device 101 can display an object that moves within the three-dimensional environment according to the user’s head movement and according to an elasticity model that mimics a lazy following movement behavior. When the user moves (e.g., rotates the user’s head), head-locked with elasticity can be used to smooth movement of the object in the three-dimensional environment.
[0023] As used herein, an object displayed in a world-locked orientation in a three-dimensional environment does not have a distance or orientation offset (e.g., a fixed distance or orientation offset) relative to a user.
[0024] As used herein, an object displayed in a tilt-locked orientation in a 3D environment (referred to herein as a tilt-locked object) has a distance offset relative to a user (such as a part of the user's body, e.g., the user's torso, or the user's head). In some examples, the tilt-locked object is displayed in a fixed orientation relative to the 3D environment. In some examples, the tilt-locked object moves according to a polar (e.g., spherical) coordinate system centered on a pole passing through the user (e.g., the user's head). For example, the tilt-locked object moves in the 3D environment based on the movement of the user's head within a spherical space surrounding the user's head (e.g., centered on the user's head). Thus, if the user tilts their head (e.g., tilts up or down in the pitch direction, rotating about the pitch axis), the tilt-locked object will follow the head tilt and move radially along the sphere such that the tilt-locked object is repositioned in the 3D environment with the same distance offset relative to the user as before the head tilt, while optionally maintaining the same orientation relative to the 3D environment. In some examples, if a user moves their head in the scrolling direction (e.g., rotating clockwise or counterclockwise around the scroll axis), the tilt-locked object will not be repositioned (e.g., reoriented) in the 3D environment.
[0025] FIG. 1 An electronic device 101 is illustrated according to some examples of this disclosure, which presents a three-dimensional environment (e.g., an extended reality (XR) environment or a computer-generated reality (CGR) environment, optionally including representations of physical objects and / or virtual objects). In some examples, such as FIG. 1 As shown, electronic device 101 is a head-mounted display or other head-mountable device configured to be worn on the head of a user of electronic device 101. See below for reference. FIG. 2A An example of an architecture block diagram to describe electronic device 101. For example... FIG. 1 As shown, electronic device 101 and table 106 are located in a physical environment. The physical environment may include physical features such as physical surfaces (e.g., floor, wall) or physical objects (e.g., table, lamp, etc.). In some examples, electronic device 101 may be configured to detect and / or capture images of the physical environment including table 106 (exemplified in the field of view of electronic device 101).
[0026] In some examples, such as FIG. 1 As shown, electronic device 101 includes one or more internal image sensors 114a oriented toward the user's face (e.g., referred to below). FIG. 2A-2B(The described eye-tracking camera). In some examples, an internal image sensor 114a is used for eye tracking (e.g., detecting the user's gaze). The internal image sensor 114a is optionally arranged on the left and right portions of the display 120 to enable eye tracking of the user's left and right eyes. In some examples, the electronic device 101 also includes external image sensors 114b and 114c facing outwards from the user to detect and / or capture the physical environment of the electronic device 101 and / or movement of the user's hands or other body parts.
[0027] In some examples, display 120 has a field of view visible to the user. In some examples, the user-visible field of view is the same as the field of view of external image sensors 114b and 114c. For example, when display 120 is optionally part of a head-mounted device, the field of view of display 120 is optionally the same as or similar to the field of view of the user's eyes. In some examples, the user-visible field of view is different from the field of view of external image sensors 114b and 114c (e.g., narrower than the field of view of external image sensors 114b and 114c). In other examples, the field of view of display 120 may be smaller than the field of view of the user's eyes. The user's viewpoint determines what is visible in the field of view, and the viewpoint typically specifies the position and orientation relative to the three-dimensional environment. As the user's viewpoint shifts, the field of view of the three-dimensional environment also shifts accordingly. In some examples, electronic device 101 may be an optically transparent device, through which display 120 is a transparent or translucent display through which parts of the physical environment can be directly viewed. In some examples, display 120 may be included within a transparent lens and may overlap entirely or partially with the transparent lens. In other examples, the electronics may be a video pass-through device, wherein display 120 is an opaque display configured to display an image of the physical environment using images captured by external image sensors 114b and 114c. Although FIG. 1 A single display is shown, but it should be understood that display 120 optionally includes more than one display. For example, display 120 optionally includes a pair of stereoscopic displays (e.g., a left display panel and a right display panel for the user's left and right eyes, respectively), the outputs displayed by this pair of stereoscopic displays being combined (e.g., combined by the user's brain) to create FIG. 1 The view showing the content. See the following references for some examples. FIG. 2A-2B In more detail, the display 120 includes or corresponds to a transparent or translucent surface (e.g., a lens) that is not equipped with display capabilities (e.g., and therefore cannot generate and display virtual objects 104), and alternatively presents a direct view of the physical environment in the user's field of view (e.g., the user's eye's field of view).
[0028] In some examples, the electronic device 101 is configured to display (e.g., in response to a trigger) the virtual object 104 in a three-dimensional environment. The virtual object 104 is represented by FIG. 1 The illustrated cube represents a cube that does not exist in the physical environment, but is displayed in a three-dimensional environment that is positioned on top of the table 106 (e.g., a real-world table or a representation thereof). Optionally, in response to detecting a planar surface of the table 106 in the physical environment 100, the virtual object 104 is displayed on the surface of the table 106 in the three-dimensional environment that is displayed via the display 120 of the electronic device 101.
[0029] It will be appreciated that the virtual object 104 is a representative virtual object, and that one or more different virtual objects (e.g., virtual objects having various dimensions, such as two-dimensional or other three-dimensional virtual objects) can be included and rendered in the three-dimensional environment. For example, the virtual object can represent an application or user interface that is displayed in the three-dimensional environment. In some examples, the virtual object can represent content that corresponds to the application and / or that is displayed in the three-dimensional environment via the user interface. In some examples, the virtual object 104 is optionally configured to be interactive and responsive to user input (e.g., an air gesture, such as an air pinch gesture, an air tap gesture, and / or an air touch gesture), such that a user can virtually touch, tap, move, rotate, or otherwise interact with the virtual object 104.
[0030] As discussed herein, one or more air pinch gestures performed by a user (e.g., with the hand 103 in FIG. 1 are detected by one or more input devices of the electronic device 101 and interpreted by the electronic device 101 as one or more user inputs that are directed to content displayed by the electronic device 101. Additionally or alternatively, in some examples, one or more user inputs that are interpreted by the electronic device 101 as being directed to content (e.g., the virtual object 104) displayed by the electronic device 101 are detected via one or more hardware input devices (e.g., a controller, a touchpad, a proximity sensor, a button, a slider, a knob, etc.) rather than via one or more input devices that are configured to detect air gestures performed by a user, such as one or more air pinch gestures. This description is intended to be exemplary rather than limiting; different air gestures are optionally used by a user and / or other forms of input are used to provide user input.
[0031] In some examples, the electronic device 101 can be configured to communicate with a second electronic device, such as a companion device. For example, as FIG. 1The electronic device 101 is optionally in communication with the electronic device 160, as illustrated. In some examples, the electronic device 160 corresponds to a mobile electronic device, such as a smartphone, tablet computer, smartwatch, laptop computer, or other electronic device. In some examples, the electronic device 160 corresponds to a non-mobile electronic device that is generally stationary and not easily moved within a physical environment (e.g., a desktop computer, a server, etc.). Additional examples of the electronic device 160 are described below with reference to the architectural block diagram of FIG. 1. FIG. 2B In some examples, the electronic device 101 and the electronic device 160 are associated with the same user. For example, in FIG. 1 In some examples, the electronic device 101 and the electronic device 160 are associated with the same user. For example, in FIG. 2A-2B Additional details are provided below regarding communication between the electronic device 101 and the electronic device 160.
[0032] In some examples, displaying an object in a three-dimensional environment is caused by, or enables interaction with, one or more user interface objects in the three-dimensional environment. For example, initiation of display of an object in a three-dimensional environment can include interaction with one or more virtual options / affordances displayed in the three-dimensional environment. In some examples, when display of an object is initiated in a three-dimensional environment, the electronic device can track a user’s gaze as an input to identify one or more virtual options / affordances targeted for selection. For example, the gaze can be used to identify one or more virtual options / affordances targeted for selection using another selection input. In some examples, a virtual option / affordance can be selected using hand tracking input detected via an input device in communication with the electronic device. In some examples, an object displayed in a three-dimensional environment can be moved and / or reoriented in the three-dimensional environment in accordance with movement input detected via an input device.
[0033] In the following description, an electronic device in communication with one or more displays and one or more input devices is described. It will be appreciated that the electronic device optionally is in communication with one or more other physical user-interface devices, such as a touch-sensitive surface, a physical keyboard, a mouse, a joystick, a hand- tracking device, an eye-tracking device, a stylus, etc. In addition, as described above, it will be appreciated that the described electronic device, displays, and touch-sensitive surfaces are optionally distributed between two or more devices. Accordingly, as used herein, information displayed on or by an electronic device is optionally information output by an electronic device to be displayed on a separate display device (touch-sensitive or not). Similarly, as used herein, input received at an electronic device (e.g., touch input received at a touch-sensitive surface of an electronic device, or touch input received at a surface of a stylus) is optionally input received at a separate input device from which the electronic device receives input information.
[0034] The device typically supports a variety of applications, such as one or more of the following: a drawing application, a presentation application, a word processing application, a website creation application, a disk authoring application, a spreadsheet application, a game application, a telephone application, a video conferencing application, an e-mail application, an instant messaging application, a fitness support application, a
[0035] FIG. 2A-2B A block diagram illustrating an example architecture for an electronic device in accordance with some examples of this disclosure is illustrated. In some examples, electronic device 201 and / or device 260 include one or more electronic devices. For example, electronic device 201 can be a portable device, an auxiliary device in communication with another device, a head-mounted display, a head-mounted speaker, etc., respectively. In some examples, electronic device 201 corresponds to the electronic device 101 described above with reference to FIG. 1 In some examples, electronic device 260 corresponds to the electronic device 160 described above with reference to FIG. 1 In some examples, electronic device 260 corresponds to the electronic device 160 described above with reference to
[0036] As FIG. 2A As illustrated, electronic device 201 optionally includes one or more sensors, such as one or more hand-tracking sensors 202, one or more position sensors 204A, one or more image sensors 206A (optionally corresponding to the image sensors 206 described above with reference to FIG. 1The electronic device 201 may include an internal image sensor 114a and / or external image sensors 114b and 114c, one or more touch-sensitive surfaces 209A, one or more motion and / or orientation sensors 210A, one or more eye-tracking sensors 212, one or more microphones 213A or other audio sensors, one or more body tracking sensors (e.g., torso and / or head tracking sensors), etc. The electronic device 201 may optionally include one or more output devices, such as one or more display generation components 214A (optionally corresponding to...). FIG. 1 The electronic device 201 may include a display 120, one or more speakers 216A, one or more tactile output devices (not shown), etc. The electronic device 201 optionally includes one or more processors 218A, one or more memories 220A, and / or communication circuitry 222A. One or more communication buses 208A are optionally used for communication between the components of the electronic device 201 mentioned above.
[0037] Additionally, electronic device 260 optionally includes components that are the same as or similar to those of electronic device 201. For example, such as FIG. 2B As shown, electronic device 260 optionally includes one or more position sensors 204B, one or more image sensors 206B, one or more touch-sensitive surfaces 209B, one or more orientation sensors 210B, one or more microphones 213B, one or more display generating components 214B, one or more speakers 216B, one or more processors 218B, one or more memories 220B, and / or communication circuitry 222B. One or more communication buses 208B are optionally used for communication between the components of electronic device 260 mentioned above.
[0038] Electronic devices 201 and 260 are optionally configured to communicate via a wired or wireless connection between the two electronic devices (e.g., via communication circuits 222A, 222B). For example, as FIG. 2A As indicated, electronic device 260 can be used as an accompanying device of electronic device 201. For example, in some examples, electronic device 260 processes sensor inputs from electronic devices 201 and 260, and / or uses the display generation component 214A of electronic device 201 to generate content for display.
[0039] Communication circuits 222A and 222B optionally include circuitry for communicating with electronic devices and networks such as the Internet, intranets, wired and / or wireless networks, cellular networks, and wireless local area networks (LANs). Communication circuits 222A and 222B optionally include circuitry for using near-field communication (NFC) and / or short-range communication (such as Bluetooth). ®Circuitry for communicating with other devices (e.g., other devices in a network, other devices in a personal area network, etc.). In some examples, the communication circuitry 222A, 222B includes or supports Wi-Fi (e.g., 802.11 protocol), Ethernet, Ultra Wide Band (“UWB”), high frequency systems (e.g., 900 MHz, 2.4 GHz, and 5.6 GHz communication systems), or any other communication protocol or any combination thereof.
[0040] The one or more processors 218A, 218B include one or more general- purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some examples, the one or more processors 218A, 218B include one or more microprocessors, one or more central processing units, one or more application-specific integrated circuits, one or more field-programmable gate arrays, one or more programmable logic devices, or a combination of such devices. In some examples, the memory 220A and / or 220B is a non-transitory computer-readable storage medium (e.g., a flash memory, a random access memory, or other volatile or non-volatile storage device) that stores computer-readable instructions executable by the one or more processors 218A, 218B to perform the techniques, processes, and / or methods described herein. In some examples, the memory 220A and / or 220B can include more than one non-transitory computer-readable storage medium. The non-transitory computer-readable storage medium can be any medium that can tangibly contain or store computer-executable instructions for use by or in connection with the instruction execution system, apparatus, and device (e.g., not a signal). In some examples, the storage medium is a transitory computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. The non-transitory computer-readable storage medium can include, but is not limited to, magnetic, optical, and / or semiconductor storages. Examples of such storage include magnetic disks, optical disks based on compact disc (CD), digital versatile disc (DVD), or Blu-ray technology, and persistent solid-state memory such as flash memory, solid-state drives (SSDs), etc.
[0041] In some examples, one or more display generation components 214A, 214B include a single display (e.g., a liquid-crystal display (LCD), an organic light-emitting diode (OLED), or other type of display). In some examples, one or more display generation components 214A, 214B include multiple displays. In some examples, one or more display generation components 214A, 214B can include a display with touch capabilities (e.g., a touchscreen), a projector, a holographic projector, a retinal projector, a transparent or semi-transparent display, etc. In some examples, an electronic device does not include one or more display generation components 214A or 214B. For example, some electronic devices do not include one or more display generation components 214A or 214B, but instead include a transparent or semi-transparent lens or other surface that is not configured to display or present virtual content. However, it will be understood that in such cases, the electronic device 201 and / or the electronic device 260 are optionally provided with one or more of the components illustrated and described herein, such as one or more hand tracking sensors 202, one or more eye tracking sensors 212, one or more image sensors 206A, and / or one or more motion and / or orientation sensors 210A. Alternatively, in some examples, one or more display generation components 214A or 214B are provided separate from the electronic device 201 and / or 260. For example, one or more display generation components 214A, 214B are in communication with the electronic device 201 (and / or the electronic device 260), but are not integrated with the electronic device 201 and / or the electronic device 260 (e.g., within a housing of the electronic device 201, 260). In some examples, the electronic devices 201 and 260 include one or more touch-sensitive surfaces 209A and 209B, respectively, for receiving user input, such as tap inputs and swipe inputs or other gestures (e.g., gestures based on a hand or gestures based on a finger). In some examples, one or more display generation components 214A, 214B and one or more touch-sensitive surfaces 209A, 209B form one or more touch-sensitive displays (e.g., a touchscreen integrated with each of the electronic devices 201 and 260 or a touchscreen external to each of the electronic devices 201 and 260 that is in communication with each of the electronic devices 201 and 260). FIG. 2A and FIG. 2B one or more of the other components illustrated and described herein, such as one or more hand tracking sensors 202, one or more eye tracking sensors 212, one or more image sensors 206A, and / or one or more motion and / or orientation sensors 210A. Alternatively, in some examples, one or more display generation components 214A or 214B are provided separate from the electronic device 201 and / or 260. For example, one or more display generation components 214A, 214B are in communication with the electronic device 201 (and / or the electronic device 260), but are not integrated with the electronic device 201 and / or the electronic device 260 (e.g., within a housing of the electronic device 201, 260). In some examples, the electronic devices 201 and 260 include one or more touch-sensitive surfaces 209A and 209B, respectively, for receiving user input, such as tap inputs and swipe inputs or other gestures (e.g., gestures based on a hand or gestures based on a finger). In some examples, one or more display generation components 214A, 214B and one or more touch-sensitive surfaces 209A, 209B form one or more touch-sensitive displays (e.g., a touchscreen integrated with each of the electronic devices 201 and 260 or a touchscreen external to each of the electronic devices 201 and 260 that is in communication with each of the electronic devices 201 and 260).
[0042] The electronic devices 201 and 260 optionally each include one or more image sensors 206A and 206B. The one or more image sensors 206A, 206B optionally include one or more visible light image sensors, such as charge-coupled device (CCD) sensors, and / or complementary metal-oxide-semiconductor (CMOS) sensors operable to obtain images of physical objects from a real-world environment. The one or more image sensors 206A, 206B also optionally include one or more infrared (IR) sensors, such as passive IR sensors or active IR sensors, for detecting infrared light from a real-world environment. For example, an active IR sensor includes an IR emitter for emitting infrared light into a real-world environment. The one or more image sensors 206A, 206B also optionally include one or more cameras configured to capture movement of physical objects in a real-world environment. The one or more image sensors 206A, 206B also optionally include one or more depth sensors configured to detect a distance of physical objects from the electronic devices 201, 260. In some examples, information from the one or more depth sensors can allow a device to identify and distinguish objects in a real-world environment from other objects in the real-world environment. In some examples, the one or more depth sensors can allow a device to determine texture and / or topography of objects in a real-world environment. In some examples, the one or more image sensors 206A or 206B are included in a different electronic device from the electronic devices 201 and / or 260. For example, the one or more image sensors 206A, 206B are in communication with, but not integrated within a housing of (e.g., within a housing of) the electronic devices 201, 260. In particular, in some examples, one or more cameras of the one or more image sensors 206A, 206B are integrated with and / or coupled to one or more devices separate from the electronic devices 201 and / or 260 (e.g., but in communication with the electronic devices 201 and / or 260), such as one or more input and / or output devices including the one or more image sensors 206A, 206B (e.g., one or more speakers and / or one or more microphones, such as earphones or headphones). In some examples, the electronic device 201 or the electronic device 260 corresponds to a headphone (e.g., earphones or earbuds). In such cases, the electronic device 201 or the electronic device 260 is equipped with FIG. 2A and FIG. 2B a subset of the other components illustrated and described herein. In some such examples, the electronic device 201 or the electronic device 260 is equipped with the one or more image sensors 206A, 206B, the one or more motion and / or orientation sensors 210A, 210B, and / or the speakers 216A, 216B.
[0043] In some examples, the electronic device 201, 260 uses the CCD sensor, event camera, and depth sensor in combination to detect the physical environment around the electronic device 201, 260. In some examples, the one or more image sensors 206A, 206B include a first image sensor and a second image sensor. The first image sensor and the second image sensor work in concert and are optionally configured to capture different information of physical objects in the real-world environment. In some examples, the first image sensor is a visible light image sensor and the second image sensor is a depth sensor. In some examples, the electronic device 201, 260 uses the one or more image sensors 206A, 206B to detect a position and orientation of the electronic device 201, 260 and / or the one or more display generation components 214A, 214B in the real-world environment. For example, the electronic device 201, 260 uses the one or more image sensors 206A, 206B to track a position and orientation of the one or more display generation components 214A, 214B relative to one or more fixed objects in the real-world environment.
[0044] In some examples, the electronic devices 201 and 260 include one or more microphones 213A and 213B or other audio sensors, respectively. The electronic devices 201, 260 optionally use the one or more microphones 213A, 213B to detect sound from a user and / or the real-world environment of the user. In some examples, the one or more microphones 213A, 213B include an array of microphones (e.g., multiple microphones) that optionally operate in concert to identify ambient noise or locate a source of sound in the space of the real-world environment.
[0045] The electronic devices 201 and 260 include one or more position sensors 204A and 204B, respectively, to detect a position of the electronic device 201 and / or the one or more display generation components 214A and a position of the electronic device 260 and / or the one or more display generation components 214B, respectively. For example, the one or more position sensors 204A, 204B can include a global positioning system (GPS) receiver that receives data from one or more satellites and allows the electronic devices 201, 260 to determine an absolute position of the electronic device in the physical world.
[0046] Electronic devices 201 and 260 respectively include one or more orientation sensors 210A and 210B that are used to detect the orientation and / or movement of electronic devices 201 and / or one or more display generation components 214A, and electronic devices 260 and / or one or more display generation components 214B, respectively. For example, electronic devices 201, 260 use one or more orientation sensors 210A, 210B to track changes in the positioning and / or orientation of electronic devices 201, 260 and / or one or more display generation components 214A, 214B, such as relative to physical objects in a real-world environment. One or more orientation sensors 210A, 210B optionally include one or more gyroscopes and / or one or more accelerometers.
[0047] In some examples, electronic device 201 includes one or more hand tracking sensors 202 and / or one or more eye tracking sensors 212. It will be appreciated that, although referred to as hand tracking or eye tracking sensors, additionally or alternatively, electronic device 201 optionally includes one or more other body tracking sensors, such as one or more leg tracking sensors, one or more torso tracking sensors, and / or one or more head tracking sensors. One or more hand tracking sensors 202 are configured to track positioning and / or location of one or more portions of a user’s hand, and / or movement of one or more portions of a user’s hand relative to a three-dimensional environment, relative to one or more display generation components 214A, and / or relative to another defined coordinate system. One or more eye tracking sensors 212 are configured to track positioning and movement of a user’s gaze (e.g., a user’s attention, more generally including eyes, face, or head) relative to a real-world or three-dimensional environment, and / or relative to one or more display generation components 214A. In some examples, one or more hand tracking sensors 202 and / or one or more eye tracking sensors 212 are implemented with one or more display generation components 214A. In some examples, one or more hand tracking sensors 202 and / or one or more eye tracking sensors 212 are implemented separately from one or more display generation components 214A. In some examples, electronic device 201 alternatively does not include one or more hand tracking sensors 202 and / or one or more eye tracking sensors 212. In some such examples, one or more display generation components 214A can be used by electronic device 260 to provide a three-dimensional environment, and electronic device 260 can utilize input and other data collected via other one or more sensors of electronic device 201 (e.g., one or more position sensors 204A, one or more image sensors 206A, one or more touch-sensitive surfaces 209A, one or more motion and / or orientation sensors 210A, and / or one or more microphones 213A or other audio sensors) as input and data processed by one or more processors 218B of electronic device 260. Additionally or alternatively, electronic device 260 optionally does not include FIG. 2B other components shown, such as one or more position sensors 204B, one or more image sensors 206B, one or more touch-sensitive surfaces 209B, etc. In some such examples, one or more display generation components 214A can be used by electronic device 260 to provide a three-dimensional environment, and electronic device 260 can utilize input and other data collected via one or more motion and / or orientation sensors 210A (and / or one or more microphones 213A) of electronic device 201 as input.
[0048] In some examples, one or more hand tracking sensors 202 (and / or other body tracking sensors, such as leg, torso, and / or head tracking sensors) can use one or more image sensors 206 (e.g., one or more IR cameras, 3D cameras, depth cameras, etc.) that capture three-dimensional information from a real world including one or more body parts (e.g., a human user’s hands, legs, or torso). In some examples, the hand(s) can be resolved with sufficient resolution to distinguish between the fingers and their respective positions. In some examples, one or more image sensors 206A are positioned relative to the user to define a field of view of the one or more image sensors 206A and an interaction space in which finger / hand positions, orientations, and / or movements captured by the image sensors are used as input (e.g., distinguished from the user’s stationary hands or other hands of other people in the real world environment). It can be advantageous to track the finger / hand (e.g., hand gesture, touch, tap, etc.) used for input because this does not require the user to touch, hold, or wear any type of beacon, sensor, or other marker.
[0049] In some examples, one or more eye tracking sensors 212 include at least one eye tracking camera (e.g., IR camera) and / or illumination source (e.g., IR light source, such as an LED) that emit light toward a user’s eyes. The eye tracking camera(s) can be directed toward the user’s eyes to directly or indirectly receive reflected IR light from the eyes from the light source. In some examples, both eyes are tracked individually by respective eye tracking cameras and illumination sources, and focus / gaze can be determined by tracking both eyes. In some examples, one eye (e.g., the dominant eye) is tracked by one or more respective eye tracking cameras / illumination sources.
[0050] Electronic devices 201 and 260 are not limited to the components and configurations of FIG. 2A-2B may include fewer components, other components, or additional components in a variety of configurations. In some examples, electronic device 201 and / or electronic device 260 can be implemented variously among multiple electronic devices (e.g., as a system). In some such examples, each (or more) electronic device can include one or more of the same components discussed above, such as various sensors, one or more display generating components, one or more speakers, one or more processors, one or more memories, and / or communication circuitry. One or more persons using electronic device 201 and / or electronic device 260 are optionally referred to herein as one or more users of the device.
[0051] Attention is now generally directed towards examples of electronic devices scrolling content vertically in a user interface in response to detecting a yaw movement of a head of a user of the electronic device, in accordance with some examples of the present disclosure.
[0052] FIG. 3A-3K As a whole, the electronic device illustrates scrolling content vertically in a user interface in response to detecting a yaw movement of a head of a user of the electronic device, in accordance with some examples of the present disclosure.
[0053] For illustration purposes, FIG. 3A-3G including respective top-down views 312a-312g, and FIG. 3I-3K including respective top-down views 312i-312k. These top-down views of the environment 306 (e.g., a three-dimensional environment) indicate locations of various objects (e.g., real objects and / or virtual objects) in the environment 306 in a horizontal dimension and a depth dimension in the respective drawings. The top-down views of the environment 306 also include an indication of a viewpoint of the user 304 of the electronic device 101. For example, in FIG. 3A the electronic device 101 displays a view of the environment 306 that is visible through the display 120 from the viewpoint of the user 304 illustrated by the top-down view 312a of the environment 306. Further, FIG. 3A-3G and FIG. 3I-3K including a viewing boundary 305 of the user 304 of the electronic device 101 in the respective drawings. For example, in FIG. 3A the electronic device 101 displays a view of the environment 306 (e.g., a view bounded by the viewing boundary 305 in the respective top-down view 312a) that is shown in the display 120 from the viewpoint of the user 304 illustrated by the top-down view 312a.
[0054] FIG. 3A shows the user 304 wearing the electronic device 101 in a physical environment 302, where the electronic device 101 presents the environment 306 (e.g., a three-dimensional environment) through a display 120 of the electronic device 101. In some examples, the environment 306 is an extended reality (XR) environment with one or more characteristics of the XR environment described above. For example, in FIG. 3A the display 120 of the electronic device 101 shows a user interface 330 and physical objects (e.g., edges of a physical room) that can be visible through the display 120 (e.g., through video see-through or optical see-through of the physical environment visible to the user 304 through the display 120 by the user 304). In some examples, the environment 306 is a virtual reality environment (e.g., the environment 306 is a fully or partially immersive (e.g., a level of virtual immersion is controlled by the user 304 through one or more input devices of the electronic device 101)).
[0055] FIG. 3A illustrates the electronic device 101 displaying the user interface 330 in the environment 306. In FIG. 3AIn some examples, user interface 330 is a list that includes a plurality of selectable options (e.g., as exemplified by selectable options 310a-310e). In some examples, selectable options 310a-310e are part (e.g., a subset) of a plurality of selectable options associated with user interface 330 (e.g., one or more of the plurality of selectable options are currently hidden from view / display in environment 306). FIG. 3A In some examples, the plurality of selectable options associated with user interface 330 (e.g., selectable options 310a-310e as shown) include selectable content items that include text, photos, and / or media (e.g., music) that can be selected by user 304 (e.g., via user input). FIG. 3A In some examples, the plurality of selectable options associated with user interface 330 (e.g., selectable options 310a-310e as shown) indicate information rather than being further selectable. FIG. 3A
[0056] In some examples, user interface 330 is associated with a respective application (e.g., a media streaming application), and the plurality of selectable options include selectable content associated with the respective application. In some examples, user interface 330 is associated with a system user interface, and the plurality of selectable options are settings that user 304 can select and / or control in a menu of the system user interface. In some examples, user interface 330 is arranged in environment 306 in a world-locked orientation, a body-locked orientation, a tilt-locked orientation, or a head-locked orientation (e.g., including one or more characteristics of the world-locked orientation, the body-locked orientation, the tilt-locked orientation, and / or the head-locked orientation as described above).
[0057] In some examples, due to spatial constraints, only a portion of the plurality of selectable options associated with user interface 330 are presented to user 304 in environment 306 at a given time (e.g., selectable options 310a-310e are part of the plurality of selectable options associated with user interface 330 as described above). In some examples, user interface 330 is scrollable to present one or more selectable options in the plurality of selectable options that are hidden from view of user 304 in environment 306 at a given time (e.g., are not currently displayed). FIG. 3A
[0058] In some examples, the user interface 330 corresponds to a bounded list. For example, when scrolling the user interface 330 in a first direction, a certain selectable option of the plurality of selectable options associated with the user interface 330 can correspond to a first bound, which makes the user interface 330 no longer scrollable in the first direction (e.g., as long as the first bound is reached) when the user interface 330 is scrolled in the first direction to the case where the first bound is scrolled to. Continuing the example, when scrolling the user interface 330 in a second direction (e.g., opposite the first direction), a certain selectable option of the plurality of selectable options associated with the user interface 330 can correspond to a second bound of the bounded list, which makes the user interface 330 no longer scrollable in the second direction (e.g., as long as the second bound is reached) when the user interface 330 is scrolled in the second direction to the case where the second bound is scrolled to.
[0059] In some examples, the user interface 330 corresponds to an unbounded list. For example, scrolling the user interface 330 includes cycling through the plurality of selectable options associated with the user interface 330 without reaching a selectable option of the plurality of selectable options corresponding to a boundary of the list (e.g., the user interface 330 is a carousel list). In some examples, scrolling the user interface 330 includes movement of a visible portion of the plurality of selectable options in one or more dimensions relative to the environment 306. For example, scrolling the user interface 330 includes movement of the selectable options 310a-310e in a vertical dimension relative to a current viewpoint of the user 304 in the environment 306. For example, scrolling the user interface 330 includes movement of the selectable options 310a-310e in a vertical dimension and a depth dimension relative to a current viewpoint of the user 304 in the environment 306 (e.g., the user interface 330 is a carousel list that rotates in response to user input).
[0060] In some examples, scrolling the user interface 330 includes moving and / or replacing which of the plurality of selectable options are currently visible to the user 304 in the environment 306. In some examples, moving and / or replacing which of the plurality of selectable options are currently visible to the user 304 includes presenting an animation in the environment 306 that includes changing a visual salience (e.g., opacity, brightness, color, and / or size) of one or more selectable options as they are moved and / or replaced. Thus, different selectable options of the plurality of selectable options are presented with different degrees of visual salience based on their relative position in the user interface 330. For example, as the user interface 330 is scrolled in a first direction, the selectable options 310a-310e are presented with a first degree of visual salience (e.g., opacity, brightness, color, and / or size) and the selectable options 310f-310j are presented with a second degree of visual salience (e.g., opacity, brightness, color, and / or size) that is different than the first degree of visual salience. In some examples, the first degree of visual salience is greater than the second degree of visual salience. In some examples, the second degree of visual salience is greater than the first degree of visual salience. FIG. 3AAs shown, compared to optional options 310b to 310d, optional options 310a and 310e are presented with less visual salience in environment 306 (presented at the top and bottom of user interface 330, respectively). (For example, presenting optional options 310a and 310e with less visual salience informs user 304 that optional options 310a and 310e do not have current focus and that scrolling user interface 330 will stop optional options 310a or 310e from being presented in user interface 330). Furthermore, as... FIG. 3A As shown, for example, optional option 310c is displayed with the highest visual salience because it is in the focus area of user interface 330, and optional options 310b and 310d are displayed with a visual salience between optional options 310a and 310e and optional option 310c. In some examples, from the user 304's perspective, optional options 310a to 310e appear to be presented with different levels of visual salience based on the distance of optional options 310a to 310e from the user 304's current viewpoint in environment 306 (e.g., relative to the dimension of depth). For example, the scrolling user interface 330 includes: movement of optional options 310a to 310e in the vertical direction and in the depth direction relative to the user 304's current viewpoint in the environment 306 (e.g., when a corresponding optional option among a plurality of optional options moves from the center of the user interface 330 toward the top or bottom of the user interface 330 (e.g., during scrolling of the user interface 330), that corresponding optional option moves further in depth relative to the user 304's current viewpoint in the environment 306). Therefore, in some examples, optional options 310a and 310e appear to have less visual salience from the user 304's perspective compared to optional options 310b to 310d, because optional options 310a and 310e are positioned further away from the user 304's current viewpoint in the environment 306 compared to optional options 310b to 310d.
[0061] like FIG. 3A-3CAs shown, in comparison to the plurality of selectable options currently visible in the environment 306, the selectable option 310c is presented at the center of the user interface 330 and includes the highest degree of visual salience (e.g., the selectable option 310c is displayed with a higher degree of opacity, brightness, color, and / or size (e.g., in a bolder font) in comparison to the selectable options 310a-310b and 310d-310e). In some examples, presenting the selectable option 310c with the highest degree of visual salience visually indicates to the user 304 that the selectable option 310c has the current focus (e.g., presenting the selectable option 310c with the higher degree of visual salience in comparison to the different selectable options included in the user interface 330 informs the user 304 that the selectable option 310c is the option of the plurality of selectable options that will be selected in response to a selection input (e.g., an air pinch or tap gesture) provided by the user 304). In some examples, in response to scrolling the user interface 330, the selectable option 310c is replaced with a selectable option that has the current focus of the plurality of selectable options associated with the user interface 330.
[0062] The user interface 330 is vertically scrollable. As such, the plurality of selectable options is scrollable such that it can have different vertical placements in the user interface 330 in response to a scroll input. In some examples, the electronic device 101 vertically scrolls the content of the user interface 330 in response to detecting a yaw movement of the head of the user of the electronic device 101, such as FIG. 3A As shown.
[0063] For example, while displaying the user interface 330 as in FIG. 3B , the electronic device 101 can detect a yaw movement of the head of the user of the electronic device, such as the clockwise rotation of the head of the user 304 shown by the arrow 314a in FIG. 3B-3D . In response, the electronic device 101 can scroll the content of the user interface 330 according to the detected yaw movement (e.g., based on the amount of the detected yaw movement), as shown in FIG. 3C .
[0064] In some examples, FIG. 3D and FIG. 3B illustrate example results of the electronic device 101 vertically scrolling the user interface different amounts according to different amounts of the detected yaw movement. For example, in some examples, FIG. 3B the arrow 314a is a first amount of yaw movement, and in response to detecting the first amount of yaw movement in FIG. 3B-3C , the electronic device 101 vertically scrolls the content of the user interface 330 by a first respective amount, as shown in FIG. 3B . Continuing with this example, alternatively, in some examples, FIG. 3Bthe arrow 314a is a second amount (greater than the first amount) of yaw movement, and in response to detecting FIG. 3B-3D the second amount of yaw movement in the arrow 314a, the electronic device 101 scrolls the content of the user interface 330 vertically (a second respective amount greater than the first respective amount), as illustrated in FIG. 3B-3D , where FIG. 3B-3C the illustrated vertical scroll amount is greater than FIG. 3C the illustrated vertical scroll amount. As such, in some examples, the electronic device 101 can scroll the content of a user interface different amounts in response to detecting different amounts of yaw movement.
[0065] In some examples, FIG. 3D and FIG. 3B-3C illustrate example results of the electronic device 101 scrolling the user interface 330 vertically in response to a single yaw movement (e.g., a continuous yaw movement in the first rotational direction). For example, FIG. 3C-3D the illustrated vertical scroll amount can be a result of the detection of the first portion of the yaw movement. Continuing with this example, the electronic device 101 can further scroll the content of the user interface 330 vertically in response to detecting a second portion of the single yaw movement (e.g., a continuous yaw movement in the first rotational direction), as illustrated in FIG. 3B-3C . As such, in some examples, the electronic device 101 can scroll the content of a user interface, including scrolling through a plurality of intermediate positions of the content until reaching a final position in the content that corresponds to an end of a yaw movement of the user’s head of the electronic device 101.
[0066] Additionally, note that from FIG. 3D and FIG. 3B-3C , the user interface 330 appears as a head-locked object (such as described above), so the user interface 330 is moved in the environment 306 according to the detected head movement of the user 304. Since FIG. 3D and FIG. 3C the illustrated head movement is only a yaw movement of the user’s head, the electronic device 101 moves the user interface 330 according to the yaw movement of the user’s head. Note that if the electronic device 101 detects movement of the user’s head that includes both yaw movement and pitch movement, the electronic device 101 can respond by moving the user interface 330 in the environment 306 according to both the yaw movement and the pitch movement and by scrolling the content of the user interface 330 vertically according to the yaw movement (e.g., independent of the pitch movement). Note that if the electronic device 101 detects pitch movement of the user’s head without detecting yaw movement of the user’s head, the electronic device 101 can respond by moving the user interface 330 in the environment 306 according to the pitch movement without scrolling the content of the user interface 330 vertically.
[0067] Further, note that in some examples, in response to the electronic device 101 entering a mode in which a particular yaw movement of the user’s head is mapped to a scroll request, the electronic device 101 presents an indication (e.g., a notification) that the user’s yaw movement can cause scrolling of the content of the user interface 330, such as FIG. 3C the indication 332 in FIG. 11B. In some examples, the indication 332 is a visual indication, an audio indication, and / or another type of tactile indication. As such, the electronic device 101 can present an indication to the user 304 that informs the user 304 that the user’s yaw movement can cause scrolling of the content of the user interface 330.
[0068] In some examples, the electronic device 101 scrolls the content of the user interface 330 in different directions based on the direction of the yaw movement of the user’s 304 head. For example, FIG. 3D and FIG. 3B illustrates an example in which the electronic device 101 scrolls the content of the user interface 330 vertically downward in accordance with a yaw movement in a first direction that is a clockwise movement from the perspective of the top-down view 312b in FIG. 3B as indicated by the direction of the arrow 314a in the top-down view 312b in FIG. 3E-3G . FIG. 3E illustrates an example in which the electronic device 101 detects and responds to a yaw movement of the user’s 304 head in a second direction that is different from (e.g., opposite to) the first direction. In FIG. 3E , while displaying the user interface 330, the electronic device 101 detects a yaw movement of the user’s head that is a counterclockwise movement from the perspective of the top-down view 312e in FIG. 3E-3F as indicated by the direction of the arrow 314b in the top-down view 312e in FIG. 3E . In response, the electronic device 101 scrolls the content of the user interface 330 vertically upward, as shown in FIG. 3E-3F In some examples, FIG. 3E the arrow 314b in FIG. 11E corresponds to a first amount of yaw movement, and in response to detecting the first amount of yaw movement, the electronic device 101 scrolls the content of the user interface 330 upward by a first respective amount, as shown in FIG. 3E-3G In some examples, FIG. 3E-3G the arrow 314b in FIG. 11F corresponds to a second amount of yaw movement that is greater than the first amount of yaw movement, and in response to detecting the second amount of yaw movement, the electronic device 101 scrolls the content of the user interface 330 upward by a second respective amount that is greater than the first respective amount, as shown in FIG. 3E-3F the amount of vertical scrolling illustrated by the user interface 330 in FIG. 11F is greater than the amount of vertical scrolling illustrated by the user interface 330 in FIG. 3F .
[0069] In some examples,FIG. 3G and FIG. 3E-3F An example result is illustrated in which the electronic device 101 vertically scrolls the user interface 330 in response to a single yaw movement (e.g., a continuous yaw movement in a rotational direction). For example, FIG. 3F-3G The illustrated amount of vertical scrolling can be a result of detection of a first portion of the continuous yaw movement in the first direction. Continuing the example, in response to detecting a second portion of the continuous yaw movement in the first direction, the electronic device 101 can further vertically scroll the content of the user interface 330, as shown in FIG. 3H .
[0070] FIG. 3B-3G An example illustration is illustrated in which the electronic device 101 scrolls the content of a user interface, such as the user interface 330, that is head-locked. In some examples, as described above, the content of the user interface 330 is arranged as a carousel, such as a vertical carousel. For example, the multiple selectable options can include six selectable options (e.g., the selectable options 310a-310f), where each option can be placed on a respective shelf of the vertical carousel. As a carousel, if the user interface 330 displays a first selectable option having a first orientation on the carousel in the viewpoint of the user 304 (e.g., from the viewpoint of the user 304) when a request to scroll the carousel in a first direction is detected, the first selectable option will have different intermediate orientations on the carousel in the viewpoint of the user 304 in accordance with the scrolling in the first direction in response to the scrolling in the first direction, and can again have the first orientation on the carousel in the viewpoint of the user (e.g., provided that the scrolling input results in a 360 degree rotation of the first selectable option). As such, as a carousel, it can be scrolled to any selectable option in the first direction regardless of the orientation of the selectable option when the scrolling input is detected. In one example, as a carousel, when the user interface 330 includes six selectable options, the user interface can appear as a hexagonal prism with the hexagonal base facing in a lateral direction in the viewpoint of the user and each selectable option having a respective rectangular side of the hexagonal prism. For example, in response to a scrolling input (e.g., in response to detecting a yaw movement of the user), the rectangular sides of the hexagonal prism can rotate about a central axis extending through each of the hexagonal bases of the hexagonal prism (such as the top-most rectangular side rotating towards the user and the bottom-most rectangular side rotating away from the user), thereby scrolling the selectable options. If the user interface 330 is also head-locked (as described with reference to FIG. 3B-3G , the electronic device 101 will move the user interface 330 in the environment 306 in accordance with the yaw movement of the head of the user in response to detecting the yaw movement of the head of the user, such as FIG. 3HThe movement of the user interface 330 is illustrated. Therefore, the resulting movement of the optional options would be a rotational movement about the vertical axis of the user interface 330 and a yaw axis about the head of the user 304, these movements together simulating the helical movement of the corresponding optional options in the environment 306, such as... FIG. 3B The illustrated spiral trajectory 309 and / or optional option 313 (e.g., in the environment) move according to the movement of yaw movement 307 (e.g., to the right or left). Thus, in some examples, when the user interface 330 scrolls in response to yaw movement (e.g., yaw movement 307 to the left or right), an optional option of the user interface 330 moves vertically in the environment 306 and rotates about a vertical axis (such as the yaw axis of the user 304's head).
[0071] In some examples, user interface 330 is a world-locked object, such as the object described herein with reference to a world-locked orientation. FIG. 3I and FIG. 3B-3I An example is shown where the electronic device 101 scrolls the content of the user interface 330 when the user interface 330 is locked by the world. FIG. 3B As shown, electronic device 101 has responded to FIG. 3B The detected yaw movement is used to scroll the content of the user interface 330 while maintaining the position of the user interface 330 within the environment 306. That is, the position of the user interface 330 within the environment 306 has not yet changed. FIG. 3I Move to FIG. 3J Thus, in some examples, even if the user interface 330 is a world-locked object, the electronic device 101 will scroll the content of the user interface 330 in response to detecting yaw movement of the user's head 304.
[0072] It should be noted that in some examples, if electronic device 101 detects a yaw movement of the user's head that satisfies one or more first criteria, electronic device 101 may respond by scrolling the content of user interface 330 according to that yaw movement. For example, the yaw movement described with reference to arrows 314a and 314b satisfies the first criteria, and thus, electronic device 101 responds by scrolling the content of user interface 330. If electronic device 101 detects a yaw movement of the user's head that does not satisfy the first criteria, electronic device 101 may respond by abandoning scrolling the content of user interface 330, such as... FIG. 3K and FIG. 3A As shown. For example, in cases including such FIG. 3J The user interface of the 330 display FIG. 3J In the process, electronic device 101 detects a yaw movement of user 304's head that does not meet the first criterion (such as...). FIG. 3J-3Kthe content of the user interface 330 (e.g., as indicated by arrow 314c in FIG. 3B). In response, the electronic device 101 abandons scrolling the content of the user interface 330, as indicated in FIG. 3C. In some examples, the first criteria includes a yaw movement that is greater than a threshold amount of yaw movement (e.g., 0.5 degrees, 1 degree, 2 degrees, 3 degrees, 4 degrees, or another amount). Additionally or alternatively, the first criteria includes performing the yaw movement within a threshold amount of time (e.g., such that an average angular velocity of the yaw movement is greater than a threshold angular velocity). FIG. 3A-3K
[0073] Further, note that the amount of scrolling of the content of the user interface 330 can be based on an average amount of yaw movement of the user’s head over a period of time. For example, if the average amount of yaw movement over a first period of time (e.g., 0.5s, Is, 2s, 5s, 10s, or another period of time) is a first amount of yaw movement, the electronic device 101 can scroll the content of the user interface 330 by the first amount. Continuing with this example, if the average amount of yaw movement over the first period of time is a second amount of yaw movement (where the second amount of yaw movement is greater than the first amount of yaw movement), the electronic device 101 can scroll the content of the user interface 330 by a second amount that is greater than (e.g., different from) the first amount.
[0074] Additionally, note that in some examples, the electronic device 101 scrolls the content of the user interface 330 at a scroll rate (based on an angular velocity associated with the yaw movement of the user’s head). For example, in accordance with a determination that the angular velocity associated with the yaw movement is a first angular velocity, the electronic device can scroll the content of the user interface 330 vertically at a first scroll rate. Continuing with this example, in accordance with a determination that the angular velocity associated with the yaw movement is a second angular velocity that is different from the first angular velocity, the electronic device 101 can scroll the content of the user interface 330 vertically at a second scroll rate that is different from the first scroll rate. In some examples, the faster the angular velocity associated with the yaw movement of the user’s head, the faster the scrolling performed by the electronic device in response to the yaw movement. As such, in some examples, the electronic device 101 scrolls the content of the user interface at a scroll rate (based on the angular velocity of the yaw movement of the user’s head). Further, in some examples, the electronic device scrolls the content of the user interface 330 at a threshold minimum scroll rate. In some examples, the electronic device scrolls the content of the user interface 330 at a threshold maximum scroll rate. In some examples, after scrolling the content of the user interface 330 by a first amount, the electronic device 101 can stop scrolling the content of the user interface 330 if no yaw movement of the user’s head is detected that satisfies one or more first criteria (e.g., such as a criterion that is satisfied when the yaw movement in a first direction over a period of time is above a threshold amount of yaw movement).
[0075] FIG. 3L The methods 340 in FIG. 3B are further described with reference to. FIG. 3L FIG. 3C.FIG. 3L The present disclosure illustrates a method for vertically scrolling content in a user interface in response to detecting yaw movement of a user's head on an electronic device, according to some examples of this disclosure. FIG. 2A-2B This is a flowchart illustrating, according to some examples of the present disclosure, a method 340 for vertically scrolling content in a user interface in response to detecting yaw movement of a user's head on an electronic device. It should be understood that method 340 is exemplary and more, fewer, or different operations may be performed in the same or different order. Additionally, the operations in method 340 described above may optionally be performed by running an information processing device such as a general-purpose processor (e.g., as per [reference to...]). FIG. 2A-2B One or more functional modules in the aforementioned (or dedicated chip) and / or through FIG. 3L It is implemented using other components.
[0076] Therefore, based on the foregoing, some examples of this disclosure relate to a method performed at an electronic device (e.g., electronic device 101) that communicates with one or more displays and one or more input devices. FIG. 3E Method 340. Method 340 includes: displaying (342) a user interface via the one or more displays, the user interface including content configured to be vertically scrollable in the user interface. Method 340, while displaying the user interface including the content, detects (344) a first input corresponding to a request to scroll the content via the one or more input devices, the first input including a yaw movement of the head of a user of the electronic device. Method 340 includes: in response to detecting the yaw movement of the head of the user of the electronic device, vertically scrolling (346) the content in the user interface according to the yaw movement of the head of the user of the electronic device.
[0077] Additionally or alternatively, in some examples, the yaw movement of the user's head is greater than a threshold amount of yaw movement of the user's head, and method 340 includes: detecting, via the one or more input devices, a first corresponding amount of yaw movement of the user's head (less than the threshold amount of yaw movement of the user's head) while displaying the user interface including the content and before the first input is detected (or optionally otherwise not detected); and abandoning scrolling of the content in response to detecting the first corresponding amount of yaw movement. Additionally or alternatively, in some examples, the threshold amount of yaw movement is further associated with the amount of yaw movement of the user's head over a time period, during which the yaw movement is performed, and the first corresponding amount of yaw movement is performed beyond that time period.
[0078] Additionally or alternatively, in some examples, vertically scrolling the content in the user interface in accordance with the yaw movement of the head of the user of the electronic device includes vertically scrolling the content by an amount that is based on an average amount of movement of the head of the user over a time period. For example, if the average amount of movement of the head of the user over the time period is a first amount of movement, the electronic device 101 can vertically scroll the content by a first amount of vertical scrolling. Continuing the example, if the average amount of movement of the head of the user over the time period is a second amount of movement that is different from the first amount of movement, the electronic device 101 can vertically scroll the content by a second amount that is different from the first amount of vertical scrolling. In some examples, the greater the average amount of movement of the head of the user over the time period, the greater the resulting vertical scrolling of the content.
[0079] Additionally or alternatively, in some examples, the method 340 includes, in response to detecting the first input, presenting an indication to the user of the electronic device that the content is scrollable in response to respective yaw movements of the head of the user of the electronic device.
[0080] Additionally or alternatively, in some examples, the method 340 includes vertically scrolling the content in a first vertical direction of the user interface in accordance with a determination that the yaw movement of the head of the user of the electronic device is in a first rotational direction (such as the direction indicated by arrow 314b in FIG. 3B). FIG. 3E-3F Additionally or alternatively, in some examples, the method 340 includes vertically scrolling the content in a second vertical direction of the user interface in accordance with a determination that the yaw movement of the head of the user of the electronic device is in a second rotational direction that is different from the first rotational direction. FIG. 3E For example, while displaying the content of the user interface 330 of FIG. 3B, if the electronic device 101 detects a yaw movement of the head of the user of the electronic device 101 in a direction indicated by arrow 314c in FIG. 3B (which is different from (e.g., opposite to) the direction indicated by arrow 314b in FIG. 3B), the electronic device 101 will vertically scroll the content downward, thereby changing the direction of scrolling of the content of the user interface 330 illustrated in FIG. 3B (e.g., opposite to the direction of scrolling of the content of the user interface 330 illustrated in FIG. 3B). FIG. 3J Additionally or alternatively, in some examples, vertically scrolling the content in the user interface in accordance with the yaw movement of the head of the user of the electronic device includes vertically scrolling the content by an amount that is based on an average amount of movement of the head of the user over a time period. For example, if the average amount of movement of the head of the user over the time period is a first amount of movement, the electronic device 101 can vertically scroll the content by a first amount of vertical scrolling. Continuing the example, if the average amount of movement of the head of the user over the time period is a second amount of movement that is different from the first amount of movement, the electronic device 101 can vertically scroll the content by a second amount that is different from the first amount of vertical scrolling. In some examples, the greater the average amount of movement of the head of the user over the time period, the greater the resulting vertical scrolling of the content. FIG. 3E FIG. 3E-3F FIG. 4A-4T
[0081] Additionally or alternatively, in some examples, the method 340 includes, in accordance with a determination that the yaw movement of the head of the user of the electronic device is a first amount of rotation in the first rotational direction, scrolling the content vertically in the first vertical direction by a first scroll amount; and in accordance with a determination that the yaw movement of the head of the user of the electronic device is a second amount of rotation in the first rotational direction, scrolling the content vertically in the first vertical direction by a second scroll amount that is different from the first scroll amount, the second amount of rotation being different from the first amount of rotation in the first rotational direction.
[0082] Additionally or alternatively, in some examples, the user interface is displayed at a first position in the three-dimensional environment when the first input is detected, and the method 340 includes, in response to detecting the yaw movement of the head of the user of the electronic device, moving the user interface to a second position in the three-dimensional environment that is different from the first position.
[0083] Additionally or alternatively, in some examples, the user interface is displayed at a first position in the three-dimensional environment when the first input is detected, and the method 340 includes, in response to detecting the yaw movement of the head of the user of the electronic device, moving the user interface to a second position in the three-dimensional environment that is different from the first position.
[0084] Some examples of the disclosure relate to an electronic device, including one or more processors; memory; and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods described above.
[0085] Some examples of the disclosure relate to a non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to perform any of the methods described above.
[0086] Some examples of the disclosure relate to an electronic device that includes one or more processors, memory, and means for performing any of the methods described above.
[0087] Some examples of the disclosure relate to an information processing apparatus for use in an electronic device, the information processing apparatus including means for performing any of the methods described above.
[0088] Attention is now generally directed to examples in which the electronic device detects and responds to input corresponding to a request to display one or more user interface elements, where the input includes a head rotation of a user of the electronic device, in accordance with some examples of this disclosure.
[0089] In some examples, the electronic device 101 detects head movement of a user about an axis associated with the user’s head, and in response, displays a plurality of selectable options that are paged for scrolling about an axis corresponding to an axis that is perpendicular to the axis associated with the user’s head. Such features are illustrated generally in FIG. 4U and described further with reference to the method 450 of FIG. 4A-4T .
[0090] FIG. 4A-4T Examples in which the electronic device 101 detects and responds to input corresponding to a request to display one or more user interface elements (e.g., a plurality of selectable options), where the input includes a head rotation of a user of the electronic device, in accordance with some examples of this disclosure, are illustrated generally.
[0091] For illustrative purposes, FIG. 4A include respective perspective views and respective top views 3121-312ae. The respective perspective views are generally provided to illustrate a particular head movement, such as a pitch movement of the user’s head. The top views 3121-312ae of the respective figures illustrate the spatial arrangement between the user 304 and the user interface and / or user interface elements displayed in the respective figures generally. That is, for example, in FIG. 4A , the electronic device 101 is displaying a user interface 350c facing the user 304 as illustrated by the top view 3121.
[0092] Additionally, the top views 3121-312ae indicate the position of various objects (e.g., real and / or virtual objects) visible in the display of the electronic device 101 in the horizontal and depth dimensions of the respective figures. The top views also include an indication of the point of view of the user 304 of the electronic device 101. For example, in FIG. 4A , the electronic device 101 displays a view (e.g., of a three-dimensional environment) visible through the display of the electronic device 101 from the point of view of the user 304 illustrated by the top view 3121.
[0093] Further, in FIG. 4A , the spatial arrangement between the user 304 and the user interface 350c (e.g., a more accurate spatial arrangement in the environment) is the illustrated spatial arrangement between the representation 304a of the user 304 and the user interface 350c in the perspective view. That is, in FIG. 4A-4TIn the diagram, electronic device 101' (e.g., representing electronic device 101) is displaying user interface 350c in an orientation facing user 304 (e.g., within the viewing boundary 305' of user representation 304) (as shown by the spatial arrangement between user representation 304a and user interface 350c), and the top view similarly illustrates the spatial arrangement in both the depth and horizontal dimensions. Therefore, it should be noted that the spatial arrangement is for illustrative purposes only. FIG. 4A-4T The specific head movements described (e.g., pitch head movements) indicate that the position of the user 304 in these figures (e.g., relative to the user interface in the corresponding figure) differs in the perspective and top view of the respective figure. Furthermore, FIG. 4A This includes the viewing boundary 305 of the user 304 of the electronic device 101 in the corresponding figures. For example, in FIG. 4A In this context, electronic device 101 displays a view (e.g., a three-dimensional environment) defined by viewing boundaries 305 in a corresponding top view 312l, which is shown on display 120 from the viewpoint of user 304 illustrated in top view 312a. FIG. 4B In the perspective view, there are also viewing boundaries 305 in the vertical and depth dimensions, and these viewing boundaries 305 can move relative to the user's physical environment if the user's head moves. For example, FIG. 4C The view boundary in the middle is relative to FIG. 4A The spatial arrangement of arrow 315b (which indicates the forward head direction of user 304 in the attached figure) can be compared with... FIG. 4A View boundary 305 relative to FIG. 4A The spatial arrangement of arrow 315a (which also indicates the forward head direction of user 304 in the attached figure) is the same.
[0094] exist FIG. 3A-3L In this context, electronic device 101 displays user interface 350c in environment 306. In some examples, user interface 350c includes reference retrieval systems. FIG. 4A-4C One or more features of the described user interface 330. For example, the user interface 350c may be associated with a corresponding application (e.g., a messaging application, a media streaming application, or another type of application). In some examples, the electronic device 101 displays multiple scrollable user interface elements in response to detecting a specific head movement of the user 304 of the electronic device 101, such as FIG. 4B As shown.
[0095] For example, in FIG. 4A (It includes, for example) FIG. 4B In the display of the user interface 350c, the electronic device 101 detects the user's head movement. FIG. 4B In this context, head movement refers to the upward tilting of the user's head (e.g., ...). FIG. 4Bthe upward pitch movement is a counterclockwise rotation (e.g., rotation about a pitch axis of the head of the user 304) of the head of the user 304 from the head orientation indicated by the arrow 315a to the head orientation indicated by the arrow 315b. In some examples, FIG. 4B The electronic device 101 interprets the upward pitch movement as a request to display a plurality of selectable options. For example, if FIG. 4B-4C The head movement of the user 304 in FIG. 3B is not an upward pitch movement, the electronic device 101 can not interpret such movement as a request to display a plurality of selectable options. In response to detecting FIG. 4C the upward pitch movement of the head of the user 304 in FIG. 3B, the electronic device 101 can display a plurality of selectable options 356, as shown in FIG. 4C
[0096] In some examples, the plurality of selectable options 356 correspond to different user interfaces of different applications (e.g., a music application, a movie application, an internet application, etc.). For example, the selectable option 356a can correspond to a first user interface of a first application, the selectable option 356b can correspond to a second user interface of a second application, the selectable option 356c can correspond to a third user interface of a third application, the selectable option 356d can correspond to a fourth user interface of a fourth application, and the selectable option 356e can correspond to a fifth user interface of a fifth application.
[0097] In some examples, the plurality of selectable options 356 correspond to different user interfaces of a same application (e.g., an internet application, a media application, a word processing application, an email application, a game application, or another application). For example, the application of the user interface can be an internet application, where each of the plurality of selectable options 356 corresponds to a different page (e.g., window) of the internet application. For example, the selectable option 356a can correspond to a first window of the internet application, the selectable option 356b can correspond to a second window of the internet application, the selectable option 356c can correspond to a third window of the internet application, the selectable option 356d can correspond to a fourth window of the internet application, and the selectable option 356e can correspond to a fifth window of the internet application. In some examples, the plurality of selectable options 356 can include one or more characteristics of the selectable options 310a-310e. In some examples, FIG. 4C The selectable options 356a-356e in FIG. 3B are a subset of the plurality of selectable options 356, and other selectable options not shown in FIG. 3B can be displayed in response to a scroll input. FIG. 4A-4C
[0098] FIG. 4B The plurality of selectable options 356 of FIG. 3B are horizontally scrollable. As such, FIG. 4C Examples are illustrated in which the electronic device 101 displays content that is scrollable in a direction corresponding to a direction perpendicular to an axis of rotation of the head movement that causes the electronic device 101 to display a plurality of selectable options. For example, in FIG. 4D , the electronic device 101 detects head movement about a pitch axis of the user 304 and, in response, the electronic device 101 displays a plurality of selectable options 356 that are horizontally paginated, as shown in FIG. 4E .
[0099] FIG. 4D and FIG. 4C Examples are illustrated in which the electronic device 101 detects and responds to a request to scroll the plurality of selectable options 356. In FIG. 4D , while displaying the plurality of selectable options 356 as in FIG. 4D-4E , the electronic device 101 detects a yaw movement of the head of the user of the electronic device 101, as indicated by arrow 314d in the top view 312o in FIG. 4D-4E , which is a clockwise rotation of the head of the user 304. In response, the electronic device 101 horizontally scrolls the plurality of selectable options 356, as shown in FIG. 4C . Note that the scrolling illustrated in FIG. 4E is horizontal scrolling that is in response to a yaw movement of the head of the user of the electronic device 101.
[0100] Additionally, note that the plurality of selectable options 356 includes a focus region 358a and a non-focus region 358b. For example, in FIG. 4C , the selectable option 356c is in the focus region 358a, while the remaining selectable options in the example are in the non-focus region 358b; and in FIG. 4C , the selectable option 356e is in the focus region 358a, while the remaining selectable options in the example are in the non-focus region 358b. In some examples, when a respective selectable option is in the focus region, it has a first size, and when the respective selectable option is not in the focus region, it has a second size that is smaller than the first size. For example, FIG. 4E , the selectable option 356c has the first size, and FIG. 4E , the selectable option 356b has the second size that is smaller than the first size. As such, the electronic device 101 can change the size of a respective user interface element as it enters and / or exits the focus region 358a. In some examples, when a respective selectable option is in the focus region, the selectable option is closer to the user than when it is outside the focus region. In some examples, in the non-focus region 358b, the closer a selectable option is to the focus region 358a, the larger the selectable option is and / or the closer the selectable option is to the user. For example, in FIG. 4EIn particular, the minimum selectable options in the viewpoint of the user 304 can be selectable option 356c and selectable option 356g. Continuing the example, in FIG. 4A-4C , selectable option 356d and selectable option 356f can have a size that is greater than the minimum size and less than the size of selectable option 356e in FIG. 4A .
[0101] Note that in the illustrated example of FIG. 4B , the electronic device 101 displays a selectable option (e.g., selectable option 356c) that corresponds to the user interface 350c of FIG. 4D-4E . However, such examples are non-limiting, as the present disclosure contemplates that the electronic device 101 can display, in response to detecting the head movement of FIG. 4F , a plurality of selectable options that does not include the selectable option that corresponds to the user interface 350c.
[0102] Note that the plurality of selectable options 356 behaves as head-locked content. For example, from FIG. 4F , the electronic device 101 moves the position of the plurality of selectable options 356 in the environment 306 according to the movement of the user’s head. Note that in some examples, the plurality of selectable options 356 does not behave as head-locked content, but rather has another content-locked behavior (such as world-locked).
[0103] In some examples, after displaying the plurality of selectable options 356, the electronic device 101 returns to displaying the user interface in response to a particular head movement. For example, while displaying the plurality of selectable options 356 as in FIG. 4F , the electronic device 101 detects a head movement of the user 304. In FIG. 4F , the head movement is a downward pitch movement, as indicated by arrow 317b, which is a clockwise rotation (e.g., rotation about the pitch axis of the user’s head) of the head of the user 304 from the head orientation indicated by arrow 315b to the head orientation indicated by arrow 315a. In some examples, FIG. 4F , the electronic device 101 interprets the downward pitch movement as a request to display the user interface that corresponds to the selectable option in the plurality of selectable options in the focus region 358a when the downward pitch movement is detected. For example, if FIG. 4F the head movement of the user 304 is not a downward pitch movement, then FIG. 4F-4G , the electronic device 101 can not interpret such a movement as a request to display the user interface that corresponds to the selectable option in the focus region 358a of the plurality of selectable options 356. In response to detecting the downward pitch movement in FIG. 4F-4G , the electronic device 101 can display the user interface 350e, as shown in FIG. 4F .
[0104] From FIG. 4G , the electronic device 101 ceases to display (e.g., fade out) the plurality of selectable options 356 and displays (e.g., fade in) the user interface 350e. In some examples, the user interface 350e is associated with the selectable option 356e, and the electronic device 101 displays the user interface 350e because the selectable option 356e was in the focus region 358a of the plurality of selectable options 356 when the downward pitch movement of the head of the user 304 was detected. FIG. 4F In some examples, the electronic device 101 animates the display of the user interface 350e by increasing the size of the selectable option 356e and then displaying the user interface 350e, such as the user interface 356e transitioning to the user interface 350e while other selectable options of the plurality of options 356 are ceasing to be displayed. Note also that FIG. 4G The user interface 350e has a larger size than the selectable option 356e in FIG. 4F In some examples, the size of the user interface 350e is not greater than the size of the selectable option 356e in FIG. 4D The size of the user interface 350e is not greater than the size of the selectable option 356e in FIG. 4E
[0105] Also, note that although the vertical and horizontal directions of the head of the user 304 in FIG. 4B and FIG. 4B are as indicated by the arrow 315b, it is understood that the head directions in these two figures can also be as indicated by the arrow 315a of FIG. 4B For example, after detecting the movement indicated by the arrow 317a in FIG. 4B , the electronic device 101 can allow the user 304 to orient their head back to the direction indicated by the arrow 315a of FIG. 4F without changing the display of the plurality of selectable options 356. For example, the electronic device 101 can return to displaying the user interface in response to detecting a downward pitch movement that starts from the orientation of the head indicated by the arrow 315a in FIG. 4A-4C rather than from the orientation of the head indicated by the arrow 315b in FIG. 4H-4J
[0106] As described above with reference to FIG. 4H , in some examples, the electronic device 101 displays the plurality of selectable options in response to detecting an upward pitch movement of the head of the user 304. In some examples, the electronic device 101 displays the plurality of selectable options in response to detecting a downward pitch movement of the head of the user 304, such as shown in FIG. 4H
[0107] For example, in displaying the user interface as shown in FIG. 4H When the user interface 351j (e.g., a user interface that may include one or more features of user interface 330 or 350e) is in use, the electronic device 101 detects a downward tilt movement of the user 304's head, such as... FIG. 4H As indicated by arrow 317c, the head orientation changes from that indicated by arrow 315a to that indicated by arrow 315c. In some examples, the electronic device 101 interprets a downward tilt movement as a request to display multiple optional options. For example, if... FIG. 4H If the head movement is not a downward tilting motion, then... FIG. 4I The electronic device 101 may not interpret such movement as a request to display multiple optional options. In response to detecting... FIG. 4I As the user's head tilts downwards, the electronic device 101 displays multiple optional options 360 degrees, such as... FIG. 4I As shown.
[0108] exist FIG. 4I In this context, electronic device 101 simultaneously displays a user interface 351j and multiple optional options 360. FIG. 4I In this context, multiple optional options 360 (e.g., optional options 360i to 360k) are displayed as icons (e.g., power indicators). In some examples, the icons represent applications. For instance, optional option 360i could represent a first application (e.g., an email application), optional option 360j could represent a second application (e.g., a weather application), and optional option 360k could represent a third application (e.g., a music application). FIG. 4J In the focus area, the icon is the icon below the user interface 351j (e.g., optional option 360j). Furthermore, the multiple optional options 360 may include one or more features of multiple optional options 356 and / or optional options 310a to 310e. For example, the multiple optional options 360 are capable of horizontal scrolling, as illustrated by the multiple optional options 356. Thus, FIG. 4I and FIG. 4I-4J An example of content displayed by electronic device 101 is illustrated, which is scrollable in a direction corresponding to a rotation axis perpendicular to (e.g., opposite to) head movement, causing electronic device 101 to display multiple optional options. For example, in FIG. 4I In this process, electronic device 101 detects head movement around the user's pitch axis, and in response, electronic device 101 displays user interface elements that are horizontally paginated, as shown in the reference. FIG. 4I The description and examples are provided.
[0109] Specifically, in FIG. 4I-4J In the process of simultaneously displaying the user interface 351j and multiple optional options 360, the electronic device 101 detects yaw movement of the user's head, such as...FIG. 4I-4J the yaw movement is a counterclockwise rotation of the head of the user 304. In response, the electronic device 101 scrolls the plurality of selectable options 360 horizontally, as shown in FIG. 3I-3. FIG. 4J Note that the illustrated scrolling is horizontal scrolling that is in response to a yaw movement of the head of the user of the electronic device 101. FIG. 4K
[0110] In some examples, after displaying the plurality of selectable options 360, the electronic device 101 returns to displaying the user interface in response to a particular head movement. For example, while displaying the plurality of selectable options 360 as shown in FIG. 3I-3, the electronic device 101 detects a head movement of the user 304, as shown in FIG. 3I-4. FIG. 4J In some examples, the head movement is a pitch movement, such as an upward pitch movement, as shown by arrow 317d, that is a counterclockwise rotation (e.g., rotation about a pitch axis of the user’s head) of the head of the user 304 from the head orientation indicated by arrow 315c to the head orientation indicated by arrow 315a. FIG. 4K In some examples, the head movement is a pitch movement, such as an upward pitch movement, as shown by arrow 317d, that is a counterclockwise rotation (e.g., rotation about a pitch axis of the user’s head) of the head of the user 304 from the head orientation indicated by arrow 315c to the head orientation indicated by arrow 315a. FIG. 4K In some examples, the head movement is a pitch movement, such as an upward pitch movement, as shown by arrow 317d, that is a counterclockwise rotation (e.g., rotation about a pitch axis of the user’s head) of the head of the user 304 from the head orientation indicated by arrow 315c to the head orientation indicated by arrow 315a. FIG. 4K In some examples, the head movement is a pitch movement, such as an upward pitch movement, as shown by arrow 317d, that is a counterclockwise rotation (e.g., rotation about a pitch axis of the user’s head) of the head of the user 304 from the head orientation indicated by arrow 315c to the head orientation indicated by arrow 315a. FIG. 4K In some examples, the head movement is a pitch movement, such as an upward pitch movement, as shown by arrow 317d, that is a counterclockwise rotation (e.g., rotation about a pitch axis of the user’s head) of the head of the user 304 from the head orientation indicated by arrow 315c to the head orientation indicated by arrow 315a. FIG. 4L In some examples, the head movement is a pitch movement, such as an upward pitch movement, as shown by arrow 317d, that is a counterclockwise rotation (e.g., rotation about a pitch axis of the user’s head) of the head of the user 304 from the head orientation indicated by arrow 315c to the head orientation indicated by arrow 315a. FIG. 4K-4L In response to detecting the upward pitch movement in FIG. 3I-4, the electronic device 101 displays the user interface 351i, as shown in FIG. 3I-5. FIG. 4K In response to detecting the upward pitch movement in FIG. 3I-4, the electronic device 101 displays the user interface 351i, as shown in FIG. 3I-5.
[0111] From FIG. 3I-4, the electronic device 101 ceases displaying the plurality of selectable options 360 and displays the user interface 351i. In some examples, the user interface 351i is associated with the selectable option 360i, and the electronic device 101 displays the user interface 351i because the selectable option 360i was in the focus region of the plurality of selectable options when the upward pitch movement of FIG. 3I-4 was detected. FIG. 4M-4O In response to detecting the upward pitch movement in FIG. 3I-4, the electronic device 101 displays the user interface 351i, as shown in FIG. 3I-5. FIG. 4M In response to detecting the upward pitch movement in FIG. 3I-4, the electronic device 101 displays the user interface 351i, as shown in FIG. 3I-5.
[0112] FIG. 4N Examples are illustrated of an electronic device 101 displaying a plurality of selectable options in response to detecting a yaw movement of the head of a user of the electronic device 101, where the plurality of selectable options are vertically scrollable. In FIG. 4M In particular, in FIG. 3L, the electronic device 101 displays the user interface 362s (e.g., which can have one or more characteristics of the user interfaces 330, 350e, 352i, and / or 351j). In FIG. 4N particular, in FIG. 3L, the electronic device 101 displays the user interface 362s (e.g., which can have one or more characteristics of the user interfaces 330, 350e, 352i, and / or 351j). In FIG. 4O particular, in FIG. 3L, the electronic device 101 displays the user interface 362s (e.g., which can have one or more characteristics of the user interfaces 330, 350e, 352i, and / or 351j). In FIG. 4P-4R particular, in FIG. 3L, the electronic device 101 displays the user interface 362s (e.g., which can have one or more characteristics of the user interfaces 330, 350e, 352i, and / or 351j). In FIG. 4Q particular, in FIG. 3L, the electronic device 101 displays the user interface 362s (e.g., which can have one or more characteristics of the user interfaces 330, 350e, 352i, and / or 351j). In FIG. 4P particular, in FIG. 3L, the electronic device 101 displays the user interface 362s (e.g., which can have one or more characteristics of the user interfaces 330, 350e, 352i, and / or 351j). In
[0113] In particular, in FIG. 3L, the electronic device 101 displays the user interface 362s (e.g., which can have one or more characteristics of the user interfaces 330, 350e, 352i, and / or 351j). In FIG. 4Q particular, in FIG. 3L, the electronic device 101 displays the user interface 362s (e.g., which can have one or more characteristics of the user interfaces 330, 350e, 352i, and / or 351j). In FIG. 4Q particular, in FIG. 3L, the electronic device 101 displays the user interface 362s (e.g., which can have one or more characteristics of the user interfaces 330, 350e, 352i, and / or 351j). In FIG. 4Q-4R particular, in FIG. 3L, the electronic device 101 displays the user interface 362s (e.g., which can have one or more characteristics of the user interfaces 330, 350e, 352i, and / or 351j). In FIG. 4S particular, in FIG. 3L, the electronic device 101 displays the user interface 362s (e.g., which can have one or more characteristics of the user interfaces 330, 350e, 352i, and / or 351j). In FIG. 4T particular, in FIG. 3L, the electronic device 101 displays the user interface 362s (e.g., which can have one or more characteristics of the user interfaces 330, 350e, 352i, and / or 351j). In
[0114] FIG. 4R FIG. 4S In particular, in FIG. 3L, the electronic device 101 displays the user interface 362s (e.g., which can have one or more characteristics of the user interfaces 330, 350e, 352i, and / or 351j). In FIG. 4N particular, in FIG. 3L, the electronic device 101 displays the user interface 362s (e.g., which can have one or more characteristics of the user interfaces 330, 350e, 352i, and / or 351j). In FIG. 4N particular, in FIG. 3L, the electronic device 101 displays the user interface 362s (e.g., which can have one or more characteristics of the user interfaces 330, 350e, 352i, and / or 351j). In FIG. 4S particular, in FIG. 3L, the electronic device 101 displays the user interface 362s (e.g., which can have one or more characteristics of the user interfaces 330, 350e, 352i, and / or 351j). In FIG. 4R particular, in FIG. 3L, the electronic device 101 displays the user interface 362s (e.g., which can have one or more characteristics of the user interfaces 330, 350e, 352i, and / or 351j). In FIG. 4T particular, in FIG. 3L, the electronic device 101 displays the user interface 362s (e.g., which can have one or more characteristics of the user interfaces 330, 350e, 352i, and / or 351j). In FIG. 4S When multiple optional options 364 are displayed, the electronic device 101 detects a yaw movement by the user (as indicated by arrow 314g), and in response, the electronic device 101 stops displaying the multiple optional options 364 and displays a user interface 362s, which corresponds to the optional option 364s in the focus area of the multiple optional options 364 when yaw movement is detected, such as... FIG. 4T As shown. For example, if when a detection... FIG. 3E When the yaw movement occurs, if the optional option 364q is in the focus area of multiple optional options 364, the electronic device 101 stops displaying the multiple optional options 364 and displays a user interface corresponding to the optional option 364q, which will optionally be... FIG. 3E The user interface is 362 different user interfaces. In some examples, the yaw movement of the user's head is the movement of the user's head in a direction approximately perpendicular to the direction of gravity (e.g., movement about a vertical axis), such as by... FIG. 4B The yaw movement is indicated by arrow 314d. In some examples, if the ears of the head are oriented approximately perpendicular to the direction of gravity (e.g., a line extending through the ears of the head is approximately perpendicular to the direction of gravity), then the yaw movement of the user's head is a lateral movement of the head (e.g., a horizontal rotational movement of the head), such as by... FIG. 4D Arrow 314d indicates yaw movement (which is in a direction approximately perpendicular to the direction of gravity). In some examples, if the user's head is oriented such that one ear is vertically downward and the other vertically upward (e.g., a line extending through each ear is approximately parallel to the direction of gravity), then the yaw movement of the user's head is the movement of the head in a direction approximately perpendicular to the direction of gravity. In some examples, the pitch movement of the user's head is the movement of the head in a direction corresponding to an upward or downward movement of the head (such as by...). (As indicated by arrow 317a in the diagram, the upward movement) indicates a head with ears oriented approximately perpendicular to the direction of gravity (e.g., a line extending through the ears of the head is approximately perpendicular to the direction of gravity). In some examples, if the ears of the head are oriented approximately parallel to the direction of gravity (e.g., a line extending through the ears of the head is approximately parallel to the direction of gravity, such as one ear of the head being vertically downward and the other ear being vertically upward), then the pitch movement of the head is an upward or downward vertical movement (e.g., movement about a horizontal axis), in which case this would involve an upward or downward vertical movement of the ears.
[0115] It should be noted that in some examples, the scrolling of the user interface is triggered in response to the detection of a user's gaze on the electronic device 101, a mouse click, a touch on the touchpad, or the user's voice. For example, the horizontal scrolling of the user interface described herein (e.g., see reference 101). and FIG. 4E ) can additionally or alternatively be triggered with eye tracking instead of pitch rotation (e.g., reference FIG. 4B pitch movement described above).
[0116] FIGS. 4A-4T is further described with reference to the method 460 in FIG. 4U FIG. 4U The method 460 as a whole illustrates a method for displaying a plurality of user interface elements in response to detecting a head rotation of a user of an electronic device in accordance with some examples of the present disclosure. FIG. 4U is a flowchart illustrating a method 460 for displaying a plurality of user interface elements in response to detecting a head rotation of a user of an electronic device in accordance with some examples of the present disclosure. It should be understood that the method 460 is an example, and more, fewer, or different operations can be performed in the same or different order. Additionally, the operations in the method 460 described above are optionally implemented by one or more functional modules running on an information processing apparatus, such as a general- purpose processor (e.g., as described with respect to FIGS. 2A-2B ) or a special-purpose chip and / or by other components of FIGS. 2A-2B . Moreover, it is noted that one or more operations or descriptions of the method 460 can equally apply to one or more examples of the method 340. Similarly, it is noted that one or more operations or descriptions of the method 340 can equally apply to one or more examples of the method 460.
[0117] Accordingly, in light of the above, some examples of the present disclosure relate to a method (e.g., the method 460 of FIG. 4U ) performed at an electronic device (e.g., the electronic device 101) in communication with one or more displays and one or more input devices. The method 460 includes displaying (462), via the one or more displays, a user interface of an application. The method 460 includes, while displaying the user interface of the application, detecting (464), via the one or more input devices, a first input corresponding to a request to display a plurality of user interface elements, wherein the first input comprises a first head rotation of a user of the electronic device about a first axis associated with the head. The method 460 includes, in response to detecting the first head rotation of the user of the electronic device about the first axis, displaying (466), via the one or more displays, the plurality of user interface elements, wherein the plurality of user interface elements are scrollable in response to a second head rotation of a second input different from the first input.
[0118] Additionally or alternatively, in some examples, the plurality of user interface elements correspond to different user interfaces of different applications.
[0119] Additionally or alternatively, in some examples, the plurality of user interface elements corresponds to different user interfaces of the application.
[0120] Additionally or alternatively, in some examples, the plurality of user interface elements includes a first user interface element that represents (e.g., corresponds to and / or is selectable to display) the user interface of the application.
[0121] Additionally or alternatively, in some examples, the first axis is a pitch axis of the head of the user of the electronic device. Additionally or alternatively, in some examples, the first head rotation is an upward pitch movement. Additionally or alternatively, in some examples, the first head rotation is a downward pitch movement. Additionally or alternatively, in some examples, the plurality of user interface elements is horizontally scrollable.
[0122] Additionally or alternatively, in some examples, the first axis is a yaw axis of the head of the user of the electronic device. Additionally or alternatively, in some examples, the plurality of user interface elements is vertically scrollable.
[0123] Additionally or alternatively, in some examples, the method 460 includes, while displaying the plurality of user interface elements, detecting, via the one or more input devices, a second input, where the second input has a second head rotation about a second axis associated with the head, the second axis being perpendicular to the first axis associated with the head, and in response to detecting the second head rotation, scrolling the plurality of user interface elements according to the second head rotation.
[0124] Additionally or alternatively, in some examples, when the first input is detected, the user interface of the application is displayed in the user’s point of view at a first size, and the method 460 includes, in response to detecting the first head rotation, transitioning the user interface of the application to a certain user interface element of the plurality of user interface elements (including changing a size of the user interface of the application from the first size to a second size from the user’s point of view, the second size being smaller than the first size from the user’s point of view); and displaying, via the one or more displays, a first user interface element of the plurality of user interface elements, where the first user interface element represents the user interface of the application, and where the first user interface element has the second size from the user’s point of view.
[0125] Additionally or alternatively, in some examples, the first user interface element has the first size from the viewpoint of the user when located in a focus region of the plurality of user interface elements, and the method 460 includes: detecting, via the one or more input devices, the second input including the second head rotation; and in response to detecting the second head rotation, scrolling the plurality of user interface elements including displaying, according to a determination that a respective user interface element is located in the focus region of the plurality of user interface elements when scrolled, the respective user interface element from the second size of the viewpoint of the user, and displaying, according to a determination that the respective user interface element is not located in the focus region of the plurality of user interface elements when scrolled, the respective user interface element from a third size that is less than or equal to the first size of the viewpoint of the user.
[0126] Additionally or alternatively, in some examples, the user interface of the application is displayed from a first size of the viewpoint of the user when the first input is detected, and the method 460 includes: in response to detecting the first head rotation, changing the size of the user interface of the application from the first size to a second size of the viewpoint of the user, the second size being less than the first size of the viewpoint of the user; and simultaneously displaying, via the one or more displays, a first user interface element of the plurality of user interface elements, wherein the first user interface element represents the user interface of the application and the user interface of the application is from the second size of the viewpoint of the user.
[0127] Additionally or alternatively, in some examples, the first head rotation about the first axis is in a first rotational direction, and the method 460 includes: while displaying a respective user interface element of the plurality of user interface elements, wherein the respective user interface element is selectable to display a respective user interface of a respective application corresponding to the respective user interface element, detecting, via the one or more input devices, a respective input corresponding to a selection of the respective user interface element, wherein the respective input includes a respective head rotation of the head of the user of the electronic device about the first axis in a second rotational direction that is different from the first rotational direction; and in response to detecting the respective head rotation of the head of the user of the electronic device, displaying, via the one or more displays, the respective user interface of the respective application without displaying a user interface element of the plurality of user interface elements.
[0128] Some examples of the disclosure relate to an electronic device, including: one or more processors; memory; and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods described above.
[0129] Some examples of the disclosure relate to a non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to perform any of the above-described methods.
[0130] Some examples of the disclosure relate to an electronic device, comprising one or more processors, memory, and means for performing any of the above-described methods.
[0131] Some examples of the disclosure relate to an information processing apparatus for use in an electronic device, the information processing apparatus comprising means for performing any of the above-described methods.
[0132] Attention is now generally drawn to examples of an electronic device detecting and responding to an input corresponding to a request to display a user interface, wherein the input includes a head rotation of a user of the electronic device, in accordance with some examples of the present disclosure.
[0133] FIGS. 5A-5F As a whole, examples are illustrated of an electronic device displaying different amounts of a user interface in accordance with detecting different amounts of head rotation of a user of the electronic device corresponding to a request to display the user interface, in accordance with some examples of the present disclosure.
[0134] FIG. 5ASchematic diagrams 502a to 502d illustrate the increment of a user interface based on head movement (e.g., head movement of the user about an axis associated with the user 304's head, such as the user's pitch axis). In some examples, the animation of the increment of the displayed user interface simulates the unfolding of a projector screen. For example, electronic device 101 may display a user interface as if it unfolds from bottom to top based on head movement. For example, in schematic diagram 502a, in response to detecting a first head rotation amount 506a in a first direction (e.g., an upward pitch movement of the user's head), electronic device 101 displays a first portion 510' of user interface 510, and in schematic diagrams 502b to 502d, electronic device 101 displays a further head movement in the first direction (e.g., from the first head rotation amount 506a to a second head rotation amount 506b, from the second head rotation amount 506b to a third head rotation amount 506c, and from the third head rotation amount 506c to a fourth head rotation amount 506c). The amount of rotation 506d is continuously increased by the amount of head rotation (as shown by a continuous further head movement around the user's pitch axis) to continuously increase the amount of the displayed user interface 510 (e.g., as illustrated by a continuous increase from the first portion 510' to the second portion 510'', from the second portion 510'' to the third portion 510''', and from the third portion 510''' to the total amount indicated by the user interface 510 in schematic diagram 502d), until the total amount of the user interface 510 is displayed as shown by the user interface 510 in schematic diagram 502d. It should also be noted that the reference 504 indicating the bottom of the user interface 510 does not move with the rotation of the user 304's head (e.g., around the pitch axis of the user 304's head). Thus, in FIG. 5A In this design, the bottom of the user interface is tilt-locked, while the top of the user interface is head-locked, with the top of the user interface moving in response to the user's upward tilt movement (e.g., to show an increase in the amount of user interface movement).
[0135] FIGS. 5B-5F The overall illustration shows the increasing amount of the display user interface of the electronic device 101 until it reaches the feature of displaying the user interface 510, as shown in the reference. FIG. 5A The diagrams 502a to 502d illustrate and describe this. Specifically, FIGS. 5B-5F This illustrates how electronic device 101 continuously displays a larger amount of user interface 510 until full display of user interface 510 is achieved, such as... FIG. 5F As shown.
[0136] For illustrative purposes, FIGS. 5B-5Fincluding corresponding perspective views and top views 312af to 312aj. The corresponding perspective views are generally provided to illustrate a particular head movement, and the top views 312af to 312aj of the corresponding figures illustrate the spatial arrangement, as a whole, between the user 304 and the user interface and / or user interface elements displayed in the corresponding figures. That is, for example, in FIG. 5B , the electronic device 101 is displaying a user interface 350c facing the user 304 as illustrated by the top view 312af. Further, FIGS. 5B-5F , the viewing boundary 305 of the user 304 of the electronic device 101 in the corresponding figure is included. For example, in FIG. 5A , the electronic device 101 displays a view (e.g., of a three-dimensional environment) bounded by the viewing boundary 305 in the corresponding top view 312af, which is shown in the display of the electronic device 101 from the point of view of the user 304 as illustrated by the top view 312af.
[0137] In FIG. 5B , the electronic device 101 is configured to perform the animation described with reference to FIG. 5A . In FIG. 5B , while displaying the selectable options 360h to 360j, the electronic device 101 detects a first amount of head rotation 506a (e.g., a first amount of upward pitch movement), and in response, displays a portion 510’ of the user interface 510 as illustrated in FIG. 5C . In FIG. 5C , the electronic device 101 detects a second amount of head rotation 506b (e.g., a second amount of upward pitch movement), and in response, displays a portion 510” of the user interface 510 (which is greater than the portion 510’), as illustrated in FIG. 5D . In FIG. 5D , the electronic device 101 detects a third amount of head rotation 506c (e.g., a third amount of upward pitch movement), and in response, displays a portion 510’” of the user interface 510 (which is greater than the portion 510”), as illustrated in FIG. 5E . In FIG. 5E , the electronic device 101 detects a fourth amount of head rotation 506d (e.g., a fourth amount of upward pitch movement), and in response, displays (e.g., fully displays) the user interface 510 as illustrated in FIG. 5F . In some examples, in response to detecting an input corresponding to a request to display a user interface, such as the head movements described with reference to FIG. 4F and / or FIG. 4K , the electronic device 101 animates the display of the user interface as described with reference to FIGS. 5A-5F .
[0138] It is well understood that the use of personally identifiable information should follow privacy policies and practices that are generally recognized as meeting or exceeding industry or governmental requirements for maintaining the privacy of users. In particular, personally identifiable information data should be managed and handled in a manner that minimizes risks from unauthorized or unintended access or use. Additionally, users should be given the opportunity to opt in or opt out of use of their personally identifiable information for any purpose that it was not originally collected.
[0139] For explanatory purposes, the foregoing description has been set forth by reference to particular examples. However, no person should construe this as an exhaustive list of possible embodiments, as the abovedescribed example is illustrative only. Many modifications and variations are possible in light of the above teachings. It is therefore amenable to persons skilled in the art to employ alternatives, equivalents, and modifications and to utilize or make use of other examples of the disclosure as suitable for the particular applications without departing from the scope of the disclosure.
Claims
1. A method, the method comprising: At an electronic device that communicates with one or more displays and one or more input devices: A user interface is displayed via the one or more displays, the user interface including content configured to be vertically scrollable within the user interface; When displaying the user interface including the content, a first input corresponding to a request to scroll the content is detected via the one or more input devices, the first input including a yaw movement of the user's head of the electronic device; as well as In response to detecting yaw movement of the user's head on the electronic device, the content in the user interface is scrolled vertically according to the yaw movement of the user's head on the electronic device.
2. The method of claim 1, wherein the yaw movement of the user's head is greater than a threshold amount of yaw movement of the user's head, and wherein the method comprises: When displaying the user interface including the content and before detecting the first input: The user's head is detected via the one or more input devices with a first corresponding amount of yaw movement, the first corresponding amount of yaw movement being less than the threshold amount of yaw movement of the user's head; as well as In response to detecting the yaw movement of the first corresponding amount, scrolling of the content is abandoned.
3. The method according to claim 2, wherein: The threshold amount of yaw movement is further correlated with the amount of yaw movement of the user's head over a time period; The yaw movement was performed within the stated time period; and The first corresponding yaw movement is performed within the time period.
4. The method of claim 1, wherein vertically scrolling the content in the user interface based on the yaw movement of the user's head on the electronic device comprises: The content is scrolled vertically based on the average amount of movement of the user's head over a period of time.
5. The method according to claim 1, wherein the method comprises: In response to detecting the first input, an instruction is presented to the user of the electronic device that the content can scroll in response to a corresponding yaw movement of the user's head.
6. The method according to claim 1, wherein the method comprises: Based on the yaw movement of the user's head in the first rotation direction, the content is scrolled vertically in the first vertical direction of the user interface; as well as Based on the yaw movement of the user's head determined by the electronic device, the content is scrolled vertically in a second vertical direction on the user interface, which is different from the first vertical direction of the user interface, in a second vertical direction different from the first vertical direction of the user interface.
7. The method according to claim 6, wherein the method comprises: Based on determining that the yaw movement of the user's head in the electronic device is a first amount of rotation in the first rotation direction, the content is vertically scrolled by a first amount of scrolling in the first vertical direction; as well as Based on the determination that the yaw movement of the user's head in the electronic device is a second amount of rotation in the first rotation direction, the content is vertically scrolled in the first vertical direction by a second amount of scrolling that is different from the first amount of scrolling, and the second amount of rotation is different from the first amount of rotation in the first rotation direction.
8. The method of claim 1, wherein when the first input is detected, the user interface is displayed at a first location in a three-dimensional environment, and wherein the method comprises: In response to detecting yaw movement of the user's head in the electronic device, the user interface is moved to a second position in the three-dimensional environment, different from the first position.
9. The method of claim 1, wherein when the first input is detected, the user interface is displayed at a first location in a three-dimensional environment, and wherein the method comprises: In response to detecting yaw movement of the user's head in the electronic device, the display of the user interface is maintained at the first position in the three-dimensional environment.
10. An electronic device, the electronic device comprising: One or more processors; and A memory, wherein the one or more processors are configured to execute one or more programs stored in the memory, the one or more programs including instructions for performing the method according to any one of claims 1 to 9.
11. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform the method according to any one of claims 1 to 9.