User interface and device configuration based on user identification
The computer system addresses inefficiencies in augmented and virtual reality interfaces by automatically applying user settings and displaying avatars based on user identification, improving interaction efficiency and reducing cognitive burden.
Patent Information
- Application Number
- JP2025154075
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-01-24
- Filing Date
- 2025-09-17
- Publication Date
- 2026-01-21
AI Technical Summary
Existing user interfaces for augmented and virtual reality environments are cumbersome, inefficient, and complex, requiring multiple inputs and leading to a significant cognitive burden, particularly in battery-operated devices.
A computer system with enhanced user interfaces that automatically apply user settings and display avatars based on user identification, utilizing biometric input and sensors to reduce the number and complexity of user inputs, and adapt interactions to individual users.
The system provides more efficient and intuitive interactions by minimizing user inputs and adapting to individual users, enhancing the XR experience and reducing energy consumption.
Smart Images

Figure 2026009918000001_ABST
Abstract
Description
[Technical Field]
[0001] (CROSS-REFERENCE TO RELATED APPLICATIONS) This application claims priority to U.S. Provisional Patent Application No. 63 / 151,597, entitled "USER INTERFACES AND DEVICE SETTINGS BASED ON USER IDENTIFICATION," filed February 19, 2021, and U.S. Patent Application No. 17 / 582,902, entitled "USER INTERFACES AND DEVICE SETTINGS BASED ON USER IDENTIFICATION," filed January 24, 2022, the contents of each of which are incorporated herein by reference in their entirety.
[0002] The present disclosure generally relates to computer systems in communication with display generation components, including but not limited to electronic devices that provide virtual reality and mixed reality experiences via displays, and optionally one or more input devices that provide computer-generated experiences. [Background technology]
[0003] The development of computer systems for augmented reality has progressed significantly in recent years. Exemplary augmented reality environments include at least some virtual elements that replace or augment the physical world. Input devices such as cameras, controllers, joysticks, touch-sensitive surfaces, and touchscreen displays for computer systems and other electronic computing devices are used to interact with the virtual / augmented reality environment. Exemplary virtual elements include virtual objects such as digital images, video, text, icons, and control elements such as buttons and other graphics. Summary of the Invention
[0004] Some methods and interfaces for interacting with environments that include at least some virtual elements (e.g., applications, augmented reality environments, mixed reality environments, and virtual reality environments) are cumbersome, inefficient, and limited. For example, systems that provide insufficient feedback for performing actions associated with virtual objects, systems that require a series of inputs to achieve a desired result in an augmented reality environment, and systems in which manipulating virtual objects is complex and error-prone create a significant cognitive burden for users and detract from their experience with the virtual / augmented reality environment. In addition, these methods are unnecessarily time-consuming, thereby wasting energy. This latter consideration is particularly important in battery-operated devices.
[0005] Thus, there is a need for a computer system having improved methods and interfaces for providing users with computer-generated experiences that make interaction with the computer system more efficient and intuitive for the user. Such methods and interfaces optionally complement or replace conventional methods of providing users with augmented reality experiences. Such methods and interfaces reduce the number, extent, and / or type of inputs from the user by helping the user understand the connection between the input provided and the device response to that input, thereby creating a more efficient human-machine interface.
[0006] The above-mentioned deficiencies and other problems associated with user interfaces for computer systems in communication with a display generation component and, optionally, one or more input devices are reduced or eliminated by the disclosed system. In some embodiments, the computer system is a desktop computer with an associated display. In some embodiments, the computer system is a portable device (e.g., a notebook computer, a tablet computer, or a handheld device). In some embodiments, the computer system is a personal electronic device (e.g., a wearable electronic device such as a wristwatch or a head-mounted device). In some embodiments, the computer system has a touchpad. In some embodiments, the computer system has one or more cameras. In some embodiments, the computer system has a touch-sensitive display (also known as a "touch screen" or "touchscreen display"). In some embodiments, the computer system has one or more eye-tracking components. In some embodiments, the computer system has one or more hand-tracking components. In some embodiments, the computer system has one or more output devices in addition to the display generation component, the output devices including one or more tactile output generators and one or more audio output devices. In some embodiments, the computer system has a graphical user interface (GUI), one or more processors, memory, and one or more modules, programs, or instruction sets stored in the memory for performing a plurality of functions. In some embodiments, a user interacts with the GUI through stylus and / or finger contacts and gestures on the touch-sensitive surface, the movement of the user's eyes and hands in space relative to the GUI or the user's body as captured by cameras and other movement sensors, and voice input as captured by one or more audio input devices.In some embodiments, the functions performed through the interactions optionally include image editing, drawing, presenting, word processing, spreadsheet creation, game playing, making phone calls, video conferencing, emailing, instant messaging, training support, digital photography, digital videography, web browsing, digital music playback, note taking, and / or digital video playback, and executable instructions to perform those functions are optionally contained on a non-transitory computer-readable storage medium or other computer program product configured to be executed by one or more processors.
[0007] There is a need for electronic devices with improved methods and interfaces for interacting with three-dimensional environments. Such methods and interfaces can complement or replace conventional methods for interacting with three-dimensional environments. Such methods and interfaces reduce the number, extent, and / or type of input from a user, creating a more efficient human-machine interface.
[0008] There is a need for electronic devices with improved methods and interfaces for automatically displaying one or more user interfaces and / or automatically applying one or more device settings based on user identification (e.g., automatic identification). Such methods and interfaces can complement or replace conventional methods for interacting with computer systems. Such methods and interfaces reduce the number, extent, and / or type of input from the user, creating a more efficient human-machine interface.
[0009] It should be noted that the various embodiments described above can be combined with any other embodiment described herein. The features and advantages described herein are not exhaustive, and many additional features and advantages will become apparent to those skilled in the art, particularly in light of the drawings, specification, and claims. Furthermore, it should be noted that the language used in this specification has been selected solely for the purposes of readability and explanation, and not to define or limit the subject matter of the present invention.
[0010] For a better understanding of the various described embodiments, reference should be made to the following Detailed Description of the Invention in conjunction with the following drawings, in which like reference numerals refer to corresponding parts throughout: [Brief explanation of the drawings]
[0011] [Figure 1] 1 illustrates an operating environment for a computer system for providing an extended reality (XR) experience, according to some embodiments.
[0012] [Figure 2] FIG. 1 is a block diagram illustrating a controller of a computer system configured to manage and coordinate a user's XR experience, according to some embodiments.
[0013] [Figure 3] FIG. 1 is a block diagram illustrating display generation components of a computer system configured to provide a visual component of an XR experience to a user, according to some embodiments.
[0014] [Figure 4] 1 illustrates a hand tracking unit of a computer system configured to capture a user's gesture input, according to some embodiments.
[0015] [Figure 5]1 illustrates an eye-tracking unit of a computer system configured to capture a user's gaze input, according to some embodiments.
[0016] [Figure 6] 1 is a flowchart illustrating a glint-assisted gaze tracking pipeline, according to some embodiments.
[0017] [Figure 7A] 1 illustrates an exemplary user interface for automatically applying one or more user settings based on a user's identity, according to some embodiments. [Figure 7B] 1 illustrates an exemplary user interface for automatically applying one or more user settings based on a user's identity, according to some embodiments. [Figure 7C] 1 illustrates an exemplary user interface for automatically applying one or more user settings based on a user's identity, according to some embodiments. [Figure 7D] 1 illustrates an exemplary user interface for automatically applying one or more user settings based on a user's identity, according to some embodiments. [Figure 7E] 1 illustrates an exemplary user interface for automatically applying one or more user settings based on a user's identity, according to some embodiments. [Figure 7F] 1 illustrates an exemplary user interface for automatically applying one or more user settings based on a user's identity, according to some embodiments. [Figure 7G] 1 illustrates an exemplary user interface for automatically applying one or more user settings based on a user's identity, according to some embodiments. [Figure 7H] 1 illustrates an exemplary user interface for automatically applying one or more user settings based on a user's identity, according to some embodiments.
[0018] [Figure 8]FIG. 1 is a flow diagram illustrating an example process for automatically applying one or more user settings based on a user's identification, according to some embodiments.
[0019] [Figure 9A] 1 illustrates an exemplary user interface for automatically applying and displaying a user avatar based on a user's identity, according to some embodiments. [Figure 9B] 1 illustrates an exemplary user interface for automatically applying and displaying a user avatar based on a user's identity, according to some embodiments. [Figure 9C] 1 illustrates an exemplary user interface for automatically applying and displaying a user avatar based on a user's identity, according to some embodiments. [Figure 9D] 1 illustrates an exemplary user interface for automatically applying and displaying a user avatar based on a user's identity, according to some embodiments. [Figure 9E] 1 illustrates an exemplary user interface for automatically applying and displaying a user avatar based on a user's identity, according to some embodiments. [Figure 9F] 1 illustrates an exemplary user interface for automatically applying and displaying a user avatar based on a user's identity, according to some embodiments.
[0020] [Figure 10A] FIG. 1 is a flow diagram illustrating an example process for automatically applying one or more device calibration settings based on a user's identification, according to some embodiments. [Figure 10B] FIG. 1 is a flow diagram illustrating an example process for automatically applying one or more device calibration settings based on a user's identification, according to some embodiments.
[0021] [Figure 11A]1 illustrates an exemplary user interface for automatically applying and displaying a user avatar based on a user's identity, according to some embodiments. [Figure 11B] 1 illustrates an exemplary user interface for automatically applying and displaying a user avatar based on a user's identity, according to some embodiments. [Figure 11C] 1 illustrates an exemplary user interface for automatically applying and displaying a user avatar based on a user's identity, according to some embodiments. [Figure 11D] 1 illustrates an exemplary user interface for automatically applying and displaying a user avatar based on a user's identity, according to some embodiments. [Figure 11E] 1 illustrates an exemplary user interface for automatically applying and displaying a user avatar based on a user's identity, according to some embodiments. [Figure 11F] 1 illustrates an exemplary user interface for automatically applying and displaying a user avatar based on a user's identity, according to some embodiments.
[0022] [Figure 12A] FIG. 1 is a flow diagram illustrating an exemplary process for automatically applying and displaying a user avatar based on a user's identity, according to some embodiments. [Figure 12B] FIG. 1 is a flow diagram illustrating an exemplary process for automatically applying and displaying a user avatar based on a user's identity, according to some embodiments.
[0023] [Figure 13A] 1 illustrates an exemplary user interface for displaying content based on handover criteria, according to some embodiments. [Figure 13B] 1 illustrates an exemplary user interface for displaying content based on handover criteria, according to some embodiments. [Figure 13C]1 illustrates an exemplary user interface for displaying content based on handover criteria, according to some embodiments. [Figure 13D] 1 illustrates an exemplary user interface for displaying content based on handover criteria, according to some embodiments. [Figure 13E] 1 illustrates an exemplary user interface for displaying content based on handover criteria, according to some embodiments. [Figure 13F] 1 illustrates an exemplary user interface for displaying content based on handover criteria, according to some embodiments. [Figure 13G] 1 illustrates an exemplary user interface for displaying content based on handover criteria, according to some embodiments. [Figure 13H] 1 illustrates an exemplary user interface for displaying content based on handover criteria, according to some embodiments. [Figure 13I] 1 illustrates an exemplary user interface for displaying content based on handover criteria, according to some embodiments. [Figure 13J] 1 illustrates an exemplary user interface for displaying content based on handover criteria, according to some embodiments. [Figure 13K] 1 illustrates an exemplary user interface for displaying content based on handover criteria, according to some embodiments.
[0024] [Figure 14A] 1 illustrates an exemplary user interface for displaying content based on handover criteria, according to some embodiments. [Figure 14B] 1 illustrates an exemplary user interface for displaying content based on handover criteria, according to some embodiments. DETAILED DESCRIPTION OF THE INVENTION
[0025] The present disclosure relates to a user interface that provides an extended reality (XR) experience to a user, according to some embodiments.
[0026] The systems, methods, and GUIs described herein improve user interface interaction with virtual / augmented reality environments in several ways.
[0027] In some embodiments, the computer system automatically applies and / or enables one or more user settings based on the user's identification. The computer system is in communication with a display generation component and one or more input devices. The computer system detects that at least a portion of the computer system has been placed on the individual user's body. In response to detecting that the computer system has been placed on the individual user's body and in accordance with a determination that the biometric information received via the one or more input devices corresponds to a first enrolled user, the computer system enables the computer system to be used with one or more settings associated with a first user account associated with the first enrolled user. In response to detecting that the computer system has been placed on the individual user's body and in accordance with a determination that the biometric information received via the one or more input devices does not correspond to the first enrolled user, the computer system ceases to enable the computer system to be used with one or more settings associated with the first user account associated with the first enrolled user.
[0028] In some embodiments, the computer system automatically applies device calibration settings based on the identification of the user. The computer system is in communication with the display generation component and one or more input devices. The computer system detects that at least a portion of the computer system is placed on the individual user's body. After detecting that at least a portion of the computer system is placed on the individual user's body, the computer system detects input from the individual user based on a movement or position of at least a portion of the individual user's body. In response to detecting the input from the individual user, the computer system responds to the input from the individual user. In accordance with determining that the individual user is a first user previously registered with the computer system, the computer system generates a response to the input based on the movement or position of the individual user's body portion and a first set of device calibration settings specific to the first user. In accordance with determining that the individual user is not the first user, the computer system generates a response to the input based on the movement or position of the individual user's body portion and without using the first set of device calibration settings specific to the first user.
[0029] In some embodiments, a first computer system displays a digital avatar based on the user's identification. The first computer system is in communication with a display generation component and one or more input devices. The first computer system detects a request to display an avatar for a user of the individual computer system. In response to detecting the request to display the avatar, the first computer system displays the avatar for the user of the individual computer system. In accordance with a determination that the user of the individual computer system is a registered user of the individual computer system, the first computer system displays an avatar having an appearance selected by the user of the individual computer system, the avatar moving based on the user's movements detected by one or more sensors of the individual computer system. In accordance with a determination that the user of the individual computer system is not a registered user of the individual computer system, the first computer system displays an avatar having a placeholder appearance that is not representative of the user's appearance, the avatar moving based on the user's movements detected by one or more sensors of the individual computer system.
[0030] In some embodiments, the computer system displays content based on the user's identification and based on handover criteria. The computer system is in communication with a display generation component and one or more input devices. While the computer system is located on a first user's body, the computer system displays a first user interface corresponding to a first application via the display generation component, the first user interface being displayed in a first mode with authorized access to a plurality of features associated with the first user. While the first user interface is displayed in the first mode with authorized access to a plurality of features associated with the first user, the computer system detects via the one or more input devices that the computer system has been removed from the first user's body. After detecting that the computer system has been removed from the first user's body, the computer system detects via the one or more input devices that the computer system has been placed on an individual user's body. In response to detecting that the computer system has been placed on an individual user's body and in accordance with determining that biometric information received via the one or more input devices corresponds to the first user, the computer system displays via the display generation component the first user interface in the first mode with authorized access to a plurality of features associated with the first user. In response to detecting that the computer system has been placed on the body of an individual user, and in accordance with a determination that the biometric information received via the one or more input devices does not correspond to the first user and the set of handover criteria has been met, the computer system, via the display generation component, displays the first user interface in a second mode having limited access to one or more of the plurality of features associated with the first user.
[0031] FIGS. 1-6 illustrate an exemplary computer system for providing an XR experience to a user. FIGS. 7A-7H illustrate exemplary user interfaces for automatically applying one or more user settings based on a user's identification. FIG. 8 is a flow diagram illustrating a method for automatically applying one or more user settings based on a user's identification, according to some embodiments. The user interfaces of FIGS. 7A-7H are used to illustrate processes described below, including the process of FIG. 8. FIGS. 9A-9F illustrate exemplary user interfaces for automatically applying one or more device calibration settings based on a user's identification. FIGS. 10A-10B are flow diagrams illustrating a method for automatically applying one or more device calibration settings based on a user's identification, according to some embodiments. The user interfaces of FIGS. 9A-9F are used to illustrate processes described below, including the process of FIGS. 10A-10B. FIGS. 11A-11F illustrate exemplary user interfaces for automatically applying and displaying a user avatar based on a user's identification. FIGS. 12A-12B are flow diagrams illustrating a method for automatically applying and displaying a user avatar based on a user's identification, according to some embodiments. The user interfaces of Figures 11A-11F are used to illustrate the processes described below, including the processes of Figures 12A-12B. Figures 13A-13K show exemplary user interfaces for displaying content based on handover criteria. Figures 14A-14B are flow diagrams illustrating methods for displaying content based on handover criteria, according to some embodiments. The user interfaces of Figures 13A-13K are used to illustrate the processes described below, including the processes of Figures 14A-14B.
[0032] 1, an XR experience is provided to a user via an operating environment 100 that includes a computer system 101. The computer system 101 includes a controller 110 (e.g., a processor of a portable electronic device or a remote server), a display generation component 120 (e.g., a head-mounted device (HMD), a display, a projector, a touchscreen, etc.), one or more input devices 125 (e.g., an eye-tracking device 130, a hand-tracking device 140, other input devices 150), one or more output devices 155 (e.g., a speaker 160, a tactile output generator 170, and other output devices 180), one or more sensors 190 (e.g., an image sensor, a light sensor, a depth sensor, a tactile sensor, an orientation sensor, a proximity sensor, a temperature sensor, a position sensor, a motion sensor, a velocity sensor, etc.), and optionally one or more peripheral devices 195 (e.g., a consumer electronics device, a wearable device, etc.). In some embodiments, one or more of the input device 125, the output device 155, the sensor 190, and the peripheral device 195 are integrated with the display generation component 120 (e.g., within a head-mounted or handheld device).
[0033] When describing an XR experience, various terms are used to individually refer to several related, but distinct, environments that a user can sense and / or interact with (e.g., using inputs detected by the computer system 101 generating the XR experience that cause the computer system generating the XR experience to generate audio, visual, and / or haptic feedback corresponding to various inputs provided to the computer system 101). The following is a subset of these terms:
[0034] Physical Environment: The physical environment refers to the physical world that people can sense and / or interact with without the aid of electronic systems. A physical environment, such as a physical park, includes physical objects such as physical trees, physical buildings, and physical people. People can directly sense and / or interact with the physical environment through their senses, such as sight, touch, hearing, taste, and smell.
[0035] Augmented reality: In contrast, an augmented reality (XR) environment refers to a wholly or partially simulated environment that people sense and / or interact with through electronic systems. In XR, a subset of a person's physical movements or representations thereof are tracked, and one or more properties of one or more virtual objects simulated within the XR environment are adjusted accordingly to behave according to at least one law of physics. For example, an XR system may detect the rotation of a person's head and adjust the graphical content and sound field presented to the person accordingly, in a manner similar to how such views and sounds change in a physical environment. In some circumstances (e.g., for accessibility reasons), adjustments to the property(ies) of a virtual object(s) in an XR environment may be made in response to representations of physical movements (e.g., voice commands). A person may sense and / or interact with an XR object using any one of these senses, including sight, hearing, touch, taste, and smell. For example, a person may sense and / or interact with audio objects that create a 3D or spatial audio environment that provides the perception of a point audio source in 3D space. In another example, audio objects may enable audio transparency that selectively incorporates ambient sounds from the physical environment, with or without computer-generated audio. In some XR environments, a person may sense and / or interact with only audio objects.
[0036] Examples of XR include virtual reality and mixed reality.
[0037] Virtual Reality: A virtual reality (VR) environment refers to an emulated environment designed to be based entirely on computer-generated sensory input for one or more senses. A VR environment includes multiple virtual objects that a person can sense and / or interact with. For example, computer-generated images of trees, buildings, and avatars representing people are examples of virtual objects. A person can sense and / or interact with virtual objects in a VR environment through a simulation of the person's presence in the computer-generated environment and / or through a simulation of a subset of the person's physical movements in the computer-generated environment.
[0038] Mixed Reality: A mixed reality (MR) environment refers to a mimicked environment designed to incorporate sensory input from or representations of a physical environment in addition to including computer-generated sensory input (e.g., virtual objects), as opposed to a VR environment designed to be based entirely on computer-generated sensory input. On a virtuality continuum, a mixed reality environment is anywhere between, but not including, a fully physical environment at one end and a virtual reality environment at the other. In some MR environments, computer-generated sensory input may respond to changes in sensory input from the physical environment. Some electronic systems for presenting MR environments may also track location and / or orientation relative to the physical environment to allow virtual objects to interact with real objects (i.e., physical items or representations thereof from the physical environment). For example, the system may take into account movement so that a virtual tree appears stationary relative to the physical ground.
[0039] Examples of mixed reality include augmented reality and augmented virtuality.
[0040] Augmented reality: An augmented reality (AR) environment refers to a simulated environment in which one or more virtual objects are superimposed on a physical environment or a representation thereof. For example, an electronic system for presenting an AR environment may have a transparent or translucent display through which a person can directly view the physical environment. The system may be configured to present virtual objects on the transparent or translucent display, whereby a person using the system perceives the virtual objects superimposed on the physical environment. Alternatively, the system may have an opaque display and one or more imaging sensors that capture images or videos of the physical environment, which are representations of the physical environment. The system composites the images or videos with virtual objects and presents the composite on the opaque display. The person uses the system to indirectly view the physical environment through the images or videos of the physical environment and perceive the virtual objects superimposed on the physical environment. As used herein, video of a physical environment shown on an opaque display is referred to as "pass-through video," meaning that the system captures images of the physical environment using one or more image sensors and uses those images in presenting the AR environment on the opaque display. Alternatively, the system may include a projection system that projects virtual objects, e.g., as holograms, into the physical environment or onto a physical surface, such that a person using the system perceives the virtual objects superimposed on the physical environment. An augmented reality environment also refers to a mimicked environment in which a representation of the physical environment is transformed by computer-generated sensory information. For example, when providing pass-through video, the system may distort one or more sensor images to impose a selected perspective (e.g., viewpoint) different from the perspective captured by the imaging sensor. As another example, the representation of the physical environment may be distorted by graphically altering (e.g., magnifying) a portion thereof, thereby rendering the altered portion a non-photorealistic, altered version of the originally captured image. As a further example, the representation of the physical environment may be distorted by graphically removing or obscuring a portion thereof.
[0041] Augmented Virtuality: An augmented virtuality (AV) environment refers to a mimicking environment in which a virtual or computer-generated environment incorporates one or more sensory inputs from a physical environment. The sensory inputs may be representations of one or more characteristics of the physical environment. For example, an AV park may have virtual trees and virtual buildings, while people with faces are realistically recreated from images of physical people. As another example, virtual objects may adopt the shape or color of physical items imaged by one or more imaging sensors. As a further example, virtual objects may adopt shadows that match the position of the sun in the physical environment.
[0042] Hardware: There are many different types of electronic systems that enable a person to sense and / or interact with various XR environments. Examples include head-mounted systems, projection-based systems, heads-up displays (HUDs), vehicle windshields with integrated display capabilities, windows with integrated display capabilities, displays formed as lenses designed to be placed over a person's eyes (e.g., similar to contact lenses), headphones / earphones, speaker arrays, input systems (e.g., wearable or handheld controllers with or without haptic feedback), smartphones, tablets, and desktop / laptop computers. A head-mounted system may have one or more speaker(s) and an integrated opaque display. Alternatively, a head-mounted system may be configured to accept an external opaque display (e.g., a smartphone). A head-mounted system may incorporate one or more imaging sensors for capturing images or video of the physical environment and / or one or more microphones for capturing audio of the physical environment. A head-mounted system may have a transparent or translucent display rather than an opaque display. The transparent or translucent display may have a medium through which light representing an image is directed to a person's eyes. The display may utilize digital light projection, OLED, LED, uLED, liquid crystal on silicon, laser-scanned light source, or any combination of these technologies. The medium may be a light guide, a holographic medium, an optical combiner, an optical reflector, or any combination thereof. In one embodiment, the transparent or translucent display may be configured to be selectively opaque. A projection-based system may employ retinal projection technology that projects a graphical image onto a person's retina. The projection system may also be configured to project virtual objects into the physical environment, for example, as a hologram or onto a physical surface.
[0043] In some embodiments, controller 110 is configured to manage and coordinate the XR experience for the user. In some embodiments, controller 110 includes a suitable combination of software, firmware, and / or hardware. Controller 110 is described in more detail below with reference to FIG. 2. In some embodiments, controller 110 is a computing device that is local or remote to scene 105 (e.g., the physical environment). For example, controller 110 is a local server located within scene 105. In another example, controller 110 is a remote server (e.g., a cloud server, a central server, etc.) located outside scene 105. In some embodiments, controller 110 is communicatively coupled to display generation component 120 (e.g., an HMD, a display, a projector, a touchscreen, etc.) via one or more wired or wireless communication channels 144 (e.g., BLUETOOTH, IEEE 802.11x, IEEE 802.16x, IEEE 802.3x, etc.). In another example, the controller 110 is contained within the housing (e.g., physical housing) of, or shares the same physical housing or support structure as, one or more of the display generation component 120 (e.g., an HMD or a portable electronic device including a display and one or more processors), one or more of the input devices 125, one or more of the output devices 155, one or more of the sensors 190, and / or one or more of the peripheral devices 195.
[0044] In some embodiments, display generation component 120 is configured to provide an XR experience (e.g., at least a visual component of an XR experience) to a user. In some embodiments, display generation component 120 includes a suitable combination of software, firmware, and / or hardware. Display generation component 120 is described in more detail below with reference to FIG. 3. In some embodiments, functionality of controller 110 is provided by and / or combined with display generation component 120.
[0045] According to some embodiments, the display generation component 120 provides an XR experience to the user while the user is virtually and / or physically present in the scene 105.
[0046] In some embodiments, the display generation component is worn on a part of the user's body (e.g., on their head, their hand, etc.). Thus, display generation component 120 includes one or more XR displays provided for displaying XR content. For example, in various embodiments, display generation component 120 surrounds the user's field of view. In some embodiments, display generation component 120 is a handheld device (e.g., a smartphone or tablet) configured to present XR content, where the user holds the device with a display pointed toward the user's field of view and a camera pointed toward scene 105. In some embodiments, the handheld device is optionally located within a housing worn on the user's head. In some embodiments, the handheld device is optionally located on a support (e.g., a tripod) in front of the user. In some embodiments, display generation component 120 is an XR chamber, housing, or room configured to present XR content without the user wearing or holding display generation component 120. Many user interfaces described with reference to one type of hardware for displaying XR content (e.g., a handheld device or a tripod-mounted device) may be implemented on another type of hardware for displaying XR content (e.g., an HMD or other wearable computing device). For example, a user interface showing interactions with XR content triggered based on interactions occurring in the space in front of a handheld or tripod-mounted device may be implemented similarly to an HMD in which the interactions occur in the space in front of the HMD and the XR content responses are displayed via the HMD. Similarly, a user interface showing interactions with XR content triggered based on movement of a handheld or tripod-mounted device relative to the physical environment (e.g., scene 105 or a part of the user's body (e.g., the user's eye(s), head, or hands)) may be implemented similarly to an HMD in which the interactions occur in the space in front of the HMD and the XR content responses are displayed via the HMD.
[0047] While relevant features of operating environment 100 are shown in FIG. 1, those skilled in the art will understand from this disclosure that various other features have not been shown for the sake of brevity so as not to obscure more pertinent aspects of the exemplary embodiments disclosed herein.
[0048] 2 is a block diagram of an example controller 110, according to some embodiments. While certain features are shown, those skilled in the art will understand from this disclosure that various other features are not shown for the sake of brevity so as not to obscure more pertinent aspects of the embodiments disclosed herein. Thus, by way of non-limiting example, in some embodiments, the controller 110 includes one or more processing units 202 (e.g., a microprocessor, an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a graphics processing unit (GPU), a central processing unit (CPU), a processing core, etc.), one or more input / output (I / O) devices 206, one or more communication interfaces 208 (e.g., Universal Serial Bus (USB), FIREWIRE, THUNDERBOLT, IEEE 802.3x, IEEE 802.11x, IEEE 802.16x, Global System for Mobile Communications (GSM), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Global Positioning System (GPS), Infrared (IR), BLUETOOTH, ZIGBEE, or similar types of interfaces), one or more programming (e.g., I / O) interfaces 210, memory 220, and one or more communication buses 204 for interconnecting these and various other components.
[0049] In some embodiments, one or more communication buses 204 include circuitry that interconnects and controls communication between system components. In some embodiments, one or more I / O devices 206 include at least one of a keyboard, a mouse, a touchpad, a joystick, one or more microphones, one or more speakers, one or more image sensors, one or more displays, etc.
[0050] Memory 220 includes high-speed random-access memory, such as dynamic random-access memory (DRAM), static random-access memory (SRAM), double-data-rate random-access memory (DDRRAM), or other random-access solid-state memory devices. In some embodiments, memory 220 includes non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 220 optionally includes one or more storage devices located remotely from one or more processing units 202. Memory 220 includes a non-transitory computer-readable storage medium. In some embodiments, memory 220, or its non-transitory computer-readable storage medium, stores the following programs, modules, and data structures, or a subset thereof, including optional operating system 230 and XR experience module 240:
[0051] Operating system 230 includes instructions for handling various basic system services and for performing hardware-dependent tasks. In some embodiments, XR experience module 240 is configured to manage and coordinate one or more XR experiences for one or more users (e.g., a single XR experience for one or more users, or multiple XR experiences for respective groups of one or more users). To that end, in various embodiments, XR experience module 240 includes a data acquisition unit 242, a tracking unit 244, an adjustment unit 246, and a data transmission unit 248.
[0052] 1 , and optionally from one or more of input devices 125, output devices 155, sensors 190, and / or peripheral devices 195. To that end, in various embodiments, data acquisition unit 242 includes instructions and / or logic therefor, as well as heuristics and metadata therefor.
[0053] In some embodiments, tracking unit 244 is configured to map scene 105 and track the position / location of at least display generation component 120 relative to scene 105 of FIG. 1 , and optionally, the position / location of one or more of input device 125, output device 155, sensor 190, and / or peripheral device 195. To that end, in various embodiments, tracking unit 244 includes instructions and / or logic therefor, as well as heuristics and metadata therefor. In some embodiments, tracking unit 244 includes hand tracking unit 243 and / or eye tracking unit 245. In some embodiments, hand tracking unit 243 is configured to track the position / location of one or more parts of a user's hand and / or the movement of one or more parts of a user's hand relative to scene 105 of FIG. 1 , relative to display generation component 120, and / or relative to a coordinate system defined relative to the user's hand. Hand tracking unit 243 is described in more detail below with respect to FIG. 4. In some embodiments, eye tracking unit 245 is configured to track the position and movement of the user's gaze (or, more broadly, the user's eyes, face, or head) relative to scene 105 (e.g., relative to the physical environment and / or the user (e.g., the user's hands)), or relative to XR content displayed via display generation component 120. Eye tracking unit 245 is described in more detail below with respect to FIG. 5.
[0054] In some embodiments, coordination unit 246 is configured to manage and coordinate the XR experience presented to the user by display generation component 120 and, optionally, by one or more of output devices 155 and / or peripheral devices 195. To that end, in various embodiments, coordination unit 246 includes instructions and / or logic therefor, as well as heuristics and metadata therefor.
[0055] In some embodiments, data transmission unit 248 is configured to transmit data (e.g., presentation data, location data, etc.) to at least display generation component 120, and optionally to one or more of input device 125, output device 155, sensor 190, and / or peripheral device 195. To that end, in various embodiments, data transmission unit 248 includes instructions and / or logic therefor, as well as heuristics and metadata therefor.
[0056] Although the data acquisition unit 242, the tracking unit 244 (e.g., including the eye tracking unit 243 and the hand tracking unit 244), the adjustment unit 246, and the data transmission unit 248 are shown as being present on a single device (e.g., the controller 110), it should be understood that in other embodiments, any combination of the data acquisition unit 242, the tracking unit 244 (e.g., including the eye tracking unit 243 and the hand tracking unit 244), the adjustment unit 246, and the data transmission unit 248 may be located within separate computing devices.
[0057] Furthermore, Figure 2 is intended more to illustrate the functionality of various features that may be present in particular embodiments, as opposed to a structural overview of the embodiments described herein. As will be recognized by those skilled in the art, items shown separately may be combined and some items may be separated. For example, some functional modules shown separately in Figure 2 may be implemented within a single module, and various functions of a single functional block may be performed by one or more functional blocks in various embodiments. The actual number of modules, as well as the division of specific functions and how functions are allocated among them, will vary depending on implementation and, in some embodiments, will depend in part on the particular combination of hardware, software, and / or firmware selected for a particular implementation.
[0058] 3 is a block diagram of an example of a display generation component 120, according to some embodiments. While certain features are shown, those skilled in the art will understand from this disclosure that, for the sake of brevity, various other features are not shown so as not to obscure more pertinent aspects of the embodiments disclosed herein. To that end, by way of non-limiting example, in some embodiments, the display generation component 120 (e.g., an HMD) includes one or more processing units 302 (e.g., a microprocessor, an ASIC, an FPGA, a GPU, a CPU, a processing core, etc.), one or more input / output (I / O) devices and sensors 306, one or more communication interfaces 308 (e.g., USB, FIREWIRE, THUNDERBOLT, IEEE 802.3x, IEEE 802.11x, IEEE 802.16x, GSM, CDMA, TDMA, GPS, infrared, BLUETOOTH, ZIGBEE, and / or similar types of interfaces), one or more programming (e.g., I / O) interfaces 310, one or more XR displays 312, one or more optional inward-facing and / or outward-facing image sensors 314, memory 320, and one or more communication buses 304 for interconnecting these and various other components.
[0059] In some embodiments, the one or more communication buses 304 include circuitry that interconnects and controls communication between the system components. In some embodiments, the one or more I / O devices and sensors 306 include at least one of an inertial measurement unit (IMU), an accelerometer, a gyroscope, a thermometer, one or more physiological sensors (e.g., a blood pressure monitor, a heart rate monitor, a blood oxygen sensor, a blood glucose sensor, etc.), one or more microphones, one or more speakers, a haptic engine, one or more depth sensors (e.g., structured light, time of flight, etc.), etc.
[0060] In some embodiments, the one or more XR displays 312 are configured to provide an XR experience to a user. In some embodiments, the one or more XR displays 312 correspond to holographic, digital light processing (DLP), liquid crystal display (LCD), liquid crystal on silicon (LCoS), organic light-emitting field-effect transistor (OLET), organic light-emitting diode (OLED), surface-conduction electron-emissive element display (SED), field-emission display (FED), quantum dot light-emitting diode (QD-LED), MEMS, and / or similar display types. In some embodiments, the one or more XR displays 312 correspond to waveguide displays, such as diffractive, reflective, polarized, holographic, etc. For example, the display generation component 120 (e.g., an HMD) includes a single XR display. In another example, the display generation component 120 includes an XR display for each eye of the user. In some embodiments, the one or more XR displays 312 are capable of presenting mixed reality (MR) or virtual reality (VR) content. In some embodiments, the one or more XR displays 312 are capable of presenting mixed reality (MR) or virtual reality (VR) content.
[0061] In some embodiments, the one or more image sensors 314 are configured to acquire image data corresponding to at least a portion of the user's face, including the user's eyes (and may be referred to as eye-tracking cameras). In some embodiments, the one or more image sensors 314 are configured to acquire image data corresponding to at least a portion of the user's hand(s) and optionally the user's arm(s) (and may be referred to as hand-tracking cameras). In some embodiments, the one or more image sensors 314 are configured to face forward to acquire image data corresponding to a scene as the user would view it if the display generation component 120 (e.g., an HMD) were not present (and may be referred to as a scene camera). The one or more optional image sensors 314 may include one or more RGB cameras (e.g., with a complementary metal-oxide semiconductor (CMOS) image sensor or a charge-coupled device (CCD) image sensor), one or more infrared (IR) cameras, one or more event-based cameras, and / or the like.
[0062] Memory 320 includes high-speed random-access memory, such as DRAM, SRAM, DDR RAM, or other random-access solid-state memory devices. In some embodiments, memory 320 includes non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 320 optionally includes one or more storage devices located remotely from the one or more processing units 302. Memory 320 includes a non-transitory computer-readable storage medium. In some embodiments, memory 320, or its non-transitory computer-readable storage medium, stores the following programs, modules, and data structures, or a subset thereof, including an optional operating system 330 and an XR presentation module 340:
[0063] The operating system 330 includes instructions for handling various basic system services and for performing hardware-dependent tasks. In some embodiments, the XR presentation module 340 is configured to present XR content to a user via one or more XR displays 312. To that end, in various embodiments, the XR presentation module 340 includes a data acquisition unit 342, an XR presentation unit 344, an XR map generation unit 346, and a data transmission unit 348.
[0064] In some embodiments, the data acquisition unit 342 is configured to acquire data (e.g., presentation data, interaction data, sensor data, location data, etc.) from at least the controller 110 of Figure 1. To that end, in various embodiments, the data acquisition unit 342 includes instructions and / or logic therefor, as well as heuristics and metadata therefor.
[0065] In some embodiments, the XR presentation unit 344 is configured to present XR content via one or more XR displays 312. To that end, in various embodiments, the XR presentation unit 344 includes instructions and / or logic therefor, as well as heuristics and metadata therefor.
[0066] In some embodiments, the XR map generation unit 346 is configured to generate an XR map (e.g., a 3D map of a mixed reality scene or a map of a physical environment in which computer-generated objects can be placed to generate an augmented reality) based on the media content data. To that end, in various embodiments, the XR map generation unit 346 includes instructions and / or logic therefor, as well as heuristics and metadata therefor.
[0067] In some embodiments, data transmission unit 348 is configured to transmit data (e.g., presentation data, location data, etc.) to at least controller 110, and optionally to one or more of input device 125, output device 155, sensor 190, and / or peripheral device 195. To that end, in various embodiments, data transmission unit 348 includes instructions and / or logic therefor, as well as heuristics and metadata therefor.
[0068] Although the data acquisition unit 342, the XR presentation unit 344, the XR map generation unit 346, and the data transmission unit 348 are shown as residing on a single device (e.g., the display generation component 120 of FIG. 1), it should be understood that in other embodiments, any combination of the data acquisition unit 342, the XR presentation unit 344, the XR map generation unit 346, and the data transmission unit 348 may be located in separate computing devices.
[0069] Furthermore, Figure 3 is intended more to illustrate the functionality of various features that may be present in particular implementations, as opposed to a structural overview of the embodiments described herein. As will be recognized by those skilled in the art, items shown separately can be combined and some items can be separated. For example, some functional modules shown separately in Figure 3 can be implemented within a single module, and various functions of a single functional block can be performed by one or more functional blocks in various embodiments. The actual number of modules, as well as the division of specific functions and how functions are allocated among them, will vary from implementation to implementation and, in some embodiments, will depend in part on the particular combination of hardware, software, and / or firmware selected for a particular implementation.
[0070] 4 is a schematic diagram of an example embodiment of a hand tracking device 140. In some embodiments, hand tracking device 140 (FIG. 1) is controlled by hand tracking unit 243 (FIG. 2) to track the position / location of one or more parts of a user's hand and / or the movement of one or more parts of a user's hand relative to scene 105 of FIG. 1 (e.g., relative to parts of the physical environment surrounding the user, relative to display generation component 120, or relative to parts of the user (e.g., the user's face, eyes, or head), and / or relative to a coordinate system defined relative to the user's hand. In some embodiments, hand tracking device 140 is part of display generation component 120 (e.g., embedded in or attached to a head-mounted device). In some embodiments, hand tracking device 140 is separate from display generation component 120 (e.g., located in a separate housing or attached to a separate physical support structure).
[0071] In some embodiments, the hand tracking device 140 includes an image sensor 404 (e.g., one or more IR cameras, 3D cameras, depth cameras, and / or color cameras) that captures three-dimensional scene information including at least the hand 406 of a human user. The image sensor 404 captures hand images with sufficient resolution to allow for differentiation of the fingers and their respective positions. The image sensor 404 typically captures images of other parts of the user's body, or all of the body, and can have either zoom capabilities or a dedicated sensor with high magnification to capture hand images at a desired resolution. In some embodiments, the image sensor 404 also captures 2D color video images of the hand 406 and other elements of the scene. In some embodiments, the image sensor 404 is used in conjunction with or functions as an image sensor that captures the physical environment of the scene 105. In some embodiments, the image sensor 404 is positioned relative to the user or the user's environment such that the field of view of the image sensor or a portion thereof is used to define an interaction space in which hand movements captured by the image sensor are processed as inputs to the controller 110.
[0072] In some embodiments, the image sensor 404 outputs a sequence of frames containing 3D map data (and possibly color image data) to the controller 110, which extracts high-level information from the map data. This high-level information is typically provided via an application program interface (API) to an application running on the controller, which drives the display generation component 120 accordingly. For example, a user can interact with software running on the controller 110 by moving their hand 408 and changing the posture of their hand.
[0073] In some embodiments, the image sensor 404 projects a spot pattern onto a scene containing the hand 406 and captures an image of the projected pattern. In some embodiments, the controller 110 calculates the 3D coordinates of points in the scene (including points on the surface of the user's hand) by triangulation based on the lateral shift of the pattern's spots. This approach is advantageous in that it does not require the user to hold or wear any type of beacon, sensor, or other marker. This provides depth coordinates of points in the scene relative to a predetermined reference plane at a specific distance from the image sensor 404. In this disclosure, the image sensor 404 is assumed to define a set of orthogonal x, y, and z axes such that the depth coordinate of a point in the scene corresponds to the z-component measured by the image sensor. Alternatively, the hand tracking device 440 can use other 3D mapping methods, such as stereoscopic imaging or time-of-flight measurements, based on single or multiple cameras or other types of sensors.
[0074] In some embodiments, the hand tracking device 140 captures and processes a time sequence of depth maps containing the user's hand while the user moves the hand (e.g., the entire hand or one or more fingers). Software running on the image sensor 404 and / or a processor in the controller 110 processes the 3D map data to extract patch descriptors of the hand in these depth maps. The software matches these descriptors with patch descriptors stored in the database 408, based on a previous learning process, to estimate the pose of the hand in each frame. The pose typically includes the 3D locations of the user's wrist joints and fingertips.
[0075] The software can also analyze hand and / or finger trajectories across multiple frames in a sequence to identify gestures. The pose estimation functionality described herein may be interleaved with motion tracking functionality, whereby patch-based pose estimation is performed only once every two (or more) frames, while tracking is used to discover pose changes that occur across the remaining frames. The pose, motion, and gesture information is provided to an application program running on the controller 110 via the API described above. This program can, for example, move and modify an image presented on the display generation component 120 or perform other functions in response to the pose and / or gesture information.
[0076] In some embodiments, the software may be downloaded to the controller 110 in electronic form, for example, over a network, or alternatively may be provided on a tangible, non-transitory medium, such as an optical, magnetic, or electronic memory medium. In some embodiments, the database 408 is similarly stored in memory associated with the controller 110. Alternatively, or additionally, some or all of the described functionality of the computer may be implemented in dedicated hardware, such as a custom or semi-custom integrated circuit or a programmable digital signal processor (DSP). While the controller 110 is shown in FIG. 4 as, by way of example, a separate unit from the image sensor 440, some or all of the processing functionality of the controller may be implemented by a suitable microprocessor and software, or by dedicated circuitry within the housing of the hand tracking device 402, or otherwise associated with the image sensor 404. In some embodiments, at least some of these processing functions may be performed by a suitable processor integrated with the display generation component 120 (e.g., in a television set, handheld device, or head-mounted device) or using any other suitable computerized device, such as a game console or media player. The sensing function of the image sensor 404 may likewise be integrated into a computer or other computerized device that is controlled by the sensor output.
[0077] FIG. 4 also includes a schematic diagram of a depth map 410 captured by the image sensor 404, according to some embodiments. The depth map includes a matrix of pixels having respective depth values, as described above. A pixel 412 corresponding to the hand 406 is segmented from the background and wrist in this map. The intensity of each pixel in the depth map 410 is inversely proportional to the depth value, i.e., the measured z-distance from the image sensor 404, with increasing gray levels corresponding to increasing depth. The controller 110 processes these depth values to identify and segment components of the image (i.e., groups of adjacent pixels) that have characteristics of a human hand. These characteristics can include, for example, the overall size, shape, and frame-to-frame motion of the depth map sequence.
[0078] 4 also schematically illustrates a hand skeleton 414 that the controller 110 ultimately extracts from the depth map 410 of the hand 406, according to some embodiments. In FIG. 4, the skeleton 414 is superimposed on a hand background 416 that was segmented from the original depth map. In some embodiments, key feature points on the hand (e.g., knuckles, fingertips, center of the palm, end of the hand where it connects to the wrist, etc.), and optionally the wrist or arm connected to the hand, are identified and positioned on the hand skeleton 414. In some embodiments, the location and movement of these key feature points over multiple image frames are used by the controller 110 to determine hand gestures performed by the hand or the current state of the hand, according to some embodiments.
[0079] FIG. 5 illustrates an exemplary embodiment of eye tracking device 130 ( FIG. 1 ). In some embodiments, eye tracking device 130 is controlled by eye tracking unit 245 ( FIG. 2 ) to track the position and movement of a user's gaze relative to scene 105 or relative to XR content displayed via display generation component 120. In some embodiments, eye tracking device 130 is integrated with display generation component 120. For example, in some embodiments, if display generation component 120 is a head-mounted device such as a headset, helmet, goggles, or glasses, or a handheld device disposed in a wearable frame, the head-mounted device includes both components for generating XR content for viewing by the user and components for tracking the user's gaze relative to the XR content. In some embodiments, eye tracking device 130 is separate from display generation component 120. For example, if the display generation component is a handheld device or an XR chamber, eye tracking device 130 is optionally a device separate from the handheld device or the XR chamber. In some embodiments, eye tracking device 130 is a head-mounted device or part of a head-mounted device. In some embodiments, head-mounted eye tracking device 130 is optionally used in conjunction with head-mounted or non-head-mounted display generation components. In some embodiments, eye tracking device 130 is not a head-mounted device, and is optionally used in conjunction with head-mounted display generation components. In some embodiments, eye tracking device 130 is not a head-mounted device, and is optionally part of non-head-mounted display generation components.
[0080] In some embodiments, the display generation component 120 uses a display mechanism (e.g., left and right near-eye display panels) that displays frames including left and right images in front of the user's eyes to provide a 3D virtual view to the user. For example, a head-mounted display generation component may include left and right optical lenses (referred to herein as eyepieces) positioned between the display and the user's eyes. In some embodiments, the display generation component may include or be coupled to one or more external video cameras that capture video of the user's environment for display. In some embodiments, the head-mounted display generation component may have a transparent or translucent display that allows the user to view the physical environment directly and display virtual objects on the transparent or translucent display. In some embodiments, the display generation component projects virtual objects into the physical environment. The virtual objects are projected, for example, onto a physical surface or as a hologram, allowing an individual using the system to observe the virtual objects superimposed on the physical environment. In such cases, separate display panels and image frames for the left and right eyes may not be required.
[0081] As shown in FIG. 5 , in some embodiments, the eye-tracking device 130 includes at least one eye-tracking camera (e.g., an infrared (IR) or near-IR (NIR) camera) and an illumination source (e.g., an IR or NIR light source such as an array or ring of LEDs) that emits light (e.g., IR or NIR light) toward the user's eyes. The eye-tracking camera may be aimed at the user's eyes to receive reflected IR or NIR light from the light source directly from the eyes, or alternatively, may be aimed at a “hot” mirror positioned between the user's eyes and a display panel that reflects the IR or NIR light from the eyes to the eye-tracking camera while allowing visual light to pass through. The eye-tracking device 130 optionally captures images of the user's eyes (e.g., as a video stream captured at 60-120 frames per second (fps)), analyzes the images to generate eye-tracking information, and communicates the eye-tracking information to the controller 110. In some embodiments, the user's eyes are tracked separately by their respective eye-tracking cameras and illumination sources. In some embodiments, only one eye of the user is tracked by a separate eye-tracking camera and lighting source.
[0082] In some embodiments, the eye tracking device 130 is calibrated using a device-specific calibration process to determine the eye tracking device's parameters for the particular operating environment 100, such as the 3D geometric relationships and parameters of the LEDs, camera, hot mirror (if present), eyepiece, and display screen. The device-specific calibration process may be performed at a factory or another facility before delivery of the AR / VR equipment to the end user. The device-specific calibration process may be an automatic or manual calibration process. The user-specific calibration process may include estimation of a particular user's eye parameters, such as pupil location, central visual location, optical axis, visual axis, eye spacing, etc. According to some embodiments, once the device-specific and user-specific parameters for the eye tracking device 130 have been determined, images captured by the eye tracking camera can be processed using glint-assisted methods to determine the user's current visual axis and viewpoint relative to the display.
[0083] As shown in FIG. 5, eye tracking device 130 (e.g., 130A or 130B) includes an eyepiece(s) 520 and an eye tracking system including at least one eye tracking camera 540 (e.g., an infrared (IR) or near-IR (NIR) camera) positioned on the side of the user's face where eye tracking occurs and an illumination source 530 (e.g., an IR or NIR light source such as an array or ring of NIR light emitting diodes (LEDs)) that emits light (e.g., IR or NIR light) toward the user's eye(s) 592. The eye tracking camera 540 may be positioned between the user's eye(s) 592 and the display 510 (e.g., the left or right display panel of a head-mounted display, or the display of a handheld device, a projector, etc.) and may be directed at a mirror 550 that reflects IR or NIR light from the eye(s) 592 while transmitting visible light (e.g., as shown at the top of FIG. 5), or may be directed at the user's eye(s) 592 so as to receive reflected IR or NIR light from the user's eye(s) 592 (e.g., as shown at the bottom of FIG. 5).
[0084] In some embodiments, controller 110 renders AR or VR frames 562 (e.g., left and right frames for left and right display panels) and provides frames 562 to display 510. Controller 110 uses gaze tracking input 542 from eye tracking camera 540 for various purposes, such as in processing frames 562 for display. Controller 110 optionally estimates the user's viewpoint on display 510 based on gaze tracking input 542 obtained from eye tracking camera 540, using a glint-assisted method or other suitable method. The viewpoint estimated from gaze tracking input 542 is optionally used to determine the user's current looking direction.
[0085] Some possible use cases of the user's current gaze direction are described below, but are not intended to be limiting. As an exemplary use case, the controller 110 can render virtual content differently based on the determined user's gaze direction. For example, the controller 110 may generate virtual content with higher resolution in a central visual area determined from the user's current gaze direction than in a peripheral area. As another example, the controller may position or move virtual content within a view based at least in part on the user's current gaze direction. As another example, the controller may display particular virtual content within a view based at least in part on the user's current gaze direction. As another exemplary use case in an AR application, the controller 110 can orient an external camera to capture the physical environment of the XR experience and focus in the determined direction. The external camera's autofocus mechanism can then focus on an object or surface within the environment the user is currently viewing on the display 510. As another exemplary use case, eyepiece 520 may be a focusable lens, and eye-tracking information is used by the controller to adjust the focus of eyepiece 520 so that the virtual object the user is currently looking at has the proper binocular coordination to match the convergence of the user's eyes 592. Controller 110 can utilize the eye-tracking information to orient and focus eyepiece 520 so that close objects the user is looking at appear at the correct distance.
[0086] In some embodiments, the eye tracking device is part of a head-mounted device that includes a display (e.g., display 510), two eyepieces (e.g., eyepiece(s) 520), an eye tracking camera (e.g., eye tracking camera(s) 540), and a light source (e.g., light source 530 (e.g., IR or NIR LED)) attached to the wearable housing. The light source emits light (e.g., IR or NIR light) toward the user's eye(s) 592. In some embodiments, the light sources may be arranged in a ring or circle around each lens, as shown in FIG. 5. In some embodiments, eight light sources 530 (e.g., LEDs) are arranged around each lens 520, as an example. However, more or fewer light sources 530 may be used, and other arrangements and locations of the light sources 530 may be employed.
[0087] In some embodiments, the display 510 emits light in the visible light range and not in the IR or NIR range, thereby not introducing noise into the eye-tracking system. Note that the location and angle of the eye-tracking camera(s) 540 are given by way of example and are not intended to be limiting. In some embodiments, a single eye-tracking camera 540 may be located on each side of the user's face. In some embodiments, two or more NIR cameras 540 may be used on each side of the user's face. In some embodiments, a camera 540 with a wider field of view (FOV) and a camera 540 with a narrower FOV may be used on each side of the user's face. In some embodiments, a camera 540 operating at one wavelength (e.g., 850 nm) and a camera 540 operating at a different wavelength (e.g., 940 nm) may be used on each side of the user's face.
[0088] Embodiments of an eye tracking system such as that shown in FIG. 5 may be used, for example, in computer-generated reality, virtual reality, and / or mixed reality applications to provide a user with a computer-generated reality, virtual reality, augmented reality, and / or augmented virtual experience.
[0089] Figure 6 shows a glint-assisted eye tracking pipeline, according to some embodiments. In some embodiments, the eye tracking pipeline is implemented by a glint-assisted eye tracking system (e.g., eye tracking device 130 as shown in Figures 1 and 5). The glint-assisted eye tracking system can maintain a tracking state. Initially, the tracking state is off or "no." When in the tracking state, the glint-assisted eye tracking system tracks the pupil contour and glint in the current frame using prior information from the previous frame when analyzing the current frame. When not in the tracking state, the glint-assisted eye tracking system attempts to detect the pupil and glint in the current frame, and if successful, initializes the tracking state to "yes" and continues to the next frame in the tracking state.
[0090] As shown in FIG. 6, an eye-tracking camera can capture left and right images of a user's left and right eyes. The captured images are then input into an eye-tracking pipeline for processing beginning at 610. As indicated by the arrow returning to element 600, the eye-tracking system can continue to capture images of the user's eyes at a rate of, for example, 60-120 frames per second. In some embodiments, each set of captured images may be input into the pipeline for processing. However, in some embodiments, or under some conditions, not all captured frames are processed by the pipeline.
[0091] At 610, if the tracking status is yes for the currently captured image, the method proceeds to element 640. If the tracking status is no at 610, the image is analyzed to detect the user's pupil and glint in the image, as shown at 620. If the pupil and glint are successfully detected at 630, the method proceeds to element 640. If not, the method returns to element 610 to process the next image of the user's eyes.
[0092] At 640, proceeding from element 610, the current frame is analyzed to track pupils and glints based in part on prior information from the previous frame. At 640, proceeding from element 630, a tracking state is initialized based on the detected pupils and glints in the current frame. The results of the processing at element 640 are checked to ensure that the tracking or detection results are reliable. For example, the results can be checked to determine whether a sufficient number of glints are successfully tracked or detected in the current frame to perform pupil and gaze estimation. At 650, if the results are not reliable, the tracking state is set to no at element 660 and the method returns to element 610 to process the next image of the user's eyes. At 650, if the results are reliable, the method proceeds to element 670. At 670, the tracking state is set to yes (if not already yes) and pupil and glint information is passed to element 680 to estimate the user's gaze point.
[0093] 6 is intended to serve as an example of eye-tracking technology that may be used in particular implementations. As will be recognized by those skilled in the art, other eye-tracking technologies, now existing or developed in the future, may be used in place of or in combination with the glint-assisted eye-tracking technology described herein in computer system 101 to provide a user with an XR experience according to various embodiments.
[0094] In this disclosure, various input methods are described with respect to interaction with a computer system. Where one example is provided using one input device or input method and another example is provided using a different input device or input method, it should be understood that each example may be compatible with, and optionally utilize, the input device or input method described with respect to the other example. Similarly, various output methods are described with respect to interaction with a computer system. Where one example is provided using one output device or output method and another example is provided using a different output device or output method, it should be understood that each example may be compatible with, and optionally utilize, the output device or output method described with respect to the other example. Similarly, various methods are described with respect to interaction with a virtual environment or a mixed reality environment via a computer system. Where an example is provided using interaction with a virtual environment and another example is provided using a mixed reality environment, it should be understood that each example may be compatible with, and optionally utilize, the method described with respect to the other example. Thus, the present disclosure discloses embodiments that are combinations of features of multiple examples, without exhaustively listing all features of the embodiments in the description of each exemplary embodiment. User Interface and Related Processes
[0095] Attention is now directed to embodiments of user interfaces ("UI") and associated processes that may be executed on a computer system, such as a portable multifunction device or a head-mounted device, in communication with a display generation component and (optionally) one or more input devices.
[0096] 7A-7H show exemplary user interfaces for automatically applying one or more user settings based on a user's identity, according to some embodiments. The user interfaces in these figures are used to illustrate processes described below, including the process of FIG.
[0097] 7A shows electronic device 700 that is a smartwatch that includes a touch-sensitive display 702, a rotatable and depressible input mechanism 704 (e.g., rotatable and depressible relative to the device housing or frame), buttons 706, and a camera 708. In some embodiments described below, electronic device 700 is a wearable smartwatch device. In some embodiments, electronic device 700 is a smartphone, tablet, head-mounted system (e.g., headset), or other computer system that includes and / or is in communication with a display device (e.g., display screen, projection device, etc.). Electronic device 700 is a computer system (e.g., computer system 101 of FIG. 1 ).
[0098] 7A , user 703 places electronic device 700 on the user's wrist. Electronic device 700 detects (e.g., via one or more sensors) that electronic device 700 has been placed on the user's body. In some embodiments, electronic device 700 detects that one or more criteria have been met that indicate that electronic device 700 has been placed on the user's body. In some embodiments, if electronic device 700 is a head-mounted system, electronic device 700 detects (e.g., via one or more sensors) that electronic device 700 has been placed on the user's head and / or face.
[0099] 7A , in response to detecting that the electronic device 700 has been placed on the user's body, the electronic device 700 attempts to automatically identify the user 703. In some embodiments, the electronic device 700 may attempt to identify the user 703 in various ways. For example, the electronic device 700 optionally attempts to automatically identify the user based on biometric information, such as facial recognition, eye (e.g., iris) recognition, and / or fingerprint recognition. In FIG. 7A , the electronic device 700 collects biometric information (e.g., a facial scan and / or an eye (e.g., iris) scan using the camera 708) in response to detecting that the electronic device 700 has been placed on the user's body.
[0100] 7B shows a first exemplary scenario in which electronic device 700 identifies user 703 as John, a first registered user (e.g., based on biometric information). For example, electronic device 700 compares the collected biometric information with registered biometric information (of electronic device 700) to identify user 703 as the first registered user (and thereby, optionally, logs user 703 into electronic device 700 using the first user account). In response to identifying user 703 as the first registered user, electronic device 700 displays a personalized user interface 710 corresponding to (e.g., uniquely and / or specifically corresponding to) the first registered user. In the illustrated embodiment, personalized user interface 710 indicates successful login to the first user account associated with the first registered user. In some embodiments, the electronic device 700 logging into a user account associated with the registered user includes displaying a personalization user interface associated with the registered user, applying one or more device settings associated with the registered user (e.g., specified by the registered user), providing access to secure information associated with the registered user, etc. In some embodiments, applying the one or more device settings associated with the registered user includes, for example, applying and / or displaying a visual representation (e.g., an avatar) corresponding to the registered user and / or applying one or more device calibration settings (e.g., eye movement calibration, hand movement calibration, and / or head movement calibration) corresponding to the registered user. The personalization user interface 710 includes a visual indication 712e indicating successful identification of the user 703 as the first registered user and indicating successful login to the first user account associated with the first registered user.
[0101] Personalized user interface 710 includes a time indication 712a and multiple affordances (e.g., a clock face complication). In some embodiments, each affordance is associated with an application on device 700 (e.g., electronic device 700 launches the associated application when the respective affordance is selected, and / or electronic device 700 displays information from the associated application when the respective affordance is selected).
[0102] Physical activity affordance 712b indicates a measured level of physical activity for the first enrolled user and is specific to (e.g., uniquely corresponds to) the first enrolled user. Physical activity complication 712b includes three concentric rings, each ring indicating a different physical activity metric for the first enrolled user. For example, the first ring indicates the number of calories burned by the first enrolled user during the current day, the second ring indicates the number of minutes the user was active during the current day, and the third ring indicates the number of hours during the current day the user was upright for a threshold time or number of times. In the illustrated embodiment, the first ring indicates progress toward a calorie goal, the second ring indicates progress toward a daily target number of exercise minutes, and the third ring indicates progress toward a daily target number of standing hours. Physical activity affordance 712b is optionally based on physical activity of user 703 collected (e.g., by another device and transmitted to electronic device 700) before user 703 wore electronic device 700.
[0103] Weather affordance 712c shows current weather conditions for a particular location. In some embodiments, the particular location is associated with (e.g., selected and / or designated by) a first registered user.
[0104] Calendar affordance 712d indicates one or more upcoming calendar appointments for the first registered user. In some embodiments, the one or more upcoming calendar appointments are identified based on calendar information specific to the first registered user. In Figure 7B, calendar affordance 712d indicates that the next event in the first registered user's calendar is a calendar entry titled "Yoga" at 11:15 AM.
[0105] In some embodiments, personalization user interface 710 is specific to a first registered user, at least in that the first registered user selects and / or specifies one or more aspects of personalization user interface 710. For example, the first registered user selects affordances 712a-d and the displayed locations and / or positions of affordances 712a-d, and the first registered user specifies information for what is displayed in affordances 712a-d (e.g., the first registered user specifies a location for weather affordance 712c and enters calendar information displayed in calendar affordance 712d). Different users will see different affordances and / or different information within each affordance, examples of which are described below with reference to FIG. 7C.
[0106] 7B , electronic device 700 is a smartwatch and shows personalization user interface 710 with a personalization affordance / clock face complication. In some embodiments, electronic device 700 is a head-mounted system (e.g., a headset). In some embodiments in which electronic device 700 is a head-mounted system, personalization user interface 710 includes personalization affordances similar to those described above. In some embodiments in which electronic device 700 is a head-mounted system, personalization user interface 710 includes a personalized virtual environment (e.g., a personalized virtual environment selected by and / or specific to the registered user), a real-time virtual communication session user interface associated with (e.g., specific to) the registered user, and / or one or more application icons associated with (e.g., selected by and / or specific to) the registered user.
[0107] 7C illustrates a second exemplary scenario in which, in response to detecting that electronic device 700 has been placed on the user's body, electronic device 700 identifies user 703 as Sarah, a second registered user (e.g., based on biometric information). In response to identifying user 703 as the second registered user, electronic device 700 displays a second personalization user interface 714 that corresponds (e.g., uniquely and / or specifically) to the second registered user and that is different from personalization user interface 710. In the illustrated embodiment, personalization user interface 714 indicates successful login to a second user account associated with the second registered user. Personalization user interface 714 includes a visual indication 716d indicating successful identification of user 703 as the second registered user and indicating successful login to a second user account associated with the second registered user. In some embodiments, logging into a user account associated with the second registered user includes displaying a personalization user interface associated with the second registered user, applying one or more device settings associated with the second registered user (e.g., specified by the second registered user), providing access to secure information associated with the second registered user, etc. In some embodiments, applying the one or more device settings associated with the second registered user may include, for example, applying and / or displaying a visual representation (e.g., an avatar) corresponding to the second registered user and / or applying one or more device calibration settings (e.g., eye movement calibration, hand movement calibration, and / or head movement calibration) corresponding to the second registered user.
[0108] 7C , personalization user interface 714 has a different visual appearance than personalization user interface 710. For example, personalization user interface 714 has an analog time indication 716a, while personalization user interface 710 has a digital time indication 712a. Personalization user interface 714 has a physical activity affordance 716b that is similar to physical activity affordance 712b of FIG. 7B , but physical activity affordance 716b is displayed in a different position on display 702. In addition, physical activity affordance 716b corresponds to (e.g., is unique to) a second enrolled user and displays physical activity metrics indicative of (e.g., measured based on) the second enrolled user's physical activity (while physical activity affordance 712b displays physical activity metrics indicative of the first enrolled user's physical activity). The personalization user interface 714 also has a heart rate affordance 716c that was selected for inclusion in the personalization user interface 714 by the second registered user, but was not selected for inclusion in the personalization user interface 710 by the first registered user.
[0109] 7C , electronic device 700 is a smartwatch. In some embodiments, electronic device 700 is a head-mounted system (e.g., a headset). In some embodiments in which electronic device 700 is a head-mounted system, personalization user interface 714 includes personalization affordances similar to those described above. In some embodiments in which electronic device 700 is a head-mounted system, personalization user interface 714 includes a personalized virtual environment (e.g., a personalized virtual environment selected by and / or specific to the registered user), a real-time virtual communication session user interface associated with the registered user (e.g., specific to the registered user), and / or one or more application icons associated with the registered user (e.g., selected by and / or specific to the registered user). In some embodiments in which electronic device 700 is a head-mounted system, logging into a user account associated with a second registered user includes displaying a personalization user interface associated with the second registered user, applying one or more device settings associated with the second registered user (e.g., specified by the second registered user), providing access to secure information associated with the second registered user, etc. In some embodiments, applying one or more device settings associated with the second enrolled user may include, for example, applying and / or displaying a visual representation (e.g., an avatar) corresponding to the second enrolled user and / or applying one or more device calibration settings (e.g., eye movement calibration, hand movement calibration, and / or head movement calibration) corresponding to the second enrolled user.
[0110] 7D illustrates a third exemplary scenario in which, in response to detecting that electronic device 700 has been placed on a user's body, electronic device 700 determines that user 703 is not a previously registered user (e.g., electronic device 700 failed to match biometric information from user 703 with stored biometric information of a previously registered user). In response to determining that user 703 is not a previously registered user, electronic device 700 displays guest user interface 718. Guest user interface 718 indicates the identification of user 703 as a guest user (e.g., indicates that user 703 could not be identified as a registered user) and includes visual indication 720g indicating the identification of user 703 as a guest user (e.g., indicates that user 703 could not be identified as a registered user).
[0111] Guest user interface 718 includes (e.g., only) information that is not associated with registered users and is not specific to any individual user. For example, guest user interface 718 includes time of day indication 720a, date affordance 720b, weather affordance 720c, battery level affordance 720e, and air quality affordance 720f.
[0112] 7E illustrates an alternative embodiment of the third exemplary scenario in which the electronic device 700 determines that the user 703 is not a previously registered user (e.g., fails to match biometric information from the user 703 with stored biometric information of a previously registered user). In some embodiments, in response to determining that the user 703 is not a previously registered user, the electronic device 700 displays a user picker user interface 722. The user picker user interface 722 includes selectable objects 724a-724c corresponding to different users. The first selectable object 724a corresponds to John, a first registered user, the second selectable object 724b corresponds to Sarah, a second registered user, and the third selectable object 724c corresponds to an unregistered guest user. Receiving user input corresponding to selection of the first selectable object 724a indicates a request to log in to a first user account associated with the first registered user, receiving user input corresponding to selection of selectable object 724b indicates a request to log in to a second user account associated with the second registered user, and receiving user input corresponding to selection of selectable object 724c indicates a request to display a guest user interface (e.g., guest user interface 718 of FIG. 7D).
[0113] In FIG. 7E, the electronic device 700 detects a user input 726 at a location on the display 702 corresponding to a selectable object 724a corresponding to the first registered user.
[0114] In FIG. 7E, electronic device 700 is a smartwatch. In some embodiments, electronic device 700 is a head-mounted system (e.g., a headset). In some embodiments in which electronic device 700 is a head-mounted system, user picker interface 722 and / or selectable objects 724a-724c are presented within a virtual environment. In FIG. 7E, user input 726 is received via touchscreen input. In some embodiments in which electronic device 700 is a head-mounted system, user input is received based on, for example, eye movements, hand movements, and / or hand gestures by a user to navigate within a displayed user interface (e.g., user picker interface 722) and select various selectable objects (e.g., selectable objects 724a-724c).
[0115] 7F , in response to detecting user input 726, electronic device 700 collects updated biometric information (e.g., face scan information, eye (e.g., retina, iris) scan information, and / or fingerprint information) from user 703 to determine whether user 703 is a first enrolled user (e.g., determine whether the updated biometric information corresponds to the first enrolled user and / or determine whether the updated biometric information corresponds to stored biometric information corresponding to the first enrolled user). If it is determined that the updated biometric information corresponds to the first enrolled user, electronic device 700 (optionally logs into the first user account) displays personalized user interface 710 ( FIG. 7B ) indicating successful login to the first user account associated with the first enrolled user. If it is determined that the updated biometric information does not correspond to the first enrolled user, electronic device 700 abandons logging into the first user account (and abandons displaying personalized user interface 710).
[0116] 7G , in response to determining that the updated biometric information does not correspond to the first enrolled user, electronic device 700 displays passcode entry user interface 728. Passcode entry user interface 728 displays a keypad for the user to enter a passcode corresponding to the first enrolled user. If the user enters the correct passcode (e.g., via touch input 730, voice input, and / or other user input), electronic device 700 logs into the first user account (and optionally displays user interface 710, applies one or more user settings associated with the first user account, and / or provides access to secure content associated with the first user account). If the user does not enter the correct passcode, electronic device 700 abandons logging into the first user account (and optionally abandons displaying user interface 710, abandons applying one or more user settings associated with the first user account, and / or abandons providing access to secure content associated with the first user account).
[0117] In some embodiments, the user is provided with the option to enable or disable automated biometric authentication. In such embodiments, if the user disables automated biometric authentication, the electronic device 700 ceases to store the user's biometric information. In such a scenario, the user logs into their user account, for example, by entering a passcode unique to the user account (e.g., using the passcode entry user interface 728). Thus, in some embodiments, if the first registered user, John, opts out of automated biometric authentication (e.g., disables automated biometric authentication), in response to user input 726 in FIG. 7E, the electronic device 700 optionally ceases attempting automated biometric authentication ( FIG. 7F ) and (e.g., directly) displays the passcode entry user interface 728 ( FIG. 7G ).
[0118] 7F-7G, electronic device 700 is a smartwatch. In some embodiments, electronic device 700 is a head-mounted system (e.g., a headset). In some embodiments where electronic device 700 is a head-mounted system, passcode entry user interface 728 is displayed within the virtual environment. In FIG. 7G, user input 730 is received via touchscreen input. In some embodiments where electronic device 700 is a head-mounted system, user input is received based on, for example, eye movements, hand movements, and / or hand gestures by a user to navigate within the displayed user interface (e.g., passcode entry user interface 728) and select various selectable objects.
[0119] 7H , user 703 removes electronic device 700 from the user's body. Electronic device 700 detects that electronic device 700 is no longer located on the user's body. In response to detecting that electronic device 700 is no longer located on the user's body, electronic device 700 optionally logs out of any user account to which electronic device 700 was logged in and ceases displaying any user interfaces that were displayed. Logging out of a user account may include, for example, ceasing to display a personalized user interface associated with the user account, ceasing to apply one or more user settings associated with the user account, and / or ceasing to provide access to secure content associated with the user account.
[0120] In the illustrated embodiment, electronic device 700 is a smartwatch, and FIGS. 7A-7H show user 703 putting the smartwatch on or removing it from the user's wrist. However, as noted above, in some embodiments, electronic device 700 is a different device, such as a head-mounted system (e.g., a headset) designed to be worn on the user's head. In such embodiments, electronic device 700 may attempt to automatically identify the user when it is determined that electronic device 700 is placed on the user's head (e.g., based on iris recognition and / or facial recognition when electronic device 700 is placed on the user's head). Additionally, in such embodiments, content such as user interfaces 710, 714, 710, 714, 718, 722, and 728 is optionally displayed via a display generation component in communication with the head-mounted system, and one or more user inputs are optionally received via one or more input devices in communication with the head-mounted system.
[0121] 8 is a flow diagram illustrating a method for automatically applying one or more user settings based on an identification of a user using an electronic device, according to some embodiments. Method 800 is performed in a computer system (e.g., 101, 700) (e.g., a smartphone, a tablet, a head-mounted display generation component) in communication with a display generation component (e.g., 702) (e.g., a visual output device, a 3D display, a display having at least a portion that is transparent or translucent onto which an image can be projected (e.g., a see-through display), a projector, a head-up display, a display controller) and one or more input devices (e.g., a camera 708, a touchscreen display 702) (e.g., a touchscreen, an infrared camera, a depth camera, a visible light camera, an eye-tracking device, a hand-tracking device). Some operations of method 800 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.
[0122] As described below, method 800 provides an intuitive way to automatically apply one or more user settings based on a user's identity. This method reduces the cognitive burden on the user in applying one or more user settings, thereby creating a more efficient human-machine interface. For battery-operated computing devices, allowing a user to apply one or more user settings more quickly and efficiently conserves power and extends the time between battery charges.
[0123] In some embodiments, a computer system (e.g., device 700) (e.g., a smartphone, a smartwatch, a tablet, and / or a wearable device) in communication with a display generation component (e.g., display 702) (e.g., a display controller, a touch-sensitive display system, a display (e.g., integrated and / or connected), a 3D display, a see-through display, a projector, and / or a head-up display) and one or more input devices (e.g., 702, 704, 706, 708) (e.g., a touch-sensitive surface (e.g., a touch-sensitive display), a mouse, a keyboard, a remote control, a visual input device (e.g., a camera), an audio input device (e.g., a microphone), and / or a biometric sensor (e.g., a fingerprint sensor, a facial identification sensor, and / or an iris identification sensor)) detects 802 that at least a portion of the computer system has been placed on the body of an individual user (e.g., user 703 of FIG. 7A ).
[0124] In response to detecting 804 that the computer system has been placed on the body of an individual user, and in response to determining 806 that the biometric information (e.g., a fingerprint, an image (e.g., a photograph and / or scan) representing the individual user's face, and / or iris identification information (e.g., iris scan information)) received via one or more input devices corresponds to a first enrolled user (e.g., FIGS. 7A-7B) (e.g., a first enrolled user of a plurality of users) (e.g., a user previously enrolled in the computer system) (e.g., in response to determining that the individual user is the first enrolled user), the computer system enables 808 the computer system to be used with one or more settings associated with (e.g., specified by) a first user account associated with the first enrolled user (e.g., logging the computer system into the first user account) (e.g., displaying personalization user interface 710 of FIG. 7B). In some embodiments, in response to detecting 804 that the computer system has been placed on the body of an individual user, the computer system receives biometric information (e.g., corresponding to the individual user) via one or more input devices. In some embodiments, the biometric information is received while at least a portion of the computer system is worn by an individual user. In some embodiments, the method optionally further includes displaying, via a display generation component, a first user interface (e.g., personalized user interface 710) corresponding to the first enrolled user (in some embodiments, the first user interface indicates successful login to a first user account (e.g., a first user account of a plurality of accounts) corresponding to the first enrolled user).In some embodiments, enabling the computer system to be used with one or more settings associated with the first user account (e.g., logging the computer system into the first user account) includes one or more of applying a first set of user preferences associated with the first user account, providing access to particular encrypted and / or secure user files associated with the first user account, and / or loading calibration information associated with the first user account.
[0125] In response to detecting 804 that the computer system (e.g., 700) has been placed on the individual user's body, and in accordance with determining 810 that the biometric information received via the one or more input devices (e.g., 708) does not correspond to the first enrolled user (e.g., in accordance with determining that the individual user is not the first enrolled user), the computer system discontinues 812 (e.g., FIGS. 7C-7E) (e.g., discontinuing logging into the computer system with the first user account associated with the first enrolled user). In some embodiments, discontinuing to enable the computer system to be used with the one or more settings associated with the first user account associated with the first enrolled user includes discontinuing displaying a first user interface corresponding to the first enrolled user.
[0126] Refusing to allow the computer system to be used with one or more settings associated with the first user account associated with the first registered user when it is determined that the biometric information does not correspond to the first registered user (e.g., by preventing the first user account associated with the first registered user from logging into the computer system) can improve security and prevent unauthorized users from initiating sensitive operations. Refusing to allow the computer system to be used with one or more settings associated with the first user account associated with the first registered user when it is determined that the biometric information does not correspond to the first registered user (e.g., by preventing the first user account associated with the first registered user from logging into the computer system) can also improve device usability (e.g., by limiting unauthorized access), provide a more efficient user-device interface, and reduce power usage and improve device battery life by limiting the execution of restricted operations.
[0127] When biometric information received via one or more input devices is determined to correspond to a first enrolled user, automatically enabling the computer system to be used with one or more settings associated with a first user account associated with the first enrolled user (e.g., automatically logging the computer system into the first user account associated with the first enrolled user) provides the user with the ability to log in to the first user account without having to explicitly request the user to log in. Performing an action when a set of conditions is met without requiring further user input improves device operability (e.g., by performing the action without additional user input), makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs and reducing user errors when operating / interacting with the device), and additionally reduces power usage and improves device battery life by allowing the user to use the device more quickly and efficiently.
[0128] Automatically enabling the computer system to be used with one or more settings associated with the first user account associated with the first registered user when the biometric information is determined to correspond to the first registered user (e.g., automatically logging the computer system into the first user account associated with the first registered user) allows the computer system to be placed in a locked state more frequently and for longer periods of time because it is very easy and convenient for the user to re-enter the logged-in state. Allowing the computer system to be placed in a locked state for longer periods of time improves security. Automatically enabling the computer system to be used with one or more settings associated with the first user account associated with the first registered user when the biometric information is determined to correspond to the first registered user (e.g., automatically logging the computer system into the first user account associated with the first registered user) also improves device usability (e.g., by restricting unauthorized access), makes the user-device interface more efficient, and reduces power usage and improves device battery life by restricting the execution of restricted operations.
[0129] In some embodiments, in response to detecting 804 that the computer system (e.g., 700) has been placed on the body of an individual user, and in response to determining 814 that the biometric information received via the one or more input devices (e.g., 708) does not correspond to the first enrolled user and that the biometric information received via the one or more input devices corresponds to a second enrolled user (e.g., a second enrolled user of a plurality of users) that is different from the first enrolled user (e.g., a user previously enrolled in the computer system) (e.g., in response to determining that the individual user is the second enrolled user), the computer system (e.g., 703) enables 816 the computer system to be used with one or more settings associated with (or specified by) a second user account that is different from the first user account and associated with the second enrolled user (e.g., logs in the computer system to the second user account that is different from the first user account and associated with the second enrolled user) (e.g., displays the personalization user interface 714 of FIG. 7C ).
[0130] In some embodiments, enabling the computer system to be used with one or more settings associated with a second user account that is different from the first user account and associated with a second registered user (e.g., logging the computer system into a second user account that is different from the first user account and associated with the second registered user) includes displaying, via the display generation component, a second user interface (e.g., personalization user interface 714) corresponding to the second registered user. In some embodiments, the second user interface indicates successful login to the second user account corresponding to the second registered user. In some embodiments, enabling the computer system to be used with one or more settings associated with the second user account that is different from the first user account and associated with the second registered user (e.g., logging the computer system into the second user account) includes one or more of applying a second set of user preferences associated with the second user account, providing access to certain encrypted and / or secure user files associated with the second user account, and / or loading calibration information associated with the second user account.
[0131] When biometric information received via one or more input devices is determined to correspond to a second enrolled user, automatically enabling the computer system to be used with one or more settings associated with a second user account associated with the second enrolled user (e.g., automatically logging the computer system into the second user account associated with the second enrolled user) provides the user with the ability to log in to the second user account without having to explicitly request the user to log in. Performing an action if a set of conditions is met without requiring further user input improves device operability (e.g., by performing the action without additional user input), makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate input when operating / interacting with the device and reducing user errors), and additionally reduces power usage and improves device battery life by allowing the user to use the device more quickly and efficiently.
[0132] In some embodiments, in response to detecting that the computer system has been placed on the body of an individual user (e.g., 703) and following a determination that the biometric information received via one or more input devices (e.g., 708) does not correspond to an enrolled user (e.g., recognized as a person / user but does not correspond to any user enrolled in the computer system), the computer system enters a guest mode of operation (e.g., displaying guest user interface 718 of FIG. 7D ). In some embodiments, entering the guest mode of operation includes enabling the computer system to be used with one or more settings associated with a guest user account different from the first user account (e.g., logging the computer system into a guest user account different from the first user account). In some embodiments, entering the guest mode of operation includes displaying, via a display generation component, a guest user interface corresponding to an unenrolled user (e.g., guest user interface 718). In some embodiments, entering the guest mode of operation includes one or more of applying a default set of user preferences associated with the guest user account and / or loading calibration information (e.g., a default set of calibration settings) associated with the guest user account.
[0133] Entering a guest mode of operation when it is determined that biometric information received via one or more input devices does not correspond to an enrolled user can improve security (e.g., by preventing guest users from accessing secure information of enrolled users) and prevent unauthorized users from initiating sensitive operations. Entering a guest mode of operation when it is determined that biometric information received via one or more input devices does not correspond to an enrolled user can also improve device usability (e.g., by restricting unauthorized access), provide a more efficient user-device interface, and reduce power usage and improve device battery life by restricting the execution of restricted operations.
[0134] In some embodiments, in response to detecting that the computer system (e.g., 700) has been placed on the body of an individual user, and in accordance with determining that the biometric information received via one or more input devices (e.g., 708) does not correspond to a registered user (e.g., does not correspond to any user registered with the computer system), the computer system refrains from logging the computer system into any user accounts (e.g., guest user interface 718 of FIG. 7D , user picker user interface 722 of FIG. 7E ). In some embodiments, refraining from logging the computer system into any user accounts includes, optionally via a display generation component, displaying a user interface (e.g., guest user interface 718 of FIG. 7D , user picker user interface 722 of FIG. 7E ) indicating a failed attempt to log into the user account.
[0135] Preventing any user account from logging into a computer system when it is determined that biometric information received via one or more input devices does not correspond to a registered user can improve security and prevent unauthorized users from initiating sensitive operations. Preventing any user account from logging into a computer system when it is determined that biometric information received via one or more input devices does not correspond to a registered user can also improve device usability (e.g., by limiting unauthorized access), provide a more efficient user-device interface, and reduce power usage and improve device battery life by limiting the execution of restricted operations.
[0136] In some embodiments, while a computer system (e.g., 700) is being enabled for use with one or more settings associated with a first user account associated with a first registered user (e.g., while the computer system is logged in to the first user account associated with the first registered user), the computer system (e.g., 700) detects that at least a portion of the computer system has been removed from the body of an individual user (e.g., user 703, FIG. 7H) (e.g., detects that the computer system is no longer being worn by the individual user). In response to detecting that at least a portion of the computer system has been removed from the body of the individual user, the computer system ceases enabling the computer system for use with one or more settings associated with the first user account associated with the first registered user (e.g., logs out the computer system from the first user account associated with the first registered user) ( FIG. 7H ). In some embodiments, ceasing to allow the computer system to be used with one or more settings associated with a first user account associated with the first registered user (e.g., logging out of the computer system from the first user account) includes one or more of removing application of a first set of user preferences associated with the first user account, prohibiting access to certain encrypted and / or secure user files associated with the first user account, and / or removing application of calibration information associated with the first user account.
[0137] When it is determined that the computer system has been removed from the individual user's body, ceasing to allow the computer system to be used with one or more settings associated with the first user account associated with the first registered user (e.g., logging out of the computer system from the first user account) can improve security and prevent unauthorized users from initiating sensitive operations. Ceasing to allow the computer system to be used with one or more settings associated with the first user account associated with the first registered user (e.g., logging out of the computer system from the first user account) when it is determined that the computer system has been removed from the individual user's body can also improve device usability (e.g., by limiting unauthorized access), making the user-device interface more efficient, and reducing power usage and improving device battery life by limiting the execution of restricted operations.
[0138] In some embodiments, the biometric information received via the one or more input devices is iris identification information, and determining that the biometric information received via the one or more input devices corresponds to the first enrolled user includes determining that the iris identification information (e.g., iris scan information) received via the one or more input devices corresponds to the first enrolled user, and determining that the biometric information received via the one or more input devices does not correspond to the first enrolled user includes determining that the iris identification information (e.g., iris scan information) received via the one or more input devices does not correspond to the first enrolled user. For example, in some embodiments, the computer system is a head-mounted device (e.g., a headset), and the iris identification information is provided via one or more input devices (e.g., eye tracking device 130) in communication with the computer system.
[0139] Automatically identifying a user based on iris identification information provides the user with the ability to perform various actions without explicit input (e.g., logging into a user's user account without having to explicitly request the user to log in). Performing an action when a set of conditions is met without requiring further user input can improve usability of the device (e.g., by performing the action without additional user input), make the user-device interface more efficient (e.g., by assisting the user in providing appropriate input and reducing user errors when operating / interacting with the device), and additionally reduce power usage and improve the device's battery life by allowing the user to use the device more quickly and efficiently.
[0140] In some embodiments, in response to detecting that the computer system has been placed on the body of an individual user, and in accordance with a determination that the biometric information received via one or more input devices corresponds to the individual registered user, the computer system displays a visual indication (e.g., personalization user interface 710, indicator 712, personalization user interface 714, indicator 716d) (e.g., displaying text including the individual registered user's name and / or username, displaying an avatar and / or image corresponding to the individual registered user) that the computer system has been enabled for use in one or more settings associated with the individual registered user (e.g., logged into a user account associated with the individual registered user).
[0141] The computer system provides feedback to the user regarding the current state of the device (e.g., that the computer system is logged into a user account) by displaying a visual indication that the computer system has been enabled for use with one or more configurations associated with the individual registered user (e.g., logged into a user account associated with the individual registered user). Providing improved visual feedback to the user improves device usability, increases the efficiency of the user-device interface (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device, thereby reducing user errors), and further reduces device power consumption and improves battery life by allowing the user to use the device more quickly and efficiently.
[0142] In some embodiments, in response to detecting that the computer system has been placed on the body of an individual user, and following a determination that the biometric information received via the one or more input devices does not correspond to an enrolled user (e.g., does not correspond to a user previously enrolled with the computer system), the computer system displays a user selection user interface (e.g., user interface 722) including multiple selectable options, including a first selectable option (e.g., selectable option 724a) corresponding to a first enrolled user (e.g., a name, avatar, initials, and / or other visual representation corresponding to the first enrolled user) and a second selectable option (e.g., selectable option 724b) corresponding to a second enrolled user that is different from the first enrolled user. In some embodiments, determining that the biometric information received via the one or more input devices does not correspond to an enrolled user includes determining that the biometric information received via the one or more input devices does not satisfy one or more certainty thresholds with respect to each of the one or more enrolled users.
[0143] In response to determining that the biometric information received via the one or more input devices does not correspond to an enrolled user, a user selection user interface is displayed to provide the user with feedback regarding the current state of the device (e.g., that the biometric information received via the one or more input devices does not correspond to an enrolled user). Providing improved visual feedback to the user improves usability of the device, increases the efficiency of the user-device interface (e.g., by assisting the user in providing appropriate inputs and reducing user errors when operating / interacting with the device), and further reduces power consumption and improves battery life of the device by allowing the user to use the device more quickly and efficiently.
[0144] In some embodiments, while displaying a user selection user interface (e.g., user interface 722) including a plurality of selectable options (e.g., options 724a-724c), the computer system receives user input (e.g., user input 726) corresponding to a selection of an individual selectable option from the plurality of selectable options, where the individual selectable option corresponds to an individual registered user. After receiving the user input corresponding to the selection of the individual selectable option, the computer system receives updated biometric information via one or more input devices (e.g., FIG. 7F). In response to receiving the updated biometric information (e.g., a fingerprint, an image (e.g., a photograph and / or scan) representing the individual user's face, and / or iris identification information (e.g., iris scan information)), and in accordance with a determination that the biometric information received via the one or more input devices corresponds to the individual registered user, the computer system enables use of the computer system (e.g., displays user interface 710 of FIG. 7B) with one or more settings associated with an individual user account associated with the individual registered user (e.g., logs the computer system into the individual user account associated with the individual registered user). In some embodiments, the computer system, optionally via a display generation component, displays a personalized user interface corresponding to the individual registered user (e.g., personalized user interface 610). In some embodiments, the personalized user interface indicates successful login to the individual user account corresponding to the individual registered user.In some embodiments, enabling the computer system to be used with one or more settings associated with an individual user account associated with the individual registered user (e.g., logging the computer system into the individual user account) includes one or more of applying a set of user preferences associated with the individual user account, providing access to particular encrypted and / or secure user files associated with the individual user account, and / or loading calibration information associated with the individual user account. In response to receiving updated biometric information and following a determination that the biometric information received via the one or more input devices does not correspond to the individual registered user, the computer system ceases to enable the computer system to be used with one or more settings associated with (e.g., and / or specified by) the individual user account associated with the individual registered user (e.g., displaying passcode entry user interface 628).
[0145] Refusing to allow a computer system to be used in one or more settings associated with an individual user account associated with an individual registered user when it is determined that the biometric information does not correspond to an individual registered user (e.g., by preventing the computer system from being logged into an individual user account associated with an individual registered user) can improve security and prevent unauthorized users from initiating sensitive operations. Refusing to allow a computer system to be used in one or more settings associated with an individual user account associated with an individual registered user when it is determined that the biometric information does not correspond to an individual registered user (e.g., by preventing the computer system from being logged into an individual user account associated with an individual registered user) can also improve device usability (e.g., by limiting unauthorized access), making the user-device interface more efficient, and reducing power usage and improving device battery life by limiting the execution of restricted operations.
[0146] In some embodiments, while displaying a user selection user interface (e.g., user interface 722) including a plurality of selectable options (e.g., options 724a-724c), the computer system receives user input (e.g., user input 726) corresponding to a selection of an individual selectable option among the plurality of selectable options, the individual selectable option corresponding to an individual enrolled user. After receiving the user input corresponding to the selection of the individual selectable option, and in accordance with a biometric criterion not being met (e.g., a biometric criterion not being met when the individual enrolled user is not enrolled in biometric authentication (e.g., has not opted in to biometric authentication)), and in accordance with a determination that the individual enrolled user's first setting (e.g., a biometric authentication setting for enabling biometric authentication (e.g., an iris scan authentication setting)) has not been enabled, the computer system, via the display generation component, displays a passcode entry user interface (e.g., user interface 728). After receiving user input corresponding to a selection of the respective selectable option, and in accordance with the biometric criteria not being met (e.g., the biometric criteria not being met when the respective enrolled user is not enrolled in (e.g., did not opt in to) biometric authentication), and in accordance with a determination that the respective enrolled user's first setting is enabled, the computer system performs automated biometric authentication (e.g., FIG. 7F) (and optionally ceases displaying the passcode entry user interface). In some embodiments, the computer system receives updated biometric information (e.g., a fingerprint, an image (e.g., a photograph and / or scan) representing the respective user's face, and / or iris identification information (e.g., iris scan information)) via one or more input devices (e.g., FIG. 7F).In some embodiments, performing the automated biometric authentication includes enabling the computer system to be used in one or more settings associated with (or specified by) an individual user account associated with the individual enrolled user (e.g., displaying user interface 710 of FIG. 7B ) (e.g., logging the computer system into the individual user account associated with the individual enrolled user) in accordance with a determination that updated biometric information (e.g., a fingerprint, an image (e.g., a photograph and / or scan) representing the individual user's face, and / or iris identification information (e.g., iris scan information)) received via the one or more input devices corresponds to the individual enrolled user, and refraining from enabling the computer system to be used in one or more settings associated with the individual user account associated with the individual enrolled user (e.g., displaying passcode entry user interface 728 of FIG. 7G ) (e.g., refraining from logging the computer system into the individual user account associated with the individual enrolled user) in accordance with a determination that the updated biometric information received via the one or more input devices does not correspond to the individual enrolled user.
[0147] In some embodiments, enabling the computer system to be used in one or more settings associated with an individual user account associated with the individual registered user (e.g., logging the computer system into the individual user account associated with the individual registered user) includes displaying, via a display generation component, an individual user interface corresponding to the individual registered user. In some embodiments, the individual user interface indicates successful login to the individual user account corresponding to the individual registered user. In some embodiments, enabling the computer system to be used in one or more settings associated with an individual user account associated with the individual registered user (e.g., logging the computer system into the individual user account) includes one or more of applying a set of user preferences associated with the individual user account, providing access to particular encrypted and / or secure user files associated with the individual user account, and / or loading calibration information associated with the individual user account.
[0148] Refusing to allow a computer system to be used in one or more settings associated with an individual user account associated with an individual registered user when it is determined that the biometric information does not correspond to an individual registered user (e.g., by preventing the computer system from being logged into an individual user account associated with an individual registered user) can improve security and prevent unauthorized users from initiating sensitive operations. Refusing to allow a computer system to be used in one or more settings associated with an individual user account associated with an individual registered user when it is determined that the biometric information does not correspond to an individual registered user (e.g., by preventing the computer system from being logged into an individual user account associated with an individual registered user) can also improve device usability (e.g., by limiting unauthorized access), making the user-device interface more efficient, and reducing power usage and improving device battery life by limiting the execution of restricted operations.
[0149] It should be noted that the process details described above with respect to method 800 (e.g., FIG. 8) are also applicable in a similar manner to the methods described below. For example, methods 1000, 1200, and / or 1400 optionally include one or more of the features of the various methods described above with reference to method 800. For example, a user-specific set of device calibration settings (method 1000) and / or a user avatar with a particular visual appearance (method 1200) may be enabled on a computer system as part of one or more settings associated with a first user account enabled on the computer system, as described in method 800. In another example, user-specific settings may be applied and / or de-applied based on automatic user identification when a device is handed between users, as described in method 1400. For brevity, these details will not be repeated below.
[0150] 9A-9F show exemplary user interfaces for automatically applying one or more device calibration settings based on a user's identity, according to some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes in FIGS. 10A-10B.
[0151] 9A shows electronic device 700 that is a smartwatch that includes a touch-sensitive display 702, a rotatable and depressible input mechanism 704 (e.g., rotatable and depressible relative to the device housing or frame), buttons 706, and a camera 708. In some embodiments described below, electronic device 700 is a wearable smartwatch device. In some embodiments, electronic device 700 is a smartphone, tablet, head-mounted system (e.g., headset), or other computer system that includes and / or is in communication with a display device (e.g., display screen, projection device, etc.). Electronic device 700 is a computer system (e.g., computer system 101 of FIG. 1).
[0152] 9A, a user 703 places electronic device 700 on the user's wrist. Electronic device 700 detects (e.g., via one or more sensors) that electronic device 700 has been placed on the user's body. In some embodiments, electronic device 700 detects that one or more criteria have been met that indicate that electronic device 700 has been placed on the user's body.
[0153] 9A shows a user 703 placing the smartwatch on the user's wrist. However, as noted above, in some embodiments, the electronic device 700 is a different device, such as a head-mounted system (e.g., a headset) designed to be worn on the user's head. In such embodiments, the electronic device 700 detects (e.g., via one or more sensors) that the electronic device 700 has been placed on the user's head and / or detects that one or more criteria have been met that indicate that the electronic device 700 has been placed on the user's head.
[0154] 9A , in response to detecting that electronic device 700 has been placed on a user's body, electronic device 700 attempts to automatically identify user 703. In some embodiments, electronic device 700 attempts to identify user 703 in various ways. For example, electronic device 700 optionally attempts to automatically identify the user based on biometric information, such as facial recognition, eye (e.g., iris) recognition, and / or fingerprint recognition. In FIG. 7A , electronic device 700 collects biometric information (e.g., a facial scan and / or an eye (e.g., iris) scan using camera 708) in response to detecting that electronic device 700 has been placed on a user's body.
[0155] 9A shows a user 703 placing the smartwatch on the user's wrist. However, as noted above, in some embodiments, the electronic device 700 is a different device, such as a head-mounted system (e.g., a headset) designed to be worn on the user's head. In such embodiments, the electronic device 700 optionally attempts to automatically identify the user when it is determined that the electronic device 700 is placed on the user's head (e.g., based on iris recognition and / or facial recognition when the device is placed on the user's head).
[0156] 9A , the electronic device 700 displays an application picker user interface 902. The application picker user interface 902 includes a plurality of application icons. Each application icon is associated with an application, and selecting an application icon causes the electronic device 700 to display (e.g., by opening) the application associated with the application icon. The application picker user interface 902 includes a clock application affordance 904a displayed in a center position on the display 702. The application picker user interface 902 also includes a compass application affordance 904b, a timer application affordance 904c, and a podcast application affordance 904d.
[0157] 9B , electronic device 700 detects one or more user inputs 903a-903e. Electronic device 700 detects one or more user inputs 903a-903e based on information from one or more sensors, such as one or more cameras, gyroscopes, accelerometers, pressure sensors, eye movement sensors (e.g., scanners and / or cameras), and / or microphones. In the illustrated embodiment, one or more user inputs 903a-903e correspond to navigation inputs for navigating within user interface 902. In the illustrated embodiment, one or more user inputs 903a-903e include eye movement inputs (e.g., 903a) (e.g., gaze movement, eye focus movement) and hand and / or wrist movement inputs 903b-903e. In some embodiments, the user inputs may include other and / or additional inputs, such as head movement inputs, torso movement inputs, leg and / or foot movement inputs, and / or touch inputs.
[0158] 9C-9E illustrate various exemplary scenarios in which electronic device 700 responds to user input 903a-903e differently based on the automatic identification of user 703. FIG.
[0159] 9C illustrates a first exemplary scenario in which electronic device 700 identifies user 703 as John, a first registered user (e.g., based on biometric information). In response to identifying user 703 as the first registered user, electronic device 700 applies a first set of device calibration settings corresponding to the first registered user. The device calibration settings may include, for example, eye movement calibration settings, hand movement calibration settings, head movement calibration settings, torso movement calibration settings, foot and / or leg movement calibration settings, and / or touch pressure calibration settings. Further, having applied the first set of device calibration settings corresponding to the first registered user, electronic device 700 responds to user inputs 903a-903e based on (e.g., in response to, according to) the user inputs 903a-903e and the first set of device calibration settings. In the illustrated example, the electronic device 700 updates the display of the application picker user interface 902 based on the user inputs 903a-903e and a first set of device calibration settings to display navigation within the application picker user interface 902. In Figure 9C, the compass application affordance 904b, which was previously located in the upper left position of the display 702 in Figure 9A, has been moved to a closer to a center position of the display 702 in response to the user inputs 903a-903e.
[0160] 9D illustrates a second exemplary scenario in which electronic device 700 identifies user 703 as a second registered user, Sarah (e.g., based on biometric information). In response to identifying user 703 as the second registered user, electronic device 700 applies a second set of device calibration settings corresponding to the second registered user (e.g., different from the first set of device calibration settings). Electronic device 700 responds to user inputs 903a-903e based on (e.g., in response to, according to) the user inputs 903a-903e and the second set of device calibration settings. In the illustrated example, electronic device 700 updates the display of application picker user interface 902 to display navigation within application picker user interface 902 based on user inputs 903a-903e and the second set of device calibration settings. In Figure 9D, timer application affordance 904c, which was previously located in the right-most position of display 702 in Figure 9A, has been moved to a center position on display 702 in response to user inputs 903a-903e. Thus, as a result of the different sets of device calibration settings applied in Figures 9C and 9D, electronic device 600 responds differently to the same set of user inputs 903a-903e.
[0161] 9E illustrates a third exemplary scenario in which electronic device 700 determines that user 703 is not a previously registered user (e.g., electronic device 700 fails to match biometric information from user 703 with stored biometric information of a previously registered user). In response to determining that user 703 is not a registered user, electronic device 700 applies a third (e.g., guest) set of device calibration settings corresponding to an unregistered guest user (and, in some embodiments, different from the first and second sets of device calibration settings). Electronic device 700 responds to user inputs 903a-903e based on (e.g., in response to, according to) the user inputs 903a-903e and the third (guest) set of device calibration settings. In the illustrated example, electronic device 700 updates the display of application picker user interface 902 to display navigation within application picker user interface 902 based on user inputs 903a-903e and the third (guest) set of device calibration settings. In Figure 9E, podcast application affordance 904d, which was previously located in a bottom, center position of display 702 in Figure 9A, has been moved to a center position of display 702 in response to user inputs 903a-903e. Thus, as a result of the different sets of device calibration settings applied in Figures 9C, 9D, and 9E, electronic device 700 responds differently to the same set of user inputs 903a-903e.
[0162] 9C-9E, electronic device 700 and application picker user interface 902 are used as examples to demonstrate the application of different sets of device calibration settings based on the identity of a user. Such features may be similarly applied to different situations and scenarios. For example, in some embodiments, electronic device 700 is a head-mounted system (e.g., a headset). In some such embodiments, electronic device 700 displays a three-dimensional user interface and / or a virtual environment. A user navigates within the three-dimensional user interface and / or the virtual environment by providing one or more user inputs, which in some embodiments include gaze and / or eye movements, hand movements, head movements, and / or torso movements. In response to the user inputs, electronic device 700 navigates within the three-dimensional user interface and / or the virtual environment. Navigation within the three-dimensional user interface and / or the virtual environment may differ based on different sets of device calibration settings being applied (e.g., different sets of eye movement calibration, hand movement calibration, and / or head movement calibration for different users).
[0163] In some embodiments, a set of device calibration settings for a registered user is determined based on one or more calibration inputs provided by the registered user. In some embodiments, electronic device 700 requests one or more calibration inputs during the enrollment and / or registration process, and the user optionally provides the one or more calibration inputs. For example, electronic device 700 instructs the user to move a part of the user's body (e.g., a hand, arm, leg, foot, torso, head, and / or eye) in a predetermined manner, and / or electronic device 700 asks the user to track the movement of an object with the user's eyes. Based on the one or more calibration inputs, electronic device 700 optionally determines and stores one or more values (e.g., offset values) that at least partially define the device calibration settings for that registered user.
[0164] In some embodiments, the set of guest device calibration settings represents a default set of device calibration settings, and the default set of device calibration settings is determined without any user input (e.g., without calibration input). In such embodiments, the guest user is not required to provide any calibration input, and user input provided by the guest user is processed according to the default set of device calibration settings. In some embodiments, the set of guest device calibration settings is determined based on one or more calibration inputs provided by the guest user. For example, electronic device 700 optionally prompts the guest user to provide one or more calibration inputs to determine device calibration settings to be applied to the guest user. In some embodiments, the one or more calibration inputs requested of and / or received from the guest user may represent a subset (e.g., less than) of the one or more calibration inputs requested of and / or received from a registered user. For example, the guest user is required to provide fewer calibration inputs than a registered user is required to provide.
[0165] 9F , user 703 removes electronic device 700 from the user's body. Electronic device 700 detects that electronic device 700 is no longer located on the user's body. In response to detecting that electronic device 700 is no longer located on the user's body, electronic device 700 optionally logs out of any logged-in user account, including ceasing to apply device calibration settings that were applied to user 703. Logging out of the user account may include, for example, ceasing to display a user interface that was displayed before device 700 was removed from the user's body, ceasing to apply one or more applied user settings (e.g., device calibration settings), and / or ceasing to provide access to secure content associated with the user account.
[0166] In the illustrated embodiment, electronic device 700 is a smartwatch, and FIGS. 9A-9F show user 703 wearing or removing the smartwatch from the user's wrist and also providing user inputs 903a-903e via the smartwatch. However, as noted above, in some embodiments, electronic device 700 is a different device, such as a head-mounted system (e.g., a headset) designed to be worn on the user's head. In such embodiments, electronic device 700 optionally attempts to automatically identify the user when it is determined that electronic device 700 is placed on the user's head (e.g., based on iris recognition and / or facial recognition when the device is placed on the user's head). Additionally, in such embodiments, content such as user interface 902 is optionally displayed via the head-mounted system, and one or more user inputs (e.g., user inputs 903a-903e) are received via one or more input devices in communication with the head-mounted system. Similarly, device calibration settings are optionally applied to the head-mounted system and one or more input devices in communication with the head-mounted system. For example, the device calibration settings may include gaze calibration settings, head movement calibration settings, hand and / or arm movement calibration settings, torso calibration settings, and / or foot and / or leg calibration settings.
[0167] 10A-10B are flow diagrams illustrating a method for automatically applying one or more device calibration settings based on an identification of a user using an electronic device, according to some embodiments. Method 1000 is performed in a computer system (e.g., 101, 700) in communication with a display generation configuration component and one or more input devices. Some operations of method 1000 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.
[0168] As described below, method 1000 provides an intuitive way to automatically apply one or more device calibration settings based on a user's identity. This method reduces the cognitive burden on the user when applying device calibration settings, thereby creating a more efficient human-machine interface. For battery-operated computing devices, allowing users to apply device calibration settings faster and more efficiently conserves power and extends the time between battery charges.
[0169] In some embodiments, a computer system (e.g., device 700, computer system 101) (e.g., a smartphone, smartwatch, tablet, head-mounted device, and / or wearable device) in communication with a display generation component (e.g., display 702) (e.g., a display controller, a touch-sensitive display system, a display (e.g., integrated and / or connected), a 3D display, a see-through display, a projector, and / or a head-up display) and one or more input devices (e.g., 702, 704, 706, 708) (e.g., a touch-sensitive surface (e.g., a touch-sensitive display), a mouse, a keyboard, a remote control, a visual input device (e.g., a camera), an audio input device (e.g., a microphone), and / or a biometric sensor (e.g., a fingerprint sensor, a facial identification sensor, and / or an iris identification sensor)) detects 1002 that at least a portion of the computer system has been placed on the body of an individual user (e.g., user 703). After detecting that at least a portion of the computer system is placed on the individual user's body (1004), the computer system detects input from the individual user (e.g., user inputs 903a-903e in FIG. 9B) based on the movement or position of at least a portion of the individual user's body (e.g., the position of the individual user's head, hands, eyes, or other body parts).
[0170] In response to detecting input from the individual user, the computer system (e.g., device 700) responds to the input from the individual user (e.g., user inputs 903a-903e in FIG. 9B) 1010. Pursuant to determining 1012 that the individual user is a first user previously registered with the computer system (e.g., based on an option selected by the individual user that identifies the individual user as the first user or based on an automated biometric identification of the individual user as the first user), the computer system generates 1014 a response to the input based on a movement or position of a body part of the individual user and a first set of device calibration settings (e.g., movement calibration, hand calibration, and / or eye calibration) specific to the first user (e.g., FIG. 9C). Following a determination 1016 that the individual user is not the first user (e.g., based on an option selected by the individual user indicating that the individual user is not the first user, or based on an automated biometric identification of the individual user as someone other than the first user), the computer system generates 1018 a response to the input (e.g., user inputs 903a-903e of FIG. 9B) based on a movement or position of a body part of the individual user and without using a first set of device calibration settings specific to the first user (e.g., FIG. 9D).
[0171] In some embodiments, generating a response to the input based on a movement or position of a body part of the individual user and without using the first set of device calibration settings includes generating a response to the input based on a movement or position of a body part of the individual user and a second set of device calibration settings (e.g., without applying the first set of device calibration settings) that are different from the first set of device calibration settings (e.g., a default set of device calibration settings and / or guest device calibration settings).
[0172] In some embodiments, in response to detecting that at least a portion of the computer system is placed on the body of an individual user, the computer system receives biometric information (e.g., corresponding to the individual user) via one or more input devices. In accordance with a determination that biometric information received via one or more input devices (e.g., a fingerprint, an image (e.g., a photograph and / or scan) representing an individual user's face, and / or iris identification information (e.g., iris scan information)) corresponds to a first enrolled user (e.g., a first enrolled user of a plurality of users) (e.g., a user previously enrolled in the computer system), the computer system applies a first set of device calibration settings (e.g., movement calibration, hand calibration, and / or eye calibration) corresponding to the first enrolled user (e.g., without applying a second set of device calibration settings), and in accordance with a determination that the biometric information received via the one or more input devices does not correspond to an enrolled user (e.g., does not correspond to any user previously enrolled in the computer system), the computer system applies a second set of device calibration settings (e.g., a default set of device calibration settings and / or guest device calibration settings) different from the first set of device calibration settings (e.g., without applying the first set of device calibration settings).
[0173] Automatically applying a first set of device calibration settings specific to the first user when an individual user is determined to be the first user, thereby providing the user with the ability to use the system with user-specific settings without explicitly requesting that those settings be applied. Performing an action when a set of conditions is met without requiring further user input, thereby improving device operability (e.g., by performing the action without additional user input), making the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs and reducing user errors when operating / interacting with the device), and additionally reducing power usage and improving device battery life by allowing the user to use the device more quickly and efficiently.
[0174] In some embodiments, generating a response to an input (e.g., user inputs 903a-903e of FIG. 9B ) based on a movement or position of a body part of the individual user and without using a first set of device calibration settings specific to the first user includes, in accordance with a determination that the individual user is an unregistered user (1020) (e.g., not a user registered with the computer system) (e.g., based on an option selected by the individual user indicating that the individual user is not a registered user (e.g., a guest user) or based on automated biometric identification of the individual user as an unregistered user), generating a response (1022) to the input (e.g., user inputs 903a-903e of FIG. 9B ) based on a movement or position of a body part of the individual user and a second set of device calibration settings (e.g., movement calibration, hand calibration, and / or eye calibration) that are different from the first set of device calibration settings and represent a set of guest device calibration settings for the unregistered user (e.g., without applying the first set of device calibration settings) (e.g., FIG. 9E ). In some embodiments, the second set of device calibration settings, representing a set of guest device calibration settings, is applied to any user identified as an unenrolled user. In some embodiments, after generating a response to the input based on a movement or position of a portion of the individual user's body and the second set of device calibration settings, representing a set of guest device calibration settings for unenrolled users, the computer system detects that the computer system has been removed from the individual user's body. After detecting that the computer system has been removed from the individual user's body, the computer system detects that at least a portion of the computer system has been placed on the body of a second individual user, the second individual user being different from the individual user. After detecting that at least a portion of the computer system has been placed on the body of the second individual user, the computer system detects an input from the second individual user based on a movement or position of at least a portion of the second individual user's body.In response to detecting the input from the second individual user, responding to the input from the second individual user includes the computer system generating a response to the input from the second individual user based on a movement or position of a body part of the second individual user and a second set of device calibration settings representing a set of guest device calibration settings for the unregistered user (e.g., without applying the first set of device calibration settings) in accordance with a determination that the second individual user is an unregistered user (e.g., not a user registered with the computer system) (e.g., based on an option selected by the second individual user indicating that the second individual user is not a registered user (e.g., a guest user) or based on automated biometric identification of the second individual user as an unregistered user).
[0175] Automatically applying a second set of device calibration settings for unenrolled users when an individual user is determined to be an unenrolled user provides the user with the ability to use the system in various settings without explicitly requesting that those settings be applied. Performing an action when a set of conditions is met without requiring further user input improves device operability (e.g., by performing the action without additional user input), makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs and reducing user errors when operating / interacting with the device), and additionally reduces power usage and improves device battery life by allowing the user to use the device more quickly and efficiently.
[0176] In some embodiments, generating a response to the input based on a movement or position of the individual user's body part and without using the first set of device calibration settings specific to the first user includes generating (1026) a response to the input (e.g., user inputs 903a-903e of FIG. 9B ) based on a movement or position of the individual user's body part and a third set of device calibration settings (e.g., movement calibration, hand calibration, and / or eye calibration) different from the first set of device calibration settings and specific to the second user (e.g., without applying the first set of device calibration settings) in accordance with a determination (1024) that the individual user is a second user previously registered with the computer system different from the first user (e.g., based on an option selected by the individual user or based on automated biometric identification of the individual user as the second user) (e.g., FIG. 9D ).
[0177] When an individual user is determined to be a second user, automatically applying a third set of device calibration settings specific to the second user provides the user with the ability to use the system with user-specific settings without explicitly requesting that those settings be applied. Performing an action when a set of conditions is met without requiring further user input improves device operability (e.g., by performing the action without additional user input), makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs and reducing user errors when operating / interacting with the device), and additionally reduces power usage and improves device battery life by allowing the user to use the device more quickly and efficiently.
[0178] In some embodiments, the first set of device calibration settings is determined based on a plurality of device calibration inputs received from a first user. In some embodiments, the plurality of device calibration inputs are received as part of an enrollment process for enrolling the first user in a computer system (e.g., one or more hand movement inputs, arm movement inputs, eye (e.g., iris) movement inputs detected in response to one or more prompts, such as a prompt to perform a predetermined gesture or move the eyes in a predetermined gaze pattern). Adjusting the device calibration settings for a user based on the device calibration inputs received from the user allows the device to respond to user inputs more accurately and efficiently. Adjusting the device calibration and responses for a particular user improves device usability (e.g., by assisting the user in providing appropriate inputs and reducing user errors when operating / interacting with the device), makes the user-device interface more efficient, and allows the user to use the device more quickly and efficiently, thereby reducing power usage and improving the device's battery life.
[0179] In some embodiments, generating a response to an input (e.g., user inputs 903a-903e of FIG. 9B ) based on a movement or position of a body part of the individual user and without using a first set of device calibration settings specific to the first user includes, in accordance with a determination that the individual user is an unregistered user (e.g., not a user previously registered with the computer system) (e.g., based on an option selected by the individual user indicating that the individual user is not a registered user (e.g., a guest user) or based on automated biometric identification of the individual user as an unregistered user), generating a response to the input based on a movement or position of a body part of the individual user and a second set of device calibration settings (e.g., movement calibration, hand calibration, and / or eye calibration) that are different from the first set of device calibration settings and represent a set of guest device calibration settings for the unregistered user (e.g., without applying the first set of device calibration settings) (e.g., FIG. 9E ), where the second set of device calibration settings is determined based on multiple device calibration inputs received from the unregistered user. In some embodiments, device calibration inputs from an unenrolled user are optional, and a default set of device calibration settings can be applied without receiving device calibration inputs from an unenrolled user. In some embodiments, device calibration inputs from an unenrolled user are mandatory, and an unenrolled user cannot proceed to interact with the user interface until device calibration inputs have been received from the unenrolled user.
[0180] In some embodiments, after detecting that at least a portion of the computer system has been placed on a body of the individual user and in accordance with a determination that the individual user is an unenrolled user, the computer system displays one or more prompts to the unenrolled user to provide a plurality of device calibration inputs, and generating a response to the input based on a movement or position of a portion of the individual user's body and without using at least some of the first set of device calibration settings specific to the first user comprises: after displaying one or more prompts to the unenrolled user to provide a plurality of device calibration inputs, in accordance with a determination that the unenrolled user has provided the plurality of device calibration inputs, generating a response to the input based on a movement or position of a portion of the individual user's body and without using at least some of the first set of device calibration settings specific to the first user; generating a response to the input based on a second set of settings (e.g., movement calibration, hand calibration, and / or eye calibration) determined based on the plurality of device calibration inputs received from the unenrolled user; and, pursuant to a determination that the unenrolled user has not provided the plurality of device calibration inputs (e.g., the unenrolled user has refused to provide the plurality of device calibration inputs and / or a threshold period of time has elapsed without the unenrolled user providing the plurality of device calibration inputs), generating a response to the input based on a movement or position of a body part of the individual user and a third set of device calibration settings different from the first and second sets of device calibration settings, the third set representing a default set of guest calibration settings.
[0181] In some embodiments, after detecting that at least a portion of the computer system has been placed on a body of the individual user and in accordance with a determination that the individual user is an unenrolled user, the computer system displays one or more prompts to the unenrolled user to provide a plurality of device calibration inputs, and generating a response to the input based on a movement or position of a portion of the individual user's body and without using at least some of the first set of device calibration settings specific to the first user includes: after displaying one or more prompts to the unenrolled user to provide a plurality of device calibration inputs, in accordance with a determination that the unenrolled user has provided a plurality of device calibration inputs, generating a response to the input based on the movement or position and a second set of device calibration settings (e.g., movement calibration, hand calibration, and / or eye calibration) different from the first set of device calibration settings, the second set of device calibration settings being determined based on the plurality of device calibration inputs received from the unenrolled user; and ceasing to generate a response to the input based on the movement or position of the individual user's body part pursuant to a determination that the unenrolled user has not provided the plurality of device calibration inputs (e.g., the unenrolled user has refused to provide the plurality of device calibration inputs and / or a threshold period has elapsed without the unenrolled user providing the plurality of device calibration inputs).
[0182] Adjusting device calibration settings for a user based on device calibration input received from the user allows the device to respond to user input more accurately and efficiently. Adjusting device calibration and responses for a particular user improves device usability (e.g., by assisting the user in providing appropriate inputs and reducing user errors when operating / interacting with the device), makes the user-device interface more efficient, and also reduces power usage and improves device battery life by allowing the user to use the device more quickly and efficiently.
[0183] In some embodiments, the plurality of device calibration inputs received from the unenrolled user is a smaller subset of the plurality of device calibration inputs received from the first user. Adjusting device calibration settings for the user based on the device calibration inputs received from the user allows the device to respond to user inputs more accurately and efficiently. Adjusting device calibration and responses for a particular user improves device usability (e.g., by assisting the user in providing appropriate inputs and reducing user errors when operating / interacting with the device), provides a more efficient user-device interface, and allows the user to use the device more quickly and efficiently, thereby reducing power usage and improving the device's battery life.
[0184] In some embodiments, generating a response to an input (e.g., navigation within user interface 901 of FIGS. 9C-9E ) based on a movement or position of a body part of the individual user and without using a first set of device calibration settings specific to the first user includes, in accordance with a determination that the individual user is an unregistered user (e.g., not a user previously registered with the computer system) (e.g., based on an option selected by the individual user indicating that the individual user is not a registered user (e.g., a guest user) or based on automated biometric identification of the individual user as an unregistered user), generating a response to the input based on a movement or position of a body part of the individual user and a second set of device calibration settings (e.g., movement calibration, hand calibration, and / or eye calibration) that are different from the first set of device calibration settings and represent a set of guest device calibration settings for the unregistered user (e.g., guest calibration settings applied in FIG. 9E ), where the second set of device calibration settings is a default set of device calibration settings and is not based on user input from the unregistered user.
[0185] Automatically applying a second set of device calibration settings for unenrolled users when an individual user is determined to be an unenrolled user provides the user with the ability to use the system in various settings without explicitly requesting that those settings be applied. Performing an action when a set of conditions is met without requiring further user input improves device operability (e.g., by performing the action without additional user input), makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs and reducing user errors when operating / interacting with the device), and additionally reduces power usage and improves device battery life by allowing the user to use the device more quickly and efficiently.
[0186] In some embodiments, the first set of device calibration settings includes one or more eye and / or gaze movement calibration settings. Adjusting the device calibration settings, including the eye calibration settings, for a user allows the device to respond to user input more accurately and efficiently. Adjusting the device calibration and responses for a particular user improves device usability (e.g., by assisting the user in providing appropriate inputs and reducing user errors when operating / interacting with the device), provides a more efficient user-device interface, and allows the user to use the device more quickly and efficiently, thereby reducing power usage and improving the device's battery life.
[0187] In some embodiments, the first set of device calibration settings includes one or more hand movement calibration settings. Adjusting the device calibration settings, including the hand calibration settings, for a user allows the device to respond to user input more accurately and efficiently. Adjusting the device calibration and responses for a particular user improves device usability (e.g., by assisting the user in providing appropriate inputs and reducing user errors when operating / interacting with the device), provides a more efficient user-device interface, and allows the user to use the device more quickly and efficiently, thereby reducing power usage and improving the device's battery life.
[0188] In some embodiments, generating a response to the input based on a movement or position of a portion of the individual user's body and the first set of user-specific device calibration settings includes enabling a computer system (e.g., 700) to be used with the first set of device calibration settings specific to a first user. While the computer system is being enabled to be used with the first set of device calibration settings specific to the first user (e.g., while the computer system is logged into the first user account), the computer system detects that at least a portion of the computer system has been removed from the individual user's body (e.g., detects that the computer system is no longer worn by the individual user). In response to detecting that at least a portion of the computer system has been removed from the individual user's body (e.g., for longer than a predetermined threshold duration), the computer system ceases enabling the computer system to be used with the first set of device calibration settings specific to the first user (e.g., FIG. 9F) (e.g., logs out the computer system from the first user account associated with the first user). In some embodiments, logging out the computer system from the first user account includes removing application of the first set of device calibration settings specific to the first user. In some embodiments, in response to detecting that at least a portion of the computer system has been removed from an individual user's body for longer than a predetermined threshold duration, the computer system is logged out of the first user account, regardless of how the computer system was logged into the first user account (e.g., whether by biometric authentication, passcode authentication, or other authentication).
[0189] Improve security by ceasing to allow the computer system to be used with a first set of device calibration settings specific to a first user (e.g., logging out the computer system from the first user account) when it is determined that the computer system has been removed from the individual user's body. For example, ceasing to allow the computer system to be used with the first set of device calibration settings (e.g., logging out the computer system from the first user account) when it is determined that the computer system has been removed from the individual user's body can prevent unauthorized users from initiating sensitive operations. Ceasing to allow the computer system to be used with the first set of device calibration settings (e.g., logging out the computer system from the first user account) when it is determined that the computer system has been removed from the individual user's body also improves device usability, makes the user-device interface more efficient (e.g., by restricting unauthorized access and by preventing a user from using the device with device calibration settings specific to another user), and reduces power usage and improves device battery life by restricting the execution of restricted operations.
[0190] In some embodiments, determining that the individual user is the first user is performed automatically in response to detecting that at least a portion of the computer system has been placed on the user's body (e.g., FIG. 9A) (e.g., automatic biometric identification / authentication based on biometric information collected from the individual user via one or more input devices).
[0191] Automatically identifying a user and applying a user-specific set of device calibration settings when at least a portion of the computer system is determined to be placed on the user's body, thereby providing the user with the ability to use the system with user-specific settings without explicitly requesting that those settings be applied; Performing an action when a set of conditions is met without requiring further user input, thereby improving device operability (e.g., by performing an action without additional user input); making the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs and reducing user errors when operating / interacting with the device); and allowing the user to use the device more quickly and efficiently, thereby reducing power usage and improving device battery life.
[0192] It should be noted that the process details described above with respect to method 1000 (e.g., FIGS. 10A-10B) are applicable in a similar manner to methods described elsewhere herein. For example, methods 800, 1200, and / or 1400 optionally include one or more of the features of the various methods described above with reference to method 1000. For example, a set of user-specific device calibration settings may be automatically applied as part of one or more settings associated with a user as described in method 800, and / or a set of user-specific device calibration settings may be automatically applied along with a user-specific avatar as described in method 1200. In another example, user-specific device calibration settings may be applied and / or de-applied based on automatic user identification as devices are handed between users, as described in method 1400. For brevity, these details will not be repeated below.
[0193] 11A-11F show exemplary user interfaces for automatically applying and displaying a user avatar based on a user's identity, according to some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes in FIGS. 12A-12B.
[0194] 11A shows electronic device 700 that is a smartwatch that includes a touch-sensitive display 702, a rotatable and depressible input mechanism 704 (e.g., rotatable and depressible relative to the device housing or frame), buttons 706, and a camera 708. In some embodiments described below, electronic device 700 is a wearable smartwatch device. In some embodiments, electronic device 700 is a smartphone, tablet, head-mounted system (e.g., headset), or other computer system that includes and / or is in communication with a display device (e.g., display screen, projection device, etc.). Electronic device 700 is a computer system (e.g., computer system 101 of FIG. 1).
[0195] 11A, a user 703 places electronic device 700 on the user's wrist. Electronic device 700 detects (e.g., via one or more sensors) that electronic device 700 has been placed on the user's body. In some embodiments, electronic device 700 detects that one or more criteria have been met that indicate that electronic device 700 has been placed on the user's body.
[0196] 11A shows a user 703 placing the smartwatch on the user's wrist. However, as noted above, in some embodiments, the electronic device 700 is a different device, such as a head-mounted system (e.g., a headset) designed to be worn on the user's head. In such embodiments, the electronic device 700 detects (e.g., via one or more sensors) that the electronic device 700 has been placed on the user's head and / or detects that one or more criteria have been met that indicate that the electronic device 700 has been placed on the user's head.
[0197] 11A , in response to detecting that the electronic device 700 has been placed on the user's body, the electronic device 700 attempts to automatically identify the user 703. In some embodiments, the electronic device 700 attempts to identify the user 703 in various ways. For example, the electronic device 700 optionally attempts to automatically identify the user based on biometric information, such as facial recognition, eye (e.g., iris) recognition, and / or fingerprint recognition. In FIG. 7A , the electronic device 700 collects biometric information (e.g., a facial scan and / or an eye (e.g., iris) scan using the camera 708) in response to detecting that the electronic device 700 has been placed on the user's body. In the exemplary scenario shown in FIG. 11A , the electronic device 700 determines that the biometric information from the user 703 corresponds to John, a first registered user.
[0198] 11A , electronic device 700 displays user interface 1102 including selectable object 1104 (e.g., after determining that biometric information from user 703 corresponds to a first enrolled user). Selectable object 1104 corresponds to a co-presence application in which multiple users can enter a co-presence environment to communicate with each other, as described in more detail with respect to later figures. In some embodiments, the co-presence environment is an XR environment (e.g., a virtual environment) having one or more avatars representing users present in the XR environment. Electronic device 700 detects user input 1106 at a position on user interface 1102 corresponding to selection of selectable object 1104.
[0199] 11B , in response to user input 1106, electronic device 700 replaces the display of user interface 1102 with copresence user interface 1108. Copresence user interface 1108 includes first avatar 1110 and second avatar 1112. First avatar 1110 has a visual appearance corresponding to a remote user participating in a copresence situation with user 703. For example, the remote user may be a registered user (e.g., a registered user on a remote electronic device operated by the registered user, a registered user of a service), and a user account corresponding to the remote user may be associated with avatar appearance information (e.g., avatar appearance information selected and / or specified by the remote user). As described above, in FIG. 11A , electronic device 700 has identified user 703 as John, a first registered user. Based on this identification, electronic device 700 displays avatar 1112, an avatar having a visual appearance corresponding to the first registered user (e.g., corresponding to a first user account corresponding to the first registered user). In some embodiments, the first registered user has selected and / or specified one or more visual characteristics (e.g., hair color, hair shape, face shape, face size, eye color, eye size, mouth shape, mouth size, nose shape, nose size, and / or skin color) of avatar 1112. In some embodiments, one or more visual features of avatar 1112 move within user interface 1108 in response to movement by user 703. For example, when user 703 moves the user's head, eyebrows, eyes, nose, and / or mouth, avatar 1112 optionally moves in a corresponding manner within co-presence user interface 1108. Similarly, one or more visual features of avatar 1110 optionally move within user interface 1108 in response to movement by the remote user. Although the illustrated co-presence user interface 1108 shows avatars 1110, 1112 including only a head, the avatars may include representations of additional parts of the user's body, and those avatar parts may, in some embodiments, move in accordance with the user's corresponding movements of the respective parts of the user's body.
[0200] 11B is shown from the perspective of electronic device 700 as seen by user 703, it can be understood that similar features can be described from the perspective of a remote user (represented by avatar 1110) and an electronic device being used and / or operated by the remote user. The remote user's electronic device optionally displays a co-presence user interface similar to co-presence user interface 1108, optionally displaying two avatars 1110, 1112 corresponding to the remote user and the first registered user (user 703).
[0201] In the illustrated embodiment, electronic device 700 is a smartwatch, and FIGS. 11A-11B show user interfaces (e.g., 1102, 1108) via touchscreen display 702 of electronic device 700. However, as described above, in some embodiments, electronic device 700 is a different device, such as a head-mounted system (e.g., a headset) designed to be worn on a user's head. In some embodiments, the head-mounted system displays a user interface substantially similar to user interface 1102 of FIG. 11A and receives one or more user inputs corresponding to selection of selectable object 1104. The user interface may differ from user interface 1102 in one or more respects. For example, in some embodiments, the user interface displayed by the head-mounted system is a virtual three-dimensional user interface, while user interface 1102 is displayed as a two-dimensional user interface. The one or more user inputs may include, for example, eye / gaze movements, hand movements, and one or more gestures corresponding to selection of selectable object 1104. In some embodiments, in response to one or more user inputs corresponding to the selection of selectable object 1104, the head-mounted system displays a co-presence user interface substantially similar to user interface 1108. The co-presence user interface may differ from user interface 1108 in one or more respects. For example, in some embodiments, the co-presence user interface is a virtual three-dimensional user interface having an avatar (e.g., a three-dimensional representation) of each user participating in the co-presence session (similar to avatars 1110 and 1112 in FIG. 11B ). Similar to that described above with reference to FIG. 11B , in some embodiments, each user's avatar representation has one or more visual characteristics selected and / or specified by the individual user represented by the avatar. Further, in some embodiments, each user's avatar representation has one or more visual characteristics that move within the three-dimensional virtual environment based on the movement of the individual user represented by the avatar.
[0202] 11C , the user 703 removes the electronic device 700 from the user's body. The electronic device 700 detects that the electronic device 700 is no longer located on the user's body. In some embodiments, in response to detecting that the electronic device 700 is no longer located on the user's body, the electronic device 700 ceases displaying the avatar 1112 in the co-presence user interface 1108. (Similarly, a remote electronic device operated by a remote user may also cease displaying an avatar representing and corresponding to the first registered user 703.)
[0203] 11D, a second user 1103 (different from the first user and different from the remote user) places the electronic device 700 on his or her wrist. The electronic device 700 detects that the electronic device 700 has been placed on the user's body.
[0204] In the illustrated embodiment, electronic device 700 is a smartwatch, and FIGS. 11A-11B show user interfaces (e.g., 1102, 1108) via touchscreen display 702 of electronic device 700. However, as noted above, in some embodiments, electronic device 700 is a different device, such as a head-mounted system (e.g., headset) designed to be worn on a user's head. In some such embodiments, in FIG. 11C , the head-mounted system detects that the head-mounted system is no longer positioned on the head of user 703. In response to detecting that the head-mounted system is no longer positioned on the head of user 703, the head-mounted system ceases displaying a representation of user 703 within the virtual (e.g., three-dimensional) co-presence environment (e.g., ceases displaying an (e.g., three-dimensional) avatar associated with user 703). In FIG. 11D , user 1103 places the head-mounted system on the user's head, and the head-mounted system detects that the head-mounted system has been positioned on the user's head.
[0205] 11D , in response to detecting that electronic device 700 has been placed on a user's body, electronic device 700 attempts to automatically identify user 1103. In some embodiments, electronic device 700 optionally attempts to identify user 1103 in various ways. For example, electronic device 700 optionally attempts to automatically identify the user based on biometric information, such as facial recognition, eye (e.g., iris) recognition, and / or fingerprint recognition. In FIG. 11D , in response to detecting that electronic device 700 has been placed on a user's body, electronic device 700 collects biometric information from user 1103 (e.g., a facial scan and / or an eye (e.g., iris) scan using camera 708) and determines that the biometric information corresponds to Sarah, a second registered user.
[0206] As described above, the first registered user 703 is associated with a particular set of avatar appearance information, and avatar 1112 was displayed using the avatar appearance information corresponding to the first registered user 703. Similarly, the second registered user, Sarah, is associated with a second set of avatar appearance information (different from the first set), such that the second registered user is represented by an avatar having a different visual appearance than the first registered user's avatar.
[0207] 11E , in response to determining that user 1103 is the second enrolled user (e.g., in response to determining that the biometric information corresponds to the second enrolled user), electronic device 700 displays new avatar 1114 having a visual appearance corresponding to the second enrolled user (e.g., having one or more visual characteristics selected and / or specified by the second enrolled user). Similar to avatar 1112, in some embodiments, one or more visual characteristics of avatar 1114 optionally move within user interface 1108 in response to movement by user 1103. For example, if user 1103 moves their head, eyebrows, eyes, nose, and / or mouth, avatar 1114 moves in a corresponding manner within co-presence user interface 1108 (although avatar 1114 does not move based on the movement of user 703). It can be seen that based on automatic user identification (e.g., based on biometric identification), the electronic device 700 automatically displays an avatar 1112 corresponding to the first registered user 703, and then, when the user of the electronic device 700 switches from the first registered user 703 to the second registered user 1103, the electronic device 700 automatically replaces the display of the avatar 1112 with a display of the avatar 1114 corresponding to the second registered user.
[0208] 11F illustrates a different exemplary scenario in which the second user 1103 is an unregistered guest user. In this exemplary scenario, the electronic device 700 determines (e.g., based on biometric information) that the second user 1103 is an unregistered user. In response to determining that the second user 1103 is an unregistered user, the electronic device 700 displays, within the co-presence environment 1108, an avatar 1116 having a placeholder appearance with a default set of visual characteristics. For example, in FIG. 11F, the placeholder appearance is an abstract circle representation. In some embodiments, registered users may select and / or specify one or more visual characteristics of their representative avatar, while unregistered guest users are optionally not given the option to select and / or specify visual characteristics of their avatar.
[0209] In the illustrated embodiment, electronic device 700 is a smartwatch, and FIGS. 11A-11F show a user 703, 1103 putting the smartwatch on or removing the smartwatch from the user's wrist. However, as noted above, in some embodiments, electronic device 700 is a different device, such as a head-mounted system (e.g., a headset) designed to be worn on the user's head. In such embodiments, electronic device 700 optionally attempts to automatically identify the user when it is determined that electronic device 700 is placed on the user's head (e.g., based on iris recognition and / or facial recognition when the device is placed on the user's head). Additionally, in such embodiments, content such as user interface 1108 and avatars 1110, 1112, 1114, 1116 are optionally displayed via the head-mounted system, and one or more user inputs can be received via one or more input devices in communication with the head-mounted system. 11E, in response to detecting that the head-mounted system has been placed on the head of user 1103, the head-mounted system identifies user 1103 as a second registered user (e.g., via iris scan authentication). In some embodiments, in response to identifying user 1103 as a second registered user, the head-mounted system replaces the display of the avatar corresponding to user 703 in the three-dimensional virtual co-presence environment with a (e.g., three-dimensional) avatar corresponding to user 1003. In some embodiments, in FIG. 11F, if the head-mounted system identifies user 1103 as an unregistered and / or guest user, the head-mounted system replaces the display of the avatar corresponding to user 703 in the three-dimensional co-presence environment with a (e.g., three-dimensional) avatar corresponding to the unregistered and / or guest user.
[0210] 12A-12B are flow diagrams illustrating a method for automatically applying and displaying a user avatar based on an identification of a user using an electronic device, according to some embodiments. Method 1200 is performed on a first computing system (e.g., 700, 101) in communication with a display generation configuration component and one or more input devices. Some operations of method 1200 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.
[0211] As described below, method 1200 provides an intuitive way to automatically apply and display a user avatar based on the user's identity. This method reduces the cognitive burden on the user in displaying the user avatar, thereby creating a more efficient human-machine interface. For battery-operated computing devices, allowing users to display user avatars more quickly and efficiently conserves power and extends the time between battery charges.
[0212] In some embodiments, a first computer system (e.g., device 700, computer system 101) ...) is in communication with a display generation component (e.g., display 702) (e.g., display controller, touch-sensitive display system, display (e.g., integrated or connected), 3D display, see-through display, projector, head-up display) and one or more input devices (e.g., 702, 704, 706, 708) (e.g., touch-sensitive surface (e.g., touch-sensitive display), mouse, keyboard, remote control, visual input device (e.g., camera), audio input device (e.g., microphone), biometric sensor (e.g., fingerprint sensor, face identification sensor, iris identification sensor)). A device (e.g., a smartphone, a smartwatch, a tablet, a head-mounted system, a wearable device) detects (1202) a request (e.g., user input 1106) to display an avatar of a user (e.g., user 703, user 1103, and / or a remote user represented by avatar 1110) of a separate computer system (e.g., a first computer system or a second computer system different from the first computer system) (e.g., a request to enter a co-present communication session or to display a virtual environment (e.g., an XR environment (e.g., virtual reality (VR), augmented reality (AR), and / or mixed reality (MR))) including an avatar representation of the user of the first computer system and / or an avatar representation of the user of the second computer system). In some embodiments, the request to display the avatar of the user of the separate computer system corresponds to a request to enter a communication session including the user of the separate computer system (e.g., and one or more other users of other computer systems). In some embodiments, the request to display the avatar of the user of the separate computer system occurs during a communication session including the user of the separate computer system (e.g., and one or more other users of other computer systems).
[0213] In response to detecting 1204 a request to display an avatar (e.g., user input 1106), the first computer system displays 1206 an avatar of a user of the individual computer system (e.g., 1110, 1112, 1114, 1116). In response to determining 1208 that a user of the individual computer system is a registered user of the individual computer system (e.g., based on options selected by the user and / or one or more user inputs indicating that the user is a registered user, and / or based on automated biometric identification of the user as a registered user), the first computer system displays 1210 an avatar (e.g., avatar 1110, 1112, 1114) having an appearance selected by the user of the individual computer system (e.g., based on information provided by the user during a registration process, such as a biometric scan or avatar creation process), where the avatar moves based on movements of the user detected by one or more sensors of the individual computer system. In some embodiments, the facial features of the avatar move based on movements of the user's face detected by one or more sensors of the individual computer system. In some embodiments, determining that the user of the individual computer system is a registered user of the individual computer system is performed in response to determining that at least a portion of the individual computer system is located on the body of the user of the individual computer system. In some embodiments, biometric information (e.g., corresponding to the user of the individual computer system) is received (e.g., by and / or at the individual computer system) in response to detecting that the individual computer system is located on the body of the user of the individual computer system. In some embodiments, an avatar is displayed within an XR environment (e.g., virtual reality (VR), augmented reality (AR), and / or mixed reality (MR)) (e.g., within the co-presence user interface 1008).
[0214] In accordance with a determination 1212 that the user of the individual computer system is not a registered user of the individual computer system (e.g., based on an option selected by the user and / or one or more user inputs indicating that the user is not a registered user, and / or based on an automated biometric identification of the user as not being a registered user), the first computer system displays 1214 an avatar (e.g., avatar 1116 of FIG. 11F ) having a placeholder appearance that does not represent the appearance of the user of the individual computer system (in some embodiments, not selected by the user of the individual computer system), the avatar moving based on movements of the user detected by one or more sensors of the individual computer system. In some embodiments, features of the avatar move based on movements of the user's body detected by one or more sensors of the individual computer system. In some embodiments, the determination that the user of the individual computer system is not a registered user of the individual computer system is made in response to a determination that at least a portion of the individual computer system has been placed on the body of the user of the individual computer system. In some embodiments, biometric information (e.g., corresponding to the user of the individual computer system) is received (e.g., by and / or at the individual computer system) in response to detecting that the individual computer system has been placed on the body of the user of the individual computer system. In some embodiments, the individual computer system is a first computer system and the user of the individual computer system is a user of the first computer system. In some embodiments, determining that the user of the individual computer system is a registered user of the individual computer system is determining that the user of the first computer system is a registered user of the first computer system. In some embodiments, determining that the user of the individual computer system is a registered user of the individual computer system is performed at and / or by the first computer system.In some embodiments, the determination that the user of the individual computer system is not a registered user of the individual computer system is performed at and / or by the first computer system. In some embodiments, the individual computer system is a second computer system different from the first computer system, and the user of the individual computer system is a user of the second computer system. In some embodiments, the determination that the user of the individual computer system is a registered user of the individual computer system is a determination that the user of the second computer system is a registered user of the second computer system. In some embodiments, the determination that the user of the individual computer system is a registered user of the individual computer system is performed at and / or by the second computer system. In some embodiments, the determination that the user of the individual computer system is not a registered user of the individual computer system is a determination that the user of the second computer system is not a registered user of the second computer system. In some embodiments, the determination that the user of the individual computer system is not a registered user of the individual computer system is performed at and / or by the second computer system.
[0215] Displaying an avatar with a particular appearance based on a determination that a user of an individual computer system is a registered user of the individual computer system provides the user with feedback regarding the current state of the device (e.g., that the user of the individual computer system is a registered user (e.g., a particular registered user)). Providing the user with improved visual feedback improves device usability, increases the efficiency of the user-device interface (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device, thereby reducing user errors), and further reduces device power consumption and improves battery life by allowing the user to use the device more quickly and efficiently.
[0216] By automatically displaying an avatar having a particular appearance based on a determination that a user of a particular computer system is a registered user of the particular computer system, the device is provided with the ability to switch between different avatars associated with different users without requiring complex and / or extensive user input. By performing an action when a set of conditions is met without requiring further user input, the device can be more easily operated (e.g., by performing the action without additional user input), the user can interface more efficiently with the device (e.g., by assisting the user in providing appropriate input and reducing user errors when operating / interacting with the device), and the device can be more quickly and efficiently used, thereby reducing power usage and improving battery life.
[0217] Displaying an avatar with a placeholder appearance when it is determined that the user is not a registered user provides security. Displaying an avatar with a placeholder appearance when it is determined that the user is not a registered user also improves device usability (e.g., by restricting unauthorized access), makes the user-device interface more efficient and / or secure, and reduces power usage and improves device battery life by restricting the execution of restricted operations.
[0218] In some embodiments, an avatar (e.g., 1112) visually represents (1216) a user of the first computer system (e.g., the individual computer system is the first computer system) (e.g., avatar 1112 visually represents user 703 and avatar 1114 visually represents user 1103). Displaying an avatar representing the user of the first computer system provides the user with feedback regarding the current state of the device (e.g., that the first computer system has identified the user of the first computer system). Providing the user with improved visual feedback may improve device usability, increase the efficiency of the user-device interface (e.g., by helping the user provide appropriate inputs when operating / interacting with the device, reducing user errors), and further reduce device power consumption and improve battery life by allowing the user to use the device more quickly and efficiently.
[0219] In some embodiments, the avatar (e.g., 1110) visually represents (1218) a user of a second computer system that is different from the first computer system (e.g., the separate computer system is a second computer system that is different from the first computer system) (e.g., avatar 1110 visually represents a user of the second computer system that is different from electronic device 700). Displaying an avatar representing the user of the second computer system provides the user with feedback regarding the current state of the device (e.g., that the second computer system has identified the user of the second computer system). Providing the user with improved visual feedback may improve device usability, increase the efficiency of the user-device interface (e.g., by helping the user provide appropriate inputs when operating / interacting with the device, thereby reducing user errors), and further reduce device power consumption and improve battery life by allowing the user to use the device more quickly and efficiently.
[0220] In some embodiments, the avatar is displayed 1220 (e.g., displayed to) one or more users (e.g., at a remote computer system used by the remote user represented by avatar 1110) interacting with the user of the individual computer system (e.g., one or more users in a co-present communication session with the user of the individual computer system and / or one or more users in substantially the same virtual environment as the user of the individual computer system). Displaying the avatar at one or more computer systems of one or more users interacting with the user of the individual computer system provides feedback to those users regarding the current state of the device (e.g., that the individual computer system has identified the user of the individual computer system). Providing improved visual feedback to the user improves device usability, increases the efficiency of the user-device interface (e.g., by helping the user provide appropriate inputs when operating / interacting with the device, thereby reducing user errors), and further reduces device power consumption and improves battery life by allowing users to use the device more quickly and efficiently.
[0221] In some embodiments, at least a portion (e.g., the avatar's hands, head, and / or body) of an avatar (e.g., 1110, 1112, 1114) is displayed (1222) via a display generation component in communication with a separate computer system. In some embodiments, the separate computer system is a first computer system (e.g., device 700), and the display generation component in communication with the separate computer system is a display generation component (e.g., display 702) in communication with the first computer system. In some embodiments, the separate computer system is a second computer system different from the first computer system, and the display generation component in communication with the separate computer system is a second display generation component different from the display generation component in communication with the first computer system. In some embodiments, an avatar represents a user of the first computer system (e.g., User 703, User 1103), and the first computer system, via a display generation component, displays at least a portion of the avatar (e.g., the avatar's hands and / or body are displayed for viewing by the user of the first computer system) (e.g., Avatar 1112, Avatar 1114). Displaying an avatar representing the user of the first computer system provides the user with feedback regarding the current state of the device (e.g., that the first computer system has identified the user of the first computer system). Providing the user with improved visual feedback improves device usability, increases the efficiency of the user-device interface (e.g., by helping the user provide appropriate inputs when operating / interacting with the device, thereby reducing user errors), and further reduces device power consumption and improves battery life by allowing the user to use the device more quickly and efficiently.
[0222] In some embodiments, the registered user is a first registered user and the appearance is a first appearance. Upon determining that a user of the individual computer system is a second registered user (e.g., user 1103) of the individual computer system that is different from the first registered user (e.g., user 703) (e.g., based on an option selected by the user and / or one or more user inputs indicating that the user is the second registered user, and / or based on automated biometric identification of the user as the second registered user), an avatar (e.g., avatar 1114) having a second appearance that is different from the first appearance (e.g., avatar 1112) is displayed, the second appearance being selected by the second registered user (e.g., based on information provided by the second registered user during a registration process, such as a biometric scan or an avatar creation process). In some embodiments, the avatar is displayed within an XR environment (e.g., virtual reality (VR), augmented reality (AR), and / or mixed reality (MR)). In some embodiments, the avatar moves based on user movement detected by one or more sensors of the individual computer system. In some embodiments, the avatar's facial features move based on movements of the user's face detected by one or more sensors of the individual computer system. Displaying the avatar with a second appearance selected by a second registered user provides the user with feedback regarding the device's current state (e.g., that the individual computer system has identified the user of the individual computer system). Providing the user with improved visual feedback improves device usability, increases the efficiency of the user-device interface (e.g., by helping the user provide appropriate inputs when operating / interacting with the device, thereby reducing user errors), and further reduces device power consumption and improves battery life by allowing the user to use the device more quickly and efficiently.
[0223] In some embodiments, the determination that the user of the individual computer system is a registered user of the individual computer system is performed based on automated biometric identification of the user as a registered user, where the automated biometric identification includes eye-based identification (e.g., iris-based identification). In some embodiments, the individual computer system is a first computer system (e.g., device 700), and the user of the individual computer system is a user of the first computer system (e.g., user 703, 1103). In some embodiments, the determination that the user of the individual computer system is a registered user of the individual computer system is a determination that the user of the first computer system is a registered user of the first computer system. In some embodiments, the determination that the user of the individual computer system is a registered user of the individual computer system is performed at and / or by the first computer system. In some embodiments, the automated biometric identification of the user as a registered user is performed at and / or by the first computer system. In some embodiments, the method further includes, after detecting that at least a portion of the computer system is placed on the body of the individual user, identifying the individual user as a registered user of the individual computer system (e.g., a registered user of the first computer system) based on automated biometric identification, where the automated biometric identification includes eye-based identification.
[0224] In some embodiments, the individual computer system is a second computer system different from the first computer system (e.g., a remote computer system in communication with device 700), and the user of the individual computer system is a user of the second computer system (e.g., a remote user represented by avatar 1110). In some embodiments, determining that the user of the individual computer system is a registered user of the individual computer system is a determination that the user of the second computer system is a registered user of the second computer system. In some embodiments, determining that the user of the individual computer system is not a registered user of the individual computer system is a determination that the user of the second computer system is not a registered user of the second computer system. In some embodiments, determining that the user of the individual computer system is a registered user of the individual computer system is performed in and / or by the second computer system. In some embodiments, determining that the user of the individual computer system is not a registered user of the individual computer system is performed in and / or by the second computer system. In some embodiments, the automated biometric identification of the user as a registered user and / or an unregistered user is performed in and / or by a second computer system (e.g., without being performed by the first computer system).
[0225] In some embodiments, the separate computer system is a head-mounted system (e.g., a headset). In some embodiments, the automated biometric identification of the user is performed in response to determining that the separate computer system is placed on the user's head. In some embodiments, the eye-based identification is performed by one or more eye-tracking devices in communication with (e.g., incorporated into) the separate computer system. In some embodiments, iris scan information is collected by the separate computer system in response to determining that the separate computer system is placed on the user's head.
[0226] Automatically identifying a user based on biometric identification provides a device with the ability to perform various actions without explicit user input (e.g., identify a user and automatically apply an appropriate (e.g., user-selected avatar)). Performing an action when a set of conditions is met without requiring further user input can improve device operability (e.g., by performing an action without additional user input), make the user-device interface more efficient (e.g., by assisting the user in providing appropriate input and reducing user errors when operating / interacting with the device), and also reduce power usage and improve device battery life by allowing the user to use the device more quickly and efficiently.
[0227] In some embodiments, the automatic biometric identification is performed automatically in response to a determination that at least a portion of the individual computer system is placed on the user's body (e.g., in response to a determination that the individual computer system is worn by the user) (e.g., in FIG. 11A, the automatic biometric identification is performed automatically in response to a determination that the electronic device 700 is placed on the body of the user 703, and in FIG. 11D, the automatic biometric identification is performed automatically in response to a determination that the electronic device 700 is placed on the body of the user 1103).
[0228] In some embodiments, the individual computer system is a head-mounted system (e.g., a headset). In some embodiments, the automatic biometric identification of the user is performed automatically in response to determining that the individual computer system is placed on the user's head. In some embodiments, biometric information (e.g., iris scan information, face scan information) is automatically collected by the individual computer system in response to determining that the individual computer system is placed on the user's head.
[0229] In some embodiments, the individual computer system is a first computer system (e.g., device 700), and the user of the individual computer system is a user of the first computer system (e.g., user 703, 1103). In some embodiments, determining that the user of the individual computer system is a registered user of the individual computer system is a determination that the user of the first computer system is a registered user of the first computer system. In some embodiments, determining that the user of the individual computer system is a registered user of the individual computer system is performed at and / or by the first computer system. In some embodiments, automated biometric identification of the user as a registered user is performed at and / or by the first computer system. In some embodiments, the method further includes identifying the individual user as a registered user of the individual computer system (e.g., a registered user of the first computer system) based on the automated biometric identification in response to detecting that at least a portion of the computer system is placed on a body of the individual user, wherein the automated biometric identification includes eye-based identification.
[0230] In some embodiments, the individual computer system is a second computer system different from the first computer system (e.g., a remote computer system in communication with device 700), and the user of the individual computer system is a user of the second computer system (e.g., a remote user represented by avatar 1110). In some embodiments, determining that the user of the individual computer system is a registered user of the individual computer system is a determination that the user of the second computer system is a registered user of the second computer system. In some embodiments, determining that the user of the individual computer system is not a registered user of the individual computer system is a determination that the user of the second computer system is not a registered user of the second computer system. In some embodiments, determining that the user of the individual computer system is a registered user of the individual computer system is performed in and / or by the second computer system. In some embodiments, determining that the user of the individual computer system is not a registered user of the individual computer system is performed in and / or by the second computer system. In some embodiments, the automated biometric identification of the user as a registered user and / or an unregistered user is performed in and / or by a second computer system (e.g., without being performed by the first computer system).
[0231] Automatically identifying a user based on biometric identification when a computer system is placed on the user's body provides the device with the ability to perform various actions without explicit user input (e.g., identify the user and automatically apply an appropriate (e.g., user-selected avatar)). Performing an action when a set of conditions is met without requiring further user input improves device operability (e.g., by performing an action without additional user input), makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate input and reducing user errors when operating / interacting with the device), and additionally reduces power usage and improves device battery life by allowing the user to use the device more quickly and efficiently.
[0232] In some embodiments, the registered user is a first user, and the appearance is a first appearance selected by the first user. The computer system detects, via one or more input devices, that the computer system has been removed from the first user's body (e.g., the user has stopped wearing the computer system) (e.g., FIG. 11C ). After detecting that the computer system has been removed from the first user's body, the computer system detects, via one or more input devices, that the computer system has been placed on the individual user's body (e.g., the individual user has worn the computer system) (e.g., FIG. 11D ). In response to detecting that the computer system has been placed on the individual user's body, and in accordance with a determination that the first user is no longer a user of the individual computer system (e.g., in accordance with a determination that at least a portion of the individual computer system has been removed from the first registered user's body (in some embodiments, in accordance with a determination that the individual computer system is no longer worn by the first registered user)), the computer system ceases displaying the avatar having the first appearance selected by the first user (e.g., FIG. 11E , avatar 1112 is no longer displayed). In response to detecting that the computer system has been placed on the body of the individual user, and in accordance with a determination that the user of the individual computer system is a second user of the individual computer system (e.g., user 1103) different from the first user (e.g., user 703) (e.g., in accordance with a determination that at least a portion of the individual computer system has been placed on the body of a second registered user (in some embodiments, in accordance with a determination that the second registered user has worn the computer system)), the computer system displays an avatar (e.g., avatar 1114) having a second appearance (e.g., selected by the second registered user and different from the first appearance). In some embodiments, the avatar is displayed within an XR environment (e.g., virtual reality (VR), augmented reality (AR), and / or mixed reality (MR)).In some embodiments, the avatar moves based on user movement detected by one or more sensors of the individual computer system. In some embodiments, facial features of the avatar move based on user facial movement detected by one or more sensors of the individual computer system. In some embodiments, displaying the avatar having the second appearance includes replacing a display of the avatar having the first appearance with a display of the avatar having the second appearance. In some embodiments, the method further includes receiving biometric information (e.g., corresponding to the individual user) via one or more input devices in response to detecting that the computer system has been placed on the individual user's body. Techniques for handing devices between users (and / or removing / exchanging devices between users / the same user) are further described with respect to FIGS. 13A-13K and corresponding description. The techniques described with respect to FIGS. 13A-13K can be implemented with respect to the techniques described with respect to FIGS. 11A-11F.
[0233] Displaying an avatar with a second appearance based on a determination that the user of the individual computer system is a second user provides the user with feedback regarding the current state of the device (e.g., that the individual computer system has identified the user of the individual computer system). Providing improved visual feedback to the user improves device usability, increases the efficiency of the user-device interface (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device, thereby reducing user errors), and further reduces device power consumption and improves battery life by allowing the user to use the device more quickly and efficiently.
[0234] In some embodiments, the placeholder appearance is an abstract representation (e.g., an avatar 1116) (e.g., a geometric shape, a point cloud, a blurred figure, a non-humanoid shape). In some embodiments, one or more visual characteristics of the avatar move based on movement of the user's face detected by one or more sensors of the individual computer system. Displaying an avatar with an abstract placeholder appearance based on a determination that the user of the individual computer system is not a registered user of the individual computer system provides the user with feedback regarding the current state of the device (e.g., that the user of the individual computer system is not a registered user). Providing the user with improved visual feedback improves device usability, increases the efficiency of the user-device interface (e.g., by helping the user provide appropriate inputs when operating / interacting with the device, thereby reducing user errors), and further reduces device power consumption and improves battery life by allowing the user to use the device more quickly and efficiently.
[0235] It should be noted that the process details described above with respect to method 1200 (e.g., FIGS. 12A-12B) are applicable in a similar manner to methods described elsewhere herein. For example, methods 800, 1000, and / or 1400 optionally include one or more of the features of the various methods described above with reference to method 1200. For example, a user-specific avatar may be automatically applied as part of one or more settings associated with the user as described in method 800, and / or a user-specific avatar may be automatically applied along with a set of user-specific device calibration settings as described in method 1000. In another example, a user-specific avatar may be applied and / or de-applied based on automatic user identification as the device is handed between users, as described in method 1400. For brevity, these details will not be repeated below.
[0236] 13A-13K illustrate exemplary user interfaces for displaying content based on handover criteria, according to some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes of FIGS. 14A-14B.
[0237] 13A shows electronic device 700 that is a smartwatch that includes a touch-sensitive display 702, a rotatable and depressible input mechanism 704 (e.g., rotatable and depressible relative to the device housing or frame), buttons 706, and a camera 708. In some embodiments described below, electronic device 700 is a wearable smartwatch device. In some embodiments, electronic device 700 is a smartphone, tablet, head-mounted system (e.g., headset), or other computer system that includes and / or is in communication with a display device (e.g., display screen, projection device, etc.). Electronic device 700 is a computer system (e.g., computer system 101 of FIG. 1).
[0238] 13A , a user 703 is wearing an electronic device 700. The electronic device 700 has identified the user 703 as a first registered user (e.g., via login credentials and / or passcode entry and / or via automated biometric identification, as described above). The electronic device 700 displays a user avatar 1302 to indicate that the electronic device 700 is being used by the first registered user. The electronic device 700 also displays a video player user interface 1304 that includes video content 1306a, a home affordance 1306b, a multitasking affordance 1306c, a share affordance 1306d, and a play / pause affordance 1306e. The home affordance 1306b is selectable by the user to navigate to the home user interface (e.g., to replace the display of the video player user interface 1304 with the home user interface). The multitasking affordance 1306c is selectable by the user to navigate to a multitasking user interface (e.g., replace the display of the video player user interface 1304 with the multitasking user interface). The share affordance 1306d is selectable by the user to share content (e.g., share the video content 1306a) (e.g., display a content sharing user interface). The play / pause affordance 1306e is selectable by the user to pause and / or play the video content 1306a.
[0239] 13B, while user 703 is still wearing electronic device 700, electronic device 700 receives an indication of a new message for the first registered user. Electronic device 700 displays notification 1308 corresponding to the new message superimposed on video player user interface 1304.
[0240] 13C shows that user 703 removes electronic device 700 from the user's body. Electronic device 700 detects that electronic device 700 is no longer placed on the user's body. In response to detecting that electronic device 700 is no longer placed on the user's body, electronic device 700, optionally, ceases displaying video player user interface 1304.
[0241] In the illustrated embodiment, electronic device 700 is a smartwatch, and FIG. 13C shows user 703 removing the smartwatch from the user's wrist. However, as noted above, in some embodiments, electronic device 700 is a different device, such as a head-mounted system (e.g., a headset) designed to be worn on the user's head. In some such embodiments, the head-mounted system detects that it has been removed from the user's head.
[0242] 13D-13K illustrate various exemplary scenarios that optionally occur after electronic device 700 is removed from the body of user 703.
[0243] 13D illustrates a first exemplary scenario in which the electronic device 700 is removed from the body of the user 703 (and without any intervening user) and then the same user 703 places the electronic device 700 back onto the user's body. The electronic device 700 detects and / or determines that the electronic device 700 has been placed on the user's body and identifies the user as the first registered user 703 (e.g., via automated biometric identification and / or login credentials).
[0244] In FIG. 13D, in response to determining that the electronic device 700 has been placed on the body of the first registered user 703 (e.g., in response to determining that the electronic device 700 has been placed on the body of the first registered user 703 who was also the last previous user of the electronic device 700), the electronic device 700 re-displays the same user interface and / or content (e.g., video player user interface 1304) that was displayed immediately before the electronic device 700 was removed from the user's body.
[0245] In the illustrated embodiment, electronic device 700 is a smartwatch, and FIG. 13D shows user 703 placing the smartwatch on the user's wrist. However, as noted above, in some embodiments, electronic device 700 is a different device, such as a head-mounted system (e.g., a headset) designed to be worn on the user's head. In some such embodiments, user 703 places the head-mounted system on the user's head, and the head-mounted system detects that the head-mounted system has been placed on the user's head. In some embodiments, in response to determining that the head-mounted system has been placed on the user's head, the head-mounted system automatically identifies the user (e.g., based on automatic biometric identification). In the scenario shown in FIG. 13D , the head-mounted system determines that the user is the first registered user 703 and redisplays the same user interface and / or content that was displayed immediately before the head-mounted system was removed from the user's 703's body. In this manner, when the user removes the head-mounted system and then re-attaches the head-mounted system (e.g., without any intervening user), the user can return to their previous viewing experience.
[0246] 13E illustrates a second exemplary scenario in which a different user 1103 wears electronic device 700 on their body after electronic device 700 has been removed from the body of user 703 (e.g., without any intervening user wearing electronic device 700). Electronic device 700 detects and / or determines that electronic device 700 has been placed on the user's body and determines that the user (e.g., user 1103) is a different user than the last previous user (e.g., user 703). Additionally, in the scenario of FIG. 13E, electronic device 700 detects and / or determines that handover criteria have not been met.
[0247] In some embodiments, the handover criteria optionally include criteria that are met, for example, if the electronic device 700 does not receive user input corresponding to a request to lock the electronic device 700, a user input corresponding to a request to turn off the electronic device 700, and / or a user input corresponding to a request to put the electronic device 700 to sleep (e.g., if the electronic device 700 does not receive such user input for a predetermined period of time, such as the period between the time when the user 703 removes the electronic device 700 and the time when the user 1103 puts on the electronic device 700). For example, if the user 703 provides user input corresponding to a request to lock the electronic device 700 before the user 1103 puts on the electronic device 700, the handover criteria are not met. Such user input is optionally provided, for example, within a digital user interface and / or via a physical button (e.g., button 706, depressible and rotatable input mechanism 704, etc.). In some embodiments, the handover criteria are met if all of the criteria of the handover criteria are met. In embodiments in which electronic device 700 is a different device, such as a head-mounted system, similar handover criteria can apply. For example, in some embodiments, the handover criteria can include criteria that are met when electronic device 700 does not receive user input corresponding to a request to lock the head-mounted system, to turn off the head-mounted system, and / or to put the head-mounted system to sleep (e.g., when the head-mounted system does not receive such user input for a predetermined period of time, such as the period between when user 703 removes the head-mounted system and when user 1103 puts it on). Such user input is optionally provided, for example, within a digital user interface (e.g., a virtual environment displayed by the head-mounted system) and / or via a physical button (e.g., a physical button on the head-mounted system).
[0248] In some embodiments, the handover criteria optionally include a criterion that is met if less than a threshold period of time elapses between detecting that the electronic device 700 has been removed from the body of a first user (e.g., user 703) and detecting that the electronic device 700 has been placed on the body of a subsequent user (e.g., user 1103). For example, if a period of time longer than the threshold period of time elapses between user 703 removing electronic device 700 and user 1103 putting on electronic device 700, the handover criteria are not met. In embodiments in which electronic device 700 is a different device, such as a head-mounted system, similar handover criteria can apply. For example, in some embodiments, the handover criteria may include a criterion that is met if less than a threshold period of time elapses between detecting that the head-mounted system has been removed from the body of a first user (e.g., user 703) (e.g., removed from the first user's head) and detecting that the head-mounted system has been placed on the body of a subsequent user (e.g., user 1103) (e.g., placed on the subsequent user's head).
[0249] In some embodiments, the handover criteria optionally include criteria that are met if the previous user (e.g., first registered user 703) is a registered user. For example, if the previous user (e.g., user 703) was an unregistered user using electronic device 700 in guest mode, the handover criteria are not met and the subsequent user 1103 cannot see user interface 1304, even in a limited capacity. In embodiments in which electronic device 700 is a different device, such as a head-mounted system, similar handover criteria can apply.
[0250] 13E , in response to determining that the electronic device 700 is located on the body of a user different from the first registered user 703 and in response to determining that the handover criteria are not met, the electronic device 700 ceases displaying the video player user interface 1304 and displays different content (e.g., a different user interface). In the illustrated example, the electronic device 700 has identified the user 1103 as Sarah, a second registered user. In response to this determination, the electronic device 700 displays a personalization user interface 714 corresponding to the second registered user (the personalization user interface 714 is described in more detail above with reference to FIG. 7C ). In an alternative scenario in which the electronic device 700 identifies the user 1103 as an unregistered user, the electronic device 700 may, for example, display a guest user interface (e.g., the guest user interface 718 of FIG. 7D ) and / or a user picker user interface (e.g., the user picker user interface 722 of FIG. 7E ).
[0251] In the illustrated embodiment, electronic device 700 is a smartwatch, and FIG. 13E shows user 1103 placing the smartwatch on the user's wrist. However, as noted above, in some embodiments, electronic device 700 is a different device, such as a head-mounted system (e.g., a headset) designed to be worn on the user's head. In some such embodiments, user 1103 places the head-mounted system on the user's head, and the head-mounted system detects that the head-mounted system has been placed on the user's head. In some embodiments, in response to determining that the head-mounted system has been placed on the user's head, the head-mounted system automatically identifies the user (e.g., based on automatic biometric identification). In the scenario shown in FIG. 13E, the head-mounted system determines that the user is a second registered user 1103. The head-mounted system further determines that handover criteria have not been met. In some embodiments, in accordance with determining that the user is a second registered user 1103 different from the previous user (user 703) and that the handover criteria have not been met, the head-mounted system displays content (e.g., a personalized user interface) corresponding to second registered user 1103. In some embodiments, content corresponding to the second registered user 1103 is presented by a head-mounted system within the three-dimensional virtual environment.
[0252] 13F illustrates a third exemplary scenario in which a second user 1103 puts the electronic device 700 on his or her body after the electronic device 700 has been removed from the body of the user 703 (e.g., without any intervening user), and the handover criteria are met. The electronic device 700 detects that a user different from the first registered user (user 703) has put on the electronic device 700 and that the handover criteria are met.
[0253] 13F , in response to determining that a user different from the first registered user 703 is wearing the electronic device 700 and that the handover criteria have been met, the electronic device 700 displays the user interface 1304 in a restricted mode. In some embodiments, the electronic device 700 remains logged in to the user account corresponding to the previous user / first registered user 703 while displaying the user interface 1304 in the restricted mode.
[0254] In restricted mode, subsequent user 1103 can view the content (e.g., video player user interface 1304 and video content 1306a) that was viewed by previous user 703. However, this content is presented with some restrictions. For example, in FIG. 13F , user 1103 can view user interface 1304 and video content 1306a, but user 1103 is not permitted to navigate away from this content. This is optionally done, for example, to prevent user 1103 from accessing secure content or other personal information belonging to user 703. Thus, home affordance 1306b, multitasking affordance 1306c, and share affordance 1306d are disabled, and user 1103 cannot access and / or select these affordances.
[0255] 13F, the electronic device 700 identifies the subsequent user 1103 as Sarah, a second registered user. Although the electronic device 700 remains logged in to the user account associated with the previous / first registered user, the electronic device 700 displays an avatar 1302 corresponding to the second registered user, indicating that the electronic device 700 is being operated by the second registered user. The electronic device 700 also displays an indicator 1310 to indicate that the electronic device 700 is operating in restricted mode (e.g., the video player user interface 1304 is displayed in restricted mode).
[0256] In some embodiments, when the electronic device 700 is operating in restricted mode, the electronic device 700 ceases applying one or more user settings associated with a previous user (e.g., first registered user 703). For example, when the electronic device 700 is operating in restricted mode, the electronic device 700 ceases applying device calibration settings (e.g., eye movement calibration settings, hand movement calibration settings, head movement calibration settings) associated with (e.g., specific to) the first registered user. In some embodiments, the electronic device 700 applies a generic (e.g., default) set of device calibration settings while the electronic device 700 is operating in restricted mode. In some embodiments, rather than (or in addition to) applying the generic settings, the electronic device 700 may cease applying the user-specific settings of the previous user and enable and / or begin applying the user-specific settings of a subsequent user (e.g., user 1103). For example, in FIG. 13F , the electronic device 700 optionally ceases applying device calibration settings associated with the first registered user 703, and the electronic device 700 applies device calibration settings associated with and / or unique to the second registered user 1103.
[0257] In some embodiments, when the electronic device 700 is operating in restricted mode, the electronic device 700 optionally maintains one or more user settings associated with and / or applied by a previous user (e.g., the first registered user 703). For example, one or more accessibility settings (e.g., font size settings, display size settings, accessibility zoom settings, accessibility gesture settings, and / or audio accessibility settings) applied by the first registered user 703 before handing the electronic device 700 to the second user 1103 are maintained while the second user 1103 operates the electronic device 700 in restricted mode. This allows, for example, the previous user (e.g., user 703) to apply one or more accessibility settings appropriate for the intended subsequent user (e.g., user 1103) to make the subsequent user's viewing experience more enjoyable. In some embodiments, the previous user (e.g., user 703) is provided with the option of whether to maintain the applied accessibility settings when the electronic device 700 is operating in restricted mode. In some embodiments, the accessibility settings remain available and / or accessible to subsequent users 1103 when the electronic device 700 is operating in restricted mode.
[0258] 13G , the user 1103 presses the rotatable and depressable input mechanism 704 (user input 1314), and the electronic device 700 detects the user input 1314 corresponding to the pressing and / or activation of the rotatable and depressible input mechanism 704. In a restricted experience, as presented in FIGS. 13A , 13B, and 13D , the user input 1314 would normally cause the electronic device 700 to navigate away from the video player user interface 1304 and to the home user interface. However, because the electronic device 700 is operating in the restricted mode, the user 1103 is prohibited from navigating away from the user interface 1304. Thus, despite detecting the user input 1314, the electronic device 700 refrains from navigating away from the video player user interface 1304.
[0259] 13H , user 1103 rotates input mechanism 704 (user input 1316), and electronic device 700 detects user input 1316 corresponding to the rotation of input mechanism 704. While electronic device 700 is operating in restricted mode, certain functionality is restricted, while other operations are, optionally, not restricted. For example, certain system controls, such as volume control and / or display brightness control, remain accessible to user 1103 because these controls do not provide access to sensitive or personal information. Thus, in FIG. 13H , in response to detecting user input 1316, electronic device 700 increases the volume setting and displays volume slider 1318. In some embodiments, one or more accessibility settings are also accessible to user 1103 while electronic device 700 is operating in restricted mode.
[0260] 13F-13G illustrate exemplary embodiments in which electronic device 700 is a smartwatch, handover criteria are met for a subsequent user (e.g., user 1103), and, in response, electronic device 700 operates in restricted mode. As described above, in some embodiments, electronic device 700 is a different device, such as a head-mounted system (e.g., a headset) designed to be worn on the user's head. In some such embodiments, user 1103 places the head-mounted system on the user's head, and the head-mounted system detects that the head-mounted system has been placed on the user's head. In some embodiments, in response to determining that the head-mounted system has been placed on the user's head, the head-mounted system automatically identifies the user (e.g., based on automatic biometric identification). In the scenario illustrated in FIG. 13F, the head-mounted system determines that the user is second registered user 1103. The head-mounted system further determines that the handover criteria have been met. In some embodiments, pursuant to a determination that the user is a second registered user 1103 different from the previous user (user 703) and that handover criteria have been met, the head-mounted system displays content previously accessed by the previous user (user 703) in a restricted mode. For example, if the previous user was viewing video content within a three-dimensional virtual environment (e.g., in an unrestricted mode with access to one or more features), the head-mounted system displays the same video content for the subsequent user within the three-dimensional virtual environment but in a restricted mode (e.g., with restricted access to at least some of the one or more features). In some embodiments, the restricted mode features described above with reference to electronic device 700 and additional features described below are also applicable to head-mounted systems. For example, in some embodiments, when the head-mounted system is operating in a restricted mode, one or more system controls and accessibility settings are accessible to the subsequent user, but certain functionality, such as navigation away from the displayed application and / or user interface, is restricted.In this way, a user using a head-mounted system (e.g., user 703) can remove the head-mounted system and pass it on to another subsequent user (e.g., user 1103) to share the content they were watching without the risk of the subsequent user accessing personal or confidential information.
[0261] 13I shows electronic device 1350 in addition to electronic device 700. Electronic device 1350 is a smartphone having a touchscreen display 1352. In the embodiments described below, electronic device 1350 is a smartphone. In some embodiments, electronic device 1350 is a tablet, smartwatch, laptop computer, or other computer system that includes and / or is in communication with a display device (e.g., a display screen, a projection device, etc.).
[0262] In FIG. 13I , electronic device 1350 is associated with first registered user 703. For example, electronic device 1350 is logged into a user account associated with first registered user 703. As described above, electronic device 700 is also logged into a user account associated with first registered user 703 (e.g., the same user account logged into electronic device 1350) while second registered user 1103 is operating electronic device 700 in the restricted mode. In FIG. 13I , in response to determining that electronic device 700 is operating in the restricted mode, electronic device 700 sends a notification to electronic device 1350 (e.g., via a direct connection and / or over a network) that electronic device 700 is operating in the restricted mode. Electronic device 1350 displays notification 1354 that electronic device 700 is operating in the restricted mode. Electronic device 1350 detects user input 1356 corresponding to selecting notification 1354. As described above, in some embodiments, electronic device 700 is a different device, such as a head-mounted system. In some embodiments, the head-mounted system is associated with first registered user 703 (e.g., logged into a user account associated with first registered user 703) while the head-mounted system is operating in restricted mode. In some embodiments, in response to determining that the head-mounted system is operating in restricted mode, the head-mounted system sends a notification to another computer system (e.g., device 1350) associated with first registered user 703 that the head-mounted system is operating in restricted mode.
[0263] 13J , in response to user input 1356, electronic device 1350 displays device mirroring user interface 1358. Device mirroring user interface 1358 displays the content displayed on electronic device 700 while electronic device 700 was operating in restricted mode. Electronic device 700 transmits content information to electronic device 1350 (e.g., via a direct connection and / or over a network) so that electronic device 1350 can display the content in device mirroring user interface 1358. In this way, first registered user 703 can monitor (on electronic device 1350) what second user 1103 is watching on electronic device 700 while electronic device 700 is logged into the first registered user's user account and operating in restricted mode.
[0264] As described above, in some embodiments, electronic device 700 is a different device, such as a head-mounted system. In some embodiments, the head-mounted system transmits content information to a second device associated with a previous user (e.g., first registered user 703), allowing the second device (e.g., electronic device 1350) to display the content within a device mirroring user interface. In this way, the previous user (e.g., first registered user 703) can monitor (e.g., on electronic device 1350) what a subsequent user (e.g., second registered user 1103) is viewing on the head-mounted system while the head-mounted system is logged into the first registered user's user account and operating in restricted mode.
[0265] 13K, both electronic device 700 and electronic device 1350 receive information indicating a new message for a first registered user. Electronic device 1350 displays notification 1360 corresponding to the new message for the first registered user. However, because electronic device 700 is operating in restricted mode, electronic device 700 ceases displaying the notification corresponding to the new message for the first registered user. As described above, in some embodiments, electronic device 700 is a different device, such as a head-mounted system. In some embodiments, similar to device 700, the head-mounted system can cease displaying notifications while the head-mounted system is operating in restricted mode.
[0266] In the illustrated embodiment, electronic device 700 is a smartwatch, and FIGS. 13A-13K show a user 7603, 1103 wearing the smartwatch on their wrist or removing the smartwatch from their wrist, with content being displayed on the smartwatch. However, as noted above, in certain embodiments, electronic device 700 is, optionally, a different device, such as a head-mounted system (e.g., a headset) designed to be worn on a user's head. In such embodiments, electronic device 700 optionally attempts to automatically identify the user wearing the device when it is determined that electronic device 700 is placed on the user's head (e.g., based on iris recognition and / or facial recognition when the device is placed on the user's head). Additionally, in such embodiments, content, such as user interface 1304, is optionally displayed via the head-mounted system, and one or more user inputs are, optionally, received via one or more input devices in communication with the head-mounted system. Similarly, the head-mounted system can operate in a normal, unrestricted mode (e.g., FIGS. 13A-13B, 13D) or in a restricted mode (e.g., FIGS. 13F-13K). In some embodiments, an outer portion of the head-mounted system (e.g., an outer display separate from the inner display visible only to the operating user) can display an indication when the head-mounted system is operating in restricted mode, as well as an indication of who (e.g., username) is operating the head-mounted system in restricted mode and / or what content is being displayed by the head-mounted system in restricted mode. In some embodiments, device calibration settings are applied to the head-mounted system and one or more input devices in communication with the head-mounted system. For example, the device calibration settings include gaze calibration settings, head movement calibration settings, hand and / or arm movement calibration settings, torso calibration settings, and / or foot and / or leg calibration settings.In some embodiments, when the device is being used by a first user (e.g., user 703), the electronic device 700 applies device calibration settings associated with the first user, and when the electronic device is handed over from a previous user (e.g., user 703) to a subsequent user (e.g., user 1103), the electronic device 700 ceases applying the device calibration settings associated with the first user. In some embodiments, the device calibration settings associated with the subsequent user (e.g., user 1103) are applied while the subsequent user operates the electronic device 700 in restricted mode. In some embodiments, generic and / or default device calibration settings are applied while the electronic device 700 is operating in restricted mode.
[0267] 14A-14B are flow diagrams illustrating a method for displaying content based on handover criteria using an electronic device, according to some embodiments. Method 1400 is performed in a computer system (e.g., 700, 101) in communication with a display generation configuration component and one or more input devices. Some operations of method 1400 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.
[0268] As described below, method 1400 provides an intuitive way to display content based on handover criteria. This method reduces the cognitive burden on a user in retrieving and displaying content, thereby creating a more efficient human-machine interface. For battery-operated computing devices, allowing users to retrieve and display content faster and more efficiently conserves power and extends the time between battery charges.
[0269] In some embodiments, a computer system (e.g., device 700) (e.g., a smartphone, a smartwatch, a tablet, a head-mounted system, and a head-up display) is in communication with a display generation component (e.g., display 702) (e.g., a display controller, a touch-sensitive display system, a display (e.g., integrated and / or connected), a 3D display, a see-through display, a projector, and / or a head-up display) and one or more input devices (e.g., 702, 704, 706, 708) (e.g., a touch-sensitive surface (e.g., a touch-sensitive display), a mouse, a keyboard, a remote control, a visual input device (e.g., a camera), an audio input device (e.g., a microphone), and / or a biometric sensor (e.g., a fingerprint sensor, a face identification sensor, and / or an iris identification sensor)). and / or a wearable device) displays (1404), via a display generation component, a first user interface (e.g., 1304) corresponding to a first application (e.g., a video player application displaying video content 1306a of FIG. 13A) while the computer system is disposed on the body of a first user (1402) (e.g., user 703, FIG. 13A) (e.g., while the computer system is worn by the first user) (in some embodiments, and while the computer system is logged into a first user account associated with the first user), the first user interface being displayed in a first mode with authorized access to a plurality of features (e.g., FIGS. 13A-13B) associated with the first user (e.g., a plurality of features associated with the logged-in user experience). While the first user interface is displayed in a first mode with authorized access to a plurality of features associated with the first user (1406), the computer system detects (1408) via one or more input devices that the computer system has been removed from the first user's body (e.g., the user has stopped wearing the computer system) (e.g., FIG. 13C).After detecting that the computer system has been removed from the first user's body (1410), the computer system detects via one or more input devices that the computer system has been placed on the individual user's body (e.g., that the individual user has worn the computer system) (1412).
[0270] In response to detecting that the computer system has been placed on the body of the individual user 1414 (in some embodiments, in response to detecting that the computer system has been placed on the body of the individual user, receiving biometric information (e.g., corresponding to the individual user) via one or more input devices), and in response to determining that the biometric information received via the one or more input devices (e.g., a fingerprint, an image (e.g., a photograph and / or scan) representing the individual user's face, and / or iris identification information (e.g., iris scan information)) (in some embodiments, the biometric information is received while the computer system is worn by the individual user) corresponds to a first user (e.g., user 703) 1416 (e.g., in response to determining that the individual user is the first user (e.g., regardless of whether a set of handover criteria has been met)) (e.g., FIG. 13D ), the computer system, via the display generation component, displays 1418 the first user interface (e.g., 1304) in a first mode having authorized access to a plurality of features associated with the first user.
[0271] In response to detecting that the computer system has been placed on the body of an individual user 1414 (in some embodiments, in response to detecting that the computer system has been placed on the body of an individual user, the computer system receives biometric information (e.g., corresponding to the individual user) via one or more input devices), and in response to determining that the biometric information received via the one or more input devices does not correspond to the first user (e.g., in response to determining that the individual user is not the first user) (e.g., the individual user is not the first user 603), and in response to determining that a set of handover criteria has been met 1420, the computer system, via the display generation component, displays 1422 the first user interface (e.g., user interface 1304) in a second mode (e.g., restricted mode, guest mode, and / or handover mode) having limited access to one or more of the features associated with the first user (e.g., FIGS. 13F-13K). In some embodiments, the second mode with limited access to one or more of the plurality of features associated with the first user prohibits access to a subset of content accessible to the first user (e.g., accessible in the first mode). In some embodiments, the second mode with limited access provides access to only a first user interface corresponding to the first application. In some embodiments, the second mode with limited access provides access to only the first application (e.g., prohibits access to other applications).
[0272] Displaying the first user interface in a second mode having restricted access based on a determination that the biometric information received via the one or more input devices does not correspond to the first user and a set of handover criteria has been met may improve security and prevent unauthorized users from initiating sensitive operations (e.g., by allowing the user to view the user interface only in a restricted access mode having fewer permissions). Displaying the first user interface in a second mode having restricted access based on a determination that the biometric information received via the one or more input devices does not correspond to the first user and a set of handover criteria has been met may also improve device usability (e.g., by restricting unauthorized access), making the user-device interface more efficient, and reducing power usage and improving device battery life by restricting the execution of restricted operations.
[0273] Displaying a first user interface in a first mode with authorized access based on a determination that biometric information received via one or more input devices corresponds to a first user provides the user with the ability to resume their viewing experience without additional user input. Performing an action if a set of conditions is met without requiring further user input improves operability of the device (e.g., by performing the action without additional user input), makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs and reducing user errors when operating / interacting with the device), and additionally reduces power usage and improves device battery life by allowing the user to use the device more quickly and efficiently.
[0274] In some embodiments, the set of handover criteria includes a first criterion that is met if the computer system does not receive user input corresponding to a request to lock the computer system before detecting that the computer system has been placed on an individual user's body (e.g., the electronic device 700 does not receive user input corresponding to a request to lock the computer system during the time between when the user 703 removes the electronic device 700 in FIG. 13C and when the subsequent user 1103 puts on the electronic device 700 in FIG. 13E) (and optionally after detecting that the computer system has been removed from the first user's body (e.g., during the time period between when the computer system is removed from the first user's body and when it is placed on the individual user's body)). In some embodiments, the first criterion is met if user input corresponding to a request to lock the computer system is not received during the time period between two predetermined events (e.g., the time period after the computer system is removed from the first user's body and placed on the individual user's body). In some embodiments, the method further includes, in response to detecting that the computer system has been placed on the individual user's body, ceasing to display the first user interface (e.g., ceasing to display the first user interface in either the first mode or the second mode) (in some embodiments, displaying a logged-out user interface) in accordance with determining that the biometric information received via the one or more input devices does not correspond to the first user and that a user input corresponding to a request to lock the computer system was received before detecting that the computer system has been placed on the individual user's body (and optionally after detecting that the computer system has been removed from the first user's body (e.g., during the period between the computer system being removed from the first user's body and being placed on the individual user's body)).
[0275] A handover criterion that is satisfied when the computer system does not receive user input corresponding to a request to lock the computer system can improve security (e.g., by preventing unauthorized access when a user provides input corresponding to a request to lock the computer system) and prevent unauthorized users from initiating sensitive operations. A handover criterion that is satisfied when the computer system does not receive user input corresponding to a request to lock the computer system can also improve device usability (e.g., by limiting unauthorized access), making the user-device interface more efficient, and, by limiting the execution of restricted operations, reduce power usage and improve device battery life.
[0276] In some embodiments, the set of handover criteria includes a second criterion that is met if less than a threshold period of time has elapsed since the computer system detected that it was removed from the first user's body (e.g., less than a threshold period of time has elapsed between the user 703 removing the electronic device 700 in FIG. 13C and the subsequent user 1103 putting on the electronic device 700 in FIG. 13E) (e.g., less than x seconds have elapsed since the computer system was removed from the first user's body). In some embodiments, the method further includes, in response to detecting that the computer system has been placed on the individual user's body, ceasing to display the first user interface (e.g., ceasing to display the first user interface in either the first mode or the second mode) (in some embodiments, displaying a logged-out user interface) in accordance with a determination that the biometric information received via the one or more input devices does not correspond to the first user and a threshold period of time has elapsed since the computer system detected that it was removed from the first user's body. The handover criteria, which are met when less than a threshold time period has elapsed since the computer system detected its removal from the first user's body, can improve security (e.g., by preventing unauthorized users from accessing privileged information after the threshold time period has elapsed since the computer system was removed from the first user's body) and prevent unauthorized users from initiating sensitive operations. The handover criteria, which are met when less than a threshold time period has elapsed since the computer system detected its removal from the first user's body, can also improve device usability (e.g., by limiting unauthorized access), allowing for a more efficient user-device interface, and, by limiting the execution of restricted operations, reduce power usage and improve device battery life.
[0277] In some embodiments, the set of handover criteria includes a third criterion that is met if the computer system is not turned off or put into sleep mode after detecting that the computer system has been removed from the first user's body and before detecting that the computer system has been placed on the individual user's body (e.g., electronic device 700 is not turned off or put into sleep mode during the time between user 703 removing electronic device 700 in FIG. 13C and subsequent user 1103 putting on electronic device 700 in FIG. 13E) (e.g., between the time the computer system is removed from the first user's body and placed on the individual user's body). In some embodiments, the third criterion is met if a user input corresponding to a request to put the computer system to sleep or a user input corresponding to a request to turn the computer system off is not received within a predetermined period of time (e.g., within a period of time after the computer system is removed from the first user's body and placed on the individual user's body). In some embodiments, the method further includes, in response to detecting that the computer system has been placed on the individual user's body, ceasing to display the first user interface (e.g., ceasing to display the first user interface in either the first mode or the second mode) (in some embodiments, displaying a logged-out user interface) in accordance with determining that the biometric information received via the one or more input devices does not correspond to the first user and that the computer system was turned off or placed in a sleep mode after detecting that the computer system has been removed from the first user's body and before detecting that the computer system has been placed on the individual user's body.
[0278] A handover criterion that is met when the computer system is not turned off or put into sleep mode after being removed from the first user's body can improve security (e.g., by preventing unauthorized access when a user turns off the computer system or puts the computer system into sleep mode) and prevent unauthorized users from initiating sensitive operations. A handover criterion that is met when the computer system is not turned off or put into sleep mode after being removed from the first user's body can also improve device usability (e.g., by limiting unauthorized access), making the user-device interface more efficient, and, by limiting the execution of restricted operations, reduce power usage and improve device battery life.
[0279] In some embodiments, the set of handover criteria includes a fourth criterion that is met if the first user (e.g., user 703) is a registered user (e.g., a user registered with the computer system and / or a user registered with the service). In some embodiments, the fourth criterion is not met if the first user is an unregistered user (e.g., a guest, a user not registered with the computer system, and / or a user not registered with the service). In some embodiments, when the computer system is moved from being worn by a registered user to being worn by an unregistered user (e.g., a guest user), the first user interface will continue to be displayed in the first mode. In some embodiments, when the computer system is subsequently moved from being worn by an unregistered user to another unregistered user, the first user interface will cease to be displayed in the first mode (e.g., display the first user interface in the second mode). In some embodiments, the method further includes, in response to detecting that the computer system has been placed on the body of an individual user, ceasing to display the first user interface (e.g., ceasing to display the first user interface in either the first mode or the second mode) (in some embodiments, displaying a logged-out user interface) in accordance with a determination that the biometric information received via the one or more input devices does not correspond to the first user and that the first user is not a registered user.
[0280] Handover criteria that are met when the first user is a registered user can improve security (e.g., by preventing a guest / unauthorized user from providing access to another guest / unauthorized user) and prevent unauthorized users from initiating sensitive operations. Handover criteria that are met when the first user is a registered user can also improve device usability (e.g., by restricting unauthorized access), making the user-device interface more efficient, and, by restricting the execution of restricted operations, reduce power usage and improve device battery life.
[0281] In some embodiments, in response to detecting 1414 that the computer system has been placed on the body of an individual user, and in response to determining 1424 that the biometric information received via the one or more input devices does not correspond to the first user and the set of handover criteria has not been met, the computer system ceases displaying the first user interface (e.g., displaying user interface 714 in place of user interface 1304, FIG. 13E ) (e.g., ceases displaying the first user interface in either the first mode or the second mode) (in some embodiments, displays a logged-out user interface). Removing the display of the first user interface when the biometric information does not correspond to the first user and the set of handover criteria has not been met can improve security and prevent unauthorized users from initiating sensitive operations. By ceasing to display the first user interface if the biometric information does not correspond to the first user and a set of handover criteria are not met, the device's usability is improved (e.g., by restricting unauthorized access), the user-device interface is made more efficient, and power usage is reduced and the device's battery life is improved by restricting the execution of restricted operations.
[0282] In some embodiments, in response to detecting that the computer system has been placed on the body of an individual user, and in accordance with a determination that the biometric information received via the one or more input devices does not correspond to the first user and the set of handover criteria has not been met, and in accordance with a determination that the biometric information received via the one or more input devices does not correspond to a previously registered user (e.g., a user previously registered with the computer system) (e.g., in accordance with a determination that the individual user is not a registered user), the computer system displays an unregistered user user interface (e.g., user interface 718 of FIG. 7D ) indicating a determination that the individual user is not a registered user.
[0283] Based on a determination that the biometric information does not correspond to a previously enrolled user, a user interface for an unenrolled user is displayed to provide feedback to the user regarding the current state of the device (e.g., that the computer system has determined that the user is an unenrolled user). Providing improved visual feedback to the user improves device usability, increases the efficiency of the user-device interface (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device, thereby reducing user errors), and further reduces device power consumption and improves battery life by allowing the user to use the device more quickly and efficiently.
[0284] In some embodiments, in response to detecting that the computer system has been placed on the body of an individual user, and in accordance with a determination that the biometric information received via the one or more input devices does not correspond to the first user and the set of handover criteria has not been met, and in accordance with a determination that the biometric information received via the one or more input devices corresponds to a second registered user (e.g., user 1103) (e.g., a user previously registered with the computer system) different from the first user (e.g., user 703) (e.g., in accordance with a determination that the individual user is the second registered user), a second user interface (e.g., personalized user interface 714 of FIG. 13E ) different from the first user interface (e.g., user interface 1304) is displayed, the second user interface corresponding to the second registered user (e.g., the second user's home user interface and / or a previously displayed user interface of the second user). Displaying the second user interface based on a determination that the biometric information corresponds to the second registered user provides feedback to the user regarding the current state of the device (e.g., that the computer system has identified the user as the second registered user). Providing improved visual feedback to the user improves the usability of the device, increases the efficiency of the user-device interface (e.g., by helping the user provide appropriate inputs when operating / interacting with the device, thereby reducing user errors), and further reduces the device's power consumption and improves battery life by allowing the user to use the device more quickly and efficiently.
[0285] In some embodiments, in response to detecting that the computer system has been placed on the individual user's body, and in accordance with a determination that the set of handover criteria is not met and that the biometric information received via the one or more input devices corresponds to a first user (e.g., user 703) (e.g., in accordance with a determination that the individual user is the first user), the computer system, via the display generation component, displays a first user interface (e.g., user interface 1304) in a first mode with authorized access to a plurality of features associated with the first user (e.g., FIG. 13D). Displaying the first user interface in the first mode with authorized access based on a determination that the biometric information received via the one or more input devices corresponds to the first user provides the user with the ability to resume their viewing experience without additional user input. Performing an action when a set of conditions is met without requiring further user input may improve the operability of the device (e.g., by performing the action without additional user input), make the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs and reducing user errors when operating / interacting with the device), and additionally reduce power usage and improve the device's battery life by allowing the user to use the device more quickly and efficiently.
[0286] In some embodiments, the second mode having limited access to one or more of the plurality of features associated with the first user further includes maintaining one or more user settings associated with the first user (e.g., an avatar associated with the first user and / or device calibration settings (e.g., hand calibration settings, eye calibration settings, body calibration settings) associated with the first user). Maintaining one or more user settings associated with the first user allows the user to utilize the computer system without providing additional user input to apply the one or more settings. Performing an action when a set of conditions is met without requiring further user input enhances device usability and makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device and reducing user errors), as well as reducing power usage and improving device battery life by allowing the user to use the device more quickly and efficiently.
[0287] In some embodiments, while the computer system is disposed on the individual user's body and while displaying a first user interface (e.g., user interface 1304), the computer system receives navigational user input (e.g., user input corresponding to a request to navigate within and / or from the first user interface) (e.g., user input to navigate to (e.g., display) an application different from the first application, user input to navigate from the first user interface to a different user interface (e.g., display a different user interface), user input to navigate to a particular portion of the first user interface (e.g., display a particular portion of the first user interface), user input to access a particular feature within the first user interface (e.g., display a particular feature within the first user interface), and / or user input to access particular content within the first user interface (e.g., display particular content within the first user interface)) (e.g., user input 1314 and / or user input on any of icons 1306b, 1306c, 1306d). In response to receiving the navigational user input and in accordance with determining that the first user interface is displayed in a first mode having authorized access to a plurality of features associated with the first user, navigate through the user interface in accordance with the navigational user input (e.g., display a different application than the first application, display a different user interface than the first user interface, display a particular portion of the first user interface, display a particular feature of the first user interface, and / or display particular content within the first user interface) (e.g., user input 1314 causes electronic device 700 to replace display of user interface 1304 with a home user interface when the first user interface is displayed in a first mode having authorized access).In response to receiving a navigational user input (e.g., user input 1314) and in accordance with a determination that the first user interface is displayed in a second mode having limited access to one or more of the plurality of features associated with the first user, cease navigating through the user interface in accordance with the navigational user input (e.g., FIG. 13G).
[0288] Enabling navigation within and / or from the first user interface when the first user interface is displayed in a first mode and disallowing navigation when the first user interface is displayed in a second mode improves security. For example, disallowing navigation when the first user interface is displayed in a second mode can prevent unauthorized users from initiating sensitive operations or accessing sensitive information. Enabling navigation within and / or from the first user interface when the first user interface is displayed in a first mode and disallowing navigation when the first user interface is displayed in a second mode also improves device usability (e.g., by limiting unauthorized access), makes the user-device interface more efficient, and reduces power usage and improves device battery life by limiting the execution of restricted operations.
[0289] In some embodiments, while the computer system is disposed on the individual user's body and while displaying the first user interface, the computer system receives user input (e.g., user input 1314, user input 1316). In response to receiving the user input and in accordance with a determination that the user input corresponds to a request (e.g., user input 1316) to access a system control (e.g., volume control and / or display brightness control) (e.g., user input to display a system control user interface (e.g., volume control user interface and / or display brightness user interface), user input to modify a system control setting (e.g., volume setting and / or display brightness setting)), the computer system performs an operation associated with the system control (e.g., regardless of whether the first user interface is displayed in the first mode or the second mode). In response to receiving the user input and in accordance with a determination that the user input corresponds to a request to access a non-system control and the first user interface is displayed in the first mode with authorized access to a plurality of features associated with the first user (e.g., FIGS. 13A-13B), the computer system performs an operation associated with the non-system control. In response to receiving user input and in accordance with a determination that the user input corresponds to a request to access a non-system control and that the first user interface is being displayed in a second mode having limited access to one or more of the plurality of features associated with the first user (e.g., user input 1314, FIG. 13G), the computer system ceases execution of the operation associated with the non-system control.
[0290] In some embodiments, the method includes, in response to receiving a user input, determining whether the user input is a navigation input (e.g., a user input corresponding to a request to navigate within and / or from the first user interface), (e.g., a user input to navigate to (e.g., display) an application different from the first application, a user input to navigate from the first user interface to a different user interface (e.g., display a different user interface), a user input to navigate to a particular portion of the first user interface (e.g., display a particular portion of the first user interface), a user input to access a particular feature within the first user interface (e.g., display a particular feature within the first user interface), and / or a user input to access particular content within the first user interface (e.g., display a particular content within the first user interface). displaying a navigation effect corresponding to the navigation user input (e.g., displaying an application different from the first application, displaying a user interface different from the first user interface, displaying a particular portion of the first user interface, displaying a particular feature of the first user interface, and / or displaying particular content within the first user interface) in accordance with a determination that the first user interface is displayed in a first mode having authorized access to a plurality of features associated with the first user; and ceasing to display the navigation effect corresponding to the navigation user input in accordance with a determination that the first user interface is displayed in a second mode having restricted access to one or more of the plurality of features associated with the first user.
[0291] Providing a user with access to one or more system controls while limiting access to other (e.g., more sensitive or user-private) aspects of the system improves usability of the device (e.g., by allowing the user to configure the system for their own use, assisting the user in providing appropriate inputs when operating / interacting with the device, and reducing user errors), makes the user-device interface more efficient, and additionally reduces power usage and improves the device's battery life by allowing the user to use the device more quickly and efficiently.
[0292] In some embodiments, while the computer system is disposed on the individual user's body and while displaying a first user interface (e.g., user interface 1304), the computer system receives user input. In response to receiving the user input and in accordance with a determination that the user input corresponds to a request to access (e.g., a request to display an accessibility settings user interface, a request to modify) one or more accessibility settings (e.g., a display size setting, an accessibility zoom setting, an accessibility gesture setting, and / or an audio accessibility setting), the computer system performs an operation associated with the one or more accessibility settings (e.g., regardless of whether the first user interface is displayed in the first mode or the second mode). In response to receiving the user input and in accordance with a determination that the user input corresponds to a request to access a non-accessibility setting and the first user interface is displayed in a first mode with authorized access to a plurality of features associated with the first user (e.g., FIGS. 13A-13B), the computer system performs an operation associated with the non-accessibility setting. In response to receiving user input and in accordance with a determination that the user input corresponds to a request to access the non-accessibility setting and that the first user interface is displayed in a second mode having limited access to one or more of the plurality of features associated with the first user (e.g., Figures 13F-13K), performance of the operation associated with the non-accessibility setting is canceled.
[0293] In some embodiments, the method includes, in response to receiving a user input, determining whether the user input is a navigation input (e.g., a user input corresponding to a request to navigate within and / or from the first user interface), (e.g., a user input to navigate to (e.g., display) an application different from the first application, a user input to navigate from the first user interface to a different user interface (e.g., display a different user interface), a user input to navigate to a particular portion of the first user interface (e.g., display a particular portion of the first user interface), a user input to access a particular feature within the first user interface (e.g., display a particular feature within the first user interface), and / or a user input to access particular content within the first user interface (e.g., display a particular content within the first user interface). displaying a navigation effect corresponding to the navigation user input (e.g., displaying an application different from the first application, displaying a user interface different from the first user interface, displaying a particular portion of the first user interface, displaying a particular feature of the first user interface, and / or displaying particular content within the first user interface) in accordance with a determination that the first user interface is displayed in a first mode having authorized access to a plurality of features associated with the first user; and ceasing to display the navigation effect corresponding to the navigation user input in accordance with a determination that the first user interface is displayed in a second mode having restricted access to one or more of the plurality of features associated with the first user.
[0294] Providing a user with access to one or more accessibility settings while limiting access to other (e.g., more sensitive or user-private) aspects of the system improves usability of the device (e.g., by allowing the user to configure the system for their own use, assisting the user in providing appropriate inputs when operating / interacting with the device, and reducing user errors), makes the user-device interface more efficient, and additionally reduces power usage and improves the device's battery life by allowing the user to use the device more quickly and efficiently.
[0295] In some embodiments, while the computer system is disposed on the body of a first user and while the first user interface is displayed in a first mode with authorized access to a plurality of features associated with the first user (e.g., FIGS. 13A-13B ), the computer system receives user input corresponding to a request to enable one or more accessibility settings (e.g., a display size setting, an accessibility zoom setting, an accessibility gesture setting, and / or an audio accessibility setting). In response to the user input corresponding to the request to enable the one or more accessibility settings, the computer system enables the one or more accessibility settings. While the one or more accessibility settings are enabled, the computer system detects, via one or more input devices, that the computer system has been removed from the body of the first user (e.g., user 703, FIG. 13C ) (e.g., the user has stopped wearing the computer system). After detecting that the computer system has been removed from the body of the first user, the computer system detects, via one or more input devices, that the computer system has been placed on the body of a second individual user (e.g., Figures 13D, 13E, 13F) (e.g., that the second individual user has worn the computer system).In response to detecting that the computer system has been placed on the body of a second individual user, and in accordance with a determination that biometric information received via one or more input devices (e.g., a fingerprint, an image (e.g., a photograph and / or scan) representing the individual user's face, and / or iris identification information (e.g., iris scan information)) (in some embodiments, the biometric information is received while the computer system is worn by the second individual user) corresponds to the first user (e.g., user 703, FIG. 13D ) (e.g., in accordance with a determination that the second individual user is the first user (e.g., regardless of whether a set of handover criteria has been met)), the computer system, via the display generation component, displays a first user interface (e.g., user interface 1304) in a first mode with authorized access to a plurality of features associated with the first user, while maintaining one or more accessibility settings enabled.
[0296] In response to detecting that the computer system has been placed on the body of a second individual user, and in accordance with a determination that the biometric information received via the one or more input devices does not correspond to the first user (e.g., in accordance with a determination that the second individual user is not the first user), and in accordance with a determination that a set of handover criteria has been met ( FIG. 13F ), the computer system displays, via the display generation component, the first user interface (e.g., user interface 1304) in a second mode (e.g., restricted mode, guest mode, and / or handover mode) having limited access to one or more of the features associated with the first user, while maintaining one or more accessibility settings enabled. In some embodiments, the first user can enable one or more accessibility settings (e.g., increase font size, turn on accessibility gesture settings) while in the first mode before handing the device to the individual user. As a result, the one or more accessibility settings remain enabled for the benefit of the individual user, even while in the second mode.
[0297] By maintaining one or more accessibility settings established by a first user, the user can utilize the computer system without providing additional user input to apply the one or more settings. Taking action when a set of conditions is met without requiring further user input enhances device usability, makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device and reducing user errors), and additionally reduces power usage and improves device battery life by allowing the user to use the device more quickly and efficiently.
[0298] In some embodiments, while displaying a first user interface (e.g., user interface 1304) (and optionally after detecting that the computer system has been placed on an individual user's body), the computer system receives information (e.g., an email message, an SMS message, an instant message, an alarm, calendar information, and / or other information). In response to receiving the information and following a determination that the first user interface is being displayed in a first mode with authorized access to a plurality of features associated with the first user (e.g., FIG. 13B), the computer system provides (e.g., displays, outputs audio, and / or performs a tactile output) a notification (e.g., notification 1308) corresponding to the received information (e.g., a visual indication of the received email, SMS message, instant message, alarm, calendar information, and / or other information). In response to receiving the information and in accordance with a determination that the first user interface is being displayed in a second mode having limited access to one or more of the plurality of features associated with the first user (e.g., FIGS. 13F-13K), the computer system ceases providing (e.g., displaying, outputting audio, and / or performing tactile output) a notification corresponding to the received information (e.g., FIG. 13K, device 700 ceases providing a notification corresponding to a new message to first user 703). In some embodiments, in accordance with a determination that the first user interface is being displayed in the first mode, a notification (e.g., a visual indication of a received email) corresponding to the received notification information is provided (e.g., displayed). In some embodiments, displaying the first user interface in a second mode having limited access to one or more of the plurality of features associated with the first user includes canceling the display of one or more notifications to the first user (e.g., a user viewing the user interface in the second mode having limited access does not see a notification that would have been displayed to the first user in the first mode).
[0299] Refusing to provide notifications when the computer system is operating in the second mode with restricted access can improve security (e.g., by preventing users other than the first user from viewing notifications intended for the first user) and prevent unauthorized users from initiating sensitive operations. Refusing to provide notifications when the computer system is operating in the second mode with restricted access can also improve device usability (e.g., by limiting unauthorized access), provide a more efficient user-device interface, and reduce power usage and improve device battery life by limiting the execution of restricted operations.
[0300] In some embodiments, notifications not provided during the display of the first user interface in the second mode with limited access are provided on an external computer system (e.g., a smartphone, smartwatch, tablet, and / or wearable device) distinct from the computer system and associated with the first user (e.g., notification 1360 on device 1350, FIG. 13K). Providing notifications on the external computer system provides the user with feedback regarding the current state of the device (e.g., that the computer system has received information and / or notifications). Providing improved visual feedback to the user improves device usability, increases the efficiency of the user-device interface (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device, thereby reducing user errors), and further reduces device power consumption and improves battery life by allowing the user to use the device more quickly and efficiently. Providing notifications on the external computer system while users other than the first user are using the computer system improves security. For example, providing notifications on the external computer system can prevent unauthorized users from viewing confidential information. By providing notifications on an external computer system while a user other than the first user is using the computer system, the device improves usability (e.g., by restricting unauthorized access), makes the user-device interface more efficient, and, in addition, reduces power usage and improves the device's battery life by restricting the execution of restricted operations.
[0301] In some embodiments, in response to detecting that the computer system has been placed on the individual user's body and in accordance with a determination that the biometric information received via the one or more input devices does not correspond to the first user (e.g., FIG. 13E , the electronic device 700 determines that the biometric information of the user 1103 does not correspond to the first user (e.g., user 703)) (in some embodiments, regardless of whether a set of handover criteria is met), the computer system switches the eye tracking calibration settings from a first set of eye tracking calibration settings specific to the first user (e.g., eye calibration settings specific to the user 703) to a second set of eye tracking calibration settings different from the first set of eye tracking calibration settings (e.g., a generic and / or default set of eye tracking calibration settings and / or a set of eye tracking calibration settings specific to the individual user). In some embodiments, the method further includes, in response to detecting that the computer system has been placed on the individual user's body, in accordance with a determination that the biometric information received via the one or more input devices corresponds to the first user, maintaining the first set of eye tracking calibration settings specific to the first user.
[0302] Automatically switching the eye tracking calibration settings from a first set to a second set of eye tracking calibration settings based on a determination that the biometric information does not correspond to the first user provides a user with the ability to apply various settings (e.g., eye tracking calibration settings) without explicitly requesting that those settings be applied. Performing an action when a set of conditions is met without requiring further user input improves usability of the device (e.g., by performing the action without additional user input), makes the user-device interface more efficient (e.g., by assisting the...
Claims
1. A computer system in communication with a display generation component and one or more input devices, comprising: Detecting that at least a portion of the computer system has been placed on the body of an individual user; In response to detecting that the computer system has been placed on the body of the individual user, In accordance with determining that the biometric information received via the one or more input devices corresponds to a first enrolled user, enabling the computer system to be used with one or more settings associated with a first user account associated with the first enrolled user; withdrawing from enabling the computer system to be used with the one or more settings associated with the first user account associated with the first enrolled user in accordance with a determination that the biometric information received via the one or more input devices does not correspond to the first enrolled user; A method comprising:
2. In response to detecting that the computer system has been placed on the body of the individual user, in accordance with a determination that the biometric information received via the one or more input devices does not correspond to the first enrolled user and that the biometric information received via the one or more input devices corresponds to a second enrolled user different from the first enrolled user, enabling the computer system to be used with one or more settings associated with a second user account different from the first user account and associated with the second enrolled user; The method of claim 1 further comprising:
3. In response to detecting that the computer system has been placed on the body of the individual user, entering a guest mode of operation in response to a determination that the biometric information received via the one or more input devices does not correspond to an enrolled user; The method of claim 1 or 2, further comprising:
4. In response to detecting that the computer system has been placed on the body of the individual user, refusing to allow any user account to log into the computer system in accordance with a determination that the biometric information received via the one or more input devices does not correspond to a registered user; The method of claim 1 , further comprising:
5. detecting that at least the portion of the computer system has been removed from the body of the individual user while the computer system is enabled for use with one or more settings associated with the first user account associated with the first registered user; In response to detecting that at least the portion of the computer system has been removed from the body of the individual user, ceasing to allow the computer system to be used with the one or more settings associated with the first user account associated with the first registered user; The method of claim 1 , further comprising:
6. the biometric information received via the one or more input devices is iris identification information; determining that biometric information received via the one or more input devices corresponds to the first enrolled user includes determining that iris identification information received via the one or more input devices corresponds to the first enrolled user; determining that biometric information received via the one or more input devices does not correspond to the first enrolled user includes determining that iris identification information received via the one or more input devices does not correspond to the first enrolled user.
6. The method according to any one of claims 1 to 5.
7. In response to detecting that the computer system has been placed on the body of the individual user, pursuant to the determination that the biometric information received via the one or more input devices corresponds to an individual enrolled user, displaying a visual indication that the computer system is enabled for use with one or more settings associated with the individual enrolled user. The method of claim 1 , further comprising:
8. In response to detecting that the computer system has been placed on the body of the individual user, in response to a determination that the biometric information received via the one or more input devices does not correspond to an enrolled user; a first selectable option corresponding to the first registered user; a second selectable option corresponding to a second registered user different from the first registered user; displaying a user selection user interface including a plurality of selectable options including: The method of claim 1 , further comprising:
9. receiving, while displaying the user selection user interface including the plurality of selectable options, user input corresponding to a selection of a distinct selectable option from the plurality of selectable options, the distinct selectable option corresponding to a distinct registered user; receiving updated biometric information via the one or more input devices after receiving the user input corresponding to selection of the respective selectable option; In response to receiving the updated biometric information, In accordance with a determination that the biometric information received via the one or more input devices corresponds to the individual enrolled user, enabling the computer system to be used with one or more settings associated with an individual user account associated with the individual enrolled user; in accordance with a determination that the biometric information received via the one or more input devices does not correspond to the individual enrolled user, refraining from enabling the computer system to be used with the one or more settings associated with the individual user account associated with the individual enrolled user; The method of claim 8 further comprising:
10. receiving, while displaying the user selection user interface including the plurality of selectable options, user input corresponding to a selection of a distinct selectable option from the plurality of selectable options, the distinct selectable option corresponding to a distinct registered user; after receiving the user input corresponding to a selection of the respective selectable option and in accordance with a biometric criterion not being met; displaying, via the display generation component, a passcode entry user interface in accordance with a determination that a first setting for the individual enrolled user is not enabled; performing automated biometric authentication in accordance with a determination that the first setting of the individual enrolled user is enabled, wherein performing the automated biometric authentication includes: In accordance with a determination that the updated biometric information received via the one or more input devices corresponds to the individual enrolled user, enabling the computer system to be used with one or more settings associated with an individual user account associated with the individual enrolled user; in accordance with a determination that the updated biometric information received via the one or more input devices does not correspond to the individual enrolled user, refraining from enabling the computer system to be used with one or more settings associated with the individual user account associated with the individual enrolled user; The method of claim 8, comprising:
11. 11. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more input devices, the one or more programs including instructions for performing the method of any one of claims 1 to 10.
12. 1. A computer system comprising: a display generation component; one or more input devices; one or more processors; a memory storing one or more programs configured to be executed by the one or more processors; 11. A computer system comprising: said one or more programs comprising instructions for performing the method of any one of claims 1 to 10.
13. a display generation component; one or more input devices; means for carrying out the method according to any one of claims 1 to 10; A computer system comprising:
14. 1. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more input devices, the one or more programs comprising: Detecting that at least a portion of the computer system has been placed on the body of an individual user; In response to detecting that the computer system has been placed on the body of the individual user, pursuant to a determination that the biometric information received via the one or more input devices corresponds to a first enrolled user, enabling the computer system to be used with one or more settings associated with a first user account associated with the first enrolled user; and, in accordance with a determination that the biometric information received via the one or more input devices does not correspond to the first enrolled user, refraining from enabling the computer system to be used with the one or more settings associated with the first user account associated with the first enrolled user. A non-transitory computer-readable storage medium containing instructions.
15. 1. A computer system comprising: a display generation component; one or more input devices; one or more processors; a memory storing one or more programs configured to be executed by the one or more processors; wherein the one or more programs: Detecting that at least a portion of the computer system has been placed on the body of an individual user; In response to detecting that the computer system has been placed on the body of the individual user, pursuant to a determination that the biometric information received via the one or more input devices corresponds to a first enrolled user, enabling the computer system to be used with one or more settings associated with a first user account associated with the first enrolled user; and, in accordance with a determination that the biometric information received via the one or more input devices does not correspond to the first enrolled user, refraining from enabling the computer system to be used with the one or more settings associated with the first user account associated with the first enrolled user. A computer system including instructions.
16. 1. A computer system comprising: a display generation component; one or more input devices; means for detecting when at least a portion of the computer system is placed on the body of an individual user; In response to detecting that the computer system has been placed on the body of the individual user, pursuant to a determination that the biometric information received via the one or more input devices corresponds to a first enrolled user, enabling the computer system to be used with one or more settings associated with a first user account associated with the first enrolled user; and, in accordance with a determination that the biometric information received via the one or more input devices does not correspond to the first enrolled user, refraining from enabling the computer system to be used with the one or more settings associated with the first user account associated with the first enrolled user. Means and A computer system comprising:
17. A computer system in communication with a display generation component and one or more input devices, comprising: Detecting that at least a portion of the computer system has been placed on the body of an individual user; detecting an input from the individual user based on a movement or position of at least a portion of the body of the individual user after detecting that at least a portion of the computer system has been placed on the body of the individual user; and responding to the input from the individual user in response to detecting the input from the individual user, wherein responding to the input from the individual user includes: pursuant to determining that the individual user is a first user previously registered with the computer system, generating a response to the input based on the movement or position of the portion of the individual user's body and a first set of device calibration settings specific to the first user; generating a response to the input based on the movement or position of the portion of the individual user's body and without using the first set of device calibration settings specific to the first user in accordance with determining that the individual user is not the first user; A method comprising:
18. generating the response to the input based on the movement or position of the portion of the individual user's body and without using the first set of device calibration settings specific to the first user; pursuant to determining that the individual user is an unenrolled user, generating a response to the input based on the movement or position of the part of the individual user's body and a second set of device calibration settings that is different from the first set of device calibration settings and represents a set of guest device calibration settings for an unenrolled user; 18. The method of claim 17, comprising:
19. generating the response to the input based on the movement or position of the portion of the individual user's body and without using the first set of device calibration settings specific to the first user; pursuant to determining that the individual user is a second user previously registered with the computer system different from the first user, generating a response to the input based on the movement or position of the portion of the individual user's body and a third set of device calibration settings different from the first set of device calibration settings and specific to the second user; 19. The method of claim 17 or 18, comprising:
20. 20. The method of any one of claims 17 to 19, wherein the first set of device calibration settings is determined based on a plurality of device calibration inputs received from the first user.
21. generating the response to the input based on the movement or position of the portion of the individual user's body and without using the first set of device calibration settings specific to the first user; pursuant to determining that the individual user is an unenrolled user, generating a response to the input based on the movement or position of the portion of the individual user's body and a second set of device calibration settings that is different from the first set of device calibration settings and represents a set of guest device calibration settings for an unenrolled user, the second set of device calibration settings being determined based on a plurality of device calibration inputs received from the unenrolled user; 21. The method of claim 20, comprising:
22. 22. The method of claim 21, wherein the plurality of device calibration inputs received from the unenrolled user is a subset of device calibration inputs that is smaller than the plurality of device calibration inputs received from the first user.
23. generating the response to the input based on the movement or position of the portion of the individual user's body and without using the first set of device calibration settings specific to the first user; pursuant to determining that the individual user is an unenrolled user, generating a response to the input based on the movement or position of the portion of the individual user's body and a second set of device calibration settings that is different from the first set of device calibration settings and represents a set of guest device calibration settings for an unenrolled user, the second set of device calibration settings being a default set of device calibration settings and not based on user input from the unenrolled user; 21. The method of claim 20, comprising:
24. 24. The method of any one of claims 17 to 23, wherein the first set of device calibration settings includes one or more eye and / or gaze movement calibration settings.
25. 25. The method of any one of claims 17 to 24, wherein the first set of device calibration settings includes one or more hand movement calibration settings.
26. generating the response to the input based on the movement or position of the portion of the individual user's body and the first set of device calibration settings specific to the user includes enabling the computer system to be used with the first set of device calibration settings specific to the first user, the method comprising: detecting that the at least the portion of the computer system has been removed from the body of the individual user while the computer system is enabled for use with the first set of device calibration settings specific to the first user; in response to detecting that at least the portion of the computer system has been removed from the body of the individual user, ceasing to enable the computer system to be used with the first set of device calibration settings specific to the first user; 26. The method of any one of claims 17 to 25, further comprising:
27. 27. The method of any one of claims 17 to 26, wherein the determination that the individual user is the first user is performed automatically in response to detecting that at least the portion of the computer system is placed on the body of a user.
28. 28. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more input devices, the one or more programs including instructions for performing the method of any one of claims 17 to 27.
29. 1. A computer system comprising: a display generation component; one or more input devices; one or more processors; a memory storing one or more programs configured to be executed by the one or more processors; 28. A computer system comprising: said one or more programs comprising instructions for performing the method of any one of claims 17 to 27.
30. a display generation component; one or more input devices; means for carrying out the method according to any one of claims 17 to 27; A computer system comprising:
31. 1. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more input devices, the one or more programs comprising: Detecting that at least a portion of the computer system has been placed on the body of an individual user; detecting an input from the individual user based on a movement or position of at least a portion of the body of the individual user after detecting that at least a portion of the computer system has been placed on the body of the individual user; responding to the input from the individual user in response to detecting the input from the individual user; Responding to the input from the individual user includes instructions, pursuant to determining that the individual user is a first user previously registered with the computer system, generating a response to the input based on the movement or position of the portion of the individual user's body and a first set of device calibration settings specific to the first user; generating a response to the input based on the movement or position of the portion of the individual user's body and without using the first set of device calibration settings specific to the first user in accordance with determining that the individual user is not the first user; 1. A non-transitory computer-readable storage medium comprising:
32. 1. A computer system comprising: a display generation component; one or more input devices; one or more processors; a memory storing one or more programs configured to be executed by the one or more processors; wherein the one or more programs: Detecting that at least a portion of the computer system has been placed on the body of an individual user; detecting an input from the individual user based on a movement or position of at least a portion of the body of the individual user after detecting that at least a portion of the computer system has been placed on the body of the individual user; responding to the input from the individual user in response to detecting the input from the individual user; Responding to the input from the individual user includes instructions, pursuant to determining that the individual user is a first user previously registered with the computer system, generating a response to the input based on the movement or position of the portion of the individual user's body and a first set of device calibration settings specific to the first user; generating a response to the input based on the movement or position of the portion of the individual user's body and without using the first set of device calibration settings specific to the first user in accordance with determining that the individual user is not the first user; 2. A computer system comprising:
33. 1. A computer system comprising: a display generation component; one or more input devices; means for detecting when at least a portion of the computer system is placed on the body of an individual user; means for detecting an input from the individual user based on a movement or position of at least a portion of the body of the individual user after detecting that at least a portion of the computer system has been placed on the body of the individual user; means for responding to said input from said individual user in response to detecting said input from said individual user; and the means for responding to the input from the individual user comprises: means for generating a response to the input based on the movement or position of the portion of the individual user's body and a first set of device calibration settings specific to the first user, pursuant to a determination that the individual user is a first user previously registered with the computer system; means for generating a response to the input based on the movement or position of the portion of the individual user's body and without using the first set of device calibration settings specific to the first user, in accordance with a determination that the individual user is not the first user; 2. A computer system comprising:
34. A first computer system in communication with a display generation component and one or more input devices, Detecting a request to display an avatar of a user of a respective computer system; displaying the avatar of the user of the respective computer system in response to detecting the request to display the avatar; and displaying the avatar of the user of the respective computer system comprises: pursuant to a determination that the user of the individual computer system is a registered user of the individual computer system, displaying an avatar having an appearance selected by the user of the individual computer system, the avatar moving based on the user's movements detected by one or more sensors of the individual computer system; pursuant to a determination that the user of the individual computer system is not a registered user of the individual computer system, displaying the avatar having a placeholder appearance that is not representative of the appearance of the user of the individual computer system, the avatar moving based on movements of the user detected by one or more sensors of the individual computer system; A method comprising:
35. 35. The method of claim 34, wherein the avatar visually represents a user of the first computer system.
36. 36. The method of claim 34 or 35, wherein the avatar visually represents a user of a second computer system different from the first computer system.
37. 37. The method of any one of claims 34 to 36, wherein the avatar is displayed at one or more computer systems of one or more users interacting with the user of the respective computer system.
38. 38. The method of any one of claims 34 to 37, wherein at least a portion of the avatar is displayed via a display generation component in communication with the separate computer system.
39. the registered user is a first registered user, the appearance is a first appearance, and the method includes: pursuant to determining that the user of the individual computer system is a second registered user of the individual computer system different from the first registered user, displaying the avatar with a second appearance different from the first appearance, the second appearance being selected by the second registered user; 39. The method of any one of claims 34 to 38, further comprising:
40. 40. The method of any one of claims 34 to 39, wherein the determination that the user of the individual computer system is a registered user of the individual computer system is performed based on automated biometric identification of the user as a registered user, the automated biometric identification comprising eye-based identification.
41. 41. The method of claim 40, wherein the automated biometric identification is performed automatically in response to determining that at least a portion of the individual computer system is located on the body of the user.
42. the registered user is a first user, the appearance is a first appearance selected by the first user, and the method comprises: detecting, via the one or more input devices, that the computer system has been removed from the body of the first user; detecting, via the one or more input devices, that the computer system has been placed on the body of a separate user after detecting that the computer system has been removed from the body of the first user; In response to detecting that the computer system has been placed on the body of the individual user, ceasing to display the avatar having the first appearance selected by the first user in accordance with determining that the first user is no longer the user of the respective computer system; and displaying the avatar with a second appearance in accordance with a determination that the user of the individual computer system is a second user of the individual computer system that is different from the first user; 42. The method of any one of claims 34 to 41, further comprising:
43. 43. The method of any one of claims 34 to 42, wherein the placeholder appearance is an abstract representation.
44. 44. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more input devices, the one or more programs including instructions for performing the method of any one of claims 34 to 43.
45. 1. A computer system comprising: a display generation component; one or more input devices; one or more processors; a memory storing one or more programs configured to be executed by the one or more processors; 44. A computer system comprising: said one or more programs comprising instructions for performing the method of any one of claims 34 to 43.
46. a display generation component; one or more input devices; means for carrying out the method of any one of claims 34 to 43; A computer system comprising:
47. 1. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a first computer system in communication with a display generation component and one or more input devices, the one or more programs comprising: Detecting a request to display an avatar of a user of a respective computer system; displaying the avatar of the user of the respective computer system in response to detecting the request to display the avatar. and displaying the avatar of the user of the respective computer system includes instructions: pursuant to a determination that the user of the individual computer system is a registered user of the individual computer system, displaying an avatar having an appearance selected by the user of the individual computer system, the avatar moving based on the user's movements detected by one or more sensors of the individual computer system; pursuant to a determination that the user of the individual computer system is not a registered user of the individual computer system, displaying the avatar having a placeholder appearance that is not representative of the appearance of the user of the individual computer system, the avatar moving based on movements of the user detected by one or more sensors of the individual computer system; 1. A non-transitory computer-readable storage medium comprising:
48. 1. A computer system comprising: a display generation component; one or more input devices; one or more processors; a memory storing one or more programs configured to be executed by the one or more processors; wherein the one or more programs: Detecting a request to display an avatar of a user of a respective computer system; displaying the avatar of the user of the respective computer system in response to detecting the request to display the avatar. and displaying the avatar of the user of the respective computer system includes instructions: pursuant to a determination that the user of the individual computer system is a registered user of the individual computer system, displaying an avatar having an appearance selected by the user of the individual computer system, the avatar moving based on the user's movements detected by one or more sensors of the individual computer system; pursuant to a determination that the user of the individual computer system is not a registered user of the individual computer system, displaying the avatar having a placeholder appearance that is not representative of the appearance of the user of the individual computer system, the avatar moving based on movements of the user detected by one or more sensors of the individual computer system; 2. A computer system comprising:
49. a display generation component; one or more input devices; means for detecting a request to display an avatar of a user of a respective computer system; means for displaying the avatar of the user of the respective computer system in response to detecting the request to display the avatar; and means for displaying the avatar of the user of the respective computer system comprises: means for displaying an avatar having an appearance selected by the user of the individual computer system in accordance with a determination that the user of the individual computer system is a registered user of the individual computer system, the avatar moving based on the user's movements detected by one or more sensors of the individual computer system; means for displaying the avatar having a placeholder appearance that is not representative of the appearance of the user of the individual computer system, the avatar moving based on the movement of the user detected by one or more sensors of the individual computer system, in accordance with a determination that the user of the individual computer system is not a registered user of the individual computer system; 2. A computer system comprising:
50. A computer system in communication with a display generation component and one or more input devices, comprising: displaying, via the display generation component, a first user interface corresponding to a first application while the computer system is disposed on a body of a first user, the first user interface being displayed in a first mode having authorized access to a plurality of features associated with the first user; detecting, via the one or more input devices, that the computer system has been removed from the body of the first user while the first user interface is displayed in the first mode with authorized access to the plurality of features associated with the first user; detecting, via the one or more input devices, that the computer system has been placed on the body of a separate user after detecting that the computer system has been removed from the body of the first user; In response to detecting that the computer system has been placed on the body of the individual user, displaying, via the display generation component, the first user interface in the first mode with authorized access to the plurality of features associated with the first user in accordance with determining that the biometric information received via the one or more input devices corresponds to the first user; displaying, via the display generation component, the first user interface in a second mode having limited access to one or more of the plurality of features associated with the first user in accordance with a determination that the biometric information received via the one or more input devices does not correspond to the first user and a set of handover criteria has been satisfied; and A method comprising:
51. 51. The method of claim 50, wherein the set of handover criteria includes a first criterion that is satisfied if the computer system does not receive user input corresponding to a request to lock the computer system before detecting that the computer system has been placed on the body of the individual user.
52. 52. The method of claim 50 or 51, wherein the set of handover criteria includes a second criterion that is met if less than a threshold period of time has elapsed since the computer system detected that it was removed from the body of the first user.
53. 53. The method of any one of claims 50 to 52, wherein the set of handover criteria includes a third criterion that is met if the computer system is not turned off or put into sleep mode after detecting that the computer system has been removed from the body of the first user and before detecting that the computer system has been placed on the body of the individual user.
54. 54. A method according to any one of claims 50 to 53, wherein the set of handover criteria includes a fourth criterion that is met if the first user is a registered user.
55. In response to detecting that the computer system has been placed on the body of the individual user, ceasing to display the first user interface in accordance with a determination that the biometric information received via the one or more input devices does not correspond to the first user and the set of handover criteria has not been satisfied; 55. The method of any one of claims 50 to 54, further comprising:
56. In response to detecting that the computer system has been placed on the body of the individual user, in response to the determination that the biometric information received via the one or more input devices does not correspond to the first user and the set of handover criteria was not satisfied; pursuant to a determination that the biometric information received via the one or more input devices does not correspond to a previously enrolled user, displaying an unenrolled user user interface indicating a determination that the individual user is not an enrolled user; 56. The method of claim 55, further comprising:
57. In response to detecting that the computer system has been placed on the body of the individual user, in response to the determination that the biometric information received via the one or more input devices does not correspond to the first user and the set of handover criteria was not satisfied; displaying a second user interface different from the first user interface in accordance with a determination that the biometric information received via the one or more input devices corresponds to a second enrolled user different from the first user, the second user interface corresponding to the second enrolled user; 57. The method of any one of claims 50 to 56, further comprising:
58. In response to detecting that the computer system has been placed on the body of the individual user, displaying, via the display generation component, the first user interface in the first mode with authorized access to the plurality of features associated with the first user in accordance with a determination that the set of handover criteria is not satisfied and that the biometric information received via the one or more input devices corresponds to the first user; 58. The method of any one of claims 50 to 57, further comprising:
59. 59. The method of any one of claims 50 to 58, wherein the second mode having limited access to one or more of the plurality of features associated with the first user further comprises maintaining one or more user settings associated with the first user.
60. receiving navigation user input while the computer system is disposed on the body of the individual user and while displaying the first user interface; In response to receiving the navigation user input, navigating through the user interface in accordance with the navigation user input in accordance with determining that the first user interface is displayed in the first mode with authorized access to the plurality of features associated with the first user; discontinue navigating through the user interface in accordance with the navigation user input in accordance with determining that the first user interface is displayed in the second mode having limited access to one or more of the plurality of features associated with the first user; 60. The method of any one of claims 50 to 59, further comprising:
61. receiving user input while the computer system is disposed on the body of the individual user and while displaying the first user interface; In response to receiving the user input, performing an action associated with a system control in accordance with determining that the user input corresponds to a request to access the system control; performing an operation associated with the non-system control in accordance with determining that the user input corresponds to a request to access a non-system control and that the first user interface is displayed in the first mode with authorized access to the plurality of features associated with the first user; aborting execution of the operation associated with the non-system control in accordance with determining that the user input corresponds to a request to access a non-system control and that the first user interface is being displayed in the second mode having limited access to one or more of the plurality of features associated with the first user; 61. The method of any one of claims 50 to 60, further comprising:
62. receiving user input while the computer system is disposed on the body of the individual user and while displaying the first user interface; In response to receiving the user input, performing an action associated with one or more accessibility settings in accordance with determining that the user input corresponds to a request to access the one or more accessibility settings; performing an operation associated with the non-accessibility setting in accordance with determining that the user input corresponds to a request to access a non-accessibility setting and that the first user interface is displayed in the first mode with authorized access to the plurality of features associated with the first user; canceling performance of the operation associated with the non-accessibility setting in accordance with determining that the user input corresponds to a request to access a non-accessibility setting and that the first user interface is being displayed in the second mode having limited access to one or more of the plurality of features associated with the first user; 62. The method of any one of claims 50 to 61, further comprising:
63. receiving a user input corresponding to a request to enable one or more accessibility settings while the computer system is disposed on the body of the first user and while the first user interface is displayed in the first mode with authorized access to the plurality of features associated with the first user; enabling one or more accessibility settings in response to the user input corresponding to a request to enable the one or more accessibility settings; detecting, via the one or more input devices, that the computer system has been removed from the body of the first user while the one or more accessibility settings are enabled; detecting, via the one or more input devices, that the computer system has been placed on the body of a second individual user after detecting that the computer system has been removed from the body of the first user; In response to detecting that the computer system has been placed on the body of the second individual user, pursuant to determining that the biometric information received via the one or more input devices corresponds to the first user, displaying, via the display generation component, the first user interface in the first mode with authorized access to the plurality of features associated with the first user while maintaining the one or more accessibility settings in an enabled state; pursuant to a determination that the biometric information received via the one or more input devices does not correspond to the first user and a set of handover criteria has been satisfied, displaying, via the display generation component, the first user interface in a second mode having limited access to one or more of the plurality of features associated with the first user while maintaining the one or more accessibility settings in the enabled state; 63. The method of any one of claims 50 to 62, further comprising:
64. receiving information while displaying the first user interface; In response to receiving the information, providing a notification corresponding to the received information in accordance with determining that the first user interface is displayed in the first mode with authorized access to the plurality of features associated with the first user; ceasing to provide the notification corresponding to the received information in accordance with determining that the first user interface is displayed in the second mode having limited access to one or more of the plurality of features associated with the first user; and 64. The method of any one of claims 50 to 63, further comprising:
65. 65. The method of claim 64, wherein the notifications that were not provided during display of the first user interface in the second mode having restricted access are provided on an external computer system that is different from the computer system and associated with the first user.
66. In response to detecting that the computer system has been placed on the body of the individual user, in response to a determination that the biometric information received via the one or more input devices does not correspond to the first user; switching eye tracking calibration settings from a first set of eye tracking calibration settings specific to the first user to a second set of eye tracking calibration settings different from the first set of eye tracking calibration settings; 66. The method of any one of claims 50 to 65, further comprising:
67. In response to detecting that the computer system has been placed on the body of the individual user, in response to a determination that the biometric information received via the one or more input devices does not correspond to the first user; switching hand tracking calibration settings from a first set of hand tracking calibration settings specific to the first user to a second set of hand tracking calibration settings different from the first set of hand tracking calibration settings; 67. The method of any one of claims 50 to 66, further comprising:
68. the first user interface is displayed in the second mode having restricted access on a first display portion of the computer system, and the method further comprises: In response to detecting that the computer system has been placed on the body of the individual user, in response to a determination that the biometric information received via the one or more input devices does not correspond to the first user, and the set of handover criteria is satisfied, and the computer system is operating in the second mode having limited access to one or more of the plurality of features associated with the first user; displaying, on a second display portion of the computer system different from the first display portion, an indication of what is being displayed on the first display portion; 68. The method of any one of claims 50 to 67, further comprising:
69. displaying an indication of a currently signed-in user on an external portion of the computer system; 69. The method of any one of claims 50 to 68, further comprising:
70. In response to detecting that the computer system has been placed on the body of the individual user, in accordance with the determination that the biometric information received via the one or more input devices does not correspond to the first user and the set of handover criteria has been satisfied, sending a notification to a second computer system of the first user that the computer system is operating in the second mode with limited access to one or more of the plurality of features associated with the first user; 70. The method of any one of claims 50 to 69, further comprising:
71. In response to detecting that the computer system has been placed on the body of the individual user, pursuant to the determination that the biometric information received via the one or more input devices does not correspond to the first user and the set of handover criteria has been satisfied, transmitting to a second computer system of the first user a visual indication of content being displayed by the computer system while the computer system is operating in the second mode having limited access to one or more features of the plurality of features associated with the first user; 71. The method of any one of claims 50 to 70, further comprising:
72. In response to detecting that the computer system has been placed on the body of the individual user, displaying, concurrently with the first user interface in the second mode with limited access, a visual indication that the computer system is operating in the second mode with limited access in accordance with the determination that the biometric information received via the one or more input devices does not correspond to the first user and the set of handover criteria has been satisfied.
72. The method of any one of claims 50 to 71, further comprising:
73. 73. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more input devices, the one or more programs including instructions for performing the method of any one of claims 50 to 72.
74. 1. A computer system comprising: a display generation component; one or more input devices; one or more processors; a memory storing one or more programs configured to be executed by the one or more processors; 73. A computer system comprising: said one or more programs comprising instructions for performing the method of any one of claims 50 to 72.
75. a display generation component; one or more input devices; means for carrying out the method of any one of claims 50 to 72; A computer system comprising:
76. 1. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more input devices, the one or more programs comprising: displaying, via the display generation component, a first user interface corresponding to a first application while the computer system is disposed on a body of a first user, the first user interface being displayed in a first mode having authorized access to a plurality of features associated with the first user; detecting, via the one or more input devices, that the computer system has been removed from the body of the first user while the first user interface is displayed in the first mode with authorized access to the plurality of features associated with the first user; detecting, via the one or more input devices, that the computer system has been placed on the body of a separate user after detecting that the computer system has been removed from the body of the first user; In response to detecting that the computer system has been placed on the body of the individual user, displaying, via the display generation component, the first user interface in the first mode with authorized access to the plurality of features associated with the first user in accordance with determining that the biometric information received via the one or more input devices corresponds to the first user; and displaying, via the display generation component, the first user interface in a second mode having limited access to one or more of the plurality of features associated with the first user in accordance with a determination that the biometric information received via the one or more input devices does not correspond to the first user and a set of handover criteria has been satisfied. A non-transitory computer-readable storage medium containing instructions.
77. 1. A computer system comprising: a display generation component; one or more input devices; one or more processors; a memory storing one or more programs configured to be executed by the one or more processors; wherein the one or more programs: displaying, via the display generation component, a first user interface corresponding to a first application while the computer system is disposed on a body of a first user, the first user interface being displayed in a first mode having authorized access to a plurality of features associated with the first user; detecting, via the one or more input devices, that the computer system has been removed from the body of the first user while the first user interface is displayed in the first mode with authorized access to the plurality of features associated with the first user; detecting, via the one or more input devices, that the computer system has been placed on the body of a separate user after detecting that the computer system has been removed from the body of the first user; In response to detecting that the computer system has been placed on the body of the individual user, displaying, via the display generation component, the first user interface in the first mode with authorized access to the plurality of features associated with the first user in accordance with determining that the biometric information received via the one or more input devices corresponds to the first user; and displaying, via the display generation component, the first user interface in a second mode having limited access to one or more of the plurality of features associated with the first user in accordance with a determination that the biometric information received via the one or more input devices does not correspond to the first user and a set of handover criteria has been satisfied. A computer system including instructions.
78. 1. A computer system comprising: a display generation component; one or more input devices; means for displaying, via the display generation component while the computer system is disposed on a body of a first user, a first user interface corresponding to a first application, the first user interface being displayed in a first mode having authorized access to a plurality of features associated with the first user; means for detecting, via the one or more input devices, that the computer system has been removed from the body of the first user while the first user interface is displayed in the first mode with authorized access to the plurality of features associated with the first user; means for detecting, via the one or more input devices, that the computer system has been placed on the body of an individual user after detecting that the computer system has been removed from the body of the first user; In response to detecting that the computer system has been placed on the body of the individual user, displaying, via the display generation component, the first user interface in the first mode with authorized access to the plurality of features associated with the first user in accordance with determining that the biometric information received via the one or more input devices corresponds to the first user; and displaying, via the display generation component, the first user interface in a second mode having limited access to one or more of the plurality of features associated with the first user in accordance with a determination that the biometric information received via the one or more input devices does not correspond to the first user and a set of handover criteria has been satisfied. Means and A computer system comprising: