Adjusting power usage when using companion devices

Abstract

Some examples of the disclosure relate to systems and methods for adjusting power usage when using a companion device. In some examples, a display device communicates with a companion device. The companion device causes the display device to display content on one or more displays of the display device. In some examples, the companion device obtains data using one or more input devices to determine whether one or more first criteria are met. Based on the data, the companion device displays the content on the display device in a first manner or a second manner. In some examples, the first manner is associated with a high power mode and the second manner is associated with a low power mode. In some examples, selectively activating the high power mode based on the input data allows the electronic device to save power and improve power performance and thermal performance.

Description

Cross-references to related applications

[0001] This application claims the benefit of U.S. Provisional Application No. 63 / 794,167, filed April 24, 2025, and U.S. Patent Application No. 19 / 640,170, filed April 6, 2026, the contents of which are incorporated herein by reference in their entirety for all purposes. Technical Field

[0002] This disclosure relates in its entirety to systems and methods for adjusting power when using complementary equipment. Background Technology

[0003] Some computer graphics environments provide two-dimensional and / or three-dimensional environments, where at least some of the objects displayed for the user to view are virtual and computer-generated. In some examples, electronic devices communicate with one or more monitors displaying the computer graphics environment. Displaying a computer graphics environment requires power from the electronic devices. Summary of the Invention

[0004] Some examples of this disclosure relate to systems and methods for regulating power usage when using an accessory device. In some examples, a display device communicates with the accessory device. The accessory device causes the display device to display content on one or more displays of the display device. In some examples, the accessory device uses one or more input devices to obtain data to determine whether one or more first criteria are met. Based on the data, the accessory device displays content on the display device in a first or second manner. In some examples, the first manner is associated with a high-power mode, and the second manner is associated with a low-power mode. In some examples, selectively activating a high-power mode based on input data allows the electronic device to save power and improve power performance and thermal performance.

[0005] A full description of these examples is provided in the accompanying drawings and detailed embodiments, and it should be understood that the content of this invention does not limit the scope of this disclosure in any way. Attached Figure Description

[0006] To better understand the various examples described herein, reference should be made to the following detailed embodiments and the accompanying drawings. Throughout the drawings, the same reference numerals generally refer to corresponding parts.

[0007] Figure 1 Examples of electronic devices that present a three-dimensional environment according to some examples of this disclosure are illustrated.

[0008] Figures 2A to 2B A block diagram illustrating an example architecture for an electronic device according to some examples of this disclosure is shown.

[0009] Figures 3A to 3HExamples of electronic devices according to this disclosure are illustrated, in which an electronic device transitions between different power states based on information collected from one or more input devices.

[0010] Figure 4 A flowchart illustrating an example process for transitioning between different power states based on information collected from one or more input devices, according to some examples of this disclosure, is shown. Detailed Implementation

[0011] Some examples of this disclosure relate to systems and methods for regulating power usage when using an accessory device. In some examples, a display device communicates with the accessory device. The accessory device causes the display device to display content on one or more displays of the display device. In some examples, the accessory device uses one or more input devices to obtain data to determine whether one or more first criteria are met. Based on the data, the accessory device displays content on the display device in a first or second manner. In some examples, the first manner is associated with a high-power mode, and the second manner is associated with a low-power mode. In some examples, selectively activating a high-power mode based on input data allows the electronic device to save power and improve power performance and thermal performance.

[0012] In some examples, a 3D object is displayed in a computer-generated 3D environment with a specific orientation that controls one or more behaviors of the 3D object (e.g., when the 3D object moves within the 3D environment). In some examples, the orientation of the 3D object displayed in the 3D environment is selected by the user of the electronic device or automatically by the electronic device. For example, when initiating the rendering of a 3D object in a 3D environment, the user may select a specific orientation of the 3D object, or the electronic device may automatically select the orientation of the 3D object (e.g., based on the type of the 3D object).

[0013] In some examples, 3D objects may be displayed in a 3D environment with world-locked orientation, body-locked orientation, tilt-locked orientation, or head-locked orientation, as described below. As used herein, an object displayed in a 3D environment with body-locked orientation has a distance and orientation offset relative to a portion of the user's body (e.g., the user's torso). Alternatively, in some examples, body-locked objects have a fixed distance from the user, and the orientation of the content does not reference any part of the user's body (e.g., it may be displayed in the same basic direction relative to the user, regardless of head and / or body movement). Additionally or alternatively, in some examples, body-locked objects may be configured to always maintain gravity or horizon (e.g., perpendicular to gravity) alignment, such that changes in the head and / or body's scroll direction will not cause the body-locked object to move within the 3D environment. Conversely, translational movement in either configuration will cause the body-locked object to reposition within the 3D environment to maintain the distance offset.

[0014] As used in this article, objects displayed in a head-locked orientation within a 3D environment have a distance and orientation offset relative to the user's head. In some examples, the head-locked object moves within the 3D environment as the user's head moves (when the user's viewpoint changes).

[0015] As used in this article, objects displayed in a world-locked orientation in a 3D environment do not have a distance or orientation offset relative to the user.

[0016] As used herein, an object displayed in a tilt-locked orientation in a 3D environment (referred to herein as a tilt-locked object) has a distance offset relative to a user (such as a part of the user's body, e.g., the user's torso, or the user's head). In some examples, the tilt-locked object is displayed in a fixed orientation relative to the 3D environment. In some examples, the tilt-locked object moves according to a polar (e.g., spherical) coordinate system centered on a pole passing through the user (e.g., the user's head). For example, the tilt-locked object moves in the 3D environment based on the movement of the user's head within a spherical space surrounding the user's head (e.g., centered on the user's head). Therefore, if the user tilts their head relative to gravity (e.g., up or down in the pitch direction), the tilt-locked object will follow the head tilt and move radially along the sphere, such that the tilt-locked object is repositioned in the 3D environment with the same distance offset relative to the user as before the head tilt, while optionally maintaining the same orientation relative to the 3D environment. In some examples, if the user moves their head relative to gravity in a rolling direction (e.g., clockwise or counterclockwise), the tilt-locked object is not repositioned in the 3D environment.

[0017] Figure 1 An electronic device 101 is illustrated according to some examples of this disclosure, which presents an extended reality (XR) environment (e.g., a computer-generated environment that optionally includes representations of physical and / or virtual objects). In some examples, such as Figure 1 As shown, electronic device 101 is a head-mounted display or other head-mountable device configured to be worn on the head of a user of electronic device 101. See below for reference. Figure 2A An example of an architecture block diagram to describe electronic device 101. For example... Figure 1 As shown, electronic device 101 and table 106 are located in a physical environment. The physical environment may include physical features such as physical surfaces (e.g., floor, wall) or physical objects (e.g., table, lamp, etc.). In some examples, electronic device 101 may be configured to detect and / or capture images of the physical environment including table 106 (exemplified in the field of view of electronic device 101).

[0018] In some examples, such as Figure 1As shown, electronic device 101 includes one or more internal image sensors 114a oriented toward the user's face (e.g., referred to below). Figures 2A to 2B (The described eye-tracking camera). In some examples, an internal image sensor 114a is used for eye tracking (e.g., detecting the user's gaze). The internal image sensor 114a is optionally arranged on the left and right portions of the display 120 to enable eye tracking of the user's left and right eyes. In some examples, the electronic device 101 also includes external image sensors 114b and 114c facing outwards from the user to detect and / or capture the physical environment of the electronic device 101 and / or movement of the user's hand or other body parts.

[0019] In some examples, display 120 has a field of view visible to the user (e.g., it may or may not correspond to the field of view of external image sensors 114b and 114c). Because display 120 is optionally part of a head-mounted device, the field of view of display 120 may be the same as or similar to the field of view of the user's eyes. In other examples, the field of view of display 120 may be smaller than the field of view of the user's eyes. In some examples, electronics 101 may be an optical pass-through device, through which display 120 is a transparent or translucent display through which parts of the physical environment can be directly viewed. In some examples, display 120 may be included within a transparent lens and may overlap with all or only a portion of the transparent lens. In other examples, electronics may be a video pass-through device, through which display 120 is an opaque display configured to display images of the physical environment captured by external image sensors 114b and 114c. Although a single display 120 is shown, it should be understood that display 120 may include a pair of stereoscopic displays. Figures 2A to 2B In this context, the display 120 includes or corresponds to a transparent or translucent surface (e.g., a lens) that is not equipped with display capabilities (e.g., and therefore cannot generate and display virtual objects 104), and alternatively presents a direct view of the physical environment in the user's field of view (e.g., the user's eye's field of view).

[0020] In some examples, electronic device 101 is configured to display virtual object 104 in a three-dimensional environment (e.g., in response to a trigger). Virtual object 104 is... Figure 1 The illustrated cube represents a cube that does not exist in the physical environment but is displayed in the three-dimensional environment and positioned on top of table 106 (e.g., a real-world table or a representation thereof). Optionally, in response to detecting a flat surface of table 106 in the physical environment 100, virtual object 104 is displayed on the surface of table 106 in the three-dimensional environment displayed via display 120 of electronic device 101.

[0021] It should be understood that virtual object 104 is a representative virtual object and may include and render one or more different virtual objects (e.g., virtual objects with various dimensions, such as two-dimensional virtual objects or other three-dimensional virtual objects) in a three-dimensional environment. For example, a virtual object may represent an application or user interface displayed in a three-dimensional environment. In some examples, a virtual object may represent content corresponding to an application and / or displayed in a three-dimensional environment via a user interface. In some examples, virtual object 104 may optionally be configured to be interactive and responsive to user input (e.g., air gestures, such as air pinch gestures, air tap gestures, and / or air touch gestures), allowing the user to virtually touch, tap, move, rotate, or otherwise interact with virtual object 104.

[0022] As discussed in this article, by the user (e.g., using Figure 1 One or more air pinch gestures performed by the hand (103) are detected by one or more input devices of the electronic device 101 and interpreted as one or more user inputs pointing to content displayed by the electronic device 101. Additionally or alternatively, in some examples, one or more user inputs interpreted by the electronic device 101 as pointing to content displayed by the electronic device 101 (e.g., virtual object 104) are detected via one or more hardware input devices (e.g., controllers, touchpads, proximity sensors, buttons, sliders, knobs, etc.) rather than via one or more input devices configured to detect air gestures (such as one or more air pinch gestures) performed by the user. This description is intended to be exemplary and not restrictive; the user may optionally use different air gestures and / or other forms of input to provide user input.

[0023] In some examples, electronic device 101 may be configured to communicate with a second electronic device (such as a companion device). For example, as Figure 1 As illustrated, electronic device 101 may optionally communicate with electronic device 160. In some examples, electronic device 160 corresponds to a mobile electronic device, such as a smartphone, tablet computer, smartwatch, laptop computer, or other electronic device. In some examples, electronic device 160 corresponds to a non-mobile electronic device, which is typically stationary and does not easily move within a physical environment (e.g., desktop computer, server, etc.). See below for reference. Figure 2B The following are additional examples of architectural diagrams used to describe electronic device 160. In some examples, electronic device 101 and electronic device 160 are associated with the same user. For example, in Figure 1In this configuration, electronic device 101 may be positioned (e.g., worn on) the user's head, and electronic device 160 may be positioned near electronic device 101, such as in the user's hand 103 (e.g., the hand 103 holding electronic device 160), in the user's pocket or bag, or on a surface near the user. Electronic devices 101 and 160 may optionally be associated with the same user account (e.g., the user logs into the user account on both electronic devices 101 and 160). See below for further details. Figures 2A to 2B Additional details regarding the communication between electronic device 101 and electronic device 160 are provided.

[0024] In some examples, the display of an object in a 3D environment is caused by or enabled by interaction with one or more user interface objects in the 3D environment. For example, initiating the display of an object in a 3D environment may include interaction with one or more virtual options / enabled representations displayed in the 3D environment. In some examples, when initiating the display of an object in a 3D environment, the electronic device may track the user's gaze as input for identifying one or more virtual options / enabled representations as targets for selection. For example, a gaze may be used to identify one or more virtual options / enabled representations as targets for selection using another selection input. In some examples, a virtual option / enabled representation may be selected using hand-tracking input detected via an input device communicating with the electronic device. In some examples, an object displayed in a 3D environment may move and / or reorient itself in the 3D environment based on movement input detected via an input device.

[0025] In the following description, an electronic device that communicates with one or more displays and one or more input devices is described. It should be understood that the electronic device may optionally communicate with one or more other physical user interface devices, such as touch-sensitive surfaces, physical keyboards, mice, joysticks, hand-tracking devices, eye-tracking devices, styluses, etc. Furthermore, as described above, it should be understood that the described electronic device, display, and touch-sensitive surface may optionally be distributed among two or more devices. Therefore, as used in this disclosure, information on or displayed by the electronic device may optionally be used to describe information output by the electronic device for display on a separate display device (touch-sensitive or non-touch-sensitive). Similarly, as used in this disclosure, input received on the electronic device (e.g., touch input received on a touch-sensitive surface of the electronic device, or touch input received on the surface of a stylus) may optionally be used to describe input received on a separate input device from which the electronic device receives input information.

[0026] The device typically supports a variety of applications, such as one or more of the following: drawing applications, presentation applications, word processing applications, website creation applications, disk editing applications, spreadsheet applications, game applications, telephone applications, video conferencing applications, email applications, instant messaging applications, fitness support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, TV channel browsing applications, and / or digital video player applications.

[0027] Figures 2A to 2B Block diagrams illustrating example architectures for electronic devices according to some examples of this disclosure are shown. In some examples, electronic device 201 and / or device 260 include one or more electronic devices. For example, electronic device 201 may be a portable device, an auxiliary device for communicating with another device, a head-mounted display, a head-mounted speaker, etc. In some examples, electronic device 201 corresponds to the above reference. Figure 1 The described electronic device 101. In some examples, electronic device 260 corresponds to the above reference. Figure 1 The described electronic device 160.

[0028] like Figure 2A As illustrated, electronic device 201 may optionally include one or more sensors, such as one or more hand tracking sensors 202, one or more position sensors 204A, and one or more image sensors 206A (optionally corresponding to...). Figure 1 The electronic device 201 may include an internal image sensor 114a and / or external image sensors 114b and 114c, one or more touch-sensitive surfaces 209A, one or more motion and / or orientation sensors 210A, one or more eye-tracking sensors 212, one or more microphones 213A or other audio sensors, one or more body tracking sensors (e.g., torso and / or head tracking sensors), etc. The electronic device 201 may optionally include one or more output devices, such as one or more display generation components 214A (optionally corresponding to...). Figure 1 The electronic device 201 may include a display 120, one or more speakers 216A, one or more tactile output devices (not shown), etc. The electronic device 201 may optionally include one or more processors 218A, one or more memories 220A, and / or communication circuitry 222A. One or more communication buses 208A may optionally be used for communication between the components of the electronic device 201 mentioned above.

[0029] Additionally, electronic device 260 may optionally include components that are the same as or similar to those of electronic device 201. For example, such as Figure 2BAs shown, the electronic device 260 optionally includes one or more position sensors 204B, one or more image sensors 206B, one or more touch-sensitive surfaces 209B, one or more orientation sensors 210B, one or more microphones 213B, one or more display generating components 214B, one or more speakers 216B, one or more processors 218B, one or more memories 220B, and / or communication circuitry 222B. One or more communication buses 208B are optionally used for communication between the components of the electronic device 260 mentioned above.

[0030] Electronic devices 201 and 260 are optionally configured to communicate via a wired or wireless connection between the two electronic devices (e.g., via communication circuits 222A, 222B). For example, as Figure 2A As indicated, electronic device 260 can be used as an accessory to electronic device 201. For example, in some examples, electronic device 260 processes sensor inputs from electronic devices 201 and 260, and / or uses the display generation component 214A of electronic device 201 to generate content for display.

[0031] Communication circuits 222A and 222B optionally include circuitry for communicating with electronic devices and networks such as the Internet, intranets, wired and / or wireless networks, cellular networks, and wireless local area networks (LANs). Communication circuits 222A and 222B optionally include circuitry for using near-field communication (NFC) and / or short-range communication (such as Bluetooth). ® The communication circuits 222A and 222B communicate with each other. In some examples, the communication circuits 222A and 222B include or support Wi-Fi (e.g., the 802.11 protocol), Ethernet, ultra-wideband (“UWB”), high-frequency systems (e.g., 900MHz, 2.4GHz, and 5.6GHz communication systems) or any other communication protocol or any combination thereof.

[0032] One or more processors 218A, 218B include one or more general-purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some examples, one or more processors 218A, 218B include one or more microprocessors, one or more central processing units, one or more application-specific integrated circuits, one or more field-programmable gate arrays, one or more programmable logic devices, or combinations of such devices. In some examples, memories 220A and / or 220B are non-transitory computer-readable storage media (e.g., flash memory, random access memory, or other volatile or non-volatile memory or storage device) storing computer-readable instructions configured to be executed by one or more processors 218A, 218B to perform the techniques, processes, and / or methods described herein. In some examples, memories 220A and / or 220B may include more than one non-transitory computer-readable storage medium. A non-transitory computer-readable storage medium can be any medium (e.g., excluding signals) that can tangibly contain or store computer-executable instructions for use by or in connection with an instruction execution system, apparatus, and device. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media may include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical discs based on compact disc (CD), digital versatile optical disc (DVD), or Blu-ray technology, and persistent solid-state storage devices such as flash memory, solid-state drives, etc.

[0033] In some examples, one or more display generating components 214A, 214B include a single display (e.g., a liquid crystal display (LCD), an organic light-emitting diode (OLED), or other type of display). In some examples, one or more display generating components 214A, 214B include multiple displays. In some examples, one or more display generating components 214A, 214B may include a touch-enabled display (e.g., a touchscreen), a projector, a holographic projector, a retinal projector, a transparent or translucent display, etc. In some examples, the electronic device does not include one or more display generating components 214A or 214B. For example, some electronic devices do not include one or more display generating components 214A or 214B, but instead include a transparent or translucent lens or other surface not configured to display or present virtual content. However, it should be understood that in such cases, electronic device 201 and / or electronic device 260 may optionally be equipped with Figure 2A and Figure 2BOne or more of the other components illustrated and described herein, such as one or more hand-tracking sensors 202, one or more eye-tracking sensors 212, one or more image sensors 206A, and / or one or more motion and / or orientation sensors 210A. Alternatively, in some examples, one or more display generation components 214A or 214B are provided separately from electronic devices 201 and / or 260. For example, one or more display generation components 214A, 214B communicate with electronic device 201 (and / or electronic device 260) but are not integrated with electronic device 201 and / or electronic device 260 (e.g., within the housing of electronic devices 201, 260). In some examples, electronic devices 201 and 260 respectively include one or more touch-sensitive surfaces 209A and 209B for receiving user input, such as tap input and swipe input or other gestures (e.g., hand-based or finger-based gestures). In some examples, one or more display generating components 214A, 214B and one or more touch-sensitive surfaces 209A, 209B form one or more touch-sensitive displays (e.g., touchscreens integrated with each of the electronic devices 201 and 260 or touchscreens external to each of the electronic devices 201 and 260 that communicate with each of the electronic devices 201 and 260).

[0034] Electronic devices 201 and 260 optionally include one or more image sensors 206A and 206B, respectively. The image sensors 206A and 206B optionally include one or more visible light image sensors (such as charge-coupled device (CCD) sensors) and / or complementary metal-oxide-semiconductor (CMOS) sensors capable of operating to obtain images of physical objects from a real-world environment. The image sensors 206A and 206B also optionally include one or more infrared (IR) sensors, such as passive or active IR sensors, for detecting infrared light from the real-world environment. For example, an active IR sensor includes an IR emitter for emitting infrared light into the real-world environment. The image sensors 206A and 206B also optionally include one or more cameras configured to capture movement of physical objects in the real-world environment. The image sensors 206A and 206B also optionally include one or more depth sensors configured to detect the distance between the physical object and the electronic devices 201 and 260. In some examples, information from one or more depth sensors allows a device to identify objects in a real-world environment and distinguish them from other objects in the real-world environment. In some examples, one or more depth sensors allow a device to determine the texture and / or shape of objects in a real-world environment. In some examples, one or more image sensors 206A or 206B are included in an electronic device separate from electronic devices 201 and / or 260. For example, one or more image sensors 206A, 206B communicate with electronic devices 201, 260 but are not integrated with electronic devices 201, 260 (e.g., within the housing of electronic devices 201, 260). Specifically, in some examples, one or more cameras of one or more image sensors 206A, 206B are integrated and / or coupled to one or more separate devices (e.g., communicating with electronic devices 201 and / or 260) that are separate from electronic devices 201 and / or 260, such as one or more input and / or output devices (e.g., one or more speakers and / or one or more microphones, such as headphones or headsets) that include one or more image sensors 206A, 206B. In some examples, electronic device 201 or electronic device 260 corresponds to a headphone speaker (e.g., headphones or earbuds). In such cases, electronic device 201 or electronic device 260 is equipped with Figure 2A and Figure 2B A subset of other components illustrated and described herein. In some such examples, electronic device 201 or electronic device 260 is equipped with one or more image sensors 206A, 206B, one or more motion and / or orientation sensors 210A, 210B, and / or speakers 216A, 216B.

[0035] In some examples, electronic devices 201 and 260 combine a CCD sensor, an event camera, and a depth sensor to detect the physical environment surrounding them. In some examples, one or more image sensors 206A and 206B include a first image sensor and a second image sensor. The first and second image sensors work cooperatively and are optionally configured to capture different information about physical objects in the real-world environment. In some examples, the first image sensor is a visible light image sensor, and the second image sensor is a depth sensor. In some examples, electronic devices 201 and 260 use one or more image sensors 206A and 206B to detect the location and orientation of electronic devices 201 and 260 and / or one or more display generation components 214A and 214B in the real-world environment. For example, electronic devices 201 and 260 use one or more image sensors 206A and 206B to track the location and orientation of one or more display generation components 214A and 214B relative to one or more stationary objects in the real-world environment.

[0036] In some examples, electronic devices 201 and 260 include one or more microphones 213A and 213B or other audio sensors, respectively. Electronic devices 201 and 260 may optionally use one or more microphones 213A and 213B to detect sound from a user and / or the user's real-world environment. In some examples, the one or more microphones 213A and 213B include microphone arrays (e.g., multiple microphones) that optionally operate in cooperation to identify ambient noise or locate sound sources in the space of a real-world environment.

[0037] Electronic devices 201 and 260 each include one or more position sensors 204A and 204B for detecting the positions of electronic device 201 and / or one or more display generating components 214A and electronic device 260 and / or one or more display generating components 214B, respectively. For example, the one or more position sensors 204A, 204B may include a Global Positioning System (GPS) receiver that receives data from one or more satellites and allows electronic devices 201, 260 to determine the absolute position of the electronic device in the physical world.

[0038] Electronic devices 201 and 260 respectively include one or more orientation sensors 210A and 210B for detecting the orientation and / or movement of electronic device 201 and / or one or more display generating components 214A and the orientation and / or movement of electronic device 260 and / or one or more display generating components 214B. For example, electronic devices 201 and 260 use one or more orientation sensors 210A and 210B to track changes in the positioning and / or orientation of electronic devices 201 and 260 and / or one or more display generating components 214A and 214B, such as changes relative to physical objects in a real-world environment. The one or more orientation sensors 210A and 210B may optionally include one or more gyroscopes and / or one or more accelerometers.

[0039] In some examples, electronic device 201 includes one or more hand tracking sensors 202 and / or one or more eye tracking sensors 212. It should be understood that although referred to as hand tracking sensors or eye tracking sensors, electronic device 201 additionally or optionally includes one or more other body tracking sensors, such as one or more leg tracking sensors, one or more torso tracking sensors, and / or one or more head tracking sensors. One or more hand tracking sensors 202 are configured to track the localization and / or position of one or more portions of a user's hand, and / or the movement of one or more portions of the user's hand relative to a three-dimensional environment, relative to one or more display generation components 214A, and / or relative to another defined coordinate system. One or more eye tracking sensors 212 are configured to track the localization and movement of a user's gaze (e.g., more generally, the user's attention, including the eyes, face, or head) relative to the real world or three-dimensional environment and / or relative to one or more display generation components 214A. In some examples, one or more hand tracking sensors 202 and / or one or more eye tracking sensors 212 are implemented together with one or more display generation components 214A. In some examples, one or more hand-tracking sensors 202 and / or one or more eye-tracking sensors 212 are implemented separately from one or more display generation components 214A. In some examples, the electronic device 201 alternatively does not include one or more hand-tracking sensors 202 and / or one or more eye-tracking sensors 212. In some such examples, one or more display generation components 214A may be used by the electronic device 260 to provide a three-dimensional environment, and the electronic device 260 may utilize input and other data collected via other sensors of the electronic device 201 (e.g., one or more position sensors 204A, one or more image sensors 206A, one or more touch-sensitive surfaces 209A, one or more motion and / or orientation sensors 210A, and / or one or more microphones 213A or other audio sensors) as input and data processed by one or more processors 218B of the electronic device 260. Additionally or alternatively, the electronic device 260 may optionally not include... Figure 2B Other components shown include one or more position sensors 204B, one or more image sensors 206B, one or more touch-sensitive surfaces 209B, etc. In some such examples, one or more display generation components 214A may be used by electronic device 260 to provide a three-dimensional environment, and electronic device 260 may use input and other data collected via one or more motion and / or orientation sensors 210A (and / or one or more microphones 213A) of electronic device 201 as input.

[0040] In some examples, one or more hand-tracking sensors 202 (and / or other body-tracking sensors, such as leg, torso, and / or head-tracking sensors) may use one or more image sensors 206 (e.g., one or more IR cameras, 3D cameras, depth cameras, etc.) that capture 3D information from the real world, including one or more body parts (e.g., a human user's hand, leg, or torso). In some examples, sufficient resolution is available to distinguish the hand to differentiate the fingers and their corresponding positions. In some examples, one or more image sensors 206A are positioned relative to the user to define a field of view and interaction space for one or more image sensors 206A, in which the finger / hand positions, orientations, and / or movements captured by the image sensors are used as input (e.g., to differentiate from the user's resting hand or other hands of other people in the real-world environment). Tracking the fingers / hands used for input (e.g., gestures, touches, taps, etc.) may be advantageous because it does not require the user to touch, hold, or wear any type of beacon, sensor, or other marker.

[0041] In some examples, one or more eye-tracking sensors 212 include at least one eye-tracking camera (e.g., an IR camera) and / or an illumination source (e.g., an IR light source, such as an LED) that emits light toward the user's eyes. The eye-tracking camera may be pointed at the user's eyes to receive reflected IR light from the light source directly or indirectly from the eyes. In some examples, both eyes are tracked separately by the respective eye-tracking camera and illumination source, and focus / gaze can be determined by tracking both eyes. In some examples, one eye (e.g., the dominant eye) is tracked by one or more respective eye-tracking cameras / illumination sources.

[0042] Electronic devices 201 and 260 are not limited to Figures 2A to 2B The components and configurations may include, but are not limited to, a few components, other components, or additional components in various configurations. In some examples, electronic device 201 and / or electronic device 260 may be implemented in various ways among multiple electronic devices (e.g., as a system). In some such examples, each(s) of the electronic devices may include one or more of the same components discussed above, such as various sensors, one or more display generation components, one or more speakers, one or more processors, one or more memories, and / or communication circuitry. One or more persons using electronic device 201 and / or electronic device 260 may optionally be referred to herein as one or more users of the devices.

[0043] Now turn to interaction with one or more virtual objects displayed in a three-dimensional environment presented at a first electronic device (e.g., corresponding to electronic device 201). The first electronic device communicates with a second electronic device, which determines the power states of both devices based on the context of the displayed content and data from one or more input devices. In some examples, the second electronic device operates according to a high-power state or a low-power state. In some examples, switching to a low-power state when high power is not required advantageously allows the second electronic device to regulate power consumption and extend battery life (e.g., by using less processing power when in a low-power state).

[0044] In some examples, the first electronic device (e.g., electronic device 201 described above) communicates with an accessory device (e.g., accessory device 260 and the second electronic device described above), such as Figures 2A to 2B As described. In some examples, the first electronic device is and / or includes one or more displays that depend on the second electronic device (e.g., a companion device) to display content. In some examples, the second electronic device is a wearable device having one or more output devices (e.g., a display and / or a speaker) and one or more input devices (e.g., one or more sensors described above). In some examples, the first electronic device also includes one or more sensors for collecting data to determine the power state of the second electronic device.

[0045] When in a high-power mode or state, the first electronic device includes one or more of the following power functions and / or operates according to one or more of the following power functions: world lock, body lock, face tracking, high content refresh rate, and / or high rendering rate. When in high-power mode, the second electronic device displays content on the first electronic device at a first size. When in high-power mode, the first electronic device includes and / or displays content at a first brightness, a first frame rate, and / or a first persistence level. When in high-power mode, the second electronic device maintains a first reprojection rate below a threshold reprojection rate (e.g., 25%, 50%, or 75%). In some examples, the reprojection rate is the percentage of frames not rendered by the second electronic device's graphics processing unit (GPU) but generated by software using motion data and previous frames, with the aim of maintaining a smooth and consistent visual experience even when the GPU cannot keep up with the display's content refresh rate. In some examples, the second electronic device transitions to a low-power mode or state when one or more criteria for transitioning to high-power mode are not met. When in low-power mode, the first electronic device includes one or more of the following power functions and / or operates according to one or more of the following power functions: body lock, head lock, lower content refresh rate, and / or lower rendering rate. When in low-power mode, the second electronic device displays content on the first electronic device at a second size smaller than the first size. When in low-power mode, the first electronic device includes and / or displays content at a second brightness lower than the first brightness, a second frame rate lower than the first frame rate, and / or a second persistence level higher than the first persistence level. When in low-power mode, the second electronic device maintains a second reprojection rate higher than a threshold reprojection rate. These power functions are described in more detail below. Head lock and body lock have been described in more detail above.

[0046] In some examples, world lock and body lock require more processing power and therefore need to use more battery power than head lock. For example, world lock or body lock requires approximately 90 frames per second (fps), while head lock requires approximately 45 fps to 60 fps. In some examples, content refresh rate refers to the number of times the display (e.g., the display of the first electronic device) updates the content displayed per second. In some examples, rendering rate refers to the number of frames that the second electronic device can process and display per second. In some examples, face tracking includes tracking one or more facial movements of the user's face, such as eye tracking and / or head tracking. In some examples, the second electronic device may perform face tracking more frequently in high-power mode than in low-power mode (e.g., 400 Hz in high-power mode and 100 Hz in low-power mode). In some examples, face tracking is used to perform body lock. For example, in high-power mode, the second electronic device performs face tracking to determine where the user is looking and to position the electronic device 101 relative to the user's location to display content.

[0047] Figures 3A to 3H Examples of electronic devices according to this disclosure are illustrated, in which an electronic device transitions between different power states based on information collected from one or more input devices. Figures 3A to 3H Used to illustrate the process described below, including Figure 4 The process shown is 400.

[0048] Figure 3A An example is illustrated of an electronic device 101 that presents a three-dimensional environment 300 via a display 120 (e.g., corresponding to electronic device 270), where the three-dimensional environment includes a portion of the physical environment 350 viewed from the viewpoint of a user 317 of the electronic device 101. Figure 3A In this context, electronic device 101 may optionally present a three-dimensional environment 300 via a video pass-through or optical pass-through display. Figure 3A A user 317 is shown holding electronic device 302 (e.g., an accessory device, such as electronic devices 160 and / or 260) of electronic device 101. Electronic device 302 causes electronic device 101 to display a three-dimensional environment 300. For example, electronic device 101 does not include a processor and / or other hardware for processing or generating content, and electronic device 101 is simply a display (e.g., display 120). Additionally, in some examples, electronic device 302 causes electronic device 101 to display content on display 120.

[0049] In some examples, the user's viewpoint affects the content (e.g., physical and / or virtual objects) visible in the viewport (e.g., the view of the physical environment 350 visible to the user via one or more displays 120, a monitor, or a pair of display modules providing stereoscopic content to different eyes of the same user). In some examples, the (virtual) viewport has a limitation on the user's viewpoint via... Figures 3A to 3HThe viewport boundary defines the range of the three-dimensional environment 350 visible from the display 120. In some examples, the area defined by the viewport boundary is smaller than the user's visual field in one or more dimensions (e.g., based on the user's visual field, the size of one or more displays, optical properties or other physical characteristics, and / or the position and / or orientation of one or more displays relative to the user's eyes). In some examples, the area defined by the viewport boundary is larger than the user's visual field in one or more dimensions (e.g., based on the user's visual field, the size of one or more displays, optical properties or other physical characteristics, and / or the position and / or orientation of one or more displays relative to the user's eyes). The viewport and viewport boundary typically move with the movement of one or more displays (e.g., with the user's head movement in a head-mounted device, or with the user's hand movement in a handheld device such as a tablet or smartphone). The user's viewpoint affects what is visible in the viewport; the viewpoint generally specifies the position and orientation relative to the physical environment 350, and as the viewpoint moves, the view of the physical environment 350 also moves within the viewport. For head-mounted devices, the viewpoint is typically based on the position and orientation of the user's head, face, and / or eyes to provide a perceptually accurate view of the three-dimensional environment that provides an immersive experience when the user is using the head-mounted device. For handheld or fixed devices, the viewpoint moves with the movement of the handheld or fixed device and / or with changes in the user's positioning relative to the handheld or fixed device (e.g., the user moves towards, away from, up, down, right, and / or left). For devices including displays with video pass-through, a portion of the physical environment visible (e.g., displayed and / or projected) via one or more displays is based on the field of view of one or more cameras communicating with the displays, which typically move with the displays (e.g., with the user's head for head-mounted devices, or with the user's hands for handheld devices such as tablets or smartphones), because the user's viewpoint moves with the field of view of one or more cameras (and updates the appearance of one or more virtual objects displayed via one or more displays based on the user's viewpoint (e.g., the display positioning and pose of virtual objects are updated based on the movement of the user's viewpoint)).For displays with optical perspective, the portion of the physical environment visible through one or more displays (e.g., optically visible by displaying one or more partially or fully transparent portions of the generating components) is based on the user's field of view through the partially or fully transparent portions of the generating components (e.g., moving with the user's head for head-mounted devices, or moving with the user's hand for handheld devices such as tablets or smartphones), because the user's viewpoint moves as the user moves through the field of view of the partially or fully transparent portions of the displays (and the appearance of one or more virtual objects is updated based on the user's viewpoint).

[0050] exist Figure 3A In this embodiment, electronic device 302 communicates with electronic device 101. For example, electronic device 101 and electronic device 302 communicate wirelessly (e.g., Bluetooth, Wi-Fi, and / or wireless networks) or wiredly (e.g., via wires and / or cables, such as Universal Serial Bus Type A (USB-A), Universal Serial Bus Type C (USB-C), and / or Ethernet). In some examples, electronic device 101 and electronic device 302 share a common user account and / or user (e.g., a common user / account using these devices). For example, a user may optionally log in to one or more electronic devices using a user account (e.g., a username and password).

[0051] In some examples, one or more electronic devices 101 and / or 302 each include one or more sensors and / or one or more displays. For example, the electronic devices may include an accelerometer, a global positioning sensor (GPS), an image sensor (image sensor 206A and / or 206B), an orientation sensor (e.g., orientation sensor 210A and / or 210B), and / or a position sensor (e.g., position sensor 204A and / or 204B). In some examples, when in a first power state, electronic device 101 does not include a powered display, such as... Figure 3A As shown. For example, in Figure 3A In this process, the electronic device 101 does not use the display 120 to show content, but instead presents a perspective view of the physical environment 350.

[0052] Figure 3A An example is shown where user 317 is looking at electronic device 101 while wearing electronic device 302 (or while using electronic device 101). Figure 3AIn this context, indicator 306 indicates that electronic device 302 is in a high-power state. It should be understood that indicator 306 is not necessarily a user interface element displayed via electronic device 101 and / or electronic device 302 and visible to user 317, but merely an instance of the current power state or mode of electronic device 302. In some examples, electronic device 302 obtains data indicating that user 317 is looking at electronic device 302 based on orientation data from electronic device 302 and / or electronic device 101. As described above, electronic devices 302 and 101 respectively include image sensors 206A and 206B for detecting the orientation of the respective devices. Figure 3A As shown, the orientation data indicates that the orientation vector 308a of electronic device 101 is opposite / opposite and parallel to the orientation vector 308b of electronic device 302. In some examples, when the orientation vectors 308a / 308b are within a threshold angle of parallelism (e.g., ±1°, ±5°, ±10°, or ±30°), and / or when the orientation vectors 308a / 308b are within a threshold distance of parallelism (e.g., 0.1cm, 1cm, 10cm, or 15cm), electronic device 302 determines that electronic device 101 and electronic device 302 are oriented toward each other (e.g., facing each other). In some examples, if electronic device 302 detects that electronic device 101 and electronic device 302 are facing each other using one or more sensors, electronic device 302 may also activate one or more image sensors of electronic device 302 and / or electronic device 101 (e.g., an outward-facing camera of electronic device 101 such as image sensors 114b and 114c or a front-facing camera of electronic device 302) to capture images to confirm that electronic device 302 is facing electronic device 101 and / or that user 317 is looking at electronic device 302. In some examples, one or more image sensors 114b and 114c (e.g., an outward-facing camera of electronic device 101) capture the display state of electronic device 302 to determine whether display 305 is on or off. In some examples, if display 305 is on, it is determined that electronic device 302 is in a high-power state.

[0053] After confirming that user 307 is... Figure 3AAfter (e.g., via electronic device 101) viewing electronic device 302, it is confirmed that electronic device 302 is operating in a high-power state. For example, the electronic device activates and / or transitions to high-power operation based on determining that one or more first criteria are met. In some examples, one or more first criteria for activating the high-power state include criteria that are met when user 317 is viewing and / or using electronic device 302. When in a high-power state, electronic device 302 turns on an associated display, such as display 305. In some examples, powering display 305 of electronic device 302 is a power-intensive task, so electronic device 302 activates display 305 based on determining that user 317 is actually viewing display 305. Figure 3A In this process, electronic device 302 determines that user 307 is looking at electronic device 302, which satisfies one or more of the aforementioned first criteria, and therefore electronic device 302 activates display 305 (e.g., at a first brightness). In some examples, electronic device 302 turns on display 305 in response to detecting physical input toward electronic device 302. For example, electronic device 302 detects input provided by user 317 toward electronic device 302 to turn on display 305 or touch input pointing toward display 305 (e.g., a tap of a finger on display 305).

[0054] Figure 3B Different examples of electronic devices 302 operating in a high-power state are illustrated. In some examples, one or more first criteria for activating the high-power state include criteria satisfied when electronic device 302 determines that display 120 is active while display 305 is inactive and / or powered off. In some examples, electronic device 302 obtains the display states of electronic device 101 and electronic device 302. Figure 3B In this context, electronic device 302 has enabled electronic device 101 to display a movie (or other media content) in a movie user interface 312 of a movie application (e.g., display 120 is on / active). In some examples, electronic device 302 enables electronic device 101 to display the movie user interface 312 in an immersive view or mode. For example, in Figure 3B In this context, electronic device 101 displays a cinematic user interface 312, while the representation of the physical environment 350 is diluted relative to the cinematic user interface 312 in the 3D environment 300 (e.g., the view of the physical environment 350 is displayed in shadow or presented with a dimmed effect). When viewing the cinematic user interface 312, the display 305 of electronic device 302 has a lower resolution than... Figure 3A The second brightness is shown as the first brightness. In some examples, in Figure 3BIn this context, electronic device 302 uses one or more input devices (e.g., sensors of electronic device 101 and / or electronic device 302) in a manner similarly discussed above to determine that user 317 is not looking at electronic device 302. When user 317 is not using and / or looking at electronic device 302, electronic device 302 turns off display 305 and / or applies a second brightness level to display 305. In some examples, user 317 has manually turned off display 305 using one or more input devices (e.g., by pressing a power button on electronic device 302). Additionally, as... Figure 3B As shown in the side view, user 317 faces the first direction when viewing the movie user interface 312 in the three-dimensional environment 300.

[0055] In some examples, one or more first criteria include criteria that are met when the duration of content displayed by electronic device 302 via electronic device 101 is less than a threshold time amount. For example, in Figure 3B In some examples, when electronic device 101 displays movie user interface 312, electronic device 302 has not yet met (e.g., as indicated by indicator 314) the threshold time amount for electronic device 302 to transition from high-power mode to low-power mode. In some examples, the time threshold is 5 seconds, 30 seconds, 1 minute, 5 minutes, or 10 minutes. In some examples, one or more first criteria include criteria that are met when electronic device 302 and / or electronic device 101 detects movement of electronic device 101 exceeding a threshold. For example, after detecting that the user has been relatively stationary for a threshold time amount (e.g., movement below the threshold time amount), electronic device 302 transitions from high-power mode to low-power mode when displaying user interface (e.g., user interface 312). In some examples, the movement threshold is a threshold for electronic device 302 and / or electronic device 101 not detecting movement that results in acceleration exceeding 0.1 m / s², 0.5 m / s², or 1 m / s². For example, electronic device 302 and / or electronic device 101 use one or more orientation sensors 210A, 210B to determine the acceleration of electronic device 101. Figure 3B This includes indicator 316, which includes an indication of the movement threshold M1. Figure 3B In this case, the user's movement (e.g., the movement of electronic device 101) exceeds the threshold movement M1, thereby satisfying one or more of the first criteria discussed above, and therefore electronic device 302 abandons the transition from high power mode to low power mode (e.g., continues to operate according to high power mode, as illustrated by instruction 306).

[0056] Figure 3CThis example illustrates that when a user is viewing user interface 312, even after electronic device 302 detects that the movement of electronic device 101 exceeds a threshold movement M1, electronic device 302 remains in high-power mode. Figure 3C In this process, electronic device 302 and / or electronic device 101 detect that user 317 has moved electronic device 101 (e.g., by moving / rotating head). For example, as Figure 3C As illustrated in the side view, user 317 faces a different orientation when viewing the movie user interface 312 in the three-dimensional environment 300. Figure 3B The second direction of the first direction. Because the movement occurs before the threshold time T1 (e.g., this continues to satisfy one or more of the first criteria discussed above), the electronic device 101 remains in the high-power mode. When in the high-power mode, the electronic device 302 performs body locking as described in more detail above (e.g., displaying the cinematic user interface 312 in a body-locked orientation). Because the electronic device 302 is performing body locking, the user interface 312 does not move in the three-dimensional environment 300 when the electronic device 101 moves (e.g., the electronic device 302 maintains the display of the cinematic user interface 312 in the same position and / or orientation relative to the torso of the user 317). Performing body locking improves user-device interaction by providing a more comfortable viewing environment when the user moves (e.g., does not remain stationary). Additionally and as described above, when in the high-power mode, the electronic device 302 displays the cinematic user interface 312 at a first content refresh rate and / or a first rendering rate. Because electronic device 302 is performing body locking on the movie user interface 312 displayed via electronic device 101, electronic device 302 has a high content refresh rate and / or a high rendering rate in order to adjust the display of content based on the user's movement.

[0057] exist Figure 3D In the process, after detecting that no movement M1 exceeding the threshold has been detected in electronic device 101 after a threshold time has elapsed, electronic device 302 switches to a low-power mode. For example, as... Figure 3D As indicated by indicator 314, the time has exceeded the time threshold T1, but electronic device 302 has not detected any movement greater than the movement threshold M1, as indicated by indicator 316.

[0058] In some examples, electronic device 302 switches from operating in a low-power mode to operating in a high-power mode based on determining that one or more second criteria are met. In some examples, the one or more second criteria include criteria that are met when electronic device 302 and / or electronic device 101 detects movement of electronic device 101 exceeding a second movement threshold. In some examples, as illustrated by indication identifier 316, the second movement threshold M2 is higher than the threshold referenced above. Figure 3BThe shift threshold M1 discussed is a lower threshold. For example, the shift threshold used to transition from a low-power mode to a high-power mode is lower than the shift threshold used to transition from a high-power mode to a low-power mode. In other words, a lower confidence level is required to transition from a low-power mode to a high-power mode. In some examples, the shift threshold M2 is a shift with acceleration exceeding 0.1 m / s², 0.5 m / s², or 1 m / s². Figure 3D In this process, electronic device 302 and / or electronic device 101 determine that the movement of electronic device 101 is below the movement threshold M2; therefore, electronic device 302 operates in a low-power mode, as illustrated by indicator 306.

[0059] When in low-power mode, electronic device 302 performs a second set of power functions, such as head locking and / or displays content at a second content refresh rate lower than that of high-power mode and / or a second rendering rate lower than that of high-power mode. Low-power mode has been described in more detail above.

[0060] In some examples, when in low-power mode, electronic device 302 displays content (such as...) that is different from when in high-power mode. Figure 3C The user interface 312 shown is smaller in size (e.g., as shown in the figure). Figure 3D As shown, the electronic device 302 displays content, such as user interface 312. In some examples, when in a low-power mode, the electronic device 302 displays content in a way that consumes less power. For example, the electronic device 302 switches the display of content from a fully immersive mode (e.g., as shown) to a more immersive mode. Figure 3C (as shown) reduced to a two-dimensional window (e.g., as shown) Figure 3D As shown). Figure 3D As shown, with Figure 3C Compared to the representation shown, there is less contrast between the user interface 312 and the physical environment 350 (e.g., as indicated by the shadows).

[0061] In some examples, when such Figure 3D As shown, when displaying content in low-power mode, electronic device 302 switches from displaying content in body-locked mode to displaying content in head-locked mode. Body-lock and head-lock have been described in more detail above. When in head-locked mode, electronic device 302 uses less power because it displays content at a lower rendering rate and / or content refresh rate, and also because it displays content in the same area of ​​display 120 regardless of the user's head and / or body posture. For example, when in head-locked mode, electronic device 302 updates the content display at a lower frequency than in body-locked mode, because the content remains stationary within display 120 when in head-locked mode.

[0062] In some examples, when in low-power mode, electronic device 302 sets its display (e.g., display 305 described above) to a second brightness level lower than the brightness level of electronic device 302 in high-power mode. Alternatively, in some examples, electronic device 302 sets its display to a brightness level higher than the brightness level of the display of electronic device 302 in high-power mode. In some examples, electronic device 302 performs the set of power functions described with reference to low-power mode, either independently or in combination.

[0063] exist Figure 3E In this process, electronic device 302 updates the content displayed on electronic device 101 in response to detecting movement of electronic device 101 that satisfies one or more of the second criteria discussed above. Specifically, in Figure 3E In this scenario, user 317 slightly moves their head (e.g., moves below a threshold movement M2, as indicated by indicator 316). In response to the detected movement, electronic device 302 optionally updates electronic device 101 to indicate a change in the visual appearance of the transparent or perspective portion surrounding user interface 312 (e.g., a representation of the physical environment 350). Because electronic device 302 is in a low-power mode, it performs head-locking (e.g., displays user interface 312 in a head-locked orientation), causing user interface 312 to move with electronic device 101. Figure 3E As shown, when the electronic device 101 moves in the physical environment according to the movement of the user 317's head, the user interface 312 continues to be displayed in the center of the display 120. Additionally, in Figure 3E In the case where the movement of electronic device 101 does not exceed the movement threshold M2 (e.g., the movement of electronic device 101 does not meet one or more of the second criteria discussed above), electronic device 302 does not transition from (e.g., abandons) the low-power mode to the high-power mode.

[0064] exist Figure 3F In this process, electronic device 302 detects movement of electronic device 101 exceeding the movement threshold M2. For example, in... Figure 3F In the event that user 317 stands up, electronic device 301 moves in the physical environment (e.g., longitudinally). In response to detecting movement exceeding a movement threshold M2 (e.g., satisfying one or more of the second criteria discussed above), electronic device 302 transitions from a low-power mode to a high-power mode (as illustrated in indication 306) and performs one or more power functions of the high-power mode, as described above. For example, as... Figure 3F As shown, electronic device 302 performs a body lock on electronic device 101 (e.g., displaying user interface 312 in a body lock orientation), so that as... Figure 3FAs the viewpoint of user 317 changes, user interface 312 remains at the same position and / or orientation relative to the torso of user 317 in the three-dimensional environment 300 (e.g., ...). Figure 3E (As shown) is displayed. Additionally, in Figure 3F In this context, electronic device 302 enables electronic device 101 to display content in a more immersive mode (e.g., displaying it at a larger size and / or having more pronounced brightness variations between the user interface 312 and the representation of the physical environment 350). Additionally, in Figure 3F In this process, electronic device 302 increases the rendering rate, content refresh rate, and / or frame rate. Additionally, electronic device 302 may optionally reduce the reprojection rate. In some examples, electronic device 302 reduces the persistence of content displayed via electronic device 101.

[0065] exist Figure 3F Even when electronic device 302 operates in high-power mode, the display (e.g., display 305) of electronic device 302 continues to maintain a low brightness. In some examples and as described above, electronic device 302 may perform one or more power functions associated with high-power mode (or low-power mode). In some examples, in Figure 3F In this process, electronic device 302 detects that user 317 is not looking at electronic device 302 (as described in more detail above), and therefore electronic device 302 does not change the brightness of the display of electronic device 302.

[0066] Figure 3G Examples of different electronic devices 302 operating in high-power mode when electronic device 101 displays the user interface 326 of a video game application are illustrated. In some examples, one or more first criteria for activating the high-power mode include detecting that the video game application is active on electronic device 101 and / or electronic device 302 (e.g., simultaneously or after other applications are running on electronic device 302). After or simultaneously detecting that the video game application is active, electronic device 302 transitions from low-power mode to high-power mode and / or remains in high-power mode, such as... Figure 3G As indicated by instruction 306. When a video game application is running on electronic device 302 and / or electronic device 101, electronic device 101 may move more frequently because the user is actively engaged in the video game. In some examples, when a video game application is running on electronic device 302 and / or electronic device 101, a movement threshold is established (e.g., a third) for the switching operation of electronic device 302 between power modes. For example, in Figure 3G In the middle, the third movement threshold M3, as illustrated by indicator 318, is higher than Figure 3BThe movement threshold M1 is shown. Specifically, in some examples, because electronic devices 101 and / or 302 move more when user 317 is using the video game application, the movement threshold used to switch from high-power mode to low-power mode (or from low-power mode to high-power mode) is higher. Additionally, in some examples, the corresponding threshold movement used to switch from low-power mode to high-power mode when the user interface of the video game application is displayed on electronic device 101 is higher than... Figure 3D The moving threshold M2 shown is a higher threshold.

[0067] Additionally, in Figure 3G In this context, both electronic devices 101 and 302 are used by user 317 when interacting with a video game application. However, because electronic devices 302 and / or 101 do not face each other (e.g., using the reference above...), Figure 3A (Determined by one or more first criteria described), so electronic device 302 does not increase (e.g., forgoes increasing) the display brightness of the display of electronic device 302 (e.g., display 305).

[0068] Figure 3H A graph illustrating the percentage of charge of electronic device 302 when it is actively communicating with electronic device 101 and when it is not actively communicating with electronic device 101 is shown. In some examples, active communication includes actively displaying content on electronic device 101, such as actively displaying... Figure 3F User interface 312 or Figure 3G The user interface 326 in the example. In some examples, when the electronic device 302 is plugged into a power source for charging and is also actively communicating with the electronic device 101, the electronic device 302 adjusts (e.g., reduces) the charging speed (e.g., by...). Figure 3H (Indicated by line 322b) to prevent one or more components of electronic device 302 from overheating. In some examples, when electronic device 302 is plugged into a power source for charging but is not actively communicating with electronic device 101, electronic device 302 waives the ability to regulate its charging rate (e.g., or regulates the charging rate at a lower rate), thereby allowing electronic device 302 to charge faster (e.g., by...). Figure 3H (As indicated by line 322a in the diagram). In some examples, electronic device 302 adjusts the charging speed to perform thermal mitigation on electronic device 302.

[0069] It should be understood that the examples shown and described herein are merely exemplary and additional and / or alternative elements may be provided in a three-dimensional environment for adjusting power consumption when using electronic devices. It should be understood that the appearance, shape, form, and size of each of the various user interface elements and objects shown and described herein are exemplary and alternative appearances, shapes, forms, and / or sizes may be provided. For example, alternative shapes (such as rectangular shapes, circular shapes, triangular shapes, etc.) different from those shown may be provided to represent virtual objects of a user interface (e.g., user interface 312). Additionally or alternatively, in some examples, the various options, user interface elements, control elements, etc., described herein may be selected and / or manipulated via user input received through one or more input devices communicating with one or more electronic devices. For example, selection input may be received via a physical input device (such as a mouse, touchpad, keyboard, etc.) communicating with one or more electronic devices or via physical buttons integrated with one or more electronic devices.

[0070] Figure 4 Flowcharts illustrating example processes for transitioning between different power states based on information collected from one or more input devices, according to some examples of this disclosure, are shown. In some examples, process 400 begins at an electronic device communicating with one or more first displays, one or more second displays, and one or more input devices. In some examples, the electronic device may optionally be similar to or correspond to... Figure 2A The electronic device 201 is a head-mounted display or similar to or corresponding to Figure 2B The electronic device 260 is a mobile electronic device. In some examples, one or more first displays are displays of mobile electronic devices (e.g., companion devices), and one or more second displays include head-mounted displays (e.g., similar to or corresponding to head-mounted displays). Figure 2A Electronic devices (201). For example... Figure 4 As shown, in some examples, at 402, the electronic device obtains data via one or more input devices. For example, Figure 3A The illustrated electronic device 302 obtains the same information as electronic device 302 and / or electronic device 101 (also in...). Figure 3A (As shown in the image) Context-dependent data.

[0071] like Figure 4 As shown, in some examples, at 404, the electronic device determines whether the acquired data meets one or more criteria. In some examples, the one or more criteria include and / or correspond to... Figures 3A to 3GThe first criteria and / or the second criteria described herein. For example, the first or second criteria include criteria that are met when the orientation of electronic device 302 and the orientation of electronic device 101 are aligned, criteria that are met when the display of electronic device 302 is off but the display of electronic device 101 is on, criteria that are met when a user is looking at the display of electronic device 101, and / or criteria that are met when electronic device 302 detects movement exceeding a threshold.

[0072] In some examples, if one or more criteria are met, then at step 406, the electronic device 302 is in a first power mode (e.g., a high-power mode). In some examples, if one or more criteria are not met, then at step 408, the electronic device 302 is in a second power mode (e.g., a low-power mode). In some examples, Figure 3B , Figure 3C , Figure 3F and Figure 3G The high-power mode is shown and described in some examples. Figure 3D and Figure 3E The low-power mode is shown and described in the figure.

[0073] It should be understood that process 400 is an example, and more, fewer, or different operations may be performed in the same or different order. Additionally, the operations in process 400 described above may optionally be performed by running an information processing device such as a general-purpose processor (e.g., as per [reference to...]). Figures 2A to 2B (as described) or one or more functional modules in a dedicated chip and / or through Figures 2A to 2B It is implemented using other components.

[0074] Therefore, according to the foregoing, some examples of this disclosure relate to a method comprising: at an electronic device communicating with one or more first displays, one or more second displays, and one or more input devices: obtaining data via the one or more input devices; and executing a first set of power functions based on determining that one or more first criteria are satisfied, the one or more first criteria including criteria satisfied based on the data obtained via the one or more input devices, the first set of power functions including functions for causing the one or more second displays to display content in a first manner; and executing a second set of power functions different from the first set of power functions and including functions for causing the one or more second displays to display content in a second manner different from the first manner, based on determining that the one or more first criteria are not satisfied. As a supplement or alternative to one or more examples of the examples disclosed above, in some examples, obtaining the data includes: obtaining first data indicating a first orientation of the electronic device relative to the environment of the electronic device; and obtaining second data indicating a second orientation of the one or more second displays relative to the environment using the one or more input devices. As a supplement or alternative to one or more of the examples disclosed above, in some examples, obtaining the data further includes determining a first vector corresponding to the first orientation and determining a second vector corresponding to the second orientation; and the one or more first criteria include a criterion satisfied when the first vector is misaligned with the second vector. As a supplement or alternative to one or more of the examples disclosed above, in some examples, obtaining the data includes obtaining first data indicating a first display state of the one or more first displays and second data indicating a second display state of the one or more second displays; and the one or more first criteria include a criterion satisfied when the first display state indicates that the one or more first displays are powered off and the second display state indicates that the one or more second displays are powered on. As a supplement or alternative to one or more of the examples disclosed above, in some examples, obtaining the data includes obtaining the second display state of the one or more second displays using the one or more input devices communicating with the electronic device; and the one or more first criteria include a criterion satisfied when the second display state indicates that the one or more second displays are powered on when the one or more second displays are within the field of view of the one or more input devices. As a supplement to or alternative to one or more of the examples disclosed above, in some examples, the one or more first criteria include: a first criterion satisfied when the electronic device detects movement exceeding a threshold by a user of the electronic device via the one or more input devices; and a second criterion satisfied when a first application is currently active on the electronic device.As a supplement to or alternative to one or more of the examples disclosed above, in some examples, the first set of power functions includes at least one of world lock mode, body lock mode, face tracking mode, first content refresh rate, or first rendering rate. As a supplement to or alternative to one or more of the examples disclosed above, in some examples, the second set of power functions includes at least one of head lock mode, a second content refresh rate different from the first content refresh rate, or a second rendering rate different from the first rendering rate. As a supplement to or alternative to one or more of the examples disclosed above, in some examples, the first set of power functions includes a first rendering rate and a first content refresh rate, and the second set of power functions includes a second rendering rate lower than the first rendering rate and the first content refresh rate. As a supplement to or alternative to one or more of the examples disclosed above, in some examples, the first set of power functions includes displaying content at a first size via the one or more second displays, and the second set of power functions includes displaying the content at a second size smaller than the first size. As a supplement or alternative to one or more of the examples disclosed above, in some examples, the second set of power functions includes performing multiple actions on the electronic device, the multiple actions including: reducing the brightness associated with the one or more first displays; reducing the frame rate of content displayed via the one or more first displays; increasing the persistence of the content displayed via the one or more first displays; and / or maintaining a reprojection rate of the one or more second displays above a threshold reprojection rate. As a supplement or alternative to one or more of the examples disclosed above, in some examples, when the second set of power functions is performed according to determining that the one or more first criteria are not met: the second set of power functions is stopped and the first set of power functions is performed according to determining that the one or more second criteria are met; and the second set of power functions continues to be performed according to determining that the one or more second criteria are not met. As a supplement or alternative to one or more of the examples disclosed above, in some examples, the one or more second criteria include criteria satisfied when the electronic device detects a movement of the electronic device greater than a threshold movement via the one or more input devices. As a supplement to or alternative to one or more of the examples disclosed above, in some examples, the threshold movement is lower than a corresponding threshold movement of the electronic device that satisfies the one or more first criteria. As a supplement to or alternative to one or more of the examples disclosed above, in some examples, obtaining the data includes obtaining charging data, and the method further includes: adjusting the charging speed based on determining that the charging data includes an indication that the electronic device is actively communicating with the one or more second displays; and abandoning the adjustment of the charging speed based on determining that the charging data does not include the indication.As a supplement to or alternative to one or more of the examples disclosed above, in some examples, the one or more second displays include head-mounted displays.

[0075] Some examples of this disclosure relate to an electronic device comprising: one or more processors; a memory; and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods described above.

[0076] Some examples of this disclosure relate to a non-transitory computer-readable storage medium that stores one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform any of the methods described above.

[0077] Some examples of this disclosure relate to an electronic device that includes one or more processors, a memory, and components for performing any of the methods described above.

[0078] Some examples of this disclosure relate to an information processing apparatus used in an electronic device, the information processing apparatus including components for performing any of the methods described above.

[0079] For purposes of explanation, the foregoing description has been described by reference to specific examples. However, the illustrative description above is not intended to be exhaustive or to limit the present disclosure to the precise form disclosed. Many modifications and variations are possible based on the teachings above. The examples were chosen and described in order to best elucidate the principles of the present disclosure and its practical application, thereby enabling others skilled in the art to make optimal use of the present disclosure with various modifications suitable for the particular intended purpose, as well as the various described examples.

Claims

1. A method, the method comprising: At an electronic device that communicates with one or more first displays, one or more second displays, and one or more input devices: Data is obtained via the one or more input devices; as well as A first set of power functions is executed based on determining that one or more first criteria are met, the one or more first criteria including criteria to be met based on the data obtained via the one or more input devices, the first set of power functions including functions for causing the one or more second displays to display content in a first manner; as well as Based on the determination that one or more of the first criteria are not met, a second set of power functions is executed, the second set of power functions being different from the first set of power functions and including functions for causing the one or more second displays to display content in a second manner different from the first manner.

2. The method according to claim 1, wherein obtaining the data comprises: Obtain first data indicating a first orientation of the electronic device relative to its environment; as well as Second data indicating a second orientation of the one or more second displays relative to the environment is obtained using the one or more input devices.

3. The method according to claim 2, wherein: Obtaining the data also includes determining a first vector corresponding to the first orientation and determining a second vector corresponding to the second orientation; and The one or more first criteria include criteria that are satisfied when the first vector is misaligned with the second vector.

4. The method according to claim 1, wherein: Obtaining the data includes obtaining first data indicating the state of the first display of the one or more first displays and second data indicating the state of the second display of the one or more second displays; and The one or more first criteria include criteria that are satisfied when the first display state indicates that the one or more first displays are powered off and the second display state indicates that the one or more second displays are powered on.

5. The method according to claim 1, wherein: Obtaining the data includes obtaining the second display status of the one or more second displays using the one or more input devices communicating with the electronic device; and The one or more first criteria include criteria that are met when the one or more second displays are powered on, provided that the state of the second display indicates that the one or more second displays are within the field of view of the one or more input devices.

6. The method of claim 1, wherein the one or more first criteria comprise: A first criterion is satisfied when the electronic device detects, via the one or more input devices, a movement exceeding a threshold by the user of the electronic device; and The second criterion is satisfied when the first application is currently active on the electronic device.

7. The method of claim 1, wherein the first set of power functions includes at least one of world lock mode, body lock mode, face tracking mode, first content refresh rate, or first rendering rate.

8. The method of claim 7, wherein the second set of power functions includes at least one of a head-lock mode, a second content refresh rate different from the first content refresh rate, or a second rendering rate different from the first rendering rate.

9. The method of claim 1, wherein the first set of power functions includes a first rendering rate and a first content refresh rate, and the second set of power functions includes a second rendering rate and the first content refresh rate that are lower than the first rendering rate.

10. The method of claim 1, wherein the first set of power functions includes displaying content at a first size via the one or more second displays, and the second set of power functions includes displaying the content at a second size smaller than the first size.

11. The method of claim 1, wherein the second set of power functions includes performing a plurality of actions on the electronic device, the plurality of actions including: Reduce the brightness associated with the one or more first displays; Reduce the frame rate of the content displayed via the one or more first displays; Improve the persistence of the content displayed via the one or more first displays; and / or Maintain a reprojection rate above a threshold reprojection rate for the one or more second displays.

12. The method according to claim 1, further comprising: When the second set of functions is executed based on the determination that one or more of the first criteria are not met: Based on determining that one or more second criteria are met, the second set of power functions is stopped and the first set of power functions is executed; and The second set of power functions continues to be executed if one or more second criteria are determined not to be met.

13. The method of claim 12, wherein the one or more second criteria include criteria satisfied when the electronic device detects a movement of the electronic device greater than a threshold movement via the one or more input devices.

14. The method of claim 13, wherein the threshold movement is lower than a corresponding threshold movement of the electronic device that satisfies one or more of the first criteria.

15. The method of claim 1, wherein obtaining the data includes obtaining charging data, and the method further includes: The charging speed is adjusted based on the determination that the charging data includes an indication that the electronic device is actively communicating with the one or more second displays; as well as If the charging data does not include the indication, the adjustment of the charging speed is abandoned.

16. The method of claim 1, wherein the one or more second displays comprise head-mounted displays.

17. An electronic device, the electronic device comprising: One or more processors; Memory; and One or more programs, the programs being stored in the memory and configured to be executed by the one or more processors, the programs including instructions for performing the method according to any one of claims 1 to 16.

18. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform the method according to any one of claims 1 to 16.

19. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more input devices, the one or more programs comprising instructions for performing the method according to any one of claims 1 to 16.

Images