Changing tinting levels of one or more displays

The electronic device automatically adjusts tint and content presentation based on user interaction criteria, enhancing the user experience by seamlessly transitioning between virtual and physical environments.

JP2025123199APending Publication Date: 2025-08-22APPLE INC
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2025019009
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2025-01-29
Filing Date
2025-02-07
Publication Date
2025-08-22

AI Technical Summary

Technical Problem

Users of head-mounted displays often need to manually adjust the display tint or content presentation to seamlessly view both virtual and physical environments, which can be inconvenient.

Method used

An electronic device automatically adjusts the color tint level and content presentation based on predefined criteria, such as detecting the user's attention shift from the display interface to the physical environment, allowing seamless transitions without manual input.

Benefits of technology

Enables users to focus on both virtual and physical environments without manual adjustments, providing an enhanced user experience by automatically adapting the display settings to the user's interactions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025123199000001
    Figure 2025123199000001
  • Figure 2025123199000002
    Figure 2025123199000002
  • Figure 2025123199000003
    Figure 2025123199000003
Patent Text Reader

Abstract

To provide a system and method for changing tinting levels of one or more displays.SOLUTION: In some examples, an electronic device (e.g., an HMD) presents a content in a first manner including a first tint. In some examples, in response to determining that one or more criteria are satisfied, the electronic device presents the content in a second manner and changes the tinting level from a first tinting level to a second tinting level. Changing the tinting level and the presentation of the content allows a user to seamlessly see and / or focus on different objects in a physical environment without having to manually change the tint of a display and / or without having to manually change the presentation of the content presented on the display.SELECTED DRAWING: None
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] (CROSS-REFERENCE TO RELATED APPLICATIONS) This application claims the benefit of U.S. Provisional Patent Application No. 63 / 552,068, filed February 9, 2024, U.S. Provisional Patent Application No. 63 / 743,558, filed January 9, 2025, and U.S. Provisional Patent Application No. 19 / 040,692, filed January 29, 2025, the contents of which are incorporated herein by reference in their entirety for all purposes.

[0002] The present invention relates generally to systems and methods for altering the tint level of one or more displays, and more particularly to altering the tint level of one or more displays of an electronic device based on meeting one or more criteria. [Background technology]

[0003] Some computer graphical environments provide computer-generated two-dimensional and / or three-dimensional environments in which at least some of the objects displayed for the user to view are virtual. Users of head-mounted displays (HMDs) often need to remove the HMD or provide manual input to interact with the physical environment. Summary of the Invention

[0004] The present invention generally relates to systems and methods for changing the color tint level of one or more displays, and more particularly, to changing the color tint level of one or more displays of an electronic device based on satisfying one or more criteria. In some examples, an electronic device (e.g., an HMD) presents content in a first manner including a first color tint. In some examples, in response to determining that one or more criteria are satisfied, the electronic device presents the content in a second manner and changes the color tint level from the first color tint level to a second color tint level. For example, in response to detecting that a user has shifted their attention away from a user interface displayed by the electronic device and is instead interacting with other objects in the physical environment (e.g., other electronic devices, people), the electronic device reduces the color tint level (changing the color tint level of the display to be more transparent) and / or minimizes the content. Changing the color tint level and content presentation allows a user to seamlessly view and / or focus on different objects in the physical environment without having to manually change the color tint of the display and / or manually change the presentation of the content presented on the display.

[0005] A full description of these examples is set forth in the Drawings and Detailed Description, and it should be understood that this Summary is not intended to limit the scope of the present disclosure in any way. [Brief explanation of the drawings]

[0006] [Figure 1] 1 illustrates an electronic device presenting an augmented reality environment, according to some examples of the present disclosure.

[0007] [Figure 2A] 1 shows a block diagram of an example architecture of an electronic device according to some examples of the present disclosure. [Figure 2B] 1 shows a block diagram of an example architecture of an electronic device according to some examples of the present disclosure.

[0008] [Figure 3A] 1 illustrates an example of an electronic device that presents content differently and changes the tint level of the display when one or more criteria are met, according to some examples of the present disclosure. [Figure 3B] 1 illustrates an example of an electronic device that presents content differently and changes the tint level of the display when one or more criteria are met, according to some examples of the present disclosure. [Figure 3C] 1 illustrates an example of an electronic device that presents content differently and changes the tint level of the display when one or more criteria are met, according to some examples of the present disclosure. [Figure 3D] 1 illustrates an example of an electronic device that presents content differently and changes the tint level of the display when one or more criteria are met, according to some examples of the present disclosure. [Figure 3E] 1 illustrates an example of an electronic device that presents content differently and changes the tint level of the display when one or more criteria are met, according to some examples of the present disclosure. [Figure 3F] 1 illustrates an example of an electronic device that presents content differently and changes the tint level of the display when one or more criteria are met, according to some examples of the present disclosure. [Figure 3G] 1 illustrates an example of an electronic device that presents content differently and changes the tint level of the display when one or more criteria are met, according to some examples of the present disclosure. [Figure 3H] 1 illustrates an example of an electronic device that presents content differently and changes the tint level of the display when one or more criteria are met, according to some examples of the present disclosure. [Figure 3H-A] 1 illustrates an example of an electronic device that presents content differently and changes the tint level of the display when one or more criteria are met, according to some examples of the present disclosure. [Figure 3I]1 illustrates an example of an electronic device that presents content differently and changes the tint level of the display when one or more criteria are met, according to some examples of the present disclosure. [Figure 3J] 1 illustrates an example of an electronic device that presents content differently and changes the tint level of the display when one or more criteria are met, according to some examples of the present disclosure. [Figure 3K] 1 illustrates an example of an electronic device that presents content differently and changes the tint level of the display when one or more criteria are met, according to some examples of the present disclosure. [Figure 3L] 1 illustrates an example of an electronic device that presents content differently and changes the tint level of the display when one or more criteria are met, according to some examples of the present disclosure. [Figure 3M] 1 illustrates an example of an electronic device that presents content differently and changes the tint level of the display when one or more criteria are met, according to some examples of the present disclosure. [Figure 3N] 1 illustrates an example of an electronic device that presents content differently and changes the tint level of the display when one or more criteria are met, according to some examples of the present disclosure. [Figure 3O] 1 illustrates an example of an electronic device that presents content differently and changes the tint level of the display when one or more criteria are met, according to some examples of the present disclosure.

[0009] [Figure 4] 1 shows a flow diagram illustrating an example process for causing an electronic device to present content in a three-dimensional environment in a second manner instead of a first manner, according to some examples of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0010] The present invention generally relates to systems and methods for changing the color tint level of one or more displays, and more particularly, to changing the color tint level of one or more displays of an electronic device based on satisfying one or more criteria. In some examples, an electronic device (e.g., an HMD) presents content in a first manner including a first color tint. In some examples, in response to determining that one or more criteria are satisfied, the electronic device presents the content in a second manner and changes the color tint level from the first color tint level to a second color tint level. For example, in response to detecting that a user has shifted their attention away from a user interface displayed by the electronic device and is instead interacting with other objects in the physical environment (e.g., other electronic devices, people), the electronic device reduces the color tint level (changing the color tint level of the display to be more transparent) and / or minimizes the content. Changing the color tint level and content presentation allows a user to seamlessly view and / or focus on different objects in the physical environment without having to manually change the color tint of the display and / or manually change the presentation of the content presented on the display.

[0011] In some examples, presenting an augmented reality environment using an electronic device includes presenting a pass-through video of the electronic device's physical environment. As described herein, for example, presenting a pass-through video may include displaying a virtual pass-through or a video pass-through in which the electronic device displays an image of the physical environment using one or more displays. In other examples, presenting an augmented reality environment using an electronic device includes presenting a true or actual optical see-through in which a portion of the physical environment is visible to the user through a transparent portion of the display. As described herein, reducing the tint level of the display allows for improved viewing of the physical environment through the transparent portion of the display, while increasing the tint level of the display allows for improved presentation of some virtual content (e.g., obscuring some or all of the physical environment).

[0012] In some examples, a three-dimensional object is displayed within a computer-generated three-dimensional environment in a particular orientation that controls one or more behaviors of the three-dimensional object (e.g., when the three-dimensional object is moved within the three-dimensional environment). In some examples, the orientation in which the three-dimensional object is displayed in the three-dimensional environment is selected by a user of the electronic device or automatically selected by the electronic device. For example, when initiating presentation of the three-dimensional object in the three-dimensional environment, the user may select a particular orientation of the three-dimensional object, or the electronic device may automatically select an orientation of the three-dimensional object (e.g., based on the type of three-dimensional object).

[0013] In some examples, a three-dimensional object may be displayed within a three-dimensional environment in a world-locked orientation, a body-locked orientation, a tilt-locked orientation, or a head-locked orientation, as described below. As used herein, an object displayed in a body-locked orientation in a three-dimensional environment has a distance and orientation offset relative to a part of the user's body (e.g., the user's torso). Alternatively, in some examples, a body-locked object has a fixed distance from the user (e.g., may be displayed in the same cardinal direction relative to the user regardless of head and / or body movement) without the orientation of the content being referenced to any part of the user's body. Additionally or alternatively, in some examples, a body-locked object may be configured to always remain aligned with gravity or the horizon (e.g., perpendicular to gravity) so that head and / or body changes in roll direction do not cause the body-locked object to move within the three-dimensional environment. Rather, translational movement in either configuration causes the body-locked object to reposition within the three-dimensional environment, maintaining the distance offset.

[0014] As used herein, an object displayed in a head-locked orientation in a three-dimensional environment has a distance and orientation offset relative to the user's head. In some examples, the head-locked object moves within the three-dimensional environment as the user's head moves (as the user's viewpoint changes).

[0015] As used herein, an object displayed in a world-locked orientation in a three-dimensional environment has no distance or orientation offset relative to the user.

[0016] As used herein, an object displayed in a tilt-locked orientation in a three-dimensional environment (referred to herein as a tilt-locked object) has a distance offset relative to the user, such as a part of the user's body (e.g., the user's torso) or the user's head. In some examples, the tilt-locked object is displayed at a fixed orientation relative to the three-dimensional environment. In some examples, the tilt-locked object moves according to a polar (e.g., spherical) coordinate system centered at a pole passing through the user (e.g., the user's head). For example, the tilt-locked object is moved within the three-dimensional environment based on the movement of the user's head within a spherical space surrounding (e.g., centered on) the user's head. Thus, when the user tilts their head against gravity (e.g., pitching up or down), the tilt-locked object will follow the head tilt and move radially along the sphere, resulting in the tilt-locked object being repositioned within the three-dimensional environment to be at the same distance offset relative to the user as it was before the head tilt, optionally while maintaining the same orientation relative to the three-dimensional environment. In some examples, tilt-locked objects will not reposition within the three-dimensional environment when the user moves their head in a roll direction (e.g., clockwise or counterclockwise) relative to gravity.

[0017] FIG. 1 illustrates an electronic device 101 presenting an extended reality (XR) environment (e.g., a computer-generated environment that optionally includes representations of physical and / or virtual objects) according to some examples of the present disclosure. In some examples, as shown in FIG. 1, the electronic device 101 is a head-mounted display or other head-mountable device configured to be worn on the head of a user of the electronic device 101. Examples of the electronic device 101 are described below with reference to the architectural block diagram of FIG. 2A. As shown in FIG. 1, the electronic device 101 and a table 106 are located in a physical environment. The physical environment may include physical features such as physical surfaces (e.g., floors, walls) or physical objects (e.g., tables, lamps, etc.). In some examples, the electronic device 101 may be configured to detect and / or capture images of the physical environment, including the table 106 (shown within the field of view of the electronic device 101).

[0018] In some examples, as shown in FIG. 1, electronic device 101 includes one or more internal image sensors 114a (e.g., eye-tracking cameras described below with reference to FIGS. 2A-2B) oriented toward the user's face. In some examples, internal image sensor 114a is used for eye tracking (e.g., detecting the user's gaze). Internal image sensor 114a is optionally positioned on left and right portions of display 120a to enable eye tracking of the user's left and right eyes. In some examples, electronic device 101 also includes external image sensors 114b and 114c facing outward from the user to detect and / or capture the physical environment of electronic device 101 and / or movements of the user's hands or other body parts.

[0019] In some examples, display 120a has a field of view visible to the user (e.g., which may or may not correspond to the field of view of external image sensors 114b and 114c). Because display 120a is optionally part of a head-mounted device, the field of view of display 120a is optionally the same as or similar to the field of view of the user's eyes. In other examples, the field of view of display 120a may be smaller than the field of view of the user's eyes. In some examples, electronic device 101 may be an optical see-through device in which display 120a is a transparent or semi-transparent display through which a portion of the physical environment can be viewed directly. In some examples, display 120a may be contained within a transparent lens or may overlap all or only a portion of a transparent lens. In other examples, electronic device 101 may be a video pass-through device in which display 120a is an opaque display configured to display images of the physical environment captured by external image sensors 114b and 114c. While a single display 120a is shown, it should be understood that display 120a may include a stereo pair of displays.

[0020] 1 , which is not present in the physical environment but is displayed in the XR environment positioned on top of a real-world table 106 (or a representation thereof). Optionally, the virtual object 104 may be displayed on a surface of the table 106 in the XR environment displayed via the display 120a of the electronic device 101 in response to detecting the plane of the table 106 in the physical environment 100.

[0021] It should be understood that virtual object 104 is exemplary of a virtual object, and that one or more different virtual objects (e.g., of various dimensionalities, such as two-dimensional or other three-dimensional virtual objects) can be included and rendered within the three-dimensional XR environment. For example, the virtual object may represent an application or a user interface displayed within the XR environment. In some examples, the virtual object may represent content corresponding to an application and / or displayed via a user interface in the XR environment. In some examples, virtual object 104 is optionally interactive and configured to respond to user input (e.g., air gestures such as an air pinch gesture, an air tap gesture, and / or an air touch gesture) such that a user may virtually touch, tap, move, rotate, or otherwise interact with virtual object 104.

[0022] In some examples, electronic device 101 may be configured to communicate with a second electronic device, such as a companion device. For example, as shown in FIG. 1 , electronic device 101 may communicate with electronic device 160. In some examples, electronic device 160 corresponds to a mobile electronic device, such as a smartphone, a tablet computer, a smartwatch, or other electronic device. Additional examples of electronic device 160 are described below with reference to the architecture block diagram of FIG. 2B . In some examples, electronic device 101 and electronic device 160 are associated with the same user. For example, in FIG. 1 , electronic device 101 may be positioned on (e.g., worn by) the user's head, electronic device 160 may be positioned near electronic device 101, such as in the user's hand 103 (e.g., hand 103 is holding electronic device 160), and electronic device 101 and electronic device 160 are associated with the same user account of the user (e.g., the user is logged into user accounts on electronic device 101 and electronic device 160). Additional details regarding communication between electronic device 101 and electronic device 160 are provided below with reference to FIGS. 2A-2B.

[0023] In some examples, displaying an object within the three-dimensional environment may include interaction with one or more user interface objects within the three-dimensional environment. For example, initiating the display of an object within the three-dimensional environment may include interaction with one or more virtual options / affordances displayed within the three-dimensional environment. In some examples, a user's gaze may be tracked by the electronic device as input to identify one or more virtual options / affordances for selection when initiating the display of the object within the three-dimensional environment. For example, the gaze may be used to identify one or more virtual options / affordances for selection using another selection input. In some examples, the virtual options / affordances may be selected using hand-tracking input detected via an input device in communication with the electronic device. In some examples, an object displayed within the three-dimensional environment may be moved and / or reoriented within the three-dimensional environment according to movement input detected via the input device.

[0024] In the following description, an electronic device is described that communicates with display generating components and one or more input devices. It should be understood that the electronic device optionally communicates with one or more other physical user interface devices, such as a touch-sensitive surface, a physical keyboard, a mouse, a joystick, a hand-tracking device, an eye-tracking device, a stylus, etc. It should also be understood that, as noted above, the described electronic device, display, and touch-sensitive surface are optionally distributed across two or more devices. Thus, as used in this disclosure, information displayed on or by an electronic device may optionally be used to describe information output by the electronic device for display on another display device (touch-sensitive or non-touch-sensitive). Similarly, as used in this disclosure, input received at an electronic device (e.g., touch input received on a touch-sensitive surface of the electronic device or touch input received on the surface of a stylus) is optionally used to describe input received at a separate input device from which the electronic device receives input information.

[0025] The device typically supports a variety of applications, such as one or more of a drawing application, a presentation application, a word processing application, a website creation application, a disc authoring application, a spreadsheet application, a gaming application, a telephony application, a video conferencing application, an email application, an instant messaging application, a training support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music playback application, a television channel browsing application, and / or a digital video playback application.

[0026] 2A-2B show block diagrams of example architectures of electronic devices 201 and 260, according to some examples of the present disclosure. In some examples, electronic device 201 and / or electronic device 260 include one or more electronic devices. For example, electronic device 201 may each be a portable device, an auxiliary device that communicates with another device, a head-mounted display, etc. In some examples, electronic device 201 corresponds to electronic device 101 described above with reference to FIG. 1. In some examples, electronic device 260 corresponds to electronic device 160 described above with reference to FIG. 1.

[0027] 2A , electronic device 201 optionally includes various sensors, such as one or more hand tracking sensors 202, one or more location sensors 204A, one or more image sensors 206A (optionally corresponding to internal image sensor 114a and / or external image sensors 114b and 114c of FIG. 1 ), one or more touch-sensitive surface 209A, one or more motion and / or orientation sensors 210A, one or more eye-tracking sensors 212, one or more microphones 213A or other audio sensors, one or more body-tracking sensors (e.g., torso and / or head-tracking sensors), one or more display generating components 214A, optionally corresponding to display 120a of FIG. 1 , one or more speakers 216A, one or more processors 218A, one or more memories 220A, and / or communications circuitry 222A. One or more communications buses 208A are optionally used for communication between the above-mentioned components of electronic device 201. 2B , electronic device 260 optionally includes one or more location sensors 204B, one or more image sensors 206B, one or more touch-sensitive surfaces 209B, one or more orientation sensors 210B, one or more microphones 213B, one or more display generating components 214B, one or more speakers 216B, one or more processors 218B, one or more memories 220B, and / or communications circuitry 222B. One or more communications buses 208B are optionally used for communication between the above-mentioned components of electronic device 260. Electronic devices 201 and 260 are optionally configured to communicate via a wired or wireless connection between the two electronic devices (e.g., via communications circuitry 222A, 222B). For example, as shown in FIG. 2A , electronic device 260 may function as a companion device to electronic device 201.

[0028] Communications circuitry 222A, 222B optionally includes circuitry for communicating with electronic devices, networks such as the Internet, an intranet, wired and / or wireless networks, cellular networks, and wireless local area networks (LANs). Communications circuitry 222A, 222B optionally includes circuitry for communicating using short-range communications such as near-field communications (NFC) and / or Bluetooth.

[0029] The processor(s) 218A, 218B include one or more general-purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some examples, memory 220A or 220B is a non-transitory computer-readable storage medium (e.g., flash memory, random access memory, or other volatile or non-volatile memory or storage device) that stores computer-readable instructions configured to be executed by processor(s) 218A, 218B to perform the techniques, processes, and / or methods described below. In some examples, memory 220A and / or 220B can include two or more non-transitory computer-readable storage media. A non-transitory computer-readable storage medium can be any medium (other than a signal) that can tangibly store or carry computer-executable instructions used by or in connection with an instruction execution system, apparatus, or device. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media may include, but are not limited to, magnetic, optical, and / or semiconductor storage devices. Examples of such storage include magnetic disks, compact discs (CDs), digital versatile discs (DVDs), or optical discs based on Blu-ray technology, as well as persistent solid-state memory such as flash and solid-state drives.

[0030] In some examples, display generating component(s) 214A, 214B include a single display (e.g., a liquid crystal display (LCD), organic light emitting diode (OLED), or other type of display). In some examples, display generating component(s) 214A, 214B include multiple displays. In some examples, display generating component(s) 214A, 214B can include a display with touch capabilities (e.g., a touchscreen), a projector, a holographic projector, a retina projector, a transparent or translucent display, etc. In some examples, electronic devices 201 and 260 include touch-sensitive surface(s) 209A and 209B, respectively, for receiving user inputs such as tap and swipe inputs or other gestures. In some examples, display generating component(s) 214A, 214B and touch-sensitive surface(s) 209A, 209B form touch-sensitive display(s) (e.g., a touchscreen integrated with each of electronic devices 201 and 260 or external to each of electronic devices 201 and 260 in communication with each of electronic devices 201 and 260). In some examples, display generating component(s) 214A includes one or more tint layers, as described in further detail in FIGS. 3A-3O. In some examples, the tint layer is integrated into display generating component(s) 214A. In some examples, the tint layer is a separate layer within display generating component(s) 214A. For example, as shown in FIG. 2A , display generating component(s) 214A includes tint-adjustable layer 230.

[0031] Electronic devices 201 and 260 optionally include image sensor(s) 206A and 206B, respectively. Image sensor(s) 206A, 206B optionally include one or more visible light image sensors, such as charge-coupled device (CCD) sensors and / or complementary metal-oxide semiconductor (CMOS) sensors, operable to acquire images of physical objects from the real-world environment. Image sensor(s) 206A, 206B also optionally include one or more infrared (IR) sensors, such as passive or active IR sensors, for detecting infrared light from the real-world environment. For example, an active IR sensor includes an IR emitter for emitting infrared light into the real-world environment. Image sensor(s) 206A, 206B also optionally include one or more cameras configured to capture movement of physical objects in the real-world environment. The image sensor(s) 206A, 206B also optionally include one or more depth sensors configured to detect the distance of a physical object from the electronic device 201, 260. In some examples, information from the one or more depth sensors may enable the device to identify an object in the real-world environment and distinguish it from other objects in the real-world environment. In some examples, the one or more depth sensors may enable the device to determine the texture and / or topography of an object in the real-world environment.

[0032] In some examples, the electronic device 201, 260 uses a combination of a CCD sensor, an event camera, and a depth sensor to detect the physical environment around the electronic device 201, 260. In some examples, the image sensor(s) 206A, 206B include a first image sensor and a second image sensor. The first image sensor and the second image sensor cooperate and are optionally configured to capture different information of physical objects in the real-world environment. In some examples, the first image sensor is a visible light image sensor and the second image sensor is a depth sensor. In some examples, the electronic device 201, 260 uses the image sensor(s) 206A, 206B to detect the position and orientation of the electronic device 201, 260 and / or the display generating component(s) 214A, 214B within the real-world environment. For example, the electronic device 201, 260 uses image sensor(s) 206A, 206B to track the position and orientation of the display generating component(s) 214A, 214B relative to one or more fixed objects in the real-world environment.

[0033] In some examples, electronic devices 201 and 260 include microphone(s) 213A and 213B, respectively, or other sound sensors. Electronic devices 201, 260 optionally use microphone(s) 213A, 213B to detect sounds from the user and / or the user's real-world environment. In some examples, microphone(s) 213A, 213B include an array of microphones (multiple microphones) that optionally work in conjunction, such as to identify ambient noise or to localize a sound source within a space in the real-world environment.

[0034] The electronic devices 201 and 260 each include location sensor(s) 204A and 204B for detecting the location of the electronic device 201A and / or display generating component(s) 214A and the location of the electronic device 260 and / or display generating component(s) 214B, respectively. For example, the location sensor(s) 204A, 204B may include a Global Positioning System (GPS) receiver that receives data from one or more satellites, allowing the electronic devices 201, 260 to determine the device's absolute position in the physical world.

[0035] The electronic devices 201 and 260 include orientation sensor(s) 210A and 210B, respectively, for detecting the orientation and / or movement of the electronic device 260 and / or display generating component(s) 214A and the orientation and / or movement of the electronic device 201 and / or display generating component(s) 214B, respectively. For example, the electronic devices 201, 260 use the orientation sensor(s) 210A, 210B to track changes in the position and / or orientation of the electronic device 201, 260 and / or display generating component(s) 214A, 214B relative to physical objects, etc., in a real-world environment. The orientation sensor(s) 210A, 210B optionally include one or more gyroscopes and / or one or more accelerometers.

[0036] The electronic device 201, in some examples, includes hand tracking sensor(s) 202 and / or eye tracking sensor(s) 212 (and / or other body tracking sensor(s), such as leg, torso, and / or head tracking sensor(s)). The hand tracking sensor(s) 202 are configured to track the position / location of one or more parts of a user's hand and / or the movement of one or more parts of a user's hand relative to the augmented reality environment, relative to the display generating component(s) 214A, and / or relative to another defined coordinate system. The eye tracking sensor(s) 212 are configured to track the position and movement of the user's gaze (more generally, eyes, face, or head) relative to the real world or the augmented reality environment and / or relative to the display generating component(s) 214A. In some examples, hand tracking sensor(s) 202 and / or eye tracking sensor(s) 212 are implemented together with display generating component(s) 214A. In some examples, hand tracking sensor(s) 202 and / or eye tracking sensor(s) 212 are implemented separately from display generating component(s) 214A. In some examples, electronic device 201 alternatively does not include hand tracking sensor(s) 202 and / or eye tracking sensor(s) 212. In some such examples, display generation component(s) 214A may be utilized by electronic device 260 to provide an augmented reality environment and utilize input and other data collected via other sensor(s) of electronic device 260 (e.g., one or more location sensors 204A, one or more image sensors 206A, one or more touch-sensitive surface 209A, one or more motion and / or orientation sensors 210A, and / or one or more microphones 213A or other audio sensors) as input and data processed by processor 218B of electronic device 201.Additionally or alternatively, electronic device 201 optionally does not include other components shown in FIG. 2B , such as location sensor 204B, image sensor 206B, and / or touch-sensitive surface 209B. In some such examples, display generating component(s) 214A may be utilized by electronic device 260 to provide an augmented reality environment, and electronic device 260 may utilize as input inputs and other data collected via one or more motion and / or orientation sensors 210A (and / or one or more microphones 213A) of electronic device 201.

[0037] In some examples, hand tracking sensor(s) 202 (and / or other body tracking sensor(s), such as leg, torso, and / or head tracking sensor(s)) can use image sensor(s) 206 (e.g., one or more IR cameras, 3D cameras, depth cameras, etc.) to capture three-dimensional information from the real world, including one or more body parts (e.g., a human user's hand, leg, or torso). In some examples, the hand can be resolved with sufficient resolution to distinguish fingers and their respective positions. In some examples, one or more image sensor(s) 206A are positioned relative to the user to define the field of view of the image sensor(s) 206A and an interaction space in which the position, orientation, and / or movement of the fingers / hand captured by the image sensor(s) are used as input (e.g., to distinguish from the user's stationary hand or other hands of other people in the real-world environment). Tracking fingers / hands for input (e.g., gestures, touches, taps, etc.) can be advantageous in that it does not require the user to touch, hold, or wear any kind of beacon, sensor, or other marker.

[0038] In some examples, the eye tracking sensor(s) 212 include at least one eye tracking camera (e.g., infrared (IR) camera) and / or illumination source (e.g., IR light source, LED, etc.) that emits light toward the user's eyes. The eye tracking camera may be aimed at the user's eyes to receive reflected IR light from the light source directly or indirectly from the eyes. In some examples, both eyes are tracked separately by respective eye tracking cameras and illumination sources, and focus / gaze can be determined from tracking of both eyes. In some examples, one eye (e.g., dominant eye) is tracked by one or more respective eye tracking cameras / illumination sources.

[0039] 2A-2B and may include fewer, other, or additional components in multiple configurations. In some examples, electronic device 201 and / or electronic device 260 may each be implemented among multiple electronic devices (e.g., as a system). In some such examples, each of the (or multiple) electronic devices may each include one or more of the same components described above, such as various sensors, one or more display generating components, one or more speakers, one or more processors, one or more memories, and / or communications circuitry. A person using electronic device 201 and / or electronic device 260 is optionally referred to herein as a user of the device.

[0040] The user then directs their attention to an electronic device (e.g., corresponding to electronic device 201 and / or electronic device 101) that includes one or more tint-adjustable displays. In some examples, the electronic device applies a first tint color to the display while presenting content in a first manner. In some examples, the user may desire to use and / or interact with a second electronic device communicatively connected to the electronic device. The second and / or other electronic devices may send an indication to the electronic device indicating that the user is no longer viewing the content or that the user of the electronic device intends to direct their attention to something other than the content. As a result, the electronic device presents the content in a second manner and applies a second tint color to the display that is different from the first tint color to allow the user to better view the second electronic device. The electronic device can use one or more criteria described below to determine when to present content in a second manner and when to change the tint color from a first tint color to a second tint color, as described with reference to FIGS. 3A-3O.

[0041] In some examples, the electronic device may determine or receive an indication from one or more different electronic devices that the user is interacting or intends to interact with people and / or objects in a physical environment that differs from the content presented on the electronic device. For example, the one or more electronic devices may include a microphone, a mobile phone, and / or a smartwatch. In some examples, the electronic device may use one or more sensors (e.g., inertial measurement unit (IMU) sensors) in communication with the electronic device to determine whether the user is interacting or intends to interact with the physical environment.

[0042] The techniques described herein provide an improved user experience. For example, the methods and systems described herein provide a seamless transition between virtual content experiences and interaction with a physical environment without limited or explicit user input. For example, the electronic device automatically presents content in a different manner based on whether one or more criteria are met. Additionally, the electronic device automatically transitions a display(s) from a first color level to a second color level based on whether one or more criteria are met.

[0043] 3A-3O illustrate examples of electronic devices that present content differently and change the tint level of a display when one or more criteria are met, according to some examples of the present disclosure. Figures 3A-3O are used to illustrate the methods described below, including process 400 of FIG. 4.

[0044] 3A-3C illustrate an example of an electronic device that alters content presentation and display tint levels based on an indication from a second electronic device and / or an indication from a sensor in the electronic device. FIG. 3A illustrates an electronic device 101 presenting a three-dimensional environment 300 via a display 120a from the perspective of a user of the electronic device 101 (e.g., facing a desk 304 in a room in which the electronic device 101 is located, as shown in FIG. 3B). In some examples, the three-dimensional environment 300 is a see-through representation of the physical environment. For example, the display on the electronic device 101 is transparent, allowing the user to view the physical environment through the display. In some examples, the electronic device 160 causes the electronic device 101 to present the three-dimensional environment 300. In some examples, the user's viewpoint determines which content (e.g., physical objects and / or virtual objects) is visible in a viewport (e.g., a view of the three-dimensional environment 300 visible to the user through one or more displays 120a, a display or pair of display modules that provide stereoscopic content to different eyes of the same user, or through an optical see-through device). In some examples, the (virtual) viewport has a viewport boundary that defines the extent of the three-dimensional environment 300 visible to the user through the display 120a of FIGS. 3A-3O. In some examples, the area defined by the viewport boundary is smaller than the user's field of view in one or more dimensions (e.g., based on the user's field of view, the size, optical properties or other physical characteristics of the one or more displays, and / or the location and / or orientation of the one or more displays relative to the user's eyes). In some examples, the area defined by the viewport boundary is larger than the user's field of view in one or more dimensions (e.g., based on the user's field of view, the size, optical properties or other physical characteristics of the one or more displays, and / or the location and / or orientation of the one or more displays relative to the user's eyes).The viewport and viewport boundaries typically move as one or more displays move (e.g., with the user's head in the case of a head-mounted device, or with the user's hands in the case of a handheld device such as a tablet or smartphone). The user's viewpoint determines what content is visible in the viewport. The user's viewpoint determines what content is visible within the viewport; the viewpoint generally specifies a location and orientation relative to the three-dimensional environment; as the viewpoint shifts, the view of the three-dimensional environment also shifts within the viewport. In the case of a head-mounted device, the viewpoint is typically based on the location and orientation of the user's head, face, and / or eyes to provide a view of the three-dimensional environment that is perceptually accurate and provides an immersive experience when the user is using the head-mounted device. In the case of a handheld or stationary device, the viewpoint shifts as the handheld or stationary device is moved and / or as the user's position relative to the handheld or stationary device changes (e.g., as the user moves toward, away from, above, below, to the right, and / or to the left of the device). In devices that include displays with video pass-through, the portion of the physical environment that is visible (e.g., displayed and / or projected) through one or more displays is based on the field of view of one or more cameras that communicate with the display, which typically moves with the display (e.g., moves with the user's head in a head-mounted device, or moves with the user's hands in a handheld device such as a tablet or smartphone), as the user's viewpoint moves as the field of view of one or more cameras moves (and the appearance of one or more virtual objects displayed through the one or more displays is updated based on the user's viewpoint (e.g., the displayed position and pose of the virtual objects are updated based on the movement of the user's viewpoint)).For displays with optical see-through, the portions of the physical environment that are visible through one or more displays (e.g., optically visible through one or more partially or fully transparent portions of the display generating components) are based on the user's view through the partially or fully transparent portions of the displays (e.g., move with the user's head in the case of a head-mounted device, or move with the user's hand in the case of a handheld device such as a tablet or smartphone), as the user's viewpoint moves (and the appearance of one or more virtual objects is updated based on the user's viewpoint) as the user's view through the partially or fully transparent portion(s) of the display generating components moves.

[0045] 3A, electronic device 101 includes display 120a and multiple sensors as described above, and is controlled by electronic device 101 and / or electronic device 160 to display one or more user interfaces while the user interacts with electronic device 101, electronic device 160, and / or the physical world, presenting a true or actual optical see-through in which portions of the physical environment are visible to the user through transparent portions of the display, such as one or more of the user's hands, such as hand 103, as shown in FIG. 1 and described below. Figures herein show optical see-throughs presented to the user by electronic device 101 (e.g., displayed by display 101 of electronic device 120a). In some examples, electronic device 101 may be similar to electronic device 101 of FIG. 1 or electronic device 201 of FIG. 2 and / or may be a head-mountable system / device and / or a projection-based system / device (including a hologram-based system / device) configured to generate and present a three-dimensional environment, such as, for example, a head-up display (HUD), a head-mounted display (HMD), a window with integrated viewing capabilities, a display formed as a lens designed to be placed on a person's eye (e.g., similar to a contact lens), etc. In some examples, electronic device 160 (e.g., shown in FIG. 3B and described below) may be similar to electronic device 160 of FIG. 1 or electronic device 260 of FIG. 2.

[0046] 3A , the electronic device 160 causes the electronic device 101 to display a user interface 302 of a movie player application in a three-dimensional environment 300 (showing the physical environment through an optical see-through) in a first manner (e.g., a full-screen immersive user interface) with a first color tint level 308. In some examples, the electronic device 101 displays the user interface 302 while tinting portions of the display 120a of the electronic device 101 that correspond to the physical environment 306 (e.g., behind and around the user interface 302) that is visible through the display 120a of the electronic device 101 with the first color tint level 308. For example, as shown in FIG. 3A , the physical environment includes a desk 304. While the electronic device 101 is displaying the user interface 302, a representation of the desk 304 is not presented and / or otherwise visible in the three-dimensional environment 300 from the user's perspective. In some examples, while the electronic device 101 is displaying the user interface 302, the display 120a of the electronic device 101 appears at the first tint level 308 while the user is wearing the electronic device 101. For example, the display 120a of the electronic device 101 may be tinted at the first tint level 308 so that others viewing the electronic device 101 can see the first tint level 308. In some examples, the first tint level 308 is applied to the display 101 of the electronic device 120a. In some examples, while the electronic device 101 is displaying the user interface 302 having the first tint level 308, others viewing the electronic device 101 can see the first tint level 308 applied to the display 120a, and vice versa.

[0047] It should be appreciated that in some examples, electronic device 101 may simultaneously present three-dimensional environment 300 having first tint level 308 while displaying a different user interface than user interface 302, or multiple user interfaces (e.g., including or different from user interface 302) associated with multiple different applications. For example, as shown in FIG. 3A , electronic device 101 may display user interface 302 playing a movie, such as from a movie application, while tinting portions of display 120a corresponding to other portions of three-dimensional environment 300 (e.g., behind and around user interface 302). In some examples, electronic device 101 may display the same tint characteristics as shown in FIG. 3A while a user alternately views and / or interacts with other user interfaces, such as, but not limited to, content user interfaces (e.g., web browsing user interfaces, video chat user interfaces, video player user interfaces, music user interfaces, gaming user interfaces, and / or social media user interfaces). In some examples, a user of the electronic device 101 can determine (e.g., manually or by verbal command) which applications and / or user interfaces to display in a first manner while the three-dimensional environment 300 is presented at the first tint level 308.

[0048] In some examples, presenting content (e.g., user interface 302) in a first manner includes presenting the content at a first size, a first brightness, a first opacity, a first location, and / or a first anchoring manner. For example, as shown in FIG. 3A , user interface 302 is presented at a first size that occupies a majority of the field of view of three-dimensional environment 300 (e.g., a majority of display 120a), at a first brightness that contrasts with a color-adjusted background provided via first color level 308, at a first opacity that limits the user's ability to see representations of the physical environment behind and / or through user interface 302, at a first location that is centered in the field of view of three-dimensional environment 300, and in a first anchoring manner. In some examples, the anchoring manner refers to whether the user interface is displayed in a head-locked orientation, a world-locked orientation, or a tilt-locked orientation, as described above. 3A, user interface 302 is displayed in a first anchoring manner, while user interface 302 is displayed in a head-locked orientation. In some examples, a user of electronic device 101 may change one or more of the characteristics of the display of content described above (e.g., how the user interface is displayed).

[0049] In some examples, while displaying content (e.g., user interface 302) in the three-dimensional environment 300 in a first manner, electronic device 101 or electronic device 160 determines that one or more criteria are met. As a result, electronic device 101 displays the content in a second manner, as shown in FIG. 3B . Automatically displaying the content in the second manner after determining that one or more criteria are met allows electronic device 101 to display / allow the user to see more of the user's physical environment 306 without additional input, thereby reducing erroneous input to the electronic device. Displaying the content in the second manner optionally includes one or more of: displaying user interface 302 at a second size different from the first size, at a second brightness different from the first brightness, at a second opacity different from the first opacity, at a second location different from the first location, and / or according to a second anchoring scheme different from the first anchoring scheme. For example, as shown in FIG. 3B , user interface 302 is displayed in three-dimensional environment 300 that is smaller than user interface 302 in FIG. 3A . Alternatively, in some examples, the user interface is minimized and no longer displayed and / or invisible in three-dimensional environment 300 from the user's perspective (e.g., the content is hidden and optionally represented by user interface elements while video playback continues as audio only). In some examples, the second size of user interface 302 depends on the type of user interface being displayed. For example, as shown in FIG. 3B , the user interface of a movie player application is displayed at a reduced size in three-dimensional environment 300. Alternatively, the user interface of a web browser application may be minimized, not shown at all, and / or may not currently be visible from the user's perspective while the user interface is displayed in the second manner. In some examples, minimizing the content on electronic device 101 includes ceasing display of user interface 302 on electronic device 160 and displaying user interface 302 on electronic device 101.For example, the video user interface may be minimized on electronic device 101 and may continue playing automatically on electronic device 160. Alternatively, users of electronic devices 101 and 160 may determine which user interfaces are minimized and / or which are displayed at a smaller size (e.g., user preferences or settings). Additionally, as shown in FIG. 3B , user interface 302 is less bright and less opaque than user interface 302 of FIG. 3A , allowing representations of physical environment 306 (e.g., electronic device 160, desk 304, and / or table 312) to be easily viewed and / or otherwise focused on, while optionally drawing attention away from user interface 302. In some examples, displaying content in a second manner (e.g., at a second size smaller than the first size) involves applying a second tint level to display 120 a of electronic device 101. As shown in FIG. 3B , the second color tint level 316 is applied to the display 120a, making the representation of the physical environment 306 clearly visible in the three-dimensional environment 300 and allowing the user to view the electronic device 160 through the display 120a. In other words, because the user interface 302 is displayed at a smaller size (e.g., in a second manner) and because the second color tint level 316 corresponds to a transparent state of the display 120a, the user can view the physical environment through the display 120a (via optical see-through). As shown in FIG. 3B , because the display 120a of the electronic device 101 is shown at the second color tint level 316, the second color tint level 316 can be seen by others. The electronic device 101 applies the second color tint level 316 to the display 120a to indicate (e.g., to others) that content is being displayed on the electronic device 101 in a second manner. As shown in Figure 3B, the second tint level 316 is more transparent (e.g., less opaque) than the first tint level 308 of Figure 3A. Additionally, in some examples, displaying the content in the second manner includes displaying the content using a world-locked orientation instead of a head-locked orientation.In some examples, a user can change one or more characteristics of the second scheme (e.g., manually via user input). Alternatively, in some examples, a user of electronic device 101 can manually change the tint level separately from the content display functions described herein.

[0050] In some examples, electronic device 101 changes tint levels by adjusting the opacity of a dedicated layer of display 120a. For example, display 120a optionally includes multiple layers, including one or more controllable tint layers, where each controllable tint layer may be configured to filter an adjustable amount of light (e.g., light having a particular wavelength or range of wavelengths). In some examples, one of the controllable tint layers may include a frosted glass layer that can be controlled to scatter an adjustable amount of incident light corresponding to first tint level 308, second tint level 316, and / or other tint levels described herein. Alternatively, in some examples, display 120a does not have a separate controllable tint layer. For example, a tint control may be integrated into display 120a (e.g., integrated into another layer of display 120a).

[0051] 3B illustrates an example in which one or more first criteria and one or more second criteria are satisfied for electronic device 101 to display content in a second manner and / or in a second color shade. In some examples, satisfaction of the one or more first criteria is evaluated based on input detected by electronic device 160, and satisfaction of the one or more second criteria is evaluated based on input detected by electronic device 101. For example, the one or more first criteria include a criterion that is satisfied when electronic device 160 detects an input (e.g., a touch input on a touchscreen, a button input, etc.) and / or a criterion that is satisfied when electronic device 160 detects movement, optionally a characteristic movement (e.g., lifting electronic device 160). The one or more second criteria optionally include a criterion that is satisfied when electronic device 101 detects movement greater than a threshold movement (e.g., an indication of a head tilt downward).

[0052] 3B, the user picks up electronic device 160 (e.g., detected by a motion sensor having one or more characteristics of a motion sensor as described above with reference to FIGS. 2A-2B) and / or unlocks electronic device 160 (e.g., including powering on the display of electronic device 160) to view message user interface 314. In some examples, the user unlocks electronic device 160 by providing user input detected via one or more input devices (e.g., image sensor, depth sensor, etc.) of electronic device 160. In some examples, electronic device 160 uses biometric data, such as the user's fingerprint or face map, to verify the user's identity in order to unlock electronic device 160. In response to detecting a characteristic movement of electronic device 160 and / or electronic device 101 (e.g., horizontal and / or vertical movement of electronic device 160 toward electronic device 101 corresponding to lowering the head a threshold amount toward the handheld device and / or moving the handheld device a threshold amount toward the head location) and / or an input to unlock electronic device 160, in some examples, electronic device 160 transmits an indication to electronic device 160 that one or more first criteria have been met for electronic device 101. In some examples, the horizontal movement corresponds to movement of electronic device 160 from a first yaw position to a second yaw position. In some examples, the vertical movement corresponds to movement of electronic device 160 from a first pitch to a second pitch.

[0053] 3B , while picking up and viewing the message user interface 314 on the electronic device 101, the user also tilts their head down to view the electronic device 160 (which is detected by the electronic device 160). In some examples, the movement of the user's head as the user looks down at the electronic device 160 is greater than a threshold movement required by the electronic device 101 to transition the color tone level and the way content is displayed. In some examples, the movement is relative to gravity and / or the horizon (e.g., the horizon of the three-dimensional environment 300, which optionally corresponds to a horizon line or plane passing through the field of view (e.g., the center of the field of view) of the three-dimensional environment 300). In some examples, the movement is relative to a forward direction for viewing content, which is independent of gravity or the horizon of the physical environment.

[0054] In some examples, the threshold movement required by electronic device 101 depends on the user interface displayed on electronic device 101 (and / or with which the user is engaged). For example, as shown in FIG. 3A , while watching a movie using user interface 302, which is typically associated with relatively little head movement, the threshold movement required to satisfy one or more second criteria is lower than when the user is using a user interface with relatively more head movement (e.g., a gaming user interface). In some examples, the required threshold movement is a movement toward electronic device 160 (e.g., a downward vertical rotational movement (pitch) toward electronic device 101 as shown in FIGS. 3A and 3B ) that can be 5 degrees, 10 degrees, 20 degrees, 30 degrees, 45 degrees, etc. from a first position (shown in FIG. 3A ), depending on the user interface displayed on electronic device 160. In some examples, using different reference movements based on the user interface allows the electronic device to automatically transition content from being displayed in a first manner to being displayed in a second manner while reducing erroneous transitions based on movement.

[0055] In response to detecting that one or more first criteria and one or more second criteria have been met (e.g., at electronic device 160, at electronic device 101, or at a combination of both devices), electronic device 101 stops displaying the content in the first manner and begins displaying the content in the second manner, as described above. For example, user interface 302 is automatically displayed at a smaller size while electronic device 101 displays the content in the second manner. Displaying user interface 302 at a smaller size allows a representation of physical environment 306 to be visible. In some examples, a movie continues to play within user interface 302 while at a smaller size. In some examples, displaying content in the second manner allows a user to view electronic device 160 without obstruction. For example, a user may wish to read a notification, such as a text message, email, social media notification, or other notification, or to focus on electronic device 160. Although FIGS. 3A-3C focus primarily on the first and second criteria, the operations described herein may be based on a subset of the first and / or second criteria.

[0056] In some examples, the user may want to resume viewing the user interface 302 after interacting with the electronic device 160. As shown in Figure 3C, the user may move the electronic device 160 out of the field of view (e.g., place the electronic device 160 back on the desk 304) and / or move their head back to the position shown in Figure 3A (e.g., raise their head to the first position), which results in a movement of the electronic device 101. As shown in Figure 3C, during this movement, the user moves the electronic device 160 from the second position (e.g., shown in Figure 3B) to a third position that is between the first and second positions. After the electronic device 160 detects (e.g., using one or more input devices, such as an IMU sensor and / or an accelerometer) that the electronic device 101 is being moved toward the first position, the electronic device 160 may transition the display 120a (or displays) of the electronic device 101 from the second color tone level 316 to the first color tone level 308 (and the three-dimensional environment 300 from the second color tone level 316 to the first color tone level 308). For example, the electronic device 101 displays content within the three-dimensional environment 300 in a third manner that includes a third color tone level 320 while the user returns their head to the first position and lowers the electronic device 160 to its original position (shown in FIG. 3A ). The third color tone level 320 corresponds to a third physical color tone level 320 applied to the display(s) of the electronic device 101, as shown in FIG. 3C . In some examples, the third tint level 320 is less transparent than the second tint level 316 but more transparent than the first tint level 308. Displaying the content in the third modality while transitioning from the second modality to the first modality allows the electronic device to provide feedback to the user, indicating to the user that the content is transitioning from the second modality to the first modality.

[0057] In some examples, while transitioning from the second scheme to the first scheme, the content in the three-dimensional environment 300 transitions from the second size to the first size, from the second brightness to the first brightness, from the second opacity to the first opacity, from the second location to the first location, and / or from the second anchoring scheme to the first anchoring scheme. In some examples, transitioning from the second scheme to the first scheme includes displaying the content in a third scheme, a scheme that allows for a gradual transition from the second scheme to the first scheme. For example, as shown in FIG. 3C , transitioning the display of the user interface 302 from the second size to the first size includes displaying the user interface 302 in the three-dimensional environment 300 at a third size that is larger than the second size but smaller than the first size. In some examples, while displaying content in the third manner, electronic device 160 detects that the user is moving electronic device 160 toward electronic device 160's second position (e.g., to resume viewing electronic device 160) and that electronic device 101 has moved to electronic device 101's second position (as shown in FIG. 3B ). As a result, electronic device 160 causes electronic device 101 to gradually transition the display of content from the third manner to the second manner (e.g., instead of the first manner). Additionally or alternatively, in some examples, causing electronic device 101 to display content in the second manner may also include a gradual transition from the first manner to the second manner, similar to the description of the gradual transition from the second manner to the first manner above. In some examples, when one or more first criteria and / or one or more second criteria are no longer met, electronic device 101 returns to the view shown in FIG. 3A . For example, when electronic device 101 is returned to the first position and / or electronic device 160 is returned to its first position, electronic device 101 resumes displaying content in the first format and first color shade.Additionally or alternatively, in some examples, electronic device 101 resumes displaying content in the first manner with the first tint when electronic device 160 is out of the field of view of electronic device 101 and / or when electronic device 101 and / or electronic device 160 are raised by a second threshold amount that is less than the aforementioned threshold amount.

[0058] 3D illustrates an alternative example in which one or more criteria are met to cause the electronic device 101 to display content in a second manner. In some examples, the electronic device 160 causes the electronic device 101 to display content in the second manner when movement from a first position to a second position is detected by the electronic device 101 (e.g., as opposed to movement being detected by both the electronic device 101 and the electronic device 160). As described above, the first position is the position the electronic device 101 was in while it displayed the content in the first manner (e.g., FIG. 3A ), and the second position is the position of the electronic device 101 while it displayed the content in the second manner (e.g., FIG. 3B ). In some examples, the electronic device 101 detects movement greater than a threshold movement using one or more sensors, such as an IMU sensor, as illustrated in FIG. 3B .

[0059] As shown in FIG. 3D , the electronic device 101 detects vertical movement greater than the threshold movement, which causes the electronic device 101 to display content in a second manner. In some examples, the electronic device 101 may detect horizontal / angular movement greater than the threshold movement to cause the electronic device 101 to display content in the second manner. Horizontal / angular movement is described in more detail in FIGS. 3E-3F . In some examples, the one or more criteria also include a criterion that is met when the display of the electronic device 160 is on, such as when the electronic device 160 receives an alert (e.g., a notification). As shown in FIG. 3D , the display of the electronic device 160 is on and displays the lock screen user interface 324. In some examples, the display turns on as a result of the electronic device 160 receiving an indication of a notification event and displaying a visual indication 326 of the notification. In some examples, the electronic device 101 detects movement greater than a threshold movement in response to the electronic device 160 displaying a visual indication 326 (e.g., as a result of the user moving their head downward toward the electronic device 160).

[0060] 3E-3F illustrate an example in which electronic device 160 causes electronic device 160 to display content in a second manner in response to electronic device 160 detecting sound and corresponding movement of electronic device 101. In some examples, electronic device 160, electronic device 101, and / or a different electronic device (e.g., an external microphone communicatively connected to electronic device 160 and / or electronic device 101) detects sound 336 and the direction of sound 336 (e.g., behind the user of electronic device 101 as shown in the figures). Additionally, in some examples, electronic device 101, electronic device 160, and / or a communicatively connected electronic device detects a rotation (e.g., horizontal / angular rotation) of electronic device 101 toward sound 336. As described above, as a result of detecting sound 336 and a rotation greater than a threshold movement / rotation toward sound 336, electronic device 160 causes electronic device 101 to display content in the second manner. 3F , the user of the electronic device 101 rotates the electronic device 101 to a second position toward the direction of the sound 336. As a result, the electronic device 101 presents content within the three-dimensional environment 300 in a second manner that includes changing the tint of the electronic device 101 from the first tint level 308 to the second tint level 316. Changing the tint level allows the person emitting (e.g., speaking) the sound 336 to determine that the user of the electronic device 101 is looking at them (e.g., changing the tint allows the person to see the eyes of the user of the electronic device 101) and allows the user of the electronic device 101 to see the person emitting the sound 336.

[0061] In some examples, the one or more first criteria for causing the electronic device 101 to display content in the second manner may be based solely on movement of the electronic device 160 (rather than also based on movement and / or input of the electronic device 101). In some examples, such as the examples described in FIGS. 3E-3F , the electronic device 101 moves (rotationally and horizontally) toward a sound detected by a microphone. During this interaction, the electronic device 160 optionally does not move or moves (horizontally and rotationally) less than a threshold distance relative to the first position of the electronic device 160. In some examples, the first position is the position of the electronic device 101 while the electronic device 160 is displaying content in the first manner. For example, the electronic device 160 may be in a user's pocket and may move a negligible amount during the human interaction shown in FIGS. 3E-3F . In some examples, the one or more first criteria for causing the electronic device 101 to display content in the second manner may include any combination of criteria described herein.

[0062] Alternatively, in some examples, if both electronic device 101 and electronic device 160 are moving in the same direction (e.g., at the same speed and / or acceleration), electronic device 101 optionally does not display content in the second manner. For example, a user may be turning in their chair, causing both electronic device 101 and electronic device 160 to move (e.g., at the same speed and in the same direction). In some such examples, electronic device 101 does not begin displaying content in the second manner.

[0063] 3G-3H illustrate alternative examples of content presented in a second manner. In some examples, rather than entirely altering the characteristics of the three-dimensional environment 300 as described in the previous figures, the electronic device 101 can selectively display portions of the content in the three-dimensional environment 300 in the second manner and selectively tint one or more display portions with a second tint color. For example, in FIG. 3G , in response to determining that one or more criteria for presenting content in the second manner are met (e.g., detecting that the display of the electronic device 160 is on, detecting that the electronic device 160 has received an alert (e.g., a notification), and / or detecting that movement of the electronic device 160 is greater than a threshold distance described herein), the electronic device 160 causes the electronic device 101 to apply a bubble effect 330 to the three-dimensional environment 300. In some examples, applying the bubble effect 330 includes displaying a (e.g., predetermined) portion of the three-dimensional environment 300, including the user interface 302, in a second tint level 316 that is more transparent than the first tint level 308. In some examples, the bubble effect 330 includes a boundary between one or more areas of the display having the second color level 316 and one or more areas of the display having the first color level 308. Although FIGS. 3G-3H show the bubble effect 330 with a curved boundary (e.g., a sphere, a conical section, etc.) between the first color level 308 and the second color level 316, the bubble effect 330 may be displayed with other boundaries (e.g., a rectangle, a plane, or other shape that divides one or more areas of the display having the first color level 308 and one or more areas of the display having the second color level 316). In some examples, the bubble effect 330 may increase in size (e.g., volume) when the electronic device 160 detects movement of the electronic device 160 toward the user (e.g., toward the electronic device 101), as shown in FIG. 3H. For example, the size of the bubble effect 330 increases as the height (relative to the ground) of the electronic device 160 increases.In some examples, the bubble effect 330 may increase in size as the user tilts their head (and electronic device 101) toward the electronic device 160 (e.g., the electronic device 160 occupies more real estate in the user's field of view). For example, as shown in FIG. 3H , a smaller portion of the user interface 302 remains displayed in the three-dimensional environment 300, while a larger portion of the physical environment 306 becomes visible from the user's perspective of the electronic device 101. Thus, in some examples, applying the bubble effect 330 may, as one advantage, allow the user to gather information indicative of the context of the physical environment 306 (e.g., view and / or interact with one or more physical objects in the physical environment 306, such as the electronic device 160) without ceasing and / or minimizing the display of the user interface 302. In some examples, the display(s) of the electronic device 101 may also include both the first tint level 308 and the second tint level 316. For example, as shown in FIG. 3H, the area of ​​the display(s) of electronic device 101 represented by bubble effect 330 includes second tint level 316.

[0064] In some examples, electronic device 160 includes an image sensor such as that described in FIGS. 2A-2B. In some examples, the image sensor is an infrared sensor, a camera, or other optical sensor. In some examples, electronic device 160 can use the image sensor to determine the location of display 120a (e.g., one or more displays of electronic device 101) relative to the location of electronic device 160. In other words, electronic device 160 can use the image sensor to determine the relationship between the position of electronic device 101 and the position of electronic device 160. For example, electronic device 160 determines the location of electronic device 160 relative to electronic device 101 using the location of electronic device 101 relative to electronic device 160. In some examples, after determining the relationship between the position of electronic device 101 and electronic device 160, electronic device 160 (or electronic device 101) applies the second tint level 308 to the portion of display 120 corresponding to the location of electronic device 160. For example, in FIGS. 3G and 3H, electronic device 160 causes electronic device 101 to apply a bubble effect 330 to an area of ​​three-dimensional environment 300 that includes electronic device 160.

[0065] While FIGS. 3G-3H show a bubble effect 330, in some examples, the bubble effect 330 may be replaced by a tint gradient, as shown in FIGS. 3H-A. In some examples, the bubble effect 330 includes two tint levels with a boundary between them, while the tint gradient shown in FIGS. 3H-A includes three or more tint levels. For example, the tint gradient effect includes a boundary between a first tint level and a second tint level and includes an intermediate tint level that gradually transitions the tint level from the first tint level to the second tint level. In some examples, the tint gradient includes a gradient of tint levels (e.g., including the third tint level described above) that gradually transitions from the first tint level to the second tint level. For example, in FIG. 3G, the electronic device 160 optionally uses an image sensor to determine the location of the electronic device 101 relative to the electronic device 160 and generate a display of the tint gradient. 3H-A, the second tint level is applied to the location of the electronic device 160 at the bottom of the display 120a, the first tint level is applied to the top of the display 120a, and the electronic device 101 gradually transitions between the first and second tint levels. In some examples, the electronic device 160 causes the display 120a to dynamically adjust the tint gradient based on the location of the electronic device 160. For example, if the location of the electronic device 160 moves upward toward the top of the electronic device 101, the electronic device 160 moves the gradient so that more of the display 120a includes the second tint level. Specifically, the boundary between the first and second tint levels and the gradient therebetween move so that the location of the electronic device 160 toward the bottom of the display 120a includes the second tint level.

[0066] In some examples, electronic device 101 and / or electronic device 160 may not have a high degree of confidence regarding the position of electronic device 160 relative to display 120a of electronic device 101. In such examples, electronic device 160 may have a defined gradient level for electronic device 160 based on the estimated location of electronic device 101. In some examples, the defined gradient level includes a second tint level of 25%, 50%, 75%, or 100% from bottom to top based on the estimated location of electronic device 160.

[0067] In some examples, one or more third criteria must be met for electronic device 101 to cause electronic device 160 to resume displaying content in the first manner described above. In some examples, after the one or more third criteria are met, electronic device 160 causes electronic device 101 to display content in the first manner, including applying a first tint level 308 to one or more displays also shown in three-dimensional environment 300, as shown in FIG. 3I. In some examples, the one or more third criteria may be met when the criteria for displaying content in the second manner are no longer met. In some examples, the one or more third criteria may include a criterion that is met when the display of electronic device 160 is turned off (e.g., by a user or after a threshold amount of time has elapsed without electronic device 160 receiving input). For example, as shown in FIG. 3I, the display of electronic device 160 is no longer active and electronic device 101 is in the first position. In some examples, the one or more third criteria are met when electronic device 101 and electronic device 160 are in their respective first positions. For example, electronic device 101 and / or electronic device 160 detect movement of electronic device 101 and / or electronic device 160 consistent with returning the respective electronic devices to their first positions. In some examples, the one or more third criteria are met when electronic device 160, electronic device 101, and / or a different electronic device (e.g., an external microphone) no longer detects sound. In some examples, resuming displaying content in the first manner includes causing electronic device 101 to apply a first tint level 308 to the display(s), as shown in FIG. 3I.

[0068] 3J-3M illustrate additional examples in which electronic device 101 and / or electronic device 160 apply a second tint level to display 120a of electronic device 101 in response to detecting that one or more second criteria are met. As described above, the one or more second criteria are met when electronic device 101 detects a movement greater than a threshold movement. In some embodiments, automatically changing the tint level in response to detecting a particular movement (e.g., sitting to standing, standing to walking, or other movement) can allow a user to better understand their physical environment without additional input to electronic device 101 and / or electronic device 160 (e.g., without having to close, move, or resize virtual content).

[0069] 3J, the electronic device 101 detects that the user is seated (e.g., seated in chair 350). In FIG. 3J, the electronic device 101 displays (or causes the electronic device 160 to display) the user interface 302 in a first manner using a first tint level 308, as described in more detail in FIG. 3A. In some examples, the electronic device 101 continues to display the user interface 302 in the first manner at the first tint level while the electronic device 101 and / or the electronic device 160 detects that the user remains seated (e.g., does not detect movement that meets one or more second criteria).

[0070] 3K-3M illustrate examples in which the electronic device 101 and / or the electronic device 160 detects movements that satisfy one or more second criteria. In some examples, the one or more second criteria are met when the electronic device 101 and / or the electronic device 160 detects movements that indicate a transition between the user being seated and the user being standing (e.g., detecting a threshold increase in height from the ground) and / or movements that indicate the user is walking (e.g., detecting a linear velocity greater than a threshold). In some examples, the one or more second criteria are met when the electronic device 101 and / or the electronic device 160 detects movements that exceed a threshold movement (e.g., a sudden movement that indicates the user falling). For example, the detected acceleration is greater than a threshold acceleration.

[0071] 3K , in response to electronic device 101 and / or electronic device 160 detecting movement indicating the user is standing, electronic device 101 stops displaying user interface 302 (e.g., a video application) and display 120a changes from a first tint level to a second tint level. In some examples, electronic device 101 and / or 160 detects a transition from a state in which situational awareness of physical environment 306 is less important to a state in which situational awareness of physical environment 306 is present, so display 120a changes from the first tint level to the second tint level and electronic device 101 stops displaying user interface 302. For example, while in a seated state, a user of electronic device 101 and / or 160 is not at risk of colliding with the physical environment if there is no movement in the physical environment. In contrast, user movement indicating a transition to standing increases the likelihood of movement or an increased risk of collision unless the user can see their physical environment 306. 3K, electronic device 101 and / or electronic device 160 detects that the user is standing up (e.g., to begin moving to a different location, to direct their attention to a different object other than display 120a, etc.). In some examples, electronic device 101 and / or electronic device 160 use one or more location, orientation, and / or movement sensors, such as an accelerometer and / or an inertial measurement unit (IMU), to detect that electronic device 101 is moving against the gravity vector and has a positive acceleration and / or velocity that exceeds a threshold amount of acceleration or velocity, indicating that the user is transitioning from a seated position to a standing position.

[0072] 3L, electronic device 101 and / or electronic device 160 detect that the user is walking. In some examples, electronic device 101 and / or electronic device 160 can use a global positioning sensor, an IMU, and / or other sensors to determine that the user is walking (moving). For example, electronic device 101 and / or electronic device 160 can detect that the location of the individual devices is moving and / or detect acceleration, a change in velocity, a change in position, and / or other movements consistent with walking. For example, electronic device 101 and / or electronic device 160 detects a linear velocity above a threshold velocity (the threshold is modified by the implementer to distinguish between standing and walking).

[0073] In some examples, in response to detecting a standing position or a walking movement, the electronic device 101 may present a user interface 302 as shown in Figure 3B. Specifically, rather than minimizing the content as shown in Figures 3K and 3M, the electronic device 101 displays the content of the user interface 302 at a smaller size as shown in Figure 3B.

[0074] In some examples, the electronic device 101 may resume displaying the user interface 302 at the first tint level in response to detecting movement indicating the user is sitting (or movement indicating the user is walking and stationary). For example, the electronic device 101 and / or the electronic device 160 may detect movement having a gravity vector with positive acceleration and / or velocity indicating a transition from standing to sitting. In some examples, the electronic device 101 and / or the electronic device 160 may detect a downward position change indicating a transition from standing to sitting. In some examples, the electronic device 101 and / or the electronic device 160 may detect a linear velocity below a threshold velocity (the threshold may be modified by an implementer to distinguish between standing and walking) indicating a transition from walking to standing and stationary. In some examples, the electronic device 101 may resume displaying the user interface 302 at the first tint level (e.g., a user interface previously displayed while the user was sitting) in response to detecting that the user is no longer standing (e.g., the user is sitting) and / or moving (e.g., the user is stationary).

[0075] 3M , in response to detecting movement exceeding a threshold movement (e.g., indicative of a fall or other sudden movement), electronic device 101 ceases displaying user interface 302 and changes the tint level from a first tint level to a second tint level. For example, electronic device 101 and / or 160 includes an accelerometer, IMU, or other motion sensor that detects sudden changes in acceleration and / or acceleration exceeding a threshold acceleration. Alternatively or additionally, electronic device 101 and / or 160 can detect a sudden deceleration (or deceleration followed by acceleration). For example, electronic device 101 and / or 160 detects a fall suffered by the user. In response to detecting the sudden movement, electronic device 101 ceases displaying user interface 302 and changes the tint level from a first tint level 308 to a second tint level 316, thereby enabling the user to focus on the physical environment 306 to assess the situation, take action during and / or recover from the fall, and / or receive care.

[0076] 3N-3O show an example in which electronic device 101 and / or electronic device 160 change the manner in which content is presented based on meeting one or more fourth criteria. In FIGS. 3N and 3O, electronic device 101 and / or electronic device 160 are also in communication with a third electronic device 352. In some examples, electronic device 352 is an external display device and / or a computer, such as a desktop computer, television, or laptop. In some examples, electronic device 352 is a smartphone, tablet, and / or head-mounted display.

[0077] In FIG. 3N, display 120a displays user interface 354 of a web browser application. In FIG. 3N, electronic device 101 does not have electronic device 352 in its field of view (e.g., electronic device 352 is not displayed in three-dimensional environment 300). While electronic device 101 does not have electronic device 352 in its field of view, electronic device 101 (and / or electronic device 160) displays user interface 354 on display 120a. In some examples, if electronic device 101 and / or electronic device 160 detect an electronic device in its field of view that includes the capability to display the user interface currently displayed on display 120a, electronic device 101 stops presenting the user interface on display 120a, and the electronic device in its field of view begins presenting its individual user interface, as shown in FIG. 3O. In other words, in FIG. 3N, electronic device 101 displays user interface 354 in a first manner using a first tint level 316. In response to detecting that electronic device 352 is within the field of view of electronic device 101, electronic device 101 begins presenting content in a fourth manner, where electronic device 101 stops displaying the content on display 120a and begins presenting pass-through video of physical environment 306, and electronic device 352 begins displaying the content.

[0078] 3O shows electronic device 352 presenting pass-through video of physical environment 306, including a representation of electronic device 101 displaying user interface 354. In some examples, electronic device 101 presents the pass-through video (e.g., while including second tint level 308) in response to detecting that one or more criteria are met. For example, the one or more criteria optionally include a criterion that is met when electronic device 352, electronic device 101, and / or electronic device 352 detects that a user's attention is directed to electronic device 160. In some examples, the one or more criteria include a criterion that is met when electronic device 352 includes functionality to display a user interface. As described above, electronic device 101 and / or electronic device 160 detect that electronic device 352 includes functionality to display a user interface. For example, electronic device 352 includes an application corresponding to user interface 354 (e.g., the application is downloaded) and / or electronic device 352 communicates with electronic device 101 and / or electronic device 160. In some examples, electronic device 101, 160, and / or 352 detects that a user's attention is directed to electronic device 160 based on gaze data, image data (e.g., from an outward-facing camera capturing an image including electronic device 101), and / or head rotation data from one or more image and / or motion sensors (e.g., inward-facing cameras, outward-facing cameras, IMUs, and other sensors) on electronic device 352, 352, and / or 352. Additionally or alternatively, in some examples, electronic device 101, 160, and / or 352 detects input directed to electronic device 352, such as tap input (e.g., by a finger, stylus, keyboard, and / or cursor), gaze input, gesture input, and / or voice input. In some examples, electronic device 352 includes one or more accessories capable of receiving input from a user, such as a microphone, mouse, trackpad, and / or keyboard.

[0079] 3N and 3O show an example with electronic device 352, such as a desktop or laptop computer, similar interactions can be performed using any electronic device, such as electronic device 160. For example, electronic device 101 and / or electronic device 160 may detect that electronic device 160 is within field of view, and then electronic device 160 may begin presenting content that was previously presented on display 120a.

[0080] Alternatively or additionally, in some examples, the electronic device 160 causes the electronic device 352 to perform the tint operations described herein and illustrated in FIGS. 3N and 3O when the user interface 354 within the three-dimensional environment 300 is fixed relative to the electronic device 101. For example, the user interface 354 may be fixed to a location (e.g., top, left, right, bottom, etc.) within the three-dimensional environment of the electronic device 352 (e.g., to increase the information viewable by the user and maintain a connection between physical objects and virtual content in the environment). As shown in FIG. 3N, while viewing the user interface 354 in the three-dimensional environment 300, the electronic device 160 causes the electronic device 101 to include a first tint level 316. In response to detecting that the electronic device 101 includes the electronic device 352 within its field of view, the electronic device 160 causes the electronic device 352 to include a second tint level 308 so that the user can view the electronic device 101.

[0081] In some examples, while presenting pass-through video at second tint level 308 (as shown in FIGS. 3B, 3C, 3D, 3G, 3H, 3H-A, and 3O), electronic device 160 may send an indication to electronic device 352 to increase the brightness or change the color of a display associated with electronic device 352. In some examples, while presenting content through display 120a using second tint level 308, the electronic device in the pass-through video may appear dim or off-color compared to when a user views the respective electronic device without display 120a and / or electronic device 101. For example, display 120a and / or a tint applied to display 120a may cause the brightness of the external display or the color of the external display to appear different than when not viewed through display 120a (e.g., electronic device 101). Accordingly, electronic device 101 and / or electronic device 160 can send indications to individual electronic devices to increase the brightness or change the color of the display associated with the individual electronic device to offset the respective tint effect (e.g., to provide a better viewing experience for the user). For example, in FIG. 3O, electronic device 352 can increase the brightness and / or provide a color adjustment of the display. Additionally, in FIGS. 3B, 3C, 3D, 3G, and / or 3H, electronic device 160 can brighten and / or adjust the color of the display while electronic device 101 includes second tint level 308. In some examples, altering the brightness and / or color of the external display to account for viewing through electronic device 101 improves user interaction with the external display and electronic device 101 by offsetting the effects of the lens / display(s) (e.g., display 120a) of electronic device 101. In some examples, color adjustments include adding color (e.g., yellow, blue, green, or other colors) and / or modifying the RGB (red, green, blue) standard to more accurately represent colors in the real world.

[0082] FIG. 4 shows a flow diagram illustrating an example process for causing an electronic device to present content in a three-dimensional environment in a second manner instead of a first manner, according to some examples of the present disclosure. In some examples, process 400 is performed in an electronic device in communication with one or more displays and one or more input devices. In some examples, the electronic device is, optionally, a head-mounted display similar to or corresponding to electronic device 201 of FIG. 2A or a mobile electronic device similar to or corresponding to electronic device 260 of FIG. 2B. As shown in FIG. 4, in some examples, at 402, the electronic device causes one or more displays to present content in a first manner while a first tint color level is applied on the one or more displays. For example, an electronic device (e.g., electronic device 160 of FIG. 3A) causes one or more displays of electronic device 101 of FIG. 3A to present content, such as user interface 302, in a first manner (e.g., occupying the entire field of view of electronic device 101) and in a first tint color 308.

[0083] In some examples, at 404, while one or more displays are presenting content in a first manner and while the first tint level is applied on the one or more displays, the electronic device determines that one or more criteria are met. For example, the electronic device detects vertical (e.g., upward) movement of the electronic device 101 greater than a threshold movement toward the user of the electronic device 160, movement of the electronic device 101 toward the electronic device 160 greater than a threshold (rotational) movement, or both, as shown in FIG. 3B. Alternatively or additionally, in some examples, the electronic device detects sound and movement of the electronic device 101 toward the sound, as shown in FIG. 3F. In some examples, in response to determining that one or more criteria are met at 406, the electronic device causes the content to be presented in a second manner different from the first manner at 408. For example, as shown in FIG. 3D, the electronic device 101 presents the content in the second manner, such as presenting the user interface 302 at a smaller size than in FIG. 3A.

[0084] In some examples, the electronic device applies a second tint level to one or more displays, the second tint level being different from the first tint level, at 410. For example, as shown in FIG. 3B, the electronic device 160 applies a second tint level 316 to the electronic device 101, the second tint level 316 being more transparent than the first tint level 308.

[0085] It will be understood that process 400 is an example, and that more, fewer, or different operations may be performed in the same or a different order. Additionally, the operations of process 400 described above are optionally implemented by executing one or more functional modules of an information processing device, such as a general-purpose processor (e.g., as described with respect to FIGS. 2A-2B) or an application-specific chip, and / or by other components of FIGS. 2A-2B.

[0086]

[0010] Thus, in accordance with the above, some examples of the present disclosure are directed to a method including an electronic device in communication with one or more displays and one or more input devices, causing the one or more displays to present content in a first manner while a first color tint level is applied on the one or more displays, determining that one or more criteria are met while the one or more displays present the content in the first manner and while the first color tint level is applied on the one or more displays, and in response to determining that the one or more criteria are met, causing the content to be presented in a second manner different from the first manner, and applying the second color tint level different from the first color tint level on the one or more displays. In addition to or as an alternative to one or more of the examples disclosed above, in some examples, causing the one or more displays to present the content in the first manner further includes causing the one or more displays to present the content in a first size, and causing the one or more displays to present the content in the second manner further includes causing the one or more displays to present the content in a second size smaller than the first size. Additionally or alternatively to one or more of the examples disclosed above, in some examples, causing the one or more displays to present the content in a first manner further includes causing the one or more displays to present the content at a first luminance, and causing the one or more displays to present the content in a second manner further includes causing the one or more displays to present the content at a second luminance that is less than the first luminance. Additionally or alternatively to one or more of the examples disclosed above, in some examples, causing the one or more displays to present the content in a first manner further includes causing the one or more displays to present the content at a first opacity, and causing the one or more displays to present the content in a second manner further includes causing the one or more displays to present the content at a second opacity that is less than the first opacity.Additionally or alternatively to one or more of the examples disclosed above, in some examples, causing the one or more displays to present the content in a first manner further includes causing the one or more displays to present the content at a first location on the one or more displays, and causing the one or more displays to present the content in a second manner further includes causing the one or more displays to present the content at a second location different from the first location on the one or more displays. Additionally or alternatively to one or more of the examples disclosed above, in some examples, causing the one or more displays to present the content in a first manner further includes causing the one or more displays to present the content according to a first anchoring scheme, and causing the one or more displays to present the content in a second manner further includes causing the one or more displays to present the content in a second anchoring scheme different from the first anchoring scheme. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the second color tone level provides a higher transparency level for the one or more displays compared to the first color tone level. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more displays and the one or more input devices are included within the second electronic device, and the one or more criteria include a criterion that is met when movement of the second electronic device satisfies the one or more second criteria. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more second criteria include a criterion that is met when movement is greater than a threshold movement of the second electronic device. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the threshold movement of the second electronic device is based on content presented on the one or more displays. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more second criteria include a criterion that is met when movement of the second electronic device includes movement of the second electronic device from a first pitch to a second pitch.In addition to or as an alternative to one or more of the embodiments disclosed above, in some examples, the one or more second criteria include a criterion that is met when movement of the second electronic device includes movement of the second electronic device from a first yaw position to a second yaw position. In addition to or as an alternative to one or more of the embodiments disclosed above, in some examples, the one or more second criteria include a criterion that is met when movement of the second electronic device includes movement of the second electronic device in a horizontal rotation direction that exceeds a first threshold amount and when movement of the electronic device includes movement of the electronic device in a horizontal rotation direction that is less than a second threshold amount. In addition to or as an alternative to one or more of the embodiments disclosed above, in some examples, applying the second tint level further includes causing a transition from the first tint level to the second tint level, and includes applying at least a third tint level between the first tint level and the second tint level. In addition to or as an alternative to one or more of the examples disclosed above, in some examples, the one or more displays and the one or more input devices are included in the second electronic device, and the one or more criteria include a criterion that is met in response to detecting a sound and movement of the second electronic device toward the sound. In addition to or as an alternative to one or more of the examples disclosed above, in some examples, the one or more criteria include a criterion that is met when a display of the electronic device different from the one or more displays presenting the content is turned on. In addition to or as an alternative to one or more of the examples disclosed above, in some examples, the one or more criteria include a criterion that is met when the electronic device detects an input using the one or more input devices. In addition to or as an alternative to one or more of the examples disclosed above, in some examples, the one or more input devices include a motion sensor and an image sensor. In addition to or as an alternative to one or more of the examples disclosed above, in some examples, causing the content to be presented in the second manner includes causing the one or more displays to stop presenting the content in the first manner and causing the content to be presented on the electronic device.Additionally or alternatively to one or more of the examples disclosed above, in some examples, causing the one or more displays to present the content in the second manner further includes causing the one or more displays to minimize the content. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the method further includes determining that one or more third criteria are met, and in response to determining that the one or more third criteria are met, causing the one or more displays to present the content in the first manner and applying a first tint level to the one or more displays. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more second criteria include a criterion that is met when movement of the electronic device and / or movement of the second electronic device corresponds to a user transitioning between standing and sitting. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more second criteria include a criterion that is met when movement of the electronic device and / or movement of the second electronic device corresponds to a user walking. In addition to or as an alternative to one or more of the examples disclosed above, in some examples, the method further includes detecting, via one or more input devices, movement of the electronic device and / or movement of the second electronic device beyond a second movement threshold, and in response to detecting the movement of the electronic device and / or the movement of the second electronic device, causing the content to be presented in a third manner different from the first manner and applying a third tint level to the one or more displays different from the first tint level. In addition to or as an alternative to one or more of the examples disclosed above, in some examples, the method further includes detecting, via an image sensor of the electronic device, locations of the one or more displays relative to the electronic device, and in response to detecting the locations of the one or more displays relative to the electronic device, applying a second tint level to portions of the one or more displays corresponding to the locations of the electronic device.Additionally or alternatively to one or more of the examples disclosed above, in some examples, applying the second color tint level to the location of the electronic device on the one or more displays includes applying a color tint gradient from a bottom of the one or more displays to the location of the electronic device on the one or more displays. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more criteria include a criterion that is met when the electronic device is within a field of view of the one or more displays, and the method further includes increasing a luminance level of a display of the electronic device in response to applying a second color tint level, different from the first color tint level, on the one or more displays. Additionally or alternatively to one or more of the examples disclosed above, in some examples, the one or more criteria include a criterion that is met when the electronic device is within a field of view of the one or more displays, and the method further includes causing a color modification of the display of the electronic device. Some examples of the present disclosure are directed to a method, in an electronic device in communication with one or more first displays, one or more second displays, and one or more input devices, that includes causing the one or more first displays to present content to one or more second displays while a first tint level is applied on the one or more first displays; determining that one or more criteria are met while the one or more displays are presenting content to the one or more second displays and while the first tint level is applied on the one or more first displays; and applying a second tint level, different from the first tint level, on the one or more first displays in response to determining that the one or more criteria are met.

[0087] In addition to or as an alternative to one or more of the examples disclosed above, in some examples, in response to determining that one or more criteria are met, the content is presented in a second manner that is different from the first manner.

[0088] Some examples of the present disclosure are directed to electronic devices comprising one or more processors, a memory, and one or more programs, the one or more programs being stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods described above.

[0089] Some examples of the present disclosure are directed to a non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform any of the methods described above.

[0090] Some examples of the present disclosure are directed to electronic devices comprising one or more processors, a memory, and means for performing any of the above methods.

[0091] Some examples of the present disclosure are directed to an information processing apparatus for use in an electronic device, the information processing apparatus comprising means for performing any of the above methods.

[0092] The foregoing description has been set forth with reference to specific embodiments for purposes of explanation. However, the illustrative description above is not intended to be exhaustive or to limit the disclosure to the precise form disclosed. Many modifications and variations are possible in light of the above teachings. The examples were chosen and described to best explain the principles of the disclosure and its practical application, thereby enabling those skilled in the art to best utilize the disclosure and various described examples, with various modifications suited to the particular use contemplated.

Claims

1. 1. A method comprising:

1. An electronic device in communication with one or more displays and one or more input devices, comprising: causing the one or more displays to present content in a first manner while a first color tint level is applied on the one or more displays; determining that one or more criteria are met while the one or more displays are presenting the content in the first manner and while the first color tint level is applied on the one or more displays; In response to determining that the one or more criteria are met, presenting the content in a second format different from the first format; applying a second tint level to the one or more displays, the second tint level being different from the first tint level.

2. causing the one or more displays to present the content in the first manner further includes causing the one or more displays to present the content at a first size, a first luminance, a first opacity, at a first location on the one or more displays, and / or according to a first anchoring manner; causing the one or more displays to present the content in the second manner further comprises causing the one or more displays to present the content at a second size smaller than the first size, at a second luminance less than the first luminance, at a second opacity less than the first opacity, at a second location on the one or more displays that is different from the first location, and / or according to a second anchoring manner that is different from the first anchoring manner. The method of claim 1.

3. The method of claim 1 , wherein the second color level provides a higher level of transparency to the one or more displays compared to the first color level.

4. 2. The method of claim 1 , wherein the one or more displays and one or more input devices are contained within a second electronic device, and the one or more criteria include a criterion that is met when movement of the second electronic device satisfies one or more second criteria.

5. The method of claim 4 , wherein the one or more second criteria include a criterion that is met when the movement is greater than a threshold movement of the second electronic device.

6. The method of claim 5 , wherein the threshold movement of the second electronic device is based on the content presented on the one or more displays.

7. 6. The method of claim 5, wherein the one or more second criteria include a criterion that is met when the movement of the electronic device and / or the movement of the second electronic device corresponds to a user transitioning between standing and sitting.

8. The method of claim 5 , wherein the one or more second criteria include a criterion that is met when the movement of the electronic device and / or the movement of the second electronic device corresponds to a user walking.

9. detecting, via the one or more input devices, the movement of the electronic device and / or the movement of the second electronic device beyond a second movement threshold; In response to detecting the movement of the electronic device and / or the movement of the second electronic device, presenting the content in a third format different from the first format; applying a third color level to the one or more displays, the third color level being different from the first color level; The method of claim 5 further comprising:

10. 4. The method of claim 3, wherein applying the second tint level further comprises causing a transition from the first tint level to the second tint level, the transition comprising applying a third tint level between at least the first tint level and the second tint level.

11. 10. The method of claim 1, wherein the one or more displays and one or more input devices are included in a second electronic device, and the one or more criteria include criteria that are met in response to detecting a sound and movement of the second electronic device toward the sound.

12. The method of claim 1 , wherein the one or more criteria include a criterion that is met when a display of the electronic device that is different from the one or more displays presenting content is turned on.

13. the one or more input devices include a motion sensor and an image sensor, and the method further comprises: Detecting a location of the one or more displays relative to the electronic device via the image sensor of the electronic device; 10. The method of claim 1, further comprising: in response to detecting the location of the one or more displays relative to the electronic device, applying the second tint level to a portion of the one or more displays corresponding to a location of the electronic device.

14. causing the content to be presented in the second manner, causing the one or more displays to cease presenting the content in the first manner; and causing the content to be presented on the electronic device.

15. The method of claim 1 , wherein causing the content to be presented in the second manner further comprises causing the one or more displays to minimize the content.

16. determining that one or more third criteria are met; and In response to determining that the one or more third criteria are met, causing the one or more displays to present the content in the first manner; applying the first color tint level to the one or more displays; The method of claim 1 further comprising:

17. The one or more criteria include a criterion that is met when the electronic device is within a field of view of the one or more displays, and the method further comprises:

10. The method of claim 1, further comprising increasing a brightness level of a display of the electronic device in response to applying a second tint level to the one or more displays, the second tint level being different from the first tint level.

18. The one or more criteria include a criterion that is met when the electronic device is within a field of view of the one or more displays, and the method further comprises: The method of claim 1 , further comprising causing a color modification of a display of the electronic device.

19. 20. A non-transitory computer-readable storage medium storing one or more programs comprising instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform the method of any one of claims 1 to 18.

20. 1. An electronic device comprising: one or more processors; Memory and and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for performing the method of any one of claims 1 to 18.

Citation Information

Patent Citations

  • Image display control device

    JP2008305141A

  • Devices, methods, and graphical user interfaces for interacting with three-dimensional environments

    US20220091722A1