Interference reduction in augmented reality environments

Abstract

Embodiments relate to aspects of an augmented reality environment selected or otherwise modified to account for disturbing stimuli. Similarly, one or more metrics that reflect or otherwise indicate the user's ability to focus on the current or upcoming activity may be used to adjust the user's interaction with the augmented reality environment. The augmented reality environment may be generated by an augmented reality system including a head mounted display, a set of sensors, and a processor configured to enter a focus mode that reduces interference in the augmented reality environment. While in the focus mode, a processor may receive imaging data of a physical environment around a user using the set of sensors, and generate the augmented reality environment that includes a rendering of a first region of the physical environment in which the identified object is replaced with additional content.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This Patent Cooperation Treaty patent application claims priority to U.S. Provisional Patent Application No. 63 / 409,181, filed on September 22, 2022, and entitled “Distraction Reduction in Extended Reality Environments,” the contents of which are incorporated herein by reference in their entirety. Technical Field

[0003] The described embodiments generally relate to extended reality systems. More specifically, the embodiments relate to reducing distractions and promoting user focus during interaction with an extended reality environment. Background Art

[0004] Extended reality systems can be used to generate partially or fully simulated environments (e.g., virtual reality environments, mixed reality environments, etc.) in which virtual content can replace or enhance the physical world. Simulated environments can provide users with engaging experiences and are used in games, personal communications, virtual travel, health care, and many other scenarios. When a given simulated environment includes a portion of a user's physical environment (such as mixed reality and augmented reality environments), certain aspects of the physical environment may be disruptive or otherwise interfere with the user's ability to focus on a particular task or experience. Therefore, it may be desirable for these systems to provide additional types of user experiences that help maintain the user's attention on a given activity. Summary of the invention

[0005] An embodiment relates to a wearable system comprising a head-mounted display, a set of sensors, and a processor configured to determine whether an activation criterion has been met. In response to meeting the activation criterion, the system is configured to enter a focus mode that reduces distractions in an extended reality environment. When in the focus mode, the system may use the set of sensors to receive imaging data of a physical environment surrounding a user, use the imaging data to identify an object that meets the distraction criterion and is located within a first area of ​​the physical environment, and select additional content based on the identified object. The system may generate an extended reality environment that includes a reproduction of the first area of ​​the physical environment, wherein the reproduction includes a sub-area in which the imaging data associated with the identified object is replaced with additional content. The system may display the extended reality environment using the head-mounted display.

[0006] Embodiments also relate to a head mounted device worn by a user and comprising a display, a first set of sensors configured to detect a physical environment around the user, a second set of sensors configured to measure one or more physiological parameters of the user, and a processor configured to generate an extended reality environment including a first reproduction of a first portion of the physical environment. The system may use the display to display the extended reality environment, use the second set of sensors to detect the user's engagement with a candidate object in the first reproduction, and in response to the detected user engagement satisfying the selection criteria, assign a distraction type to the candidate object. In response to satisfying the activation criteria, the system may enter a focus mode that reduces distractions in the extended reality environment. When in the focus mode, the system may use the first set of sensors to receive imaging data of the physical environment around the user, and use the imaging data to identify a target object associated with the selected distraction type and located within a second area of ​​the physical environment. The system may generate an extended reality environment that includes a second reproduction of the second area of ​​the physical environment, wherein the target object is replaced with additional content.

[0007] Embodiments also relate to a method for operating a head mounted device during a focus mode with reduced distractions in an extended reality environment. The method may include using a set of sensors to receive imaging data of a physical environment surrounding a user, using the imaging data to identify a candidate object in a portion of the physical environment. The method may include selecting a first distraction criterion and determining that the candidate object does not satisfy the first distraction criterion. The method may include generating an extended reality environment including a first reproduction of the portion of the physical environment with the candidate object and displaying the extended reality environment using a display. The method may include selecting a second distraction criterion and determining that the candidate object satisfies the second distraction criterion. The method may include updating the extended reality environment to include a second reproduction of the portion of the physical environment that replaces the candidate object with additional content and displaying the updated extended reality environment with the display.

[0008] An embodiment relates to a wearable system comprising a head-mounted display, a set of sensors, and a processor configured to determine whether an activation criterion has been met. The system may determine a current activity of a user and, in response to meeting the activation criterion, enter a focus mode that reduces distractions in an extended reality environment. When in the focus mode, the system may use the set of sensors to receive imaging data of a physical environment surrounding the user and select a main area and a peripheral area of ​​the extended reality environment. The main area may correspond to a first area of ​​the physical environment, and the peripheral area corresponds to a second area of ​​the physical environment. The system may generate an extended reality environment having a main area and a peripheral area, wherein the main area includes content associated with the current activity, and the peripheral area includes a modified representation of the second area of ​​the physical environment. The system may cause the head-mounted display to display the extended reality environment, wherein the modified representation is generated by applying a modification to the imaging data associated with the second area of ​​the physical environment.

[0009] Embodiments also relate to a wearable system comprising a head mounted display, a set of sensors, and a processor configured to receive imaging data of a physical environment surrounding a user using the set of sensors. The system may enter a focus mode that reduces distractions in an extended reality environment. While in the focus mode, the system may select an area of ​​the physical environment and apply modifications to imaging data associated with the area to generate a modified representation of the area. The system may select a candidate object in the physical environment that meets a selection criterion, and generate an extended reality environment that includes the modified representation of the area and a reproduction of the candidate object.

[0010] Embodiments also relate to a wearable system comprising a head mounted display, a set of sensors, and a processor configured to receive imaging data of a physical environment surrounding a user using the set of sensors. The system may enter a focus mode that reduces distractions in an extended reality environment and determine a current activity of the user while in the focus mode. While in the focus mode, the system may determine that a first area of ​​the physical environment is associated with the current activity and determine that a second area of ​​the physical environment is not associated with the current activity. The system may select a modification and use the modification to generate a modified representation of the second area of ​​the physical environment. The system may generate an extended reality environment including a reproduction of the first area of ​​the physical environment and a modified representation of the second area of ​​the physical environment, and cause the head mounted display to display the extended reality environment.

[0011] An embodiment relates to a wearable system that includes a head-mounted display, a set of sensors, and a processor configured to enter a first focus mode in response to determining that a first activation criterion has been met, the first focus mode reducing distractions in an extended reality environment. When in the first focus mode, the system may use the set of sensors to receive imaging data of a physical environment surrounding a user, and cause the head-mounted display to display an extended reality environment that includes a reproduction of a first portion of the physical environment, wherein distracting objects in the first portion of the physical environment are replaced with additional content. In response to determining that a second activation criterion has been met, the system may enter a second focus mode that reduces distractions in the extended reality environment. When in the second focus mode, the system may use the set of sensors to receive imaging data of a physical environment surrounding a user, and cause the head-mounted display to display an extended reality environment that includes a modified representation of a second portion of the physical environment.

[0012] The embodiment also relates to a wearable system, which includes a head-mounted display, a set of sensors, and a processor configured to use the set of sensors to receive imaging data of a physical environment around a user. The system can identify that the user is initiating an activity, and in response to identifying that the user is initiating an activity, cause the head-mounted display to display multiple selectable options, each option associated with a corresponding focus mode that reduces distractions in an extended reality environment. The system can detect input that selects one of the multiple selectable options corresponding to the selected focus mode, and enter the selected focus mode. When in the selected focus mode, the system can select a portion of the physical environment based on the selected focus mode, and cause the head-mounted display to present an extended reality environment in which the imaging data associated with the portion of the physical environment is replaced with additional content.

[0013] Embodiments also relate to a wearable system comprising a head-mounted display, a set of sensors, and a processor configured to use the set of sensors to receive imaging data of a physical environment around a user. In response to determining that an activation criterion has been met, the system may determine a first attention state of the user and select a first focus mode that reduces distractions in an extended reality environment. The first focus mode may be selected based on the first attention state. The system may enter a first focus mode, wherein the processor is configured to select a first portion of a physical environment based on a first criterion and cause the head-mounted display to present an extended reality environment in which imaging data associated with the first portion of the physical environment is replaced with first additional content. The system may determine that the first attention state has changed to a second attention state and select a second focus mode that reduces distractions in an extended reality environment. The second focus mode may be selected based on the second attention state. The system may change from the first focus mode to the second focus mode, wherein the processor is configured to select a second portion of the physical environment based on a second criterion and cause the head-mounted display to present an extended reality environment in which imaging data associated with the second portion of the physical environment is replaced with second additional content.

[0014] Embodiments relate to a wearable system that includes a head-mounted display, a set of sensors, and a processor configured to cause the wearable system to enter a focus mode that reduces distractions in an extended reality environment. In the focus mode, the system may use the set of sensors to receive imaging data of a physical environment surrounding a user and select an area of ​​the physical environment that includes an object that meets a distraction criterion. The system may cause the head-mounted display to display an extended reality environment in which the imaging data associated with the area of ​​the physical environment is replaced with additional content. The system may detect user engagement corresponding to the additional content that meets the interaction criterion, and in response to detecting the user engagement corresponding to the additional content, update the extended reality environment to include a reproduction of a portion of the object.

[0015] Embodiments also relate to a wearable system comprising a head-mounted display, a set of sensors, and a processor configured to enter a focus mode that reduces distractions in an extended reality environment in response to determining that a first activation criterion has been met. When in the focus mode, the system may use the set of sensors to receive imaging data of a physical environment around a user, and cause the head-mounted display to display an extended reality environment that includes a reproduction of a portion of the physical environment, wherein an object in the portion of the physical environment is replaced with additional content. The system may use the set of sensors to detect a change in an object, and in response to a change in an object that meets an update criterion, update the reproduction of the portion of the physical environment to remove the additional content.

[0016] The embodiment also relates to a wearable system comprising a head-mounted display, a set of sensors, and a processor configured to operate in multiple focus modes that reduce distractions in an extended reality environment. In each of the multiple focus modes, the system may use the set of sensors to receive imaging data of a physical environment around a user, identify objects in the physical environment that meet distraction criteria, and cause the head-mounted display to display an extended reality environment that includes a first area that reproduces the physical environment and a second area that replaces the objects in the physical environment with additional content. The system may determine user engagement corresponding to the second area in a first focus mode among the multiple focus modes, and in response to the determined user engagement satisfying the first criteria, update the second area of ​​the extended reality environment to reproduce the object. In a second focus mode among the multiple focus modes, and in response to the determined user engagement satisfying a second criterion different from the first criterion, the system may update the second area of ​​the extended reality environment to reproduce the object.

[0017] Embodiments relate to a wearable system that includes a head-mounted display, a set of sensors, and a processor configured to determine that a user is initiating a first activity in an extended reality environment. In response to determining that the user is initiating the first activity, the system may select a focus criterion associated with the first activity, use the set of sensors to detect a focus state of the user, and determine whether the detected focus state satisfies the focus criterion. In response to the detected focus state failing to satisfy the focus criterion, the system may cause the head-mounted display to display a notification in the extended reality environment.

[0018] Embodiments also relate to a wearable system comprising a head-mounted display, a set of sensors, and a processor configured to use the set of sensors to receive imaging data of a physical environment surrounding a user. The system may determine an estimated future activity of the user, and based on the estimated future activity, select a focus mode from a set of candidate focus modes that reduce distractions in an extended reality environment. The system may enter the selected focus mode during which the processor causes the head-mounted display to display an extended reality environment comprising a first area and a second area, the first area comprising a reproduction of a first portion of the physical environment, the second area comprising additional content.

[0019] Embodiments also relate to a wearable system, the wearable system including a head mounted display, a set of sensors, and a processor configured to determine that a user is performing a first activity in an extended reality environment. When the user is performing the first activity, the system can use the set of sensors to detect the user's attention state, determine whether the detected attention state meets a focus criterion associated with the first activity, and pause the first activity in response to the detected attention state not meeting the focus criterion and initiate a second activity in the extended reality environment. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The present disclosure will be readily understood through the following detailed description in conjunction with the accompanying drawings, in which like reference numerals represent like structural elements, and in which:

[0021] Figure 1 An exemplary block diagram of an extended reality system is shown;

[0022] Figure 2A A perspective view of a user positioned in a physical environment is shown. Figure 2B and Figure 2C An example of an extended reality environment generated based on the physical environment around the user is shown;

[0023] Figure 3 An extended reality environment including virtual content added to a physical environment is shown;

[0024] Figure 4 An example process for identifying that an object meets interference criteria and generating an extended reality environment that replaces the object with additional content is shown;

[0025] Figure 5A and Figure 5B An example of identifying an object in a physical environment 500 and replacing the object with additional content in an extended reality environment is shown;

[0026] Figure 6 An example process for assigning distraction types to objects within a physical environment and generating an extended reality environment that uses the assigned distraction types to replace specific objects with additional content is shown;

[0027] Figure 7 An example user interface for assigning interference criteria to an object is shown;

[0028] Figure 8 shows an example user interface for setting distraction criteria for various focus modes that may be implemented by an extended reality system;

[0029] Fig. 9 showing an example user interface presenting a recommended focus mode and including an option for a user to select between different focus modes;

[0030] Fig.10 An example user interface for identifying and / or modifying sounds of an extended reality environment is shown;

[0031] Fig.11 An example process for modifying objects within an extended reality environment based on a user's activities is shown;

[0032] Fig.12An example process for modifying an object within an extended reality environment based on a determined level of concentration is shown;

[0033] Fig.13 An example process for detecting and replacing objects in an extended reality environment based on a user-selected focus mode is shown;

[0034] Fig.14 An example process for recommending a focus mode at an extended reality system based on a user's environment is shown;

[0035] Fig.15A and Fig. 15B is an example of an extended reality environment that may be generated by an extended reality system based on different areas of the physical environment surrounding a user and applying different modifications to the different areas;

[0036] Fig.16 An example process for identifying different areas of a physical environment and generating an extended reality environment that applies visual modifications to one or more of those areas is shown;

[0037] Fig.17A and Fig. 17B An example extended reality environment that can be used to analyze a physical environment and select a focus mode based on sensed parameters of the physical environment is shown;

[0038] Fig.18 An example process is shown that can identify one or more objects within a physical environment and apply regional modifications to the area surrounding the object but reproduce the object in an extended reality environment;

[0039] Fig.19 An example of an extended reality environment including one or more real objects shown to a user, wherein virtual modifications are applied to areas surrounding the objects, is shown;

[0040] Fig. 20A and Fig. 20B An example of an extended reality environment that can be configured to replace a physical environment with additional content is shown;

[0041] Fig.21 An example process for determining a region associated with an activity and applying region modifications to other portions of an extended reality environment is shown;

[0042] Fig. 22 An example process for generating a virtual object in an extended reality environment while applying region modifications within the extended reality environment is shown;

[0043] Fig.23 An example of an extended reality environment that may be generated to include virtual content and regional modifications is shown;

[0044] Fig.24 An example process for dynamically updating or changing zone modifications during focus mode is shown;

[0045] Fig.25 An example process for switching between different types of focus modes is shown. In some cases, an extended reality system may be configured to switch between different focus modes based on a user's activity or change in activity;

[0046] Fig.26A The physical environment 2600 surrounding the user is shown and may include a room with a door, a window, a table, books, and a display showing dynamic content;

[0047] Fig.26B showing a first extended reality environment generated by an extended reality system and displayed to a user;

[0048] Fig.26C showing a second extended reality environment generated by the extended reality system and displayed to the user;

[0049] Fig. 27 An example process 2700 is shown for changing between different focus modes based on user input to an extended reality system.

[0050] Fig.28 An example process 2800 is shown for initiating a focus mode and switching between different focus modes based on one or more monitored parameters of a user and / or environment.

[0051] Fig.29A and Fig.29B showing different notifications that may be introduced into an extended reality environment during different focus modes;

[0052] Fig.30 A process for determining when to allow a breach of an object in an extended reality environment is shown;

[0053] Fig.31A and Fig.31B An example of a breakthrough of an object in an extended reality environment operating in a focus mode is shown;

[0054] Fig.32 A process flow for determining when to allow a breach of an object in an extended reality environment based on one or more parameters of the object is shown;

[0055] Fig.33 An example process flow for determining whether to initiate an activity in focus mode based on a user's attention state is shown;

[0056] Fig.34An example process for assessing a user's attention state and recommending an initial activity before engaging in a future activity is shown;

[0057] Fig.35 An example process for pausing a current activity based on one or more monitored parameters of a user is shown;

[0058] Fig.36 shows an example user interface for pausing an activity; and

[0059] Fig.37 An example extended reality environment is shown showing modifications to the physical environment prior to initiating an activity in focus mode. DETAILED DESCRIPTION

[0060] Reference will now be made in detail to the representative embodiments illustrated in the accompanying drawings. It should be understood that the following description is not intended to limit the embodiments to a preferred embodiment. On the contrary, it is intended to cover alternatives, modifications and equivalents that may be included in the essence and scope of the described embodiments defined by the appended claims.

[0061] The various embodiments described herein relate to increasing a user's attention to a particular task or activity while the user is participating in an extended reality environment generated by an extended reality system. Certain stimuli (people, objects, sounds, etc.) in the user's physical environment (if an extended reality environment is included) may interfere with the user while the user is participating in a desired activity. Therefore, in some embodiments described herein, various aspects of the extended reality environment are selected or otherwise modified to take into account disruptive stimuli. Similarly, one or more metrics that reflect or otherwise indicate a user's ability to focus on a current or upcoming activity can be used to adjust the user's interaction with the extended reality environment.

[0062] For example, many of the embodiments described herein include generating an extended reality environment as part of a dedicated focus mode. During focus mode, the extended reality system generates an extended reality environment that is configured to reduce distractions to the user when the user performs a specific activity within the extended reality environment. This can make it easier for the user to pay attention to the desired activity, which can be any activity that the user may want to improve their attention (e.g., reading, learning, drawing, participating in cognitive training, meditation, cooking, etc.). The extended reality system will operate in a given focus mode until the focus mode is deactivated (e.g., based on a set of deactivation criteria, in response to a user request) or a new focus mode is activated. The extended reality system can operate in different focus modes in different environments (depending on the user's current activity, the user's selection of a focus mode, etc.), where each focus mode applies different techniques and / or criteria for reducing distractions in the extended reality environment.

[0063] The extended reality system described herein can use a range of techniques to reduce distractions in the extended reality environment. For example, various objects in the user's physical environment can be identified as potentially distracting and replaced with additional content in the extended reality environment. In other cases, an entire area of ​​the user's physical environment can be selected as potentially distracting and replaced with additional content in the extended reality environment (such as a modified representation of the area). In other cases, the entire physical environment can be replaced with the additional content. The decision of which objects or areas of the physical environment to replace with additional content can be dynamically selected based on predetermined criteria and / or based on the user's interaction with the extended reality environment. For example, the extended reality system can determine which parts of the user's physical environment are not associated with the user's current activity, and can reduce distractions in these areas to focus the user's attention on the objects and / or parts of the environment associated with the current activity.

[0064] The extended reality system described herein may also continuously evaluate changes in the physical environment and / or the user's interaction with the extended reality environment, and update the extended reality environment based on these monitored changes. For example, the extended reality system described herein may dynamically modify and / or display a portion of the physical environment in the extended reality environment. This may include using additional content once to modify a real object or replace a real object in the extended reality environment, and later reintroducing the real object back into the extended reality environment based on an updated situation (e.g., the detected interaction of the user with the extended reality environment and / or the measured user parameters). Additionally or alternatively, the extended reality system described herein may prepare the user for a specific task by evaluating the user's current state of attention and engaging the user in a set of tasks designed to increase the user's state of attention to match the attention criteria required for the specific task. In some cases, the extended reality system may monitor the user's state of attention and change, delay, or otherwise modify the current activity based on the user's state of attention.

[0065] References below Figures 1 to 37 However, those skilled in the art will readily appreciate that the detailed description given herein with respect to these figures is for illustration purposes only and should not be construed as limiting.

[0066] Various terms are used herein to describe the various extended reality systems and associated extended reality environments described herein. As used herein, a "physical environment" is a portion of the physical / real world surrounding a user that the user can perceive and interact with without the assistance of an extended reality system described herein. For example, a physical environment may include a room of a building or an outdoor space, as well as any objects in that space (also referred to herein as "real objects"), such as plants, furniture, books, and the like. For purposes of this application, people in a physical environment may be considered objects for the purpose of generating an extended reality environment.

[0067] As used herein, an "extended reality environment" refers to a fully or partially simulated environment that a user can perceive and / or interact with using an extended reality system as described herein. In some cases, an extended reality environment may be a virtual reality environment, which refers to a fully simulated environment in which the user's physical environment is completely replaced by virtual content within the virtual reality environment. The virtual reality environment may not be dependent on the user's physical environment, and therefore may allow the user to perceive that they are in a different simulated location (e.g., standing at a beach when they are actually standing in a room of a building). The virtual reality environment may include virtual objects (i.e., simulated objects that can be perceived by the user but do not actually exist in the physical environment) that the user can interact with.

[0068] In other cases, the extended reality environment may be a mixed reality environment, i.e., a fully or partially simulated environment in which virtual content may be presented along with a portion of the user's physical environment. Specifically, the mixed reality environment may include a reproduction and / or modified representation of one or more portions of the user's physical environment surrounding the extended reality system (discussed in more detail below). In this way, the user is able to perceive their physical environment (directly or indirectly) through the mixed reality environment while still perceiving the virtual content.

[0069] In some cases, the mixed reality environment allows virtual content to interact with the physical environment within the mixed reality environment and / or the physical environment to interact with virtual content. For example, the mixed reality environment may allow the user to perceive a virtual cat knocking over a real cup in the mixed reality environment (the real cup may then be replaced with the virtual cup because the real cup has not actually moved). Conversely, a real dog entering the mixed reality environment may startle the virtual cat. In other variations, the mixed reality environment includes an augmented reality environment in which virtual content is superimposed on a portion of the user's physical environment.

[0070] As used herein, "reproduction" of a portion of a physical environment refers to a portion of an extended reality environment that recreates that portion of the physical environment within the extended reality environment. For example, an extended reality system may have a transparent or translucent display, and may be configured to present virtual content on (one or more) transparent or translucent displays to form an extended reality environment. In these embodiments, a user may directly view portions of the physical environment that are not obscured by the presented virtual content through (one or more) transparent or translucent displays. Therefore, these portions of the physical environment that can be directly viewed by the user will be considered reproductions for the purposes of this application, and are referred to herein as "direct reproductions."

[0071] In other embodiments, the extended reality system includes (one or more) opaque displays so that the user cannot directly view the physical environment through the display. In these embodiments, the system may include one or more image sensors (e.g., as part of a camera or other imaging system) capable of capturing images of the physical environment. The extended reality system may present a portion of these images to the user by displaying these images via an opaque display, so that the user indirectly views the physical environment via the displayed image. When presented to the user as part of an extended reality environment, the image (or its parts) is considered to be a reproduction for the purposes of this application (also referred to herein as "indirect reproduction"). It should be understood that the captured image of the physical environment used to generate the indirect reproduction may undergo standard image processing operations, such as tone mapping, color balancing, and / or image sharpening, in an effort to match the indirect reproduction to the physical environment. In addition, in some cases, a foveated rendering is used to display an extended reality environment, where different fidelity levels (e.g., image resolution) are used to render different parts of the extended reality environment depending on the user's gaze direction. In these cases, for the purposes of this application, the reproduction portion rendered with lower fidelity using these foveated rendering techniques is still considered to be an indirect reproduction.

[0072] As used herein, a "modified representation" of a portion of a physical environment refers to a portion of an extended reality environment that is derived from the physical environment, but that intentionally obscures one or more aspects of the physical environment. While indirect reproduction attempts to replicate a portion of a user's physical environment within the extended reality environment, a modified representation intentionally changes one or more visual aspects of a portion of the user's physical environment (e.g., using one or more visual effects, such as artificial blur). In this way, a modified representation of a portion of a user's physical environment may allow the user to perceive certain aspects of that portion of the physical environment while obscuring other aspects. In an example of artificial blur, the user may still be able to perceive the general shape and placement of real objects within the modified representation, but may not be able to perceive the visual details of those objects that are visible in the physical environment. Where foveated rendering is used to display the extended reality environment, portions of the modified representation that are in the peripheral areas of the extended reality environment (relative to the user's gaze) may be rendered at lower fidelity using foveated rendering techniques.

[0073] As used herein, "additional content" refers to one or more portions of an extended reality environment that do not reproduce the physical environment (i.e., directly or indirectly). The additional content may include modified representations of portions of the physical environment and / or virtual content that changes what the user perceives to be present at a given location in the physical environment. For example, virtual content may be selected and generated to make it appear as if a real object has disappeared from the physical environment, to make it appear as if a real object has been replaced by a different object, or to make it appear as if the real object is in a different state (e.g., as if a light fixture is turned off in the extended reality environment even if the real light fixture is currently generating light). It should be understood that the additional content may also include "modified representations" of virtual objects, where the same modifications used to change a portion of the user's physical environment (e.g., to generate a modified representation of the user's physical environment) are also applied to the virtual objects. This may allow the modified representation of the virtual object to replace the modified representation of the real object in the extended reality environment.

[0074] As used herein, a "state of attention" determined, detected, measured, or otherwise identified for a user refers to one or more metrics that represent the user's ability to focus on a given activity. The extended reality system described herein may be able to use physiological information obtained from the user (e.g., sensed using one or more sensors and / or derived from feedback or other information provided by the user to the extended reality system) to determine the user's state of attention. The physiological information can be used to determine one or more metrics that reflect the user's level of fatigue, concentration, stress, combinations thereof, and the like. A single metric or multiple of these metrics can be used to represent the user's state of attention.

[0075] Figure 1An example block diagram of an extended reality system 100 is shown, which can take the form of any device described herein and is used to generate an extended reality environment as described herein. The extended reality system 100 may include a head mounted display 102, a sensor 104, one or more processors 106, an input / output (I / O) mechanism 108, a memory 110, and a power supply 112. The processor 106 may control some or all of the operations of the extended reality system 100 and communicate directly or indirectly with some or all of the components of the extended reality system 100.

[0076] The head-mounted display 102 may be a display worn by a user and may be used to create an immersive extended reality experience by displaying content near and in the user's field of view. The head-mounted display 102 may include a headband or other fastening mechanism that may be used to releasably couple the head-mounted display 102 to the user's head so that when the user moves their head in different directions, the display moves with the user and the relative position of the display to the user's eyes remains constant. In some cases, one or more displays may be curved or have a non-planar profile. The head-mounted display 102 may include a single display, or may include multiple displays (e.g., one display for each eye of the user).

[0077] The head mounted display 102 may include a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a light emitting diode (LED) display, and the like. Displays such as LCD displays may include a backlight component that may be controlled to provide variable levels of display brightness. In some cases, the head mounted display 102 may include one or more transparent or translucent displays, while in other cases, the head mounted display 102 may include one or more opaque displays, as previously described. In some cases, the brightness of the display may be controlled by modifying an electrical signal provided to the display element.

[0078] The sensor 104 may include one or more sensors configured to sense one or more aspects of the physical environment around the user and / or sense one or more parameters of the user. The sensor may include an optical sensor that measures the physical environment and / or movement of the user. The optical sensor may include a depth measurement sensor (or multiple sensors) that can determine the distance between various objects in the physical environment and the position of the sensing unit (e.g., a head-mounted display). The depth measurement sensor may include a time-of-flight sensor, a structured light sensor, a stereo camera, etc. The optical sensing unit may include a camera or other suitable imaging device configured to capture an image of a scene (which can then be used to identify one or more areas of the physical environment and / or the user). For example, the optical sensing unit may include a first camera that can image the physical environment and a second camera that can image one or more parts of the user (e.g., the user's eyes). The depth sensor and the camera may have overlapping fields of view, so that the identification of objects in the physical environment and / or anatomical features via the camera can be used by the device to associate the objects and / or anatomical features with the measurements made by the depth sensor.

[0079] The extended reality system 100 may communicate with other devices, such as wearable electronic devices (such as smart phones) or other suitable devices. The electronic device may measure the movement of the user and communicate the movement to the extended reality system 100. For example, the electronic device and the extended reality system may each include one or more antennas and may transmit signals, such as UWB signals, that may be used to determine the distance and / or position of the devices relative to each other.

[0080] The extended reality system may include additional sensors such as accelerometers, gyroscopes, positioning sensors such as global positioning system (GPS) sensors, wireless positioning systems, altimeters, pressure sensing systems, etc. Additionally or alternatively, the extended reality system 100 may include physiological sensors such as temperature sensors, heart rate monitors, and / or other suitable sensors. Sensors 104 may include sensors configured to sense pressure, light, touch, biometric data (e.g., one or more physiological parameters), etc. For example, sensors 104 may include thermal sensors, position sensors, light or optical sensors, accelerometers, pressure transducers, gyroscopes, magnetometers, health monitoring sensors, and the like. In addition, one or more sensors 104 may utilize any suitable sensing technology, including but not limited to capacitive, ultrasonic, resistive, optical, ultrasonic, piezoelectric, and thermal sensing technologies.

[0081] Processor 106 may be implemented as any electronic device capable of processing, receiving, or transmitting data or instructions. For example, processor 106 may be a microprocessor, a central processing unit (CPU), an application specific integrated circuit (ASIC), a digital signal processor (DSP), or a combination of such devices. As described herein, the term "processor" is intended to encompass a single processor or processing unit, multiple processors, multiple processing units, or one or more other suitable computing elements. The processing unit may be programmed to perform various aspects of the system described herein.

[0082] It should be noted that components of the extended reality system 100 may be controlled by multiple processors. For example, selected components of the extended reality system (e.g., sensor 104) may be controlled by a first processor, and other components of the extended reality system 100 (e.g., I / O 108) may be controlled by a second processor, where the first processor and the second processor may or may not communicate with each other.

[0083] I / O devices 108 may include devices that output controls, instructions, or other options to a user for operating extended reality system 100. The I / O devices may include a display, a speaker, one or more microphones, and a haptic output device, one or more of which may be used to present a guided breathing exercise to a user.

[0084] I / O devices 108 may include devices that transmit data to a user or another electronic device and / or receive data from a user or another electronic device. I / O devices may transmit electronic signals via a communication network such as a wireless and / or wired network connection. Examples of wireless and wired network connections include, but are not limited to, cellular networks, Wi-Fi, Bluetooth, IR, and Ethernet connections. In some cases, I / O devices 804 may communicate with external electronic devices, such as smart phones, electronic devices, or other portable electronic devices, as described herein.

[0085] The memory 110 may store electronic data that may be used by the extended reality system 100. For example, the memory 110 may store electronic data or content, such as, for example, audio and video files, documents and applications, device settings and user preferences, timing signals, control signals, and data structures or databases. The memory 110 may also include one or more non-transitory computer-readable storage devices for storing computer-executable instructions that, when executed by one or more computer processors, may, for example, cause the computer processors to perform the techniques described herein (such as generating an extended reality environment configured to reduce distractions to a user).

[0086] A computer readable storage device may be any medium that can tangibly contain or store computer executable instructions for use by or in conjunction with an instruction execution system, apparatus, and device. In some examples, the storage device is a transient computer readable storage medium. In some examples, the storage device is a non-transient computer readable storage medium. Non-transient computer readable storage devices may include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical disks based on CD, DVD, or Blu-ray technology, and persistent solid-state memory such as flash memory, solid-state drives, and the like.

[0087] The power supply 112 may be implemented with any device capable of providing energy to the extended reality system 100. For example, the power supply 112 may be one or more batteries or rechargeable batteries. Additionally or alternatively, the power supply 112 may be a power connector or a power cord that connects the extended reality system 100 to another power source, such as a wall outlet.

[0088] FIG. 2A to FIG. 2C 2 shows an example of how an extended reality system 201 can generate an extended reality environment based on the physical environment 200 surrounding the user 202. Specifically, Figure 2A A user 202 is shown located within a physical environment 200, and Figure 2B and Figure 2C An example of an extended reality environment 201 that can be presented to a user 200 via an extended reality system is shown. Extended reality environment 201 can be displayed on a head mounted display of an extended reality system, as described herein.

[0089] The extended reality environment 201 may be generated to include (e.g., reproduce) one or more portions of the physical environment 200 surrounding the user 202, such as in a mixed reality environment as previously discussed. In some of these cases, the extended reality environment 200 may be displayed from the perspective of the user 202 relative to the physical environment 200, which may orient the user relative to the physical environment 200 and allow the user to see and physically interact with real objects without removing the extended reality system. In addition to one or more portions of the physical environment 200, the extended reality environment 201 may also display virtual content. Thus, in some cases, the extended reality environment may include both the physical environment and virtual content, but it should be understood that in other cases, the extended reality environment may include only virtual content (e.g., such as in a virtual reality environment as previously discussed).

[0090] The extended reality system may use one or more sensors to receive imaging data and / or other data about the physical environment 200 to determine aspects of the physical environment. The extended reality may use this information to determine the location, size, and / or other characteristics of objects in the physical environment and / or the location of the user relative to the physical environment 200, and generate an extended reality environment 201. The extended reality system may generate the extended reality environment 201 to reproduce one or more portions of the physical environment 200 based on how the user would perceive the one or more portions in the physical environment 200. Similarly, the size and positioning of virtual objects may be determined within the extended reality environment 201 in a manner that allows the user 202 to perceive the virtual objects as if they actually existed in the physical environment 200.

[0091] like Figure 2A As shown, physical environment 200 may be a room including door 204, window 206, table 208, and book 210. Depending on the operation of the extended reality system, extended reality environment 201 may reproduce some or all of these objects or replace them with additional content. For example, user 202 may perform a first activity including interacting with book 210 (e.g., reading, drawing, etc.). The extended reality system may operate in a focus mode as described herein, which generates extended reality environment 201 in a manner designed to reduce distractions when user 202 is performing this activity. For example, the extended reality system may identify door 204 as a potential distraction to user 202 because the user may be distracted by people opening or closing the door, walking through the doorway, etc. Therefore, extended reality environment 201 may be generated to replace the door with virtual content.

[0092] like Figure 2B As shown in , an extended reality environment 201 is generated to replace a door 2004 and a window 206, a table 208, and a book 210 with virtual content. In this case, the extended reality environment 201 reproduces the room of the physical environment in an otherwise manner, but includes a virtual door 205, a virtual window 206, a virtual table 208, and a virtual book 210 to replace their corresponding real objects. The virtual objects are displayed based on the user's perspective. For example, a user can pick up a real book 210, but the extended reality environment 201 allows the user to perceive that they are holding the virtual book 210, which can allow the user to have the feeling of holding a physical book while reading virtual content.

[0093] Some of the focus modes described herein can reduce distractions by selectively replacing physical aspects of the environment with additional content such as virtual objects. In some cases, this can reduce distractions by removing the movement of one or more objects in the physical environment 200, which would otherwise cause corresponding movement in the extended reality environment 201. In the above case where the door 204 is identified as a potential distractor, the extended reality system can generate a virtual door 205 to replace the real door 204 within the extended reality environment 201. For example, even when the real door 204 opens and closes in the physical environment 200, the virtual door 205 can appear to remain closed. The virtual reality system can also include sound modification to remove the noise associated with opening and closing the door. Therefore, from the perspective of the user 202, the virtual door 205 can remain closed, and the user 202 may not know that the real door 204 has been opened or otherwise moved (and thereby reduce the possibility that the user 202 is distracted by this movement).

[0094] In another example, the virtual window 207 may be displayed to remove real action, such as a person or other object passing through the window. The virtual window 207 may be configured to display different content from the real window 206. This may include showing virtual content derived from different locations so that a user viewing through the virtual window 207 sees a different location from the physical environment 201. For example, a user may view through the virtual window 207 and see the surface of the moon or a city landscape from a different geographic region. In other cases, virtual content may be generated to reproduce the user's view from the real window 206, but under different circumstances. For example, it is raining in the physical environment outside the real window 206, but the virtual window 207 may simulate an environment that is the same as its environment during a sunny day. In this way, when rain would otherwise be seen through the real window 206, they may perceive the extended reality environment 201 as if it were not actually raining outside.

[0095] In other cases, it may be desirable to reproduce certain real objects in the extended reality environment 201. In situations where the user is engaging with real objects as part of an activity (e.g., such as when the user is reading from or drawing in the real book 210 as mentioned above), it may be desirable to reproduce these objects in the extended reality environment 201. For example, Figure 2C As shown in , an extended reality environment 201 can be generated to reproduce a physical book 210 and a table 208, while replacing other objects of the physical environment with virtual objects. As shown, the real door 204 is replaced with a virtual door 205, and the real window 206 is replaced with a virtual window 207, such as previously discussed.

[0096] In some cases, while a user is performing an activity in an extended reality environment, the extended reality system may be configured to generate virtual content associated with the activity in the extended reality environment. For example, if a user wishes to watch a movie using the extended reality system, a virtual viewing window may be presented in the extended reality environment, and the movie may be displayed on the virtual viewing window. In some cases, the virtual viewing window may occupy the entire extended reality environment to provide the user with a fully immersive experience while watching the movie. In these cases, the virtual content (e.g., the virtual viewing window) may completely obscure the user's ability to perceive the physical environment.

[0097] However, in other cases, the virtual content associated with the activity only occupies a subset of the extended reality environment that is visible to the user. In these cases, in addition to the virtual content associated with the activity, the extended reality environment may also include (e.g., reproduce) a portion of the user's environment. When the focus mode as described herein is used to modify one or more aspects of the extended reality environment as described herein, these modifications may be applied to areas of the extended reality environment that are not associated with the user's activities. Therefore, for a given activity performed by a user, the extended reality system described herein may designate certain portions of the extended reality environment as "associated with the activity" (which may include other portions of the real object or physical environment and / or reproductions or representations of additional content such as virtual objects, user interfaces, etc.), and designate other portions as "not associated with the activity" (which may include other portions of the real object or physical environment and / or reproductions or representations of additional content such as virtual objects, user interfaces, etc.). In these cases, the focus mode may operate to reduce interference in portions of the extended reality environment that are designated as not associated with the user's activities. Conversely, the focus mode may not affect portions of the extended reality environment associated with the activity, so that the extended reality system may generate these portions of the extended reality environment independently.

[0098] Figure 3 An extended reality environment 300 is shown that includes virtual content 301 in addition to aspects of a physical environment. In addition to virtual content 301, the extended reality environment 300 may include a physical environment as described herein (such as Figure 2A 300). The physical environment may include door 304, window 306, and table 308, which may be reproduced in the extended reality environment (e.g., as a direct reproduction or an indirect reproduction, depending on the extended reality system used to generate the extended reality environment 300).

[0099] Virtual content 301 may include a graphical overlay that is displayed as if it were positioned in a portion of a physical environment. In some cases, virtual content 301 may be associated with an activity as described above, and a user may interact with virtual content 301 in an extended reality environment. Figure 3In the illustrated variation, virtual content 301 includes a user interface that allows a user to select operating parameters of the extended reality system and may provide options that the user may select to provide input to the extended reality system. For example, virtual content 301 may display information to the user about various focus modes that may be implemented by the extended reality system. For example, virtual content 301 may display potentially disruptive objects in the physical environment (e.g., using gaze detection) and present options for confirming / rejecting whether these objects should be classified as disruptive, setting disruption criteria for these objects, classifying one or more of these objects, and the like, as will be described in detail below. Thus, virtual content 301 may be displayed in an extended reality environment to allow a user to view information about the extended reality system and provide input to the extended reality system.

[0100] In the case where virtual content 301 is designated as being associated with user activity, some or all of the areas of the physical environment reproduced in virtual environment 300 may be designed not to be associated with user activity. In these cases, focus mode may operate to reduce distractions in areas of extended reality environment 300.

[0101] In some embodiments, the technology described herein is incorporated into a system including a head-mounted display and a set of sensors that receive imaging data of the physical environment around the user, detect the user's activities, and / or detect the user's physiological parameters. The system can operate in a focus mode that identifies interfering objects in the physiological environment and generates an extended reality environment that replaces the interfering objects with additional content (e.g., replacing the object with a different virtual object, modifying the appearance of the object, or removing the object from the extended reality environment). The system can determine the interference metric of the object in the physical environment and compare the interference metric with the interference criteria to determine whether a specific object should be replaced with additional content. In some cases, the interference criteria can be based on the user's activities. For example, activities that require higher concentration may have interference criteria that are easier to meet and may result in more objects being replaced with additional content. Activities that require lower concentration may have interference criteria that are more difficult to meet and may result in fewer objects being replaced with virtual content.

[0102] The system may replace one or more objects with additional content in a variety of ways. In some cases, the system may remove disruptive objects within the extended reality environment. For example, the system may generate an extended reality environment that reproduces one or more areas of the physical environment, but removes objects from the extended reality environment. This may include generating virtual content to replace the objects, where the virtual content "fills in" the areas of the extended reality environment where the objects would be. In other cases, the virtual content may include virtual objects that replace real objects. Virtual objects may be different from virtual objects and are selected to be objects that are considered less disruptive to the user.

[0103] Figure 4 An example process 400 is shown for identifying an object that meets interference criteria and generating an extended reality environment that replaces the object with additional content. Process 400 may be performed by an extended reality system described herein.

[0104] At operation 402, process 400 may include entering a focus mode in an extended reality environment. The focus mode may generate an extended reality environment that reduces distractions in the physical environment around the user. In some cases, the focus mode may be triggered by one or more activation criteria. The activation criteria may be based on the user's current activity, and the focus mode may be initiated in response to the user being involved in a specific activity. The extended reality system may monitor the user's physiological parameters and / or retrieve other information to determine whether the user is engaged in a specific activity. For example, sensor data may indicate that the user is focusing on a specific object such as a book and / or a computer screen, which may indicate that the user is performing an activity that requires a high degree of concentration. In some cases, the extended reality system may access calendar data, email data, and / or other data associated with the user to determine the specific activity and / or activity type that the user is performing. In other cases, the user may select and initiate an activity (e.g., a game, a productivity application, etc.) within the extended reality environment.

[0105] The extended reality system can be configured to initiate a focus mode in response to the user being engaged in a defined activity and / or activity type. For example, the extended reality system can recognize that the user is reading a book and determine that reading is an activity associated with the activation criteria for initiating a focus mode. Therefore, the system can enter a focus mode to generate an extended reality environment that reduces distractions around the user.

[0106] At operation 404, process 400 may include identifying objects within the physical environment that meet the distraction criteria. The focus mode may be configured to generate an extended reality environment that removes, replaces, or otherwise modifies objects that are determined to be distracting to the user. In some cases, the extended reality system may monitor the user's interaction with the physical environment to identify objects that distract the user (e.g., divert the user's attention from a current activity). For example, the extended reality system may include sensors that monitor the user's gaze and sensors that image the physical environment around the user. The output of these sensors can be used to determine the specific object that the user is focusing on and the amount of time the user is focusing on the specific object.

[0107] The focus mode may include parameters for identifying objects to be replaced with additional content, and these parameters together form interference criteria used by the extended reality to identify these objects. For example, the interference criteria may include object type criteria, so that if the object is determined to be a specific type of object (e.g., an animal, a person, a television), the extended reality system will replace the real object with additional content. Additionally or alternatively, the interference criteria may include motion criteria, so that the extended reality replaces objects with a certain level or type of motion (e.g., a rotating fan, a bouncing ball). Additionally or alternatively, the interference criteria may include brightness criteria, so that the extended reality system will replace objects with a specific brightness or brightness change (e.g., a flashing LED, a TV screen playing dynamic content). It should be understood that, depending on the interference criteria, a given real object may only need to meet a single parameter (e.g., an object type criterion) or multiple parameters (e.g., an object type criterion and a motion criterion, such as a dog walking through the room) before the extended reality system replaces the object with additional content in the extended reality environment.

[0108] The parameters that constitute the distraction criteria may be based on the specific activity that the user is performing, the specific focus mode of the activity, and / or the user's attention state. Thus, a given focus mode may apply different distraction criteria for different activities that the user is performing. For example, a given focus mode may apply less stringent distraction criteria when the user is studying than when the user is cooking, so that a wider range of the real world will be replaced with additional content when the user is studying. In other cases, a given focus mode may apply different distraction criteria for different attention states of the user. For example, a given focus mode may apply less stringent distraction criteria when the user is tired than when the user is alert. In general, the extended reality system can customize the amount of distraction reduction provided by the system in different environments.

[0109] At operation 406, process 400 may include selecting additional content to be used to replace the real object in the extended reality environment. For example, in some cases, the additional content includes virtual content that is generated to make it appear as if the object has been removed from the physical environment. For example, if the real object is a television that is placed mounted on a wall, virtual content may be generated to replace the television with a representation of a portion of the wall. In some cases, this virtual content may be generated from an image of the same physical environment captured at an earlier time when the virtual object was not present. Additionally or alternatively, information from other portions of the physical environment may be used to interpolate the virtual content.

[0110] In other cases, the additional content includes virtual objects, so that the user perceives that the real objects have been replaced with virtual objects within the extended reality environment. For example, in the case of a real television, an extended reality system, the content may be a static virtual object such as a poster, a picture, a painting, etc. In some cases, the virtual object may be an object of the same type as the real object. For example, if the real television is showing dynamic content such as a movie, the virtual object may be a virtual television that replaces the real television in the extended reality environment.

[0111] In other cases, the additional content includes virtual content that covers at least a portion of a real object to make it appear as if the real object is in a different state. In these cases, the extended reality environment may include a reproduction of a portion of the object, while another portion of the object is replaced with the virtual content. In the case of a real television displaying dynamic content, this may include replacing the screen of the television with virtual content (e.g., a blank screen) in the extended reality environment. In this way, the user may still see a reproduction of a portion of the real television (e.g., a border / frame) in the extended reality environment, but may perceive the television as being turned off, even though it is turned on in the physical environment.

[0112] Additional content may be selected based on the type of object and / or one or more characteristics associated with the object. As a non-limiting example, a television displaying dynamic content may have its screen replaced with virtual content, while a phone displaying dynamic content may be completely replaced with a virtual object. As another non-limiting example, a moving object (such as a cat walking through a room) may be "removed" from the room along with the virtual content, while a stationary object (such as a toy) may be replaced with a virtual object. Thus, objects that meet the distraction criteria may be assigned or otherwise associated with a category (or categories) (such as object type, object size) for selecting additional content.

[0113] In some cases, the additional content associated with a given classification may be determined at least in part by the user. For example, a user may configure the system to replace a particular type of object (e.g., a television) with a particular virtual object (e.g., a painting) and / or a category of virtual content (e.g., a classic work of art). Additionally or alternatively, the system may select or adjust additional content associated with certain classifications based on learning from the user. For example, the extended reality system may sense the user's interactions with real objects and / or virtual objects over time and determine that certain objects and / or object types are less disruptive to the user. In this way, the extended reality system may prioritize the use of these objects and / or object types as additional content that replaces more disruptive objects.

[0114] At operation 408, process 400 may include generating an extended reality environment that includes a reproduction of an area of ​​the physical environment and in which the particular object identified as meeting the interference criteria is replaced with the additional virtual content identified at operation 406. As previously discussed, this may include generating an extended reality environment that makes it appear as if the virtual object no longer exists (e.g., interpolating or simulating an area of ​​the physical environment to replace the real environment). In other cases, the extended reality environment may be generated to replace the particular object (or a portion thereof) with the identified virtual object.

[0115] In other cases, the extended reality system may modify a particular object to provide a modified representation of the object within the extended reality environment. For example, in the case of a television displaying dynamic content, the dynamic content may be blurred to make it more difficult for the user to focus on the dynamic content. In other cases, a moving object may be filtered in such a way that it appears to be moving slowly. For example, a flickering light may be replaced with a modified representation that uses the average intensity of the light over the previous time period (which may make the light appear to be pulsating slowly or have a constant intensity).

[0116] Figure 5A and Figure 5B An example of identifying distracting objects in a physical environment 500 and replacing the objects with virtual content in an extended reality environment 501 is shown. Extended reality environment 501 may be an example of an extended reality environment as described herein and include virtual content that may be displayed within the context of the physical environment and / or replace one or more portions of the physical environment.

[0117] Figure 5A An example of a physical environment 500 is shown that includes real objects such as a door 504, a window 506, a table 508, a light fixture 510, and a television 512. As described herein (e.g., with respect to process 400), an extended reality system can enter a focus mode and identify one or more real objects that meet interference criteria. In this example, the extended reality system can identify that light fixture 510 and television 512 meet interference criteria associated with a focus mode, as described herein.

[0118] Figure 5B An example of an extended reality environment 501 generated during a focus mode is shown. The extended reality environment 501 can reproduce one or more areas of the physical environment 500, which can include generating a reproduction of real objects in the physical environment. For example, the extended reality environment 501 can include a reproduction of a door 504, a window 506, and a table 508, which can be generated to appear as real objects. Representations of these objects can be generated from imaging data of the physical environment obtained using one or more sensors as described herein.

[0119] The generated virtual reality environment 501 may also include additional virtual objects, including a virtual flower 511 and a virtual clock 513 that replace objects that meet the interference criteria. For example, the virtual flower 511 may replace the light fixture 510, and the virtual clock 513 may replace the television 512. In some cases, the virtual objects may be selected based on one or more physical characteristics of the real objects. For example, the virtual flower 511 may have size parameters similar to the size parameters of the light fixture 510, and the virtual clock 513 may have size parameters similar to the television 512. This may help prevent the user from accidentally interacting with (e.g., bumping or otherwise contacting) the real light fixture 510 and the television 512, because the user may perceive the presence of objects (i.e., the virtual flower 511 and the virtual clock 510) at these locations.

[0120] In some cases, the extended reality system described herein may dynamically update the interference criteria to change which types of objects will meet the interference criteria. For example, some embodiments as described herein relate to a system with a head-mounted device, the head-mounted device including a display, a first set of sensors that can detect the physical environment around the user, and a second set of sensors that can measure the physiological parameters of the user. The system may operate in a first mode to identify and classify interfering objects. In the first mode, the system may generate and display an extended reality environment including a reproduction of the physical environment around the user. The system may operate a second set of sensors to detect the user's engagement with objects in the extended reality environment and assign interference types to various objects. For example, an object that the user focuses on for a threshold duration may be assigned an interference type. The assigned interference type can then be used to identify and remove and / or modify real objects reproduced in the second mode. For example, the system may initiate a focus mode that generates an extended reality environment with reduced interference. In the focus mode, the system may use the assigned interference type to identify objects that should be replaced with additional content (e.g., removed from the extended reality environment, modified in the extended reality environment, replaced with less interfering objects, etc.). Thus, since different people may find different types of objects to be distracting, the system can learn over time what types of objects are distracting to a given user.

[0121] In some cases, when operating in the first detection mode, the user's gaze can be used to determine whether an object should be assigned a distraction type. For example, if a user gazes at an object for an amount of time that satisfies a time threshold, the system can assign a distraction type to the object, which can be used in the focus mode to determine whether the object should be replaced with additional content. The focus mode can have different thresholds / criteria for replacing objects. Each time a focus mode can be initiated, the focus mode can be associated with a level of focus, which can be based on the focus requirements of the activity or task. The system can identify distraction types based on the focus mode. Thus, in some cases, the system can replace an object with a particular distraction type while reproducing the object with another distraction type.

[0122] Figure 6 An example process 600 is shown for assigning distraction types to objects within a physical environment and generating an extended reality environment that uses the assigned distraction types to replace specific objects with additional content. Process 600 may be performed by the extended reality system described herein.

[0123] At operation 602, process 600 may include generating and displaying an extended reality environment that reproduces one or more portions of a physical environment. The extended reality may be generated and display virtual objects to a user in a manner such that the virtual objects mimic the appearance and layout of the physical environment. The extended reality environment may be generated to determine which objects within the physical environment will be associated with interference criteria for the user.

[0124] At operation 604, process 600 may include detecting a user's engagement with one or more objects in an extended reality environment. The extended reality system may be configured to detect a user's engagement with one or more objects (or object types) that meet one or more selection criteria, which indicate that these objects (or object types) are considered to be distracting to the user. For example, the extended reality system may monitor user parameters (e.g., user gaze) to identify the object that the user is focusing on and determine whether the user's focus meets one or more selection criteria. In some cases, the selection criteria may include the length of time the user looks at the object, the frequency with which the user looks at the object, the frequency with which the user touches the object or otherwise physically interacts with the object (e.g., the frequency with which the user picks up their phone), and / or any other suitable parameters. In some cases, the system may monitor one or more physiological metrics of the user (e.g., breathing rate, heart rate, pupil dilation, combinations thereof, etc.) while the user is engaging with the object, and these metrics may be used to determine whether the user's engagement with the object meets the selection criteria.

[0125] At operation 606, process 600 may include assigning a distraction type to one or more objects in the extended reality environment. For example, objects that meet certain selection criteria described above may be assigned a distraction type. Generally speaking, a distraction type is a designation that applies to a group of objects and may be used by the extended reality system to determine how a focus mode will change objects from the group within a given focus mode. In some cases, the system may determine that a particular type of object is distracting the user and, therefore, may assign a distraction type to the particular type of object.

[0126] For example, if it is determined that the user is distracted by a ceiling fan, the extended reality system may assign a distraction type of "furniture" to the ceiling fans detected in the user's physical environment. The "furniture" distraction type may also include other types of appliances determined to be distracting to the user, such as standing fans, mobile devices, or wind chimes. A given focus mode may be configured to use a particular technique to replace objects with the "furniture" distraction type with additional content, such that any real objects determined to fall under that distraction type will be replaced in the extended reality environment with additional content selected using the particular technique.

[0127] In other cases, the extended reality system may assign a distraction type based on the motion and / or one or more other characteristics of a given object. In one example, the system may determine that an object is distracting based on how the object reflects light, and may assign a "reflective object" distraction type to an object with high reflectivity. In another embodiment, the system may determine that an object that undergoes a specific type of repetitive motion is distracting to the user (regardless of the underlying object). In these cases, objects that are determined to meet the specific criteria for that repetitive motion are assigned a "repetitive motion" distraction type.

[0128] Other examples include distraction types assigned to objects (such as televisions or mobile phones) that display dynamic visual content (e.g., media, games, user interfaces, etc.). Another example distraction type may be used to identify specific types of sounds, such as alarms and / or alerts. However, other types of distractions may classify objects based on other parameters (such as size and shape). In some cases, the distraction type may specify both the type of object and the movement or characteristics of the object. For example, a rotating ceiling fan may be assigned a "moving furniture" distraction type, while a fixed ceiling fan may be assigned a different distraction type (e.g., the "furniture" distraction type mentioned above) or may not be assigned a distraction type.

[0129] In some cases, the distraction type may classify the degree / severity of distraction caused (or expected to be caused) by the object. Different distraction criteria may be used to classify objects into different distraction types. For example, objects that cause a larger amount of distraction may be assigned to certain "higher distraction" distraction types, while objects that cause less distraction may be assigned to other "lower distraction" distraction types. Therefore, certain focus modes may be configured to identify one or more distraction types that fall into these distraction types (e.g., using distraction criteria as previously discussed) and replace these objects with additional content in the extended reality environment. For example, one focus mode may only replace objects that fall into the "higher distraction" distraction type, while another focus mode may replace objects that fall into both the "higher distraction" and "lower distraction" distraction types.

[0130] The assigned distraction types for objects may be saved by the extended reality system to later identify objects that should be replaced with additional content in focus mode. In some cases, distraction types are associated with specific users of the system, such that certain focus modes may operate differently for different users. Additionally or alternatively, different focus modes may be configured to remove objects with specific distraction types. Thus, the extended reality environment generated for a focus mode may be based on both user-specific distraction types and / or a specific focus mode selected by the extended reality environment.

[0131] At operation 608, process 600 may include entering a focus mode that reduces distractions in the extended reality environment. While in focus mode, the extended reality system may use one or more sensors to acquire imaging data of the physical environment around the user, as described herein. Focus mode may be initiated by the user, or may be automatically initiated by the extended reality system when certain criteria are met (e.g., a particular activity has been initiated).

[0132] At operation 610, process 600 may include identifying a target object of the physical environment associated with the assigned distraction type. The extended reality system may receive imaging data and use the imaging data to identify an object in the physical environment. For example, the extended reality system may use a machine vision system to identify and classify objects in the physical environment. The extended reality system may determine whether the identified target object is associated with the assigned distraction type. If the target object is determined to be associated with the assigned distraction type, the extended reality system may determine that the target object should be replaced with additional content in the extended reality environment.

[0133] For example, if a ceiling fan is assigned a distraction type (e.g., a "furniture" distraction type) at operation 606 as previously discussed, the focus mode selected at operation 608 may look for instances of the ceiling fan in the physical environment (as well as any other objects that are also assigned the "furniture" distraction type). The ceiling fan identified in the physical environment, as a result of being assigned to the distraction type, may be replaced with additional content in the extended reality environment. A given focus mode may look for objects associated with multiple different distraction types, and different additional content may be selected depending on the distraction type.

[0134] At operation 612, process 600 may include generating an extended reality environment to replace the identified target object with the additional content. The extended reality environment may be generated to remove the target object from the extended reality environment, replace the target object with a different virtual object, and / or modify the target object in the virtual environment, as described herein.

[0135] Although the extended reality systems described herein may be configured to automatically associate certain objects with distraction types, and thereby set distraction criteria for determining whether a given object is replaced with additional content. Figure 7 An example user interface 700 for assigning objects to interference types is shown. The user interface 700 can be displayed in an extended reality system on a head-mounted display and provides controls for assigning interference types to objects within a physical environment. The assigned interference criteria can be used to generate an extended reality environment, as described herein.

[0136] The user interface 700 may include a preview portion 702 and one or more parameters 704 associated with the object and an option 706 to assign the object to a particular distraction type and / or focus mode. The preview portion 702 may include an image of the identified object from the physical environment, which may be generated using imaging data from one or more sensors of the extended reality system.

[0137] Parameters 704 may include pre-populated data determined by the extended reality system and presented to the user in the user interface 700. The user may change one or more of the parameters 704, which will affect how the extended reality system manages the object and / or similar objects. Parameters 704 may be initially determined by the extended reality system (e.g., using machine vision, machine learning, and / or other suitable techniques), and the initial determination may be presented in the user interface 700. For example, the first parameter 704a may include an object classification that identifies the classification (i.e., object type) to which the object belongs. The first parameter 704a may be updated by the user of the extended reality system, such as if the extended reality system mischaracterizes the object (e.g., classifies a real cat as a dog). In some cases, the user may use a voice command to confirm or change the first parameter. Additionally or alternatively, the user interface (e.g., the first parameter 704a) may display a list of suggested object types from which the user may select. For example, in response to the user indicating a change to the first parameter 704a, the user interface may display an additional menu including a list of different classifications from which the user may select.

[0138] In some cases, an object may be associated with multiple classifications that may have different hierarchical relationships. These classifications may have a hierarchical structure that includes definitions of broader and / or narrower classifications. For example, a "light fixtures" classification may be a subset of a larger "furniture" classification, which may be at a higher hierarchical level. Thus, assigning an object to a particular classification may also assign the object to a higher-level classification with a related hierarchical structure (e.g., an object assigned to the light fixtures classification will also be assigned to the furniture classification). The extended reality system may identify objects at different hierarchical levels depending on the focus mode. For example, in a first focus mode, the extended reality system may be configured to identify all objects that fall into the "light fixtures" classification and replace those objects with different additional content (but not necessarily all objects that fall into the "furniture" classification). In a second focus mode, the extended reality system may be configured to identify all objects that fall into the "furniture" classification and replace those objects with different additional content.

[0139] The second parameter 704b can be displayed in the user interface 700 and includes a distraction type that can be assigned to the object. The distraction type can be used by the extended reality system to determine whether the object should be replaced with additional content, such as described above with respect to Figure 6 For example, some focus modes may be configured to replace objects with a particular distraction type with additional content while reproducing other objects that do not have that distraction type. In some cases, objects with the same classification may have different distraction types (e.g., two items within the "furniture" classification may be assigned different distraction types). Thus, the extended reality system may generate an extended reality environment in which a first object with a particular classification is reproduced and a second object with the same particular classification is replaced with additional content. Objects may be assigned multiple distraction types.

[0140] The user may update the second parameter 704b, which may include selecting additional or alternative interference types from a set of predefined interference types and / or creating new interference types.

[0141] The third parameter 704c may include a degree of interference, which may be a measure of determining the degree of interference of a particular object to a user. The degree of interference may be determined by one or more sensors that monitor the user's interaction with the object in a physical and / or extended reality environment (e.g., gaze detection) and / or a physical parameter of the user (e.g., changes in heart rate, breathing rate, eye movement, muscle tension, posture, or any other suitable parameter). The degree of interference may characterize the amount of time a user focuses on an object. The degree of interference may be used by the extended reality system as part of an interference criterion to determine whether to replace an object with additional content or to reproduce the object in an extended reality environment. As described herein, different focus modes may define different degree of interference thresholds for determining whether an object should be reproduced or replaced. If the user wants the extended reality system to treat a particular object as more or less interfering than its current setting, the third parameter 704c may be modified by the user through interaction with the extended reality system.

[0142] The parameters 704 shown in the user interface are provided as examples, and the user interface may include additional or different parameters. In some cases, the extended reality may associate parameters with an object that are not modifiable by the user and may or may not be displayed in the user interface 700. For example, the extended reality system may determine certain characteristics of a particular object (e.g., size, color, etc.) that are not presented to the user, or are presented to the user without allowing the user to change the determined characteristics. These determined characteristics may also be used as interference criteria when deciding whether to replace an object with additional content in an extended reality environment.

[0143] The option 706 to assign an object to a particular focus mode may allow a user to have the system automatically replace the object with additional content when operating in that focus mode. For example, the user interface may display one or more focus modes (e.g., FM-02) assigned to the object. When the extended reality system is operating in one of those focus modes, the object may be replaced with additional content regardless of whether the other parameters 704 meet the distraction criteria.

[0144] As previously mentioned, the extended reality system described herein may operate in different focus modes at different times. For example, embodiments also relate to a method for operating a head mounted device in a focus mode that reduces distractions in an extended reality environment. The method may include operating in different focus modes that have different distraction criteria for determining whether an object should be replaced with additional content in the extended reality environment. For example, a first focus mode may have a first distraction criterion, and when operating in the first focus mode, the system may determine that a particular object does not meet the first distraction criterion. When operating in the first focus mode, the system may reproduce a physical environment including a representation of a particular object in the extended reality environment. A second focus mode may have a second distraction criterion, and when operating in the second focus mode, the system may determine that a particular object does meet the second distraction criterion. When operating in the second focus mode, the system may generate an extended reality environment that reproduces the physical environment and replaces the particular object with additional content. Thus, different focus modes may be configured with different thresholds and / or criteria for modifying, replacing, or removing real objects within the extended reality environment.

[0145] Figure 8 An example user interface 800 is shown for setting distraction criteria for various focus modes, which can be implemented by the extended reality system described herein. The user interface 800 can be displayed on a head mounted display of the extended reality system and provides controls for assigning distraction criteria to objects within the physical environment.

[0146] User interface 800 may include a first area 802 for identifying and / or selecting a focus mode for which distraction criteria will be defined. Area 804 elements may display the name of the focus mode and / or provide options for changing between different focus modes. For example, a user may use voice commands or other input to select a particular focus mode (e.g., a "dynamic object" focus mode) to set one or more distraction criteria.

[0147] The user interface 800 may include a second area 804 that can be used to assign distraction criteria to one or more focus modes. Figure 8 In the example shown, the distraction criteria may include object categories, which may define one or more object categories that will be replaced with additional content when operating in a specified focus mode. In other examples, the second area 804 may be selected to display other distraction criteria and / or the user interface may include other areas for additional distraction criteria. For example, the user interface may display a user interface for defining distraction types (e.g., as shown in FIG. Figure 7The user may be able to interact with the interface to select one or more defined options. For example, the user may select the first object category 806a (e.g., "display") and the second object category 806b ("doors / windows"), while the third object category 806c (e.g., "animals") and the fourth object category 806d ("lights") remain unselected.

[0148] The selected object class 806 (and / or distraction type) can be used to determine which objects will be replaced with additional content to generate an extended reality environment when operating in a specified focus mode. For example, the extended reality system can use the first distraction classification 806a and the second distraction classification 806b to identify objects that have displays (e.g., televisions, computers, etc.) and windows and doors within the physical environment. When the extended reality system is operating in the first focus mode, the extended reality system can replace these objects with additional content to reduce distractions in the extended reality environment. For example, an extended reality environment can be generated to replace any display with other objects such as pictures, make the display appear to be turned off, or remove devices from the extended reality environment. As another example, an extended reality environment can be generated to remove distractions caused by opening a door and / or movement in a window by generating additional content that makes the door appear to remain closed when it is opened and / or removes movement through the window, such as a person walking by the window.

[0149] Fig. 9 An example user interface 900 is shown that presents a recommended focus mode and includes an option for a user to select between different focus modes. User interface 900 can be displayed on a head mounted display of an extended reality system described herein.

[0150] The user interface 900 may include a first area 902 presenting a suggested focus mode that can be used to generate an extended reality environment. In some cases, the suggested focus mode may be based on the user's activity. For example, the extended reality system may determine the current activity or the activity that the user is about to start, and select a focus mode based on the determined activity. In some cases, the extended reality system may use sensor data to determine the user's activity. For example, the extended reality system may use imaging data, accelerometer data, temperature data, and / or any other suitable data to determine the activity. Additionally or alternatively, the extended reality system may access a data source such as a calendar application to determine the activity. In some cases, the system may prompt the user to identify and / or confirm the activity, or the user may otherwise indicate the activity.

[0151] In some cases, the suggested focus mode is based on the level of focus required for the activity. For example, the extended reality system can associate a particular activity with a level of focus. Activities that require a greater level of focus can be associated with a higher level of focus, and activities that require less focus can be assigned a lower level of focus. The focus mode suggestions in the first area can be based on the level of focus associated with the identified user's current or upcoming activities. For example, for an activity with a higher level of focus, the extended reality system can identify and suggest a focus mode that removes more distractions in the extended reality environment.

[0152] The user interface 900 may include a preview area 904 that displays a preview of the extended reality environment as adjusted using the suggested focus mode. For example, if the suggested focus mode is configured to replace a specific object with additional content, the preview area 904 may display the extended reality environment to show the effect of replacing the specific object with the additional content. If the user selects a different focus mode in the suggested first area 902, the preview area 904 may be updated to show the extended reality environment according to the focus mode selected by the user.

[0153] User interface 900 can include first interface element 906 that initiates the suggested focus mode. In response to user selection of the first interface element, the extended reality system can generate an extended reality environment according to the suggested focus mode and display the extended reality environment on the head mounted display, as described herein.

[0154] User interface 900 may include a second interface element 908 that can be used to edit (or navigate to a new menu that allows the user to edit) one or more parameters of the suggested focus mode. In some cases, the user may see the extended reality environment in preview area 904 and desire to change aspects of how the extended reality environment is generated. Therefore, in response to selecting the second interface element, the extended reality system can be configured to display a user interface for modifying the suggested focus mode.

[0155] Fig.10 An example user interface 1000 for identifying and / or modifying the sounds of an extended reality environment is shown. User interface 1000 may be displayed on a head mounted display of an extended reality system as described herein. In some cases, the extended reality system may be configured to sense sounds in a physical environment and block, modify, and / or replace the detected sounds. User interface 1000 may allow a user to define operating parameters for how the extended reality system responds to detected sounds. In some cases, specific sound modification settings may be associated with specific focus modes and, thereby, with specific display settings for addressing how objects are displayed in an extended reality environment. In other cases, a user may independently pick or select sound modification settings that are independent of a visual-based extended reality environment.

[0156] The user interface 1000 may include a first area 1002 indicating sounds identified by the extended reality system for later modification. In some cases, the extended reality system may identify sounds within the physical environment and display the identified sounds in the first area 1002 of the user interface. The extended reality may be configured with one or more criteria for identifying whether a sound is potentially disruptive, which may then be displayed to the user in the user interface 1000. In some cases, the extended reality system may identify sounds using parameters defined such as intensity level, duration, pitch, frequency, and the like. In other cases, the extended reality system may use a machine learning component to identify specific sounds. For example, the machine learning component may output identification of sounds such as sirens, alarms, construction noises, birdsong, and the like. The extended reality system may be configured with a set of defined sounds that are modified by the system.

[0157] In some cases, the extended reality system may be configured with specific rules for resolving different recognized sounds. For example, the extended reality system may always emit a siren or other emergency sound to the user. For example, when the extended reality system is operating in focus mode, other sounds such as alarms may be delayed and / or modified to reduce interference. In some cases, the extended reality may allow the user to modify or define how to modify a particular sound or sound category. In some cases, when a new sound is detected, a user interface 1000 with the recognized sound may be displayed to the user. In other cases, the extended reality system may set initial parameters for resolving the recognized sound and prompt the user to modify these parameters (e.g., using user interface 1000).

[0158] The user interface 1000 may include a second area 1004 for setting parameters for modifying the recognized sound. The second area may include various controls that the user can set, some of which are in the Fig.10 . For example, the second area 1004 may include a noise cancellation control, and the user may select the noise cancellation control to remove a specific sound when in focus mode. In some cases, the noise cancellation control may have different options for how it modifies the sound. For example, the noise cancellation control may allow the sound to be removed so that the user cannot hear it. The second area may also include a control for modifying the volume of a specific sound. For example, a volume control may cause the extended reality system to reduce the volume level of the sound emitted to the user. Therefore, the user can still hear the sound, but the volume is reduced. In other examples, the second area 1004 may allow the user to replace the sound with a different noise.

[0159] Fig.11An example process 1100 for modifying an object within an extended reality environment based on a user's activity is shown. In some cases, the process can be automatic, and the extended reality system can automatically enter a new focus mode or can automatically prompt the user to confirm entering the focus mode. Process 1100 can be performed by an extended reality system including the extended reality system described herein.

[0160] At operation 1102, process 1100 may include determining an activity associated with the user. In some cases, the activity may be a current activity, and in other cases, the activity may be a future activity, such as an activity that the user is about to start. The extended reality may determine the activity in various ways. In some cases, the user may indicate the activity, for example, using an interface of the extended reality system. In other cases, the extended reality system may determine the activity using one or more sensors and / or other data sources. The extended reality system may prompt the user to confirm whether the identified activity is correct and / or provide the user with the option to correct or specify a different activity.

[0161] In some cases, the extended reality system may use calendar data to determine the user's activities. For example, the extended reality system may access the user's digital calendar to determine whether the user has scheduled any activities. For example, the calendar data may indicate that the user has an upcoming scheduled event. In some cases, the extended reality system may use sensor data to determine when the user begins an activity. For example, imaging data may be used to identify environmental aspects that indicate that the user is in or enters a physical environment associated with an activity. Additionally or alternatively, other sensor data may be used, such as accelerometer data, which may be used to identify motion associated with a particular activity.

[0162] In other cases, historical data can be used to predict activities. For example, the system can track the user's interactions with the system and use that data to determine when the user is engaged in a particular activity or will be engaged in a particular activity. For example, if a user performs an activity and initiates a particular focus mode on a regular schedule, the extended reality system can track that usage and use it to determine when future activities will occur.

[0163] At operation 1104, process 1100 may include selecting a focus mode based on an activity. In some cases, the system may have a defined association between a particular activity and a particular focus mode. Thus, in response to determining that the user is engaging in a particular activity, the system may initiate a particular focus mode associated with the activity. In other cases, the system may select a focus mode based on historical data. For example, the system may determine that each time the user engages in a particular activity, the user selects a particular focus mode. In this example, the system may suggest the focus mode and / or automatically initiate the focus mode in response to determining that the user is engaging in the activity or will engage in the activity.

[0164] At operation 1106, process 1100 may include generating an extended reality environment according to a second focus mode. In some cases, the extended reality system may automatically generate and display an extended reality environment in response to detecting that the user is initiating and / or has performed an activity. In some cases, the system may prompt the user to begin a focus mode. For example, the system may display an indication of a selected focus mode to the user and require the user to provide input to the system to begin the selected focus mode.

[0165] Fig.12 An example process 1200 is shown for selecting to activate a different focus mode or modifying a focus mode within an extended reality environment based on a determined level of focus. Process 1200 may be performed by an extended reality system including the extended reality systems described herein.

[0166] At operation 1202, process 1200 may include determining a desired level of focus for a user, which may represent how much attention the user desires (or is expected) to direct to a given task. Thus, a higher level of focus represents a desired level of attention, and thus the extended reality system will take a more comprehensive approach to reducing distractions. The desired level of focus may be selected from a discrete number of options and may be represented as a numerical value (e.g., from 0 to 100), a characterization (e.g., "high," "medium," or "low"), and the like.

[0167] In some cases, the required level of concentration may be based on the activity that the user is performing or about to perform. The extended reality system may associate different activities with different required levels of concentration. In some cases, the level of concentration for an activity may be user-defined, and in other cases, the system may determine the level of concentration, for example, using sensor data. For example, the extended reality system may monitor parameters of the user, such as eye movement, the amount of time focused on an object associated with the activity, physiological parameters such as breathing, user movement (e.g., using accelerometer signals), and the like. The monitored parameters may be used to assign a required level of concentration to an activity. For example, if the user's gaze is focused on a particular object for most of the time in the activity, the extended reality system may determine that the activity requires a higher level of concentration.

[0168] In other cases, the required level of concentration may be set by the user in response to initiating an extended reality environment or a specific activity within an extended reality environment. The extended reality system may display different levels of concentration to the user, and the user may select the desired level of concentration. In other cases, the extended reality system may determine the required level of concentration based on the user's state. For example, the system may obtain information about the amount of activity the user has performed that day, the user's sleep data, and / or other metrics to determine whether the user may be easily distracted. For example, if the system determines that the user has performed a large amount of activity that day (e.g., compared to other days) and / or the user is tired (e.g., due to less than an average amount of sleep), the system may determine to select a higher required level of concentration. That is, performing a large amount of activity or fatigue in a day may make the user more easily distracted. Therefore, in some cases, the system may be configured to select a higher level of concentration to take this factor into account.

[0169] At operation 1204, process 1200 may include selecting a focus mode based on the desired concentration level. In some cases, the extended reality system may select a focus mode that removes more potentially disruptive objects by replacing objects with additional content for higher desired concentration levels. In these examples, as the concentration level increases, the range of objects replaced with additional content may increase. In some cases, the extended reality may be configured to have a defined limit on the number of objects replaced with additional content. The defined limit may be used to prevent the extended reality from becoming different from the physical environment.

[0170] The extended reality system may select a subset of focus modes based on the desired concentration level and present those focus modes to the user for the user to select a particular focus mode. For example, each focus mode may be associated with a concentration level or a range of concentration levels. The extended reality system may identify which focus modes correspond to the user's desired concentration level (e.g., determined at operation 1202) and display those focus modes to the user.

[0171] At operation 1206, process 1200 may include generating an extended reality environment according to the selected focus mode. In some cases, the extended reality system may automatically generate and display the extended reality environment in response to determining a particular focus mode or the user selecting a particular focus mode. In some cases, the system may prompt the user to begin the focus mode. For example, the system may display an indication of the selected focus mode to the user and require the user to provide input to the system to begin the selected focus mode.

[0172] Fig.13 An example process 1300 is shown for detecting and replacing objects in an extended reality environment based on a user-selected focus mode. Process 1300 may be performed by an extended reality system including an extended reality system described herein.

[0173] At operation 1302, the system may include displaying a set of focus modes to a user. In some cases, the set of focus modes may include all focus modes available to the user. In other cases, the system may identify a subset of focus modes, for example, based on activity and / or level of focus, and display the subset of focus modes. In some cases, the focus modes may be organized into different categories, which may be based on the effects provided by the focus modes. For example, one or more focus modes may cause an extended reality environment that replaces dynamic content on a screen with static content, removes distractions from a television, other computers (e.g., not associated with the current activity), etc. The categories of focus modes may be presented to the user.

[0174] In other examples, the system may determine a focus mode to suggest to the user based on the user's previous interactions with the extended reality system. For example, if the user selects a particular focus mode every time they perform a particular activity, the extended reality system may recognize that routine and suggest the particular focus mode to the user.

[0175] At operation 1304, process 1300 may include receiving, at the extended reality system, a selection of a particular focus mode. The user may select the particular focus mode in a variety of ways including voice commands, gestures, using interface controls, and the like.

[0176] At operation 1306, the process may include generating an extended reality environment according to the selected focus mode. In some cases, the extended reality system may generate and display the extended reality environment in response to the user selecting a particular focus mode. In some cases, the system may prompt the user to begin the focus mode. For example, the system may display an indication of the selected focus mode to the user and require the user to provide input to the system to begin the selected focus mode.

[0177] Fig.14 An example process 1400 is shown for recommending a focus mode at an extended reality system based on a user's environment. Process 1400 may be performed by an extended reality system including an extended reality system described herein.

[0178] At operation 1402, process 1400 may include detecting aspects of the physical environment that may be used to identify one or more focus modes. The extended reality system may evaluate the environment to identify the number, type, and / or degree of distractions present in the environment. In some cases, the system may select one or more focus modes to present to the user based on the current conditions of the environment. For example, if the extended reality system detects high levels of noise and activity, the system may select a focus mode that removes both noise and dynamic objects. In other cases, the system may detect an object that has been determined to be particularly distracting to the user, and may select a focus mode that causes the object to be replaced by additional content in the extended reality environment.

[0179] At operation 1404, process 1400 may include presenting a selected focus mode to the user based on conditions present in the physical environment. In some cases, the extended reality system may continue to monitor and evaluate conditions in the physical environment and suggest new or modified focus modes based on the changed conditions. For example, a first focus mode may be initiated when the physical environment is relatively quiet and a small amount of activity is detected within the physical environment. Aspects of the environment may change, and noise and / or activity levels may increase. In response to detecting this change in the physical environment, the extended reality system may suggest a different or modified focus mode to the user to account for these changes. In other cases, the extended reality system may determine that the user has changed activity and suggest a modified or different focus mode based on the detected changes.

[0180] At operation 1406, process 1400 may include receiving, at the extended reality system, a selection of a particular focus mode. The user may select the particular focus mode in a variety of ways including voice commands, gestures, using interface controls, and the like.

[0181] At operation 1406, the process may include generating an extended reality environment according to the selected focus mode. In some cases, the extended reality system may generate and display the extended reality environment in response to the user selecting a particular focus mode. In some cases, the system may prompt the user to begin the focus mode. For example, the system may display an indication of the selected focus mode to the user and require the user to provide input to the system to begin the selected focus mode.

[0182] Embodiments are also directed to an extended reality system including a head mounted display, a set of sensors, and a processor. The system may be configured to identify different regions within a physical environment and generate an extended reality environment that applies modifications to one or more of the different regions to form a modified representation of the physical environment. The system may operate in a focus mode that uses region modifications to reduce distractions in the extended reality environment. The extended reality system may receive imaging data of the physical environment surrounding the user and identify different regions within the physical environment. In some cases, the environment may be divided into regions associated with a current activity and regions peripheral to the current activity.

[0183] The extended reality system may generate an extended reality environment that reproduces the area associated with the current activity and modifies the appearance of the area surrounding the current activity. For example, the peripheral area may be modified by blurring (or otherwise changing the focus) to help focus the user's attention on the main area associated with the activity. For example, blurring the peripheral area may reduce the details of the object and / or other parts of the peripheral area to reduce the possibility that the user focuses on these aspects of the extended reality environment. In other cases, the color profile, brightness, contrast, or other visual effects of the peripheral area may be modified. In some cases, filters or other visual effects may be applied to the peripheral area. For example, a synthetic style transfer may be applied to the peripheral area, which causes the parts of the physical environment in the peripheral area to be displayed in a stylized manner. The stylized manner may make the peripheral area appear as if it is drawn, colored, or otherwise distinguished from the main area that reproduces the physical environment.

[0184] In some cases, the modifications applied to the peripheral area may be selected based on the user's current activity. For example, the modification may be based on the concentration level associated with the current activity. If the activity is associated with a higher concentration level, the extended reality system may apply large modifications to the peripheral area, and if the activity is associated with a lower concentration level, the extended reality system may apply less significant modifications to the peripheral area. In some cases, the same type of modification may be adjusted based on the activity and / or the associated concentration level. For example, a modification that produces a blur effect in the peripheral area may have less blur for an activity with a lower concentration level, and may have more significant blur for an activity with a higher concentration threshold. In other cases, different regional effects may be applied based on the concentration level associated with the activity.

[0185] In addition to or as an alternative to object-based modifications as described herein, one or more region modifications may be applied in an extended reality environment. For example, an extended reality system may generate an extended reality environment in which a first region of a physical environment is reproduced and a second region of the physical environment is modified to produce a different visual effect (e.g., a blur effect, a style transfer, etc.). The extended reality may also identify an object in the first or second region and replace the object with additional content as described herein.

[0186] Embodiments relate to an extended reality system that can identify an object within a physical environment and reproduce the object in an extended reality environment while applying regional effects to other portions of the extended reality environment. For example, the extended reality system can identify an object that a user is currently interacting with and reproduce the real object while generating an extended reality environment around the object. The extended reality system can apply regional modifications to the extended reality environment surrounding the object. Thus, a user may be able to view and interact with real objects while in an extended reality environment, and the extended reality environment can be configured to help increase the user's focus / attention on the real object.

[0187] The embodiment may also include an extended reality system that is configured to generate area modifications to generate modified representations in an extended reality environment based on the user's current state. The extended reality system may determine and monitor the user's attention state, and select area modifications for the extended reality environment based on the user's attention state. For example, if the extended reality system determines that the user has a high degree of attention, the system may apply less important modified areas in the extended reality environment. Alternatively, if the extended reality system determines that the user has a lower / reduced attention state, the system may apply more significant area modifications in the extended reality environment. In some cases, the extended reality system may periodically or continuously monitor the user's attention state, and update or otherwise change the modifications based on changes in the user's attention state. Therefore, the system can dynamically adapt modifications in the extended reality environment based on changes in the user's state and / or changes in the user's surroundings.

[0188] Fig.15A and Fig. 15B is an example of an extended reality environment 1501 that can be generated by an extended reality system based on different areas of the physical environment 1500 surrounding the user and applying different modifications to the different areas. Extended reality environment 1501 can be an example of an extended reality environment as described herein and displayed to a user by an extended reality system as described herein.

[0189] The physical environment may include door 1502, window 1504, and object 1506. The extended reality system may be configured to enter a focus mode that reduces distractions by identifying one or more areas of the physical environment and generating an extended reality environment that includes a modified representation of the area. For example, the extended reality system may be configured to determine that a door and / or window may be distracting to the user. For example, the opening and closing of a door and / or the movement seen through window 1504 may cause the user to focus on these parts of the room.

[0190] The extended reality system can use the imaging data to identify different areas of the physical environment. For example, the extended reality environment can enter a focus mode that modifies a first area 1501 of the physical environment including a door 1502 and a window 1504 and reproduces a second area 1503 including an object 1506. The extended reality system can use the imaging data to identify the first area 1501 and the second area 1503 and define a boundary around these areas, which can be used to determine which areas of the physical environment should be reproduced and which areas of the physical environment should be modified in the extended reality environment.

[0191] In some cases, the extended reality may determine and select an area based on the user's current activity. As described herein, the extended reality system may determine an activity associated with the user. For example, object 1502 may include a display, and the extended reality system may recognize that the user is interacting with object 1502. The extended reality system may also identify objects that meet the interference criteria of the focus mode, such as doors 1504 and windows 1506, as described herein. The extended reality system may select a first area 1501 to include doors 1504 and windows 1506, and select a second area to include objects 1503 associated with the activity. In some cases, the extended reality system may designate an area associated with the activity (e.g., second area 1503) as a primary area, and designate other areas (e.g., first area 1501) as peripheral areas.

[0192] Fig. 15B An example extended reality environment 1501 including a modified representation of a first area 1501 and a reproduction of a second area 1503 is shown. The extended reality system can generate a modified representation by applying a modification to the imaging data. The modification to the imaging data can be applied in a variety of ways to produce a different visual representation of the second area. In some cases, the modification can be a blurring effect that reduces the sharpness of the peripheral area 1501 so that it appears out of focus (which can make it more difficult for the user to perceive details in the peripheral area and be distracted by it). In other cases, the modification can intentionally change other display parameters of the peripheral area 1501, such as color profile, brightness, saturation, color temperature, and / or similar parameters, to distort the degree to which the representation of the physical environment is compared to the actual physical environment. For example, a portion of the peripheral area 1501 can be changed to a monochrome color scheme, which can reduce the distraction associated with a colorful, visually "busy" portion of the physical environment. Additionally or alternatively, the modification can apply a style transfer to the peripheral area 1501, which can include displaying the peripheral area 1501 to appear black and white, a sepia effect, displaying the peripheral area according to a specific artistic style, and / or any other suitable visual modification.

[0193] The modifications (e.g., blur effects, color profiles, etc.) may be applied to varying degrees, ranging from slight modifications to the visual representation of peripheral area 1501 to more significant modifications to peripheral area 1501. In some cases, the degree of modification may be based on activity, a degree of focus associated with a focus mode, a degree of distraction from objects in peripheral area 1501, etc.

[0194] In some cases, the type of modification may be selected based on an activity associated with the user, such as the current activity. The user may assign a specific modification to a specific activity. In other cases, the system may select a modification based on parameters associated with a specific activity. For example, for an activity involving a user engaging in different areas of the extended reality environment, the extended reality system may choose to show modifications of objects or other features in the peripheral area 1501. This may help the user maintain continuity as they shift focus to different areas of the room. In other examples, the activity may involve the user focusing on a specific object that is unlikely to move. In these cases, the extended reality system may choose to prevent us from more significantly changing the modifications of the peripheral area, which may help maintain the user's focus on the current activity.

[0195] Fig.16 An example process 1600 is shown for identifying different areas of a physical environment and generating an extended reality environment that applies visual modifications to one or more of the areas. Process 1600 may be performed by an extended reality system, such as the extended reality systems described herein.

[0196] At operation 1602, process 1600 may include entering a focus mode in an extended reality environment. Focus mode may generate an extended reality environment that reduces distractions in the physical environment around the user. In some cases, the process may be initiated in response to satisfying activation criteria, as described herein.

[0197] At operation 1604, process 1600 may include identifying a first area and a second area of ​​a physical environment. In some cases, the first and second areas may be determined based on the user's interaction with the physical and / or virtual environment. For example, the extended reality system may determine an area of ​​the environment that the user is primarily interacting with, which may be determined based on the duration of the user's engagement with the area. In some cases, the extended reality system may determine an activity that the user is performing and determine an area of ​​the environment based on the activity. For example, an activity such as reading a book may be associated with specific objects such as a book, a table, a chair, and the like. The extended reality system may identify an area of ​​the environment by identifying these objects within the environment.

[0198] In some cases, the first area may be used to determine the second area. For example, when the physical environment is a room, the second area may be the rest of the room excluding the first area. In other cases, the second area may be determined based on proximity to the user. For example, the second area may be a defined distance from the user, a defined area around the user that does not include the first area, and the like. In other cases, the second area may be identified from potential interference factors within the environment. For example, the extended reality system may use one or more sensors to identify objects such as windows, doors, screens, and the like, as described herein. In some cases, the extended reality system may identify objects based on user-defined interference factors, and / or objects that the system has learned to attract the user's attention from the current task. In these cases, the extended reality system may select the second area to include one or more identified objects.

[0199] At operation 1606, process 600 may include selecting a modification to be applied to a second region. The modification may be applied to a region that is not related to the user's current activity. However, in other cases, the modification may be applied to a first region that is related to the current activity. In these cases, the modification may be used to enhance the user's focus on the current activity and / or draw the user's attention to a particular physical and / or virtual object associated with the activity.

[0200] The extended reality system may apply modifications to the second area generated in the extended reality environment. The modifications may include the modifications described herein (e.g., Fig.15A and Fig. 15B ) and modify the visual appearance of the second area. The modification may be selected based on the activity, parameters of the environment, parameters of the user, etc., as described herein. In some cases, the modification may be selected based on the time of day and / or the environment of the user. For example, for the same activity, a first modification may be selected in the morning, and a different modification may be selected in the evening. In some cases, for the same activity, a first modification may be selected in a first environment (e.g., an office), and a second activity may be selected in a second environment (e.g., a home).

[0201] At operation 1608, process 1600 may include generating an extended reality environment including a modified representation of the second area. The extended reality may be generated as described herein and include the selected modification. The extended reality system may be generated to reproduce the first area such that it reproduces the physical environment. In some cases, the extended reality system may update the extended reality environment including the area (e.g., size, shape, location, effect, etc.) based on the changed environmental parameters and / or changes in how the user interacts with the environment.

[0202] Fig.17A and Fig. 17BAn example extended reality environment is shown that can be used to analyze a physical environment and select a focus mode based on sensed parameters of the physical environment. The extended reality system can be configured to evaluate the environment and select a focus mode, which can be automatically initiated or recommended to the user as described herein. The extended reality system can be configured to select a focus point based on the type of object and / or potential distractions within the environment. For example, a physical environment with multiple disruptive objects positioned across space may require modifying the focus mode for a larger portion of the environment. In these cases, the system may select a region-based focus mode. In other cases, the physical environment may have a single disruptive object and / or distracting factors positioned closer together. In this case, the extended reality system may choose to replace an object-based focus mode for a particular object with additional content.

[0203] Fig.17A An example of a first extended reality environment 1700 is shown, in which the extended reality system can select a zone focus mode. The first extended reality environment 1700 can be generated from the surrounding physical environment. The extended reality environment 1700 may include a door 1702, a window 1704, a table 1706, a lamp 1708, and a television 1710. The system can determine that multiple objects in the environment are assigned an interference type or otherwise meet interference criteria. For example, as described herein, the door 1702, the window 1704, the lamp 1708, and the television 1710 can meet the interference criteria.

[0204] The extended reality system may sense multiple parameters associated with the identified objects. For example, the system may determine the number of objects, the relative positioning of the objects, the distance between the objects, or other parameters. The extended reality system may select a focus mode based on the sensed parameters that meet one or more criteria. For example, if the number of objects exceeds a threshold (e.g., two objects), the extended reality system may select a region-based focus mode. In other examples, if the objects are positioned at a threshold distance from each other, the system may select a region focus mode.

[0205] In other embodiments, objects of a certain type / category may trigger the extended reality system to select an area-based focus mode. For example, a door or a window may cause the system to apply an area-based focus mode.

[0206] Fig. 17BAn example of a second extended reality environment 1701 is shown, in which the extended reality system may select a regional focus mode. The first extended reality environment 1701 may be generated from the surrounding physical environment. The extended reality environment 1701 may include a room with a window 1712, a table 1714, and a book 1716. The extended reality system may identify the window 1712 as being associated with an interference type and / or satisfying interference criteria as described herein. In this example, the extended reality system may select an object-based focus mode to replace the window with additional content as described herein. The object-based focus mode may be selected based on the number of interfering objects (e.g., window 1712) being below a threshold. The object-based focus mode may also be selected based on the position of the interfering object relative to other objects (e.g., objects associated with the current activity).

[0207] Fig.18 An example process 1800 is shown that can identify one or more objects within a physical environment and apply regional modifications to the area surrounding the objects but render the objects in an extended reality environment. Process 1800 can be performed by an extended reality system including the extended reality systems described herein.

[0208] At operation 1802, process 1800 may include entering a focus mode in an extended reality environment. The focus mode may be configured to reduce distractions by applying a zone modification around one or more objects in the extended reality environment. For example, the extended reality environment may be configured to increase focus on an object by removing distractions around the object and / or increasing the visual importance of the object within the extended reality environment. Thus, a zone modification may be applied that draws the user's attention to the object.

[0209] At operation 1804, process 1800 may include identifying an object in a physical environment and one or more regions of the environment surrounding the object. In some cases, the object may be identified based on the user's interaction with the environment and / or the object. For example, if the user is reading a book, the extended reality system may detect the user's focus on the book (e.g., using gaze detection) and identify the book as a target object. In some cases, the extended reality system may prompt the user to confirm that the identified object is correct, for example, by displaying a confirmation notification within the extended reality environment.

[0210] In other cases, the extended reality system may identify one or more objects based on an activity associated with the user. The extended reality system may use the techniques described herein to identify an activity. An activity may be associated with one or more objects, and the user may not interact with these objects. Therefore, identifying an object based on an activity may allow the extended reality system to apply a modification that attracts the user's attention to the object. In some cases, as the activity progresses, the extended reality system may update the identified objects. For example, an activity may be configured to proceed through a group of objects. The extended reality system may apply a first modification to highlight a first object, followed by a second modification to highlight a second object, and so on. Therefore, the identified objects can be used to guide a series of actions.

[0211] At operation 1806, process 1800 may include selecting a modification to be applied to the area, which may include one or more of the modifications described herein. In some cases, the modification may be based on the type / category of the object, as described herein. For example, if the object is a book, the modification applied to the area around the book may include elements of the room, such as a table or desk on which the book is placed, which may help maintain the user's orientation to the environment. Additionally or alternatively, the amount of the modification may be based on an activity and / or a degree of concentration on the activity as described herein.

[0212] At operation 1808, process 1800 may include generating an extended reality environment using the selected modification, the extended reality environment including a modified representation of the identified area around the object. In some cases, the extended reality system may generate an extended reality environment that reproduces the object using virtual content so that the virtual object appears to be an actual real object and the area around the object is displayed using the selected visual modification. In these cases, the user may interact with the virtual object, and the extended reality system may be configured to dynamically update the virtual object based on the user interaction.

[0213] In other cases, the extended reality system may show the actual real object and generate virtual content around the actual real object so that the extended reality environment includes both physical content and virtual content. In these cases, the extended reality system may overlay the modification on the area surrounding the object. Thus, the user can interact with the actual object while the area around the object appears with the visual modification.

[0214] Fig.19An example of an extended reality environment 1900 including one or more real objects shown to a user, where virtual modifications are applied to areas around the objects is shown. Extended reality environment 1900 may include table 1902 and book 1904 located on table 1904. The extended reality system may determine that table 1902 and book 1904 will be displayed to the user. For example, the extended reality system may determine that table 1902 and book are associated with a current activity and / or the user is currently interacting with these objects. The extended reality system may identify area 1901 as the area to which the modifications will be applied. In this example, the rest of the room may be selected as area 1901. However, in other examples, the area may be configured differently and include a smaller portion of the room.

[0215] The extended reality system 1901 can generate an extended reality environment to show the physical table 1902 and the physical book 1904, while using a virtual display to apply modifications to the area around the table 1902 and the book 1904. Thus, the user can interact with actual real objects in the context of the extended reality environment 1900.

[0216] The modifications may be applied to other objects / portions of the environment so that these other objects are still shown and / or displayed to the user, but with the modifications applied. For example, the area to which the modifications are applied may include door 1906 and window 1908. The extended reality system may apply the modifications so that the extended reality environment 1900 shows the features of door 1906 and window 1908, but with the modified visual effects. For example, where the modification is a blur effect that changes the focus of area 1901, the extended reality environment may display door 1906 and window 1908 with the blur effect so that they appear out of focus to the user.

[0217] Fig. 20A and Fig. 20B An example of an extended reality environment 2001 that may be configured to replace a physical environment 2000 with virtual content is shown. Fig. 20A A physical environment 2000 is shown including a door 2002, a window 2004, and a television 2006 in a room. In some cases, the extended reality system can generate modifications that replace one or more areas of the room with other virtual content or replace objects in the extended reality environment 2001 with virtual content. For example, the extended reality system can identify a first area 2001 associated with a television 2006. For example, a user can be interacting / watching the television. The extended reality system can identify a second area 2003 that includes other portions of the physical environment 2000 to which the modifications are to be applied.

[0218] Fig. 20BAn example extended reality environment is shown that can be generated based on a first area 2001 and a second area 2003. The extended reality system can generate virtual content in the second area that removes objects or other features of the physical environment 2000 from the extended reality environment 2001. For example, the modification of the second area 2003 may include focusing the user's attention on a virtual overlay on the first area 2001.

[0219] Fig.21 An example process 2100 is shown for determining a region associated with an activity and applying region modifications to other portions of an extended reality environment. The process can be performed by an extended reality system including the extended reality systems described herein.

[0220] At operation 2102, process 2100 may include entering a focus mode in an extended reality environment. The focus mode may be configured to reduce distractions by identifying an area associated with an activity of the user and applying regional modifications to other parts of the extended reality environment. For example, the extended reality environment may be configured to increase focus on the activity by reproducing an area associated with the activity while applying modifications to other areas of the environment. The associated area may be determined based on the activity.

[0221] At operation 2104, process 2100 may include identifying an area associated with an activity. In some cases, the size or area of ​​the area may be determined based on the type of activity. Activities involving user interaction in a limited space may have a smaller area, while activities involving user interaction with objects over a larger area may have a larger area. For example, for an activity involving a user interacting with a book, the extended reality system may be configured to define the area to include an area immediately surrounding the book, such as the top of a table on which the book is placed, a desk, and the like. For activities involving a larger area, such as a user cooking, the extended reality system may define an area that includes a larger area, which may be based on objects that will be used, such as a counter, an oven, a refrigerator, and the like.

[0222] In some cases, the extended reality system may receive an indication of an area from the user. For example, the extended reality system may display a virtual environment of an activity and receive input from the user defining an area associated with the activity. In other cases, the extended reality system may suggest an area to the user and provide the user with an option to accept the area and / or provide the user with an option to modify the suggested area and / or redefine the area. The extended reality may be configured to save the defined area and use the defined area for future activities.

[0223] In other cases, the extended reality system may define dynamic regions that change based on the user's movements and / or interactions in the extended reality environment. For example, the extended reality system may use one or more sensors to determine the direction the user is looking at and / or the objects the user is interacting with. The extended reality environment may define a dynamic region to include the user's current focus direction. Thus, as the user changes focus to different parts of the room, the region may update based on these user movements.

[0224] At operation 2106, process 2100 may include generating an extended reality environment including a rendering of the identified area and modifications of other areas of the environment, as described herein. The extended reality environment may be displayed to the user using a head mounted display, as described herein.

[0225] Fig. 22 An example process 2200 for generating a virtual object in an extended reality environment while applying region modification within the extended reality environment is shown. The process 2200 may include incorporating aspects of both an object modification scheme and a region modification scheme into the extended reality environment. The process may be performed by an extended reality system including the extended reality system described herein.

[0226] At operation 2202, process 2200 may include entering a focus mode in an extended reality environment. Focus mode may be initiated in response to one or more criteria being met and / or a user initiating as described herein. Focus mode may be configured to reduce distractions in the extended reality environment by applying regional modifications to one or more portions of the extended reality environment and also generating virtual content within the extended reality environment.

[0227] At operation 2204, process 2200 may include identifying virtual content to be introduced into the extended reality environment. Virtual content may be content that is not part of the physical environment and is introduced to enhance the user's focus on an activity or object and / or reduce distractions within the extended reality environment.

[0228] In some cases, virtual content may include objects introduced into the extended reality environment. In other cases, virtual content may include sounds such as music, white noise, and / or other sounds. Sounds and / or objects corresponding to activities in which the user is engaged may be introduced. For example, if the user is reading a book about an animal such as a dog, the extended reality system may generate a virtual frog and include frog sounds such as croaking noises. As another example, the user may be writing an article about a topic that includes a snow field. The extended reality environment may use one or more sensors to determine that the user is writing an article and / or use language processing techniques to identify the topic the user is writing. In an example where the user is writing a topic that includes a snow field, the extended reality system may generate a virtual field that appears around the user and includes snowfall and / or the sound of snowfall. In this regard, the extended reality system may generate an atmosphere that enhances the user's connection to the identified activity.

[0229] As another example, the extended reality system may determine that the user is studying a particular painting, artist, or style of art. In response to determining that the user is studying a particular work of art, the extended reality system may generate an extended reality environment to include a reproduction of the work of art. For example, the work of art may be displayed corresponding to its actual physical size. Thus, the user's understanding and / or concentration on the artwork may be improved by visualizing a realistic virtual representation of the artwork.

[0230] Additionally or alternatively, a regional modification may be generated and the virtual content may be displayed with the regional modification. In some cases, the regional modification may be used to remove aspects of the physical environment to enhance the effect of the virtual content. For example, in an example where virtual artwork is generated for display in an extended reality environment, a regional modification may be displayed around the virtual artwork to focus the user's attention on the artwork and remove or reduce the impact of objects in the physical environment.

[0231] At operation 2206, process 2200 may include generating an extended reality environment including virtual content and area modifications. In some cases, the extended reality system may update the perspective of artwork in the extended reality environment based on user movement. For example, as the user moves around, the perspective of artwork in the extended reality environment may change to correspond to the user's movement.

[0232] Fig.23 An example of an extended reality environment 2300 that can be generated to include virtual content and regional modifications is shown. The physical environment may include a room with a door 2302 and a window 2304. Fig. 22In the discussed artwork example, the extended reality system can generate an extended reality environment 2300 to include a virtual object 2301, which is shown as a painting in this example. In addition, the extended reality environment can include modifications to an area 2303 displayed around the virtual object 2301. The modifications to the area 2303 can be applied to other objects within the area 2303, such as a door 2302.

[0233] Fig.24 An example process 2400 for dynamically updating or changing a zone modification during a focus mode is shown. In some cases, the zone modification may be updated based on a user parameter such as user movement. In other cases, the zone modification may be updated based on an activity and / or a user's progress through an activity. In additional cases, the zone modification may be updated based on a change in the physical environment surrounding the user. Process 2400 may be performed by an extended reality system including the extended reality system described herein.

[0234] At operation 2402, process 2400 may include entering a focus mode in an extended reality environment. The focus mode may be configured to reduce distractions by identifying an area associated with an activity of a user and applying regional modifications to other portions of the extended reality environment. For example, the extended reality environment may be configured to increase focus on the activity by reproducing an area associated with the activity while applying modifications to other areas of the environment. The associated area may be determined based on the activity.

[0235] At operation 2404, process 2400 may include identifying an area based on the user's activity, which may include the processes described herein. For example, the extended reality system may be configured to identify an area of ​​the environment and / or one or more objects associated with the activity.

[0236] At operation 2406, process 2400 may include selecting modifications to be applied to an area in the extended reality environment. In some cases, the modifications may be applied to other areas not associated with the activities described herein. In other cases, the modifications may be applied to areas associated with the activities.

[0237] At operation 2408, process 2400 may include generating an extended reality environment including a rendering of the identified area and modifications of other areas of the environment, as described herein. The extended reality environment may be displayed to the user using a head mounted display, as described herein.

[0238] At operation 2410, process 2400 may include monitoring parameters and / or activities of a user while a focus mode is active in an extended reality system. The system may monitor the user's focus on an activity and / or object (e.g., using gaze detection) or other physiological data. The system may monitor the user's progress through the activity. Additionally or alternatively, the system may monitor changes in the physical environment around the user.

[0239] At operation 2412, process 2400 may include updating the extended reality environment based on one or more parameters determined for the user. For example, if the user's attention state drops below a threshold or meets an interference criterion, the extended reality system may update the modification to the extended reality environment. This may include modifying the effect of the current region modification, such as increasing the degree to which the modification modifies the physical environment. For example, if a blur modification is applied to a region, the extended reality system may increase the focus of the blur effect, such as to de-emphasize an area of ​​the environment. In other cases, the extended reality environment may transition to a different type of modification, such as style transfer. Additionally or alternatively, if the system determines that a particular object is disruptive, the system may replace the object with additional content as described herein.

[0240] In some cases, updating the extended reality environment may include adding different types of modifications. For example, if a visual modification is applied to an area, the extended reality system may include a sound modification.

[0241] Embodiments described herein relate to an extended reality system that can switch between different focus modes using one or more criteria. The extended reality system may include a head-mounted display that can display an extended reality environment to a user. The extended reality system may also include a set of sensors that can receive imaging data of the physical environment and / or monitor parameters of the user. The extended reality system may determine that a first activation criterion has been met and enter a first focus mode, which may be an object-based focus mode. When operating in the first focus mode, the extended reality system may identify one or more objects in the physical environment and generate an extended reality environment, which includes reproducing a portion of the physical environment and replacing the one or more objects with additional content, as described herein.

[0242] The extended reality system may determine that the second activity criteria have been met and enter a second focus mode, which may be a region-based focus mode. When operating in a region-based focus mode, the extended reality system may generate an extended reality environment in which a first region of the physical environment is reproduced and a second region of the physical environment is replaced with a modified representation of the physical environment. The modified representation of the second region may be generated by applying modifications to imaging data of the physical environment received from one or more sensors. The modified representation may be configured to reduce distractions in the extended reality environment by directing the user's focus to regions and / or objects of the extended reality environment associated with the activity the user is performing. For example, the modification may include de-emphasizing details in the second region by changing the focus of the second region to generate a blur effect, changing lighting conditions such as color temperature, brightness, etc., and / or applying filtering or style conversion to display the second region with a composite effect.

[0243] In some cases, the first mode may be implemented by the extended reality system when the required level of concentration is lower, and the second mode may be implemented when the required level of concentration is higher. For example, the first mode may result in a less drastic modification of the physical environment, and the extended reality environment may more fully reproduce the physical environment in addition to one or more identified objects. The second mode may result in a greater modification of the physical environment by modifying areas of the environment in the extended reality environment, which may more significantly change the user's perception of the environment.

[0244] The activation criteria for different focus modes may be based on the user's current activity. In some cases, different activities may be associated with different levels of focus. If the level of focus of the current activity meets a first threshold, the extended reality system may enter a first focus mode. If the level of focus of the current activity meets a second threshold, the extended reality system may enter a second focus mode. In some cases, the thresholds for the focus modes may be set to increase modifications to increase the sensitivity of the system to reduce distractions by replacing objects with virtual content and / or modifying one or more areas of the environment. For example, the first threshold for entering a first object-oriented focus mode may be less than the second threshold for entering a second area-based focus mode.

[0245] In some cases, the system may include multiple object-based focus modes and / or multiple region-based focus modes with increasing levels of modification. For example, a first object-based focus mode may be configured with a higher threshold for replacing objects with additional content, and thus may result in a lower amount of modification to the physical environment (e.g., fewer objects are replaced with additional content). A second object-based focus mode may be configured with a lower threshold for replacing objects with additional content, and thus may result in a larger amount of modification to the physical environment. In some cases, a focus mode may include both object-based modifications and region-based modifications.

[0246] Embodiments also relate to an extended reality system that can display multiple different focus modes and allow a user to select a desired focus mode for generating an extended reality environment. In some cases, the extended reality may determine that the user is initiating an activity or is about to initiate an activity and present one or more focus modes that can be used during the activity. In some cases, one or more presented focus modes may be based on the identified activity. For example, a focus mode may be selected based on the degree of focus associated with the activity. In some cases, the extended reality system may monitor the user during the focus mode and adjust the focus mode, suggest a different focus mode, or enter a different focus mode based on the monitored parameters. For example, if the extended reality system determines that the user changes from a first activity to a second activity, the system may initiate a second focus mode associated with the second activity.

[0247] In some cases, the extended reality system may switch between different focus modes based on the user's attention state. The extended reality system may monitor the user's attention state and update or change the focus mode based on changes in the user's attention state. For example, the extended reality system may operate in a first focus mode presenting an extended reality environment in which a first portion of the physical environment is replaced with additional content. In response to determining that the user's attention state has decreased, the extended reality system may enter a second focus mode presenting an extended reality environment in which a second portion of the physical environment is replaced with additional content. The second portion of the physical environment may be a different portion from the first portion of the physical environment.

[0248] Fig.25 An example process 2500 for switching between different types of focus modes is shown. In some cases, an extended reality system can be configured to switch between different focus modes based on an activity or a change in activity of a user. For example, the extended reality system can determine that the user has switched from a first activity to a second activity and changed from a first focus mode to a second focus mode based on the detected change. Process 2500 can be performed by an extended reality system including the extended reality system described herein.

[0249] At operation 2502, process 2500 may include entering a first focus mode in an extended reality environment. The first focus mode may reduce distractions in the extended reality environment by identifying one or more objects that meet distraction criteria and replacing those objects with additional content as described herein. The first focus mode may be selected in response to determining that the user is performing a particular activity or is about to perform a particular activity. The extended reality system may associate a particular activity with a particular focus mode. For example, the object-based focus mode may be selected in response to the extended reality system determining that the user is performing a first activity.

[0250] At operation 2504, process 2500 may include generating an extended reality environment that replaces one or more objects with additional content, as described herein. For example, the extended reality system may be configured to identify specific objects, specific types / categories of objects, objects that meet defined interference criteria, and the like. The extended reality system may generate an extended reality environment and replace the identified objects with additional content, which may include replacing the identified objects with different objects, removing the objects from the extended reality environment, and / or modifying the objects. The extended reality system may display the extended reality environment to the user using one or more head-mounted displays, as described herein.

[0251] At operation 2506, process 2500 may include determining a change in user activity. In some cases, the extended reality system may automatically determine that the user activity has changed. For example, the extended reality system may use sensor data from one or more sensors to determine a change in user activity, which may be indicated by movement data, gaze detection, or any other suitable parameter, as described herein. In other cases, the extended reality system may determine a change in user activity based on one or more user inputs, for example, the user may indicate that they are changing to a different activity and / or selecting a different focus mode.

[0252] At operation 2508, process 2500 may include entering a second focus mode in the extended reality environment. The second focus mode may be initiated in response to determining that the user has changed from the first activity to the second activity. In some cases, the second focus mode may be selected based on the second activity. For example, the extended reality system may select the second focus mode based on identifying a specific activity that may be associated with the second focus mode. The second focus mode may be operable to produce a different effect of reducing distractions in the extended reality environment. In some cases, the second focus mode may include a more significant modification to the extended reality environment than the first focus mode. For example, the first focus mode may be an object-based focus mode that reproduces a physical environment and uses additional content to modify objects within the environment. The second focus mode may be an area-based focus mode that modifies one or more areas of the physical environment by changing the visual appearance of the area in the extended reality environment.

[0253] At operation 2510, process 2500 may include generating an extended reality environment that modifies one or more areas of a physical environment. The modification may include modifying the visual appearance of the extended reality environment by changing visual aspects of the physical environment, such as focus, brightness, color temperature, etc. In other cases, the modification of one or more areas may include replacing portions of the environment with virtually generated content, which may include introducing virtual content that is not present in the physical environment and / or creating visual effects that are not present in the physical environment.

[0254] FIG. 26A to FIG. 26C Examples of different extended reality environments 2601, 2603 that can be generated in different focus modes and based on the physical environment 2600 are shown. In some cases, the extended reality system can generate a first extended reality environment 2601 in response to determining that the user is performing a first activity, and generate a second extended reality environment 2603 in response to determining that the user is performing a second activity.

[0255] Fig.26AA physical environment 2600 surrounding a user is shown and may include a room with a door 2602, a window 2604, a table 2606, a book 2608, and a display 2610 that is displaying dynamic content. The extended reality system may determine that the user is performing a first activity that includes interacting with the display 2610. The first activity may be associated with a first focus mode that includes replacing an object that meets a distraction criterion with additional content. In the current example, the extended reality system determines that the book 2608 meets the distraction criterion. For example, the extended reality system may monitor the user's gaze to determine one or more objects that the user is focusing on and the duration of focus on a particular object. The extended reality system may determine that the focus on the book 2608 meets the distraction metric and may generate a first extended reality environment 2601 that replaces the book 2608 with additional content.

[0256] Fig.26B A first extended reality environment 2601 generated by an extended reality system and displayed to a user is shown. The extended reality environment 2601 can be generated so that it appears that there is no book on the table 2606. For example, the extended reality system can generate virtual content that replaces the book and fills the area of ​​the table where the book is located. In other cases, the book 2608 can be replaced with other additional content that displays other objects in the extended reality environment and / or modifies the appearance of the book 2608.

[0257] The extended reality system can determine that the user has switched activity from interacting with display 2610 to interacting with book 2608. In response to the change in activity, the extended reality system can enter into a generated Fig.26C . The second extended reality environment 2603 may be authorized based on the user's specific activity. For example, when interacting with book 2608, the user is more likely to be distracted by the physical environment. Therefore, the second extended reality environment 2603 may be configured to generate more significant changes to the physical environment to help remove distractions. The second focus mode may include modifying one or more areas of the physical environment 2600. For example, the extended reality system may identify book 2608 and table 2606 as being associated with the user's current activity. The extended reality system may modify other areas of the environment that are not associated with the activity.

[0258] In some cases, modifications to other areas may include generating visual modifications to other parts of the room, including door 2602, window 2604, and display 2610. In some cases, the modifications may be applied uniformly to the entire room. For example, the extended reality system may generate visual modifications such as blur effects, style transfer, or other changes applied across the room in addition to book 2608 and table 2606. In other cases, the extended reality system may apply different modifications to different areas of the room. For example, the extended reality system may determine that door 2602 and window 2604 have a lower probability of interference, and apply a first modification to the area of ​​the room including door 2602 and window 2604. The extended reality system may determine that display 2610 has a higher probability of interference, and apply different modifications to the area of ​​the room including display 2610.

[0259] Fig. 27 An example process 2700 is shown for changing between different focus modes based on user input to an extended reality system. The process can be performed by an extended reality system including the extended reality system described herein.

[0260] At operation 2702, process 2700 may include determining that a user is initiating an activity. The extended reality system may determine that a user is initiating a particular activity based on sensor data and / or other data received by the system, as described herein. In some cases, a user may indicate that they are initiating a particular activity.

[0261] At operation 2704, process 2700 may include presenting a plurality of different focus modes to the user for selection of a particular focus mode. In some cases, the extended reality system may display a plurality of selectable options each associated with a different focus mode. Different focus modes may be identified based on an activity. For example, the extended reality system may identify a particular activity that the user is performing and identify a focus mode associated with the particular activity and / or the type of activity. In other cases, an activity may be associated with a particular degree of focus, and the extended reality system may select a focus mode having a degree of focus that corresponds to the particular degree of focus of the activity.

[0262] At operation 2706, process 2700 may include entering a focus mode in the extended reality environment based on a focus mode selected by the user. For example, the user may select one of the displayed focus modes, and the extended reality system may initiate the selected focus mode. In some cases, the extended reality system may use the focus mode selected by the user to recommend a focus mode generated for recommendation to the user for a particular activity. The extended reality system may also automatically enter a particular focus mode using the focus mode selected by the user in response to determining that the user is initiating a particular activity in the future. For example, at a subsequent time when the extended reality system determines that the user is initiating a particular activity, the extended reality system may automatically enter the focus mode last selected by the user for that activity.

[0263] At operation 2708, process 2700 may include generating an extended reality environment according to the selected mode. The generated extended reality environment may be displayed to the user using a head mounted display, as described herein. In some cases, the extended reality system may determine that the user activity has changed and exit the selected focus mode, switch to a different focus mode, and / or prompt the user to select a different focus mode, as described herein.

[0264] Fig.28 An example process 2800 is shown for initiating a focus mode and switching between different focus modes based on one or more monitored parameters of a user and / or environment.

[0265] At operation 2802, process 2800 may include determining one or more parameters associated with the user, activity, and / or environment and selecting a second focus mode based on the determined parameters. In some cases, the extended reality system may determine a level of focus associated with the current activity. For example, different activities may be associated with different levels of focus, as described herein.

[0266] At operation 2804, process 2800 may include determining that a first activation criterion has been met. For example, the extended reality system may determine that a level of concentration associated with the user's activity meets a first threshold.

[0267] At operation 2806, process 2800 may include entering a first focus mode in the extended reality environment based on satisfying a first activation criterion. The first focus mode may be selected based on an activity and / or a level of focus associated with the activity. For example, the first focus mode may be associated with a particular level of focus or a range of levels of focus, and may be selected by the extended reality system upon determining that the level of focus of the activity corresponds to a particular level of focus for the first focus mode or falls within a range of levels of focus associated with the first focus mode. In some cases, the effects of different focus modes may correspond to the level of focus required for the activity. In some cases, the first focus mode may be an object-based focus mode and identifies one or more disruptive objects within the physical environment and replaces the disruptive objects with additional content as described herein.

[0268] At operation 2808, process 2800 may include determining that a second activation criterion has been met. For example, the extended reality system may determine that a level of concentration associated with the user's activity meets a second threshold.

[0269] At operation 2810, process 2800 may include entering a second focus mode in the extended reality environment based on satisfying the first activation criteria. The second focus mode may be selected based on an activity and / or a level of focus associated with the activity. For example, the second focus mode may be associated with a particular level of focus or a range of levels of focus and may be selected by the extended reality system upon determining that the level of focus of the activity corresponds to a particular level of focus for the second focus mode or falls within a range of levels of focus associated with the second focus mode. In some cases, the second focus mode may be a region-based focus mode of the extended reality environment that generates a representation that modifies a portion of the physical environment, as described herein.

[0270] Fig.29A and Fig.29B Different notifications that may be introduced into an extended reality environment during different focus modes are shown. The extended reality system may display notifications in the extended reality environment in various ways. In some cases, the prominence, amount of information, manner in which notifications are displayed, and / or other aspects of notifications may be introduced based on the focus mode, the particular activity, and / or the level of focus. For example, a focus mode associated with a higher level of focus and / or that removes a greater amount of distractions may suppress notifications and / or present notifications to reduce the impact on the extended reality environment. A focus mode associated with a lower level of focus may present notifications with additional information and / or present notifications in a more prominent manner in the extended reality environment, which may be more likely to draw the user's attention to a particular notification.

[0271] Additionally or alternatively, notifications may be displayed or otherwise communicated to the user in the extended reality environment based on the content or type of notifications. For example, in a focus mode with a higher level of focus, the extended reality system may only display notifications of high importance and / or notifications of a particular type, such as emergency-based notifications. In some cases, the presentation of notifications and / or the type of information communicated in the notifications may be based on the content and / or importance of the notifications. For example, Fig.29A As shown, the extended reality system may display an extended reality environment 2901 that includes modifications to one or more areas 2903 of the physical environment. The extended reality system may display a first notification 2902 for an email by displaying an icon indicating that the email was received but without providing specific information about the email. In this example, the icon may be less likely to draw the user's attention away from the particular activity. In other cases, the extended reality system may display a notification that includes additional information. For example, Fig.29B As shown in , the extended reality system can display a second notification 2904 including additional information about the email (such as the sender, subject, etc. of the email) in the extended reality environment 2901.

[0272] In these examples, notifications may be generated based on a focus mode and / or parameters associated with the notification. For example, the first notification 2902 may be displayed in a focus mode with a higher degree of focus, and therefore, the extended reality system may generate a less disruptive notification. In other cases, the extended reality system 2902 may determine that the first notification has low importance (e.g., based on the content of the email, the sender of the email, the importance designation, the subject, etc.) and generate a less prominent notification. The extended reality system may generate a more prominent second notification 2904 based on a lower focus mode and / or a determination that the second notification has a higher importance.

[0273] The various embodiments described herein relate to an extended reality system that can generate an extended reality environment that replaces real objects with additional content to reduce interference in the extended reality environment. The extended reality system can monitor the user's interaction with the environment and / or changes in the environment to determine whether one or more breakthrough criteria have been met. As used herein, the term "breakthrough" may refer to reproducing / showing one or more objects in an extended reality environment that have previously been replaced by additional content within the extended reality environment. For example, in focus mode, an extended reality environment can be generated to replace real objects or areas of the environment with additional content or other modifications such as another object. In some cases, the extended reality system may be configured with breakthrough criteria that can be used to determine when a real object that has been modified in the extended reality environment should be reproduced or shown in the extended reality environment.

[0274] In a first set of examples, an extended reality environment may be generated to replace an object that meets an interference criterion with additional content. The extended reality system may monitor the user's engagement with the extended reality environment and detect the user's engagement with the additional content that has been used to replace the object. In response to detecting that the user's engagement with the additional content meets the interaction criteria, the extended reality system may update the extended reality environment to reproduce the object or a portion of the object. For example, the physical environment may include a screen that is displaying dynamic content, and the extended reality environment may replace the dynamic content with additional content such as a blank screen or other content such as a static picture. The user may expect to see something on the screen and look at the direction of the screen in the virtual environment. In response to determining that the user is looking in the direction of the screen for a defined duration, the extended reality system may temporarily or permanently display the dynamic content in the extended reality environment.

[0275] In another set of examples, the extended reality system may display an object or a portion of the object that has been replaced with additional content in response to a change in the object. This may allow an object to break out into the extended reality environment in response to some change in the object, which may include movement of the object, changes in content associated with the object, and / or other changes to the object. For example, the extended reality environment may replace a door in a room with additional content to remove distractions associated with the door opening and closing. The extended reality system may detect that the door has been left open (as opposed to opened and closed) and update the extended reality environment to display a rendition of the door so that the user can see that it has been left open.

[0276] In other examples, the extended reality system may enter different focus modes configured with different criteria for allowing the object to break through. For example, in a first focus mode, the extended reality system may replace the object with additional content and be configured with a first engagement criterion for allowing the object to break through into the extended reality environment. In a second focus mode, the extended reality system may replace the object with additional content and be configured with a second engagement criterion for allowing the object to break through into the extended reality environment. The criteria may be configured so that different focus modes have different levels of break through, which may make the object harder or easier to break through, depending on the activity or user and / or the selected focus mode.

[0277] For example, the first engagement criterion may include a first time threshold for the user to look in the direction of the object that has been replaced by the additional content, and the second engagement criterion may be a second time threshold for the user to look in that direction. The second time threshold may be greater than the first time threshold. Thus, the second focus mode may require greater user engagement with the additional content that replaces the object to allow breakthrough.

[0278] Fig.30A process 3000 is shown for determining when to allow a breach of an object in an extended reality environment. An extended reality system may be configured to allow a breach of an object or area in an extended reality environment. Object or area breaching may include changing from replacing the object or area with additional content to displaying a rendition of the area / object in the extended reality environment. The extended reality system may be configured to allow breaching in response to a variety of different factors, including changes in the physical environment, changes in user parameters, detecting a particular type of event (e.g., an emergency vehicle), and the like. Process 3000 may be performed by an extended reality system including the extended reality system described herein.

[0279] At operation 3002, process 3000 may include entering a focus mode in an extended reality environment. Focus mode may be configured to reduce distractions in the extended reality environment by identifying objects that meet distraction criteria or determining one or more objects associated with a current activity as described herein.

[0280] At operation 3004, process 3000 may include generating an extended reality environment that replaces an area of ​​the physical environment with additional content. The extended reality environment may be generated to replace one or more objects with virtual content and / or to visually modify one or more areas of the physical environment as described herein.

[0281] Different focus modes may be configured with different breakout criteria that may be used by the extended reality system to determine when to allow breakout of objects and / or areas in the extended reality environment. In some cases, the breakout criteria may be based on the user's engagement with the additional content used to replace the object and / or with the area of ​​the extended reality environment corresponding to the replaced / modified object.

[0282] At operation 3006, process 3000 may include detecting a user's engagement with additional content that replaces an object while in an extended reality environment. In some cases, detecting user engagement may include monitoring the user's eye movement to determine the direction the user is looking at, the content within the virtual environment that the user is focusing on, and the like. The extended reality system may also determine the amount of time the user is focused on a particular area, particular content, and / or a particular object. The focus direction and / or duration (e.g., gaze detection) may be used to determine whether the user's engagement with the additional content meets the interaction criteria. For example, if the user's engagement with the additional content that replaces the object meets the interaction criteria, the extended reality system may be configured to allow a breakout of the object and may display a reproduction of the object or a portion of the object.

[0283] For example, an extended reality environment may be generated that replaces dynamic content on a display with virtual content that causes the display to appear to be off within the extended reality system environment. The system may detect that the user is looking at a blank display. If the extended reality system determines that the user's gaze on the display meets or exceeds a time threshold, the system may determine that the user's engagement with the blank display meets the interaction criteria.

[0284] At operation 3008, process 3000 may include updating the extended reality environment based on the user's engagement with the additional content. In some cases, if the extended reality system determines that the interaction criteria are met, the extended reality system may switch from replacing the object with the additional content to displaying a reproduction of the object or a portion of the object. In the case of the display example, the extended reality system may reproduce dynamic content on the display in response to user interaction with the virtually generated blank screen that meets the interaction criteria.

[0285] Fig.31A and Fig.31B An example of a breakout of an object in an extended reality environment 3101 operating in focus mode is shown. Fig.31A As shown, an extended reality environment 3101 may be generated to replace content on display 3102 with virtually generated content that causes the display to appear to be off in the extended reality environment. The extended reality system may detect the user's gaze on area 3101 and determine that the user's gaze meets the interaction criteria. For example, the extended reality system may determine that the user has focused on area 3104 for a defined duration. In response to meeting the interaction criteria, the extended reality system may update the extended reality environment. For example, Fig.31B As shown, the extended reality environment can be updated to reproduce the content being displayed by display 3102.

[0286] Additionally or alternatively, determining the user's engagement with an object or area of ​​the extended reality environment may include detecting other types of user interactions, such as gestures, voice commands, and / or inputs to the extended reality system (e.g., via a user interface). In some cases, the duration of the break may be based on the focus mode and / or the detected user interactions. For example, if, in response to displaying content on the display, the user looks in a different direction, the extended reality system may be configured to continue replacing the object with additional content (e.g., restarting displaying a blank screen on display 3102).

[0287] Fig.32A process flow 3200 is shown for determining when to allow a breakout of an object in an extended reality environment based on one or more parameters of the object. The extended reality system can monitor the physical environment while generating the extended reality environment, and update the extended reality environment based on changes to the physical environment. In some cases, the extended reality environment can be updated based on changes to an object or area being replaced / modified with additional content. In other cases, the extended reality environment can be updated based on changes to the environment, such as a person entering the physical environment, an object moving toward the user, or other changes. Monitoring of the physical environment allows the extended reality system to update and adapt the extended reality environment to changing conditions.

[0288] At operation 3202, process 3200 may include entering a focus mode in an extended reality environment. Focus mode may be configured to reduce distractions in the extended reality environment by identifying objects that meet distraction criteria or determining that one or more objects are associated with a current activity as described herein.

[0289] At operation 3204, process 3200 may include generating an extended reality environment that replaces objects with additional content. The extended reality environment may be generated to replace one or more objects with virtual content and / or to visually modify one or more areas of the physical environment as described herein.

[0290] At operation 3206, process 3200 may include using one or more sensors of the extended reality system to detect a change in an object. In some cases, the detected change may be the movement of the object. For example, the extended reality system may be configured to determine the direction of movement of the object, such as whether the object is approaching the user, moving away from the user, moving in parallel, and the like. In some cases, the extended reality system may detect movement rate and changes such as approach speed and direction. Additionally or alternatively, the extended reality system may detect changes in the appearance of the object, changes in content displayed by the object (e.g., a display), or changes in other parameters associated with the object.

[0291] The detected changes can be used to determine whether an object in the physical environment meets the criteria for updating the extended reality environment based on the detected changes of the object. The extended reality system can be configured to determine that the change of the object meets the update criteria. In the case of detecting the movement of the object, the extended reality system can define the update criteria to include specific types of movement of the object. For example, the movement of the object toward the user may meet the movement criteria, while the movement away from or parallel to the user may not meet the movement criteria. Therefore, the extended reality system can be configured to update how the object is reproduced in the extended reality environment based on the type of movement. Different focus modes may include different update criteria. For example, some focus modes may require a larger amount of movement (e.g., the object will hit the user), while other focus modes may require less movement and update the extended reality environment based on the movement of any object in the environment.

[0292] At operation 3208, process 3200 may include updating the extended reality environment based on the detected changes. In some cases, this may include switching from replacing the object with the additional content to displaying a rendition of the object in the extended reality environment. In other cases, the extended reality system may show the actual real object within the context of the extended reality system and / or stop displaying the extended reality environment so that the user can see the physical environment.

[0293] In other cases, the extended reality environment may update additional content based on detected changes that meet the update criteria. For example, the extended reality environment may replace an object with virtual content to remove an object in the extended reality environment. If the extended reality system detects a change in an object that meets the update criteria, the extended reality system may replace the object with different virtual content to indicate the change in the object. For example, the object may be a pet of a user of the system. Initially, the extended reality system may replace the pet with virtual content to generate an extended reality environment that does not include the pet. The system may determine that the pet is walking toward the user and determine that the movement meets the update criteria (e.g., movement criteria for focus mode). The extended reality system may update the extended reality environment to reproduce the pet so that the user can see the pet walking toward them. In other cases, the extended reality system may generate a modified version of the pet to help reduce interference with the user. For example, a blur effect, style conversion, or other modified representations may be used to display the pet to help reduce interference in the extended reality environment.

[0294] In some cases, different focus modes may be configured with different update criteria for determining whether to update the extended reality environment based on changes to an object. For example, a first focus mode may include a first update criterion for switching from replacing an object with additional content to reproducing the object in an extended reality environment, and a second focus mode may include a second update criterion different from the first update criterion for switching from replacing an object with additional content to reproducing the object. Different focus modes may be associated with different attention states of a user, and the update criteria may be based on the attention state. For example, a first focus mode may be associated with a lower attention state, and the first update criterion may require less significant changes to reproduce an object in an extended reality environment than a second focus mode. Thus, the first focus mode may allow for a larger number of breakthroughs than the second focus mode. The extended reality system may transition between focus modes based on detected activity, a user's selection of a focus mode, based on changes in the environment, and / or in response to meeting other criteria, as described herein.

[0295] Embodiments described herein also relate to an extended reality system that determines whether a user is in an attention state that meets the focus criteria for an activity. Different activities may be associated with different focus criteria, for example, based on the difficulty of a particular activity. The extended reality system may assess whether a user is "ready" to perform a particular activity (e.g., whether the user is likely to be able to fully focus on the activity, whether the activity is likely to be performed at a threshold level of efficiency, etc.). The system may determine that the current attention state does not meet the focus criteria for a particular activity, and take one or more actions in response. The system prompts the user to delay the activity or perform one or more actions to prepare the user for the activity in the extended reality environment.

[0296] In some cases, the extended reality system is configured to determine that the user is initiating a first activity in the extended reality environment and select a focus criterion for the activity. The focus criterion may be associated with a degree of focus required for the activity (where activities requiring greater mental effort / focus have a greater degree of required focus, and activities requiring less mental effort / focus have a lower degree of required focus). The extended reality system may determine the user's attention state, which may include measuring physiological parameters of the user (such as eye movement, heart rate, breathing rate) and / or assessing parameters (such as the amount of sleep the user has over a period of time, stress levels, etc.). The extended reality system may determine whether the user's attention state meets the focus criterion for the first activity. In response to determining that the attention state does not meet the focus criterion, the extended reality system may prompt the user to perform a second activity configured to increase the user's attention state.

[0297] The second activity may be selected based on the user's attention state, based on the first activity, based on a user selection, and so on. The second activity may be initiated in the extended reality environment and include tasks to prepare the user for the first activity. In some cases, the tasks may include audio or visual stimulation, breathing, relaxation or other mental exercises, or other suitable activities. In some cases, in response to performing the second activity, the extended reality system may initiate the first activity. In other cases, the extended reality system may reassess the user's level of concentration to determine whether it meets the concentration criteria. In response to initiating the first activity, the extended reality system may enter a focus mode that reduces distractions in the extended reality environment, as described herein.

[0298] In some cases, the extended reality system may determine the user's future activities and enter a focus mode in the extended reality environment that prepares the user for the future activities. For example, the focus mode may be selected to improve the user's ability to focus by removing distractions in the extended reality environment before the user participates in the activity. In some cases, the focus mode may reproduce some of the physical environment in the extended reality environment and add additional content to other parts of it that do not exist in the physical environment. The additional content may replace, remove or otherwise modify objects in the physical environment and / or modify one or more areas of the extended reality environment as described herein. In some cases, the additional content may be selected based on the user's attention state. The additional content may include visual, auditory or tactile stimulation configured to increase the user's ability to focus. For example, the additional content may replace disruptive objects in the physical environment with soothing or calming virtual effects. For example, the virtual effect may include changing the brightness of the room (e.g., reducing the brightness), changing the color temperature (e.g., using a warmer color temperature to reproduce parts of the physical environment), and replacing disruptive objects with different objects, as described herein.

[0299] The extended reality system may be configured to determine that the user's attention state does not meet the focus criteria of the current activity (e.g., the degree of focus required for the current activity), and to pause the current activity in the extended reality environment. In some cases, in response to pausing the first activity, a different activity may be initiated in the extended reality environment. In other cases, the extended reality system may present a list of recommended activities to the user in response to pausing the current activity. The recommended activities may be based on the user's current attention state and / or the suspended activity. In some cases, the extended reality system may schedule the suspended activity for another time, such as a different day. The suspended activity may be rescheduled based on a user profile that indicates when the user's attention state may meet the focus criteria of the suspended activity. For example, the extended reality system may track the user's attention state over time, and develop a focus profile indicating how the user's focus changes over a period of time in response to performing a particular activity, etc. Thus, this profile can be used to select an alternative activity or reschedule a suspended activity.

[0300] Fig.33 An example process 3300 is shown for determining whether to initiate an activity in a focus mode based on a user's attention state. Process 3300 can be performed by an extended reality system including the extended reality system described herein.

[0301] At operation 3302, process 3300 may include determining that a user is initiating a first activity in an extended reality environment, as described herein. For example, the extended reality system may identify the first activity in response to user input indicating the first activity and / or using sensor data (e.g., imaging data), calendar data in any other suitable manner.

[0302] At operation 3304, process 3300 may include, for example, using one or more sensors to detect the user's attention state. The extended reality system may monitor physiological parameters of the user, such as eye and / or head movement, heart rate, breathing rate, and the like. Additionally or alternatively, the extended reality system may obtain other information that can be used to determine the attention state, such as sleep data, other activities that the user has performed (e.g., which can be used to determine the user's mental fatigue or mental state), and the like. In some cases, the extended reality system may generate an extended reality environment that includes a series of tasks and evaluate the user's performance to determine the mental state. For example, the extended reality system may monitor the user's eye movement and / or focus on objects in the extended reality environment and associated with the task, how the user responds to various stimuli, and the like. This data can be used to derive the user's attention state.

[0303] At operation 3306, process 3300 may include determining that the user's attention state does not meet the focus criteria of the first activity. Each activity may include a defined degree of focus, which indicates a scale of what kind of mental workload and / or how much focus is required for a particular task. In some cases, the focus criteria may be generated based on previously collected user data and for a particular user. For example, if the user has performed the same or similar activities, the extended reality system may determine how long the user took to complete, how often the user was interrupted during the activity, the types of objects that interrupted the user, and so on. In some cases, the interference criteria may be relative to other activities that the user has performed and indicate a relative scale.

[0304] At operation 3308, process 3300 may include displaying one or more notifications to the user in the extended reality environment. The notification may indicate that the user's current estimated state of attention is below a threshold level for specifying the task. The notification may suggest that the user delay the task and try again at a later time and / or provide one or more affordances for performing other activities. In some cases, the extended reality system may display an affordance for initiating a second activity configured to prepare the user for the first activity. For example, the second activity may be configured to increase the user's ability to focus. In some cases, the second activity may be selected based on the user's current state of attention and / or a focus criterion associated with the first activity. For example, if the first user's state of attention is low, the extended reality system may select a second activity that is easier for the user or provides a greater amount of time to help the user refocus before performing the first activity.

[0305] In response to selecting the affordance for the second activity, the extended reality system may be configured to initiate an extended reality environment for performing the second activity. The extended reality system may monitor the user during the second activity, including monitoring changes in the user's attention state or other physiological conditions. In some cases, in response to the user completing the second activity, the extended reality system may initiate the first activity. In other cases, after completing the second activity, the extended reality system may determine whether the user's attention state meets the focus criteria, and if so, may initiate the first activity. If the extended reality system determines that the user's attention state does not meet the focus criteria for the first activity after the second activity, the system may exit focus mode and / or pause the first activity until a later time.

[0306] Fig.34 An example process 3400 is shown for assessing a user's attention state and recommending an initial activity before engaging in a future activity. The process 3400 may be performed by an extended reality system including the extended reality systems described herein.

[0307] At operation 3402, process 3400 may include determining a future activity for a user. The extended reality system may use data from a calendar application, based on tracking the user's schedule / routine over time, to determine a characteristic activity for the user from user input to the system indicating an activity. Additionally or alternatively, the extended reality system may use imaging data to identify the physical environment around the user and / or objects in the physical environment associated with the future activity. For example, the extended reality system may determine that the user has scheduled a writing assignment in a calendar application. The extended reality system may use imaging data to identify objects in the physical environment, such as a notebook or computer, and determine that the future activity is a writing assignment and is about to begin.

[0308] At operation 3404, process 3400 may include selecting a focus mode for generating an extended reality environment. In some cases, the extended reality environment may be generated in response to determining that the user is initiating a future activity. For example, the focus mode may be initiated at the scheduled time of the future activity, in response to the user's engagement with an object associated with the future activity (e.g., opening a notebook), and so on.

[0309] A focus mode may be selected based on future activities. For example, a particular focus mode may be associated with a particular activity and / or activity type, as described herein. In other cases, the extended reality system may select a focus mode based on the level of focus required for the activity. Additionally or alternatively, the extended reality system may present one or more focus modes to the user for selection, as described herein.

[0310] The focus mode may include an object-based focus mode that identifies one or more objects that meet distraction criteria and replaces the objects with additional content. Additionally or alternatively, the extended reality system may implement a region-based focus mode that identifies one or more regions of the environment and applies visual modifications to the regions in the extended reality environment.

[0311] At operation 3406, process 3400 may include generating a focus mode to include an initial activity. In some cases, the initial activity may be configured to help prepare the user for the determined future activity. The extended reality system may generate the initial activity in response to measuring one or more parameters of the user, such as the user's attention state. In some cases, the initial activity may include selecting additional content to include in the extended reality environment. For example, the additional content may include activities, visual stimulation, audio stimulation, and / or other content that removes distractions in the extended reality environment.

[0312] At operation 3408, the process may include initiating a future activity in response to completing the initial activity. In some cases, the focus mode may continue after initiating the activity. In other cases, the focus mode may be changed based on the activity. In other cases, the extended reality system may end the focus mode in response to initiating the activity.

[0313] Fig.35 An example process 3500 is shown for pausing a current activity based on one or more monitored parameters of a user. The process 3500 may be performed by an extended reality system including the extended reality systems described herein.

[0314] At operation 3502, process 3500 may include initiating a first activity in an extended reality environment. The extended reality system enters a focus mode for the activity, wherein the focus mode reduces distractions in the extended reality environment, as described herein. The focus mode may be selected based on the activity, a level of focus associated with the activity, a user-selected focus mode, or using other techniques, as described herein.

[0315] At operation 3504, process 3500 may include detecting a user's attention state during the activity. The extended reality system may receive sensor data from one or more sensors that measure one or more user parameters and use the sensor data to determine the user's attention state, as described herein.

[0316] At operation 3506, process 3500 may include determining that the user's attention state does not meet the focus criteria. In response to determining that the user's attention state does not meet the focus criteria, the extended reality system may pause the first activity and initiate a second activity. For example, the extended reality system may select a second activity that is configured to increase the user's attention state, provide an interruption from the first activity, or otherwise help increase the user's attention state. In some cases, the extended reality system may generate an extended reality environment for the second activity, the extended reality environment including virtual content, such as visual stimuli, audio stimuli, and one or more tasks for the user to perform.

[0317] In some cases, the extended reality system may present a list of candidate activities to the user and initiate selection of the activity in the extended reality environment. The list of candidate activities may be based on the user's attention state, the first activity, an activity type associated with the first activity, and the like.

[0318] At operation 3508, process 3500 may include re-initiating the first activity. In some cases, the first activity may be re-initiated in the extended reality environment based on successful completion of the second activity. In other cases, the first activity may be re-initiated in response to satisfying a duration, the user's attention state satisfying a focus criterion associated with the first activity. In other examples, the first activity may be re-initiated by the user.

[0319] Fig.36 An example user interface 3600 for pausing an activity is shown. User interface 3600 may include one or more affordances that may provide a user with different options for pausing or rescheduling an activity. In some cases, the user interface may be displayed in response to determining that the user's attention state does not meet a focus criterion, which may be determined prior to initiating the activity or while the user is performing the activity. The user interface may be displayed by the extended reality system in an extended reality environment.

[0320] User interface 3600 may include a first set of affordances 3602 that provide options for delaying and rescheduling an activity. For example, first set of affordances 3602 may include a first option 3604 for rescheduling an activity at a suggested time. In some cases, the extended reality system may determine the suggested time based on profile data of the user, which may be learned by the system over time. For example, the system may track the user's level of focus and determine how the user's attention state changes based on date, time, in response to other activities, and the like. The extended reality system may use this data to determine a suggested time for rescheduling the activity. First set of affordances 3602 may also include a second option 3606 for opening a calendar application, which may be used to select a date and time for scheduling the activity.

[0321] User interface 3600 may include a second set of affordances that provide one or more options for initiating a different activity (e.g., an initial activity) to help improve the user's ability to focus on completing the current activity. For example, the user interface may include a third option 3610 for performing the initial activity. The initial activity may be suggested by the system based on the user's current attention state, the focus criteria of the primary activity, or using other techniques as described herein.

[0322] Fig.37 An example extended reality environment 3700 is shown, which shows modifications to the physical environment before initiating an activity in focus mode. Extended reality environment 3700 can be generated and displayed by an extended reality system as described herein.

[0323] The extended reality environment may be room-based and may illustrate how a particular focus mode will modify the physical environment prior to initiating an activity. For example, a focus mode may enable the extended reality system to recognize that the user is engaging in an activity that includes book 3708. The extended reality system may also determine that table 2706 is associated with the book, and determine that book 3708 and table 2706 should be reproduced in the extended reality environment (e.g., by highlighting or surrounding table 3706 and book 3708). The extended reality system may identify door 3702, window 3704, and display 3710 as meeting interference criteria and specify that these objects and / or areas associated with these objects are to be replaced with additional content, as described herein. Thus, before initiating an activity, a user of the system may preview the effects of a particular focus mode, edit / change how the focus mode will operate, and / or select a different focus mode for the activity.

[0324] As described above, one aspect of the present technology is to monitor and manage the physiological condition and / or other parameters and / or user environment of the user. The disclosure contemplates that, in some cases, these collected data may include personal information data that uniquely identifies or can be used to contact or locate a specific person. Such personal information data may include demographic data, location-based data, phone numbers, email addresses, Twitter IDs (or other social media aliases or handles), home addresses, data or records related to the user's health or fitness level (e.g., vital sign measurements, medication information, exercise information), date of birth, or any other identifying information or personal information.

[0325] The present disclosure recognizes that the use of such personal information data in the present technology can be used to benefit the user. For example, the personal information data can be used to provide a user-customized tactile or audio-visual output. In addition, the present disclosure also anticipates other uses of personal information data that benefit the user. For example, health and fitness data can be used to provide insights into the user's overall health, or can be used as positive feedback to individuals using technology to pursue health goals.

[0326] The disclosure anticipates that entities responsible for the collection, analysis, disclosure, transmission, storage or other uses of such personal information data will comply with sound privacy policies and / or privacy measures. Specifically, such entities should implement and adhere to the use of privacy policies and practices that are recognized as meeting or exceeding industry or government requirements for maintaining the privacy and security of personal information data. Such policies can be easily accessed by users and should be updated as the collection and / or use of data changes. Personal information from users should be collected for legal and reasonable entity purposes and should not be shared or sold outside these legal purposes. In addition, such collection / sharing should be carried out after receiving the user's informed consent. In addition, such entities should consider taking any necessary steps to protect and safeguard access to such personal information data, and ensure that other entities with access to personal information data comply with the privacy policies and procedures of other entities. In addition, such entities can subject themselves to third-party assessments to prove that they comply with widely accepted privacy policies and practices. In addition, policies and practices should be adjusted to collect and / or access specific types of personal information data, and modified to apply to applicable laws and standards including specific considerations of jurisdiction. For example, in the United States, the collection or acquisition of certain health data may be governed by federal and / or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA); while health data in other countries may be subject to other regulations and policies and should be handled accordingly. Therefore, different privacy measures should be advocated for different types of personal data in each country.

[0327] Notwithstanding the foregoing, the present disclosure also contemplates implementation schemes in which users selectively block the use or access to personal information data. That is, the present disclosure contemplates providing hardware elements and / or software elements to prevent or block access to such personal information data. For example, with respect to determining spatial parameters, the technology of the present invention may be configured to allow a user to choose to "opt in" or "opt out" to participate in the collection of personal information data at any time during or after registration for a service. In addition to providing "opt-in" and "opt-out" options, the present disclosure also contemplates providing notifications related to access or use of personal information. For example, a user may be notified that their personal information data will be accessed when downloading an application, and then be reminded again just before the personal information data is accessed by the application.

[0328] In addition, it is the intention of the present disclosure that personal information data should be managed and processed in a manner that minimizes the risk of unintentional or unauthorized access or use. Once the data is no longer needed, the risk can be minimized by limiting the collection of data and deleting the data. In addition, and when applicable, including in certain health-related applications, data de-identification can be used to protect the privacy of users. Where appropriate, de-identification can be facilitated by removing specific identifiers (e.g., date of birth, etc.), controlling the amount or characteristics of stored data (e.g., collecting location data at the city level rather than the address level), controlling how the data is stored (e.g., aggregating data between users), and / or other methods.

[0329] Thus, while the present disclosure broadly covers the use of personal information data to implement one or more of the various disclosed embodiments, the present disclosure also contemplates that various embodiments may also be implemented without requiring access to such personal information data. That is, the various embodiments of the present technology will not fail to function properly due to the lack of all or a portion of such personal information data. For example, tactile output may be provided based on non-personal information data or an absolute minimum amount of personal information (such as an event or state at a device associated with a user, other non-personal information, or publicly available information).

[0330] The following clauses further describe various embodiments including various features described above and / or shown in the accompanying drawings:

[0331] Clause 1. A wearable system, comprising:

[0332] Head-mounted displays;

[0333] a set of sensors; and

[0334] A processor, the processor being configured to:

[0335] determining whether activation criteria have been met;

[0336] In response to satisfying the activation criteria, entering a focus mode that reduces distractions in the extended reality environment; and

[0337] When in the Focus Mode:

[0338] receiving imaging data of a physical environment using the set of sensors;

[0339] using the imaging data to identify an object located within a first area of ​​the physical environment and satisfying an interference criterion;

[0340] selecting additional content based on the identified object;

[0341] generating the extended reality environment, the extended reality environment comprising a reproduction of the first area of ​​the physical environment, wherein the reproduction comprises a sub-area in which the imaging data associated with the identified object is replaced with the additional content; and

[0342] The augmented reality environment is displayed using the head mounted display.

[0343] Clause 2. The wearable system of clause 1, wherein the processor is configured to:

[0344] determining a current activity of the user;

[0345] determining a level of concentration associated with the current activity; and

[0346] The distraction criterion is selected based on the determined level of concentration.

[0347] Clause 3. The wearable system of clause 2, wherein the processor is configured to:

[0348] A determination is made based on the current activity as to whether the activation criteria have been met.

[0349] Clause 4. The wearable system of clause 1, wherein:

[0350] The additional content includes a virtual environment representing the physical environment with the identified object removed.

[0351] Clause 5. The wearable system of clause 1, wherein:

[0352] The additional content includes a virtual object.

[0353] Clause 6. The wearable system of clause 5, wherein:

[0354] The virtual object is generated using the imaging data of the physical environment associated with the object.

[0355] Clause 7. The wearable system of clause 1, wherein:

[0356] Determining whether the activation criteria have been met includes:

[0357] detecting the user's attention state; and

[0358] It is determined whether the attention state satisfies an attention threshold.

[0359] Clause 8. The wearable system of clause 1, wherein the processor is configured to:

[0360] determining the user's attention state; and

[0361] The distraction criterion is selected based on the determined attention state.

[0362] Clause 9. The wearable system of clause 1, wherein selecting the additional content based on the identified object comprises:

[0363] determining an object type of the identified object; and

[0364] The additional content is selected using stored user preferences for the determined object type.

[0365] Clause 10. A head mounted device worn by a user, the head mounted device comprising:

[0366] monitor;

[0367] a first set of sensors configured to detect a physical environment surrounding the user;

[0368] a second set of sensors configured to measure one or more physiological parameters of the user; and

[0369] A processor, the processor being configured to:

[0370] generating an extended reality environment comprising a first reproduction of a first portion of the physical environment;

[0371] using the display to display the augmented reality environment;

[0372] detecting user engagement with a candidate object in the first representation using the second set of sensors;

[0373] In response to the detected user engagement satisfying the selection criteria, assigning a distraction type to the candidate object;

[0374] In response to satisfying the activation criteria, entering a focus mode that reduces distractions in the extended reality environment; and

[0375] When in the Focus Mode:

[0376] receiving imaging data of the physical environment surrounding the user using the first set of sensors;

[0377] using the imaging data to identify a target object associated with a selected disturbance type and located within a second area of ​​the physical environment; and

[0378] The extended reality environment is generated, the extended reality environment comprising a second rendition of the second area of ​​the physical environment, wherein the target object is replaced with additional content.

[0379] Clause 11. The head mounted device of clause 10, wherein:

[0380] Detecting the user's engagement with the candidate object includes determining an amount of time that the user's gaze location corresponds to the candidate object; and

[0381] The selection criterion is a time threshold.

[0382] Clause 12. The head mounted device of clause 10, wherein the processor is configured to:

[0383] Detecting the user's engagement with the candidate object while in the focus mode.

[0384] Clause 13. The head mounted device of clause 12, wherein:

[0385] The target object is the candidate object.

[0386] Clause 14. A head mounted device as described in Clause 10, wherein the additional content is selected based on the interference type.

[0387] Clause 15. The head mounted device of clause 10, wherein the processor is configured to, during the focus mode:

[0388] determining a current activity of the user;

[0389] determining whether the target object is associated with the current activity; and

[0390] In response to determining that the target object is not associated with the current activity, generating the extended reality environment including the second rendering.

[0391] Clause 16. The head mounted device of clause 10, wherein the processor is configured to:

[0392] The user is prompted to confirm the selected interference type.

[0393] Clause 17. A method for operating a head mounted device during a focus mode to reduce distractions in an extended reality environment, the method comprising:

[0394] Using a set of sensors to receive imaging data of the physical environment around the user;

[0395] identifying a candidate object in a portion of the physical environment using the imaging data; selecting a first interference criterion;

[0396] determining that the candidate object does not satisfy the first interference criterion;

[0397] generating the extended reality environment, the extended reality environment comprising a first rendition of the portion of the physical environment having the candidate object;

[0398] Using a display to display the augmented reality environment;

[0399] Selecting a second interference criterion;

[0400] determining that the candidate object satisfies the second interference criterion;

[0401] updating the extended reality environment to include a second rendition of the portion of the physical environment replacing the candidate object with additional content; and

[0402] The updated augmented reality environment is displayed using the display.

[0403] Clause 18. The method according to clause 17, comprising:

[0404] Determining the current activity of the user as a first activity; and

[0405] Determining that the current activity has changed from the first activity to a second activity, wherein:

[0406] selecting the first interference criterion using the first activity; and

[0407] The second interference criterion is selected using the second activity.

[0408] Clause 19. The method according to clause 18, wherein:

[0409] The additional content is selected using the second activity.

[0410] Clause 20. The method according to clause 17, comprising:

[0411] determining that the user's attention state is a first state; and

[0412] determining that the attention state has changed from the first state to a second state, wherein:

[0413] selecting the first interference criterion using the first state; and

[0414] The second interference criterion is selected using the second state.

[0415] Clause 21. A wearable system, the wearable system comprising:

[0416] Head-mounted displays;

[0417] a set of sensors; and

[0418] A processor, the processor being configured to:

[0419] determining whether activation criteria have been met;

[0420] Determine the user's current activity;

[0421] In response to satisfying the activation criteria, entering a focus mode that reduces distractions in the extended reality environment; and

[0422] When in the Focus Mode:

[0423] receiving imaging data of a physical environment surrounding the user using the set of sensors;

[0424] selecting a primary area and a peripheral area of ​​the extended reality environment, wherein the primary area corresponds to a first area of ​​the physical environment and the peripheral area corresponds to a second area of ​​the physical environment;

[0425] generating the extended reality environment having the primary area and the peripheral area, wherein the primary area includes content associated with the current activity and the peripheral area includes a modified representation of the second area of ​​the physical environment; and

[0426] causing the head mounted display to display the extended reality environment, wherein:

[0427] The modified representation is generated by applying a modification to imaging data associated with the second area of ​​the physical environment.

[0428] Clause 22. The wearable system of clause 21, wherein the processor is configured to:

[0429] The main area and the peripheral area are selected based on the current activity.

[0430] Clause 23. The wearable system of clause 22, wherein:

[0431] Selecting the primary area and the peripheral area based on the current activity includes:

[0432] Determining that the first area of ​​the physical environment is associated with the current activity; and determining that the second area of ​​the physical environment is not associated with the current activity.

[0433] Clause 24. The wearable system of clause 21, wherein the processor is configured to:

[0434] A determination is made based on the current activity as to whether the activation criteria have been met.

[0435] Clause 25. The wearable system of clause 21, wherein the processor is configured to:

[0436] The modification is selected based on the current activity.

[0437] Clause 26. The wearable system of clause 25, wherein:

[0438] Selecting the modification based on the current activity includes:

[0439] determining a level of concentration associated with the current activity; and

[0440] The modification is selected based on the determined level of concentration.

[0441] Clause 27. The wearable system of clause 21, wherein:

[0442] The content associated with the current activity includes a rendering of a portion of the first area of ​​the physical environment.

[0443] Clause 28. The wearable system of clause 27, wherein the processor is configured, when in the focus mode:

[0444] Using the imaging data to identify an object located within the first area of ​​the physical environment and satisfying an interference criterion, wherein:

[0445] The rendering includes a sub-region in which imaging data associated with the identified object is replaced with additional content.

[0446] Clause 29. A wearable system as described in Clause 21, wherein the modification is a synthetic blur effect.

[0447] Clause 30. A wearable system, the wearable system comprising:

[0448] Head-mounted displays;

[0449] a set of sensors; and

[0450] A processor, the processor being configured to:

[0451] receiving imaging data of a physical environment surrounding a user using the set of sensors;

[0452] Entering a focus mode that reduces distractions in the extended reality environment; and

[0453] When in the Focus Mode:

[0454] selecting an area of ​​the physical environment;

[0455] applying the modification to the imaging data associated with the region to generate a modified representation of the region;

[0456] selecting a candidate object in the physical environment that satisfies a selection criterion; and generating the extended reality environment including the modified representation of the area and a rendering of the candidate object.

[0457] Clause 31. The wearable system of clause 30, wherein the processor is configured to determine a current activity of the user, wherein:

[0458] Selecting the candidate object includes determining that the candidate object is associated with the current activity.

[0459] Clause 32. The wearable system of clause 31, wherein:

[0460] Selecting the region includes determining that the region is not associated with the current activity.

[0461] Clause 33. The wearable system of clause 31, wherein the processor is configured to:

[0462] The modification is selected based on the current activity.

[0463] Clause 34. The wearable system of clause 30, wherein:

[0464] The processor is configured to detect a user's engagement with the candidate object; and

[0465] Selecting the candidate includes determining that the user engagement satisfies an engagement criterion.

[0466] Clause 35. The wearable system of clause 34, wherein the processor is configured to:

[0467] After selecting the candidate, determining that the user engagement no longer meets the engagement criterion;

[0468] updating the region to include an additional region associated with the candidate object;

[0469] applying the modification to imaging data associated with the updated region to generate a modified representation of the updated region; and

[0470] The extended reality environment is updated to include the modified representation of the updated area.

[0471] Clause 36. The wearable system of clause 30, wherein the processor is configured, in response to entering the focus mode:

[0472] The user is prompted to select the modification from a set of candidate modifications.

[0473] Clause 37. A wearable system, the wearable system comprising:

[0474] Head-mounted displays;

[0475] a set of sensors; and

[0476] A processor, the processor being configured to:

[0477] receiving imaging data of a physical environment surrounding a user using the set of sensors;

[0478] Entering a focus mode that reduces distractions in the extended reality environment; and

[0479] When in the Focus Mode:

[0480] determining a current activity of the user;

[0481] determining that a first area of ​​the physical environment is associated with the current activity;

[0482] determining that a second area of ​​the physical environment is not associated with the current activity; and

[0483] Select Modify;

[0484] generating a modified representation of the second area of ​​the physical environment using the modification; and

[0485] generating the extended reality environment, the extended reality environment comprising a rendition of the first area of ​​the physical environment and the modified representation of the second area of ​​the physical environment; and

[0486] The head mounted display is caused to display the extended reality environment.

[0487] Clause 38. The wearable system of clause 37, wherein the processor is configured to:

[0488] determining the user's attention state; and

[0489] The modification is selected based on the determined attention state.

[0490] Clause 39. The wearable system of clause 37, wherein the processor is configured to:

[0491] identifying one or more objects within the first area; wherein:

[0492] The rendering of the first area of ​​the physical environment includes a sub-area in which imaging data associated with the identified object is replaced with the additional content.

[0493] Clause 40. A wearable system as described in Clause 37, wherein the modification is a style transfer effect.

[0494] Clause 41. A wearable system, the wearable system comprising:

[0495] Head-mounted displays;

[0496] a set of sensors; and

[0497] A processor, the processor being configured to:

[0498] In response to determining that the first activation criteria have been met, entering a first focus mode that reduces distractions in the extended reality environment; and

[0499] When in the first focus mode:

[0500] receiving imaging data of the physical environment surrounding the user using the set of sensors; and

[0501] causing the head mounted display to display the extended reality environment, the extended reality environment comprising a reproduction of a first portion of the physical environment, wherein distracting objects in the first portion of the physical environment are replaced with additional content;

[0502] In response to determining that the second activation criteria have been met, entering a second focus mode that reduces distractions in the extended reality environment; and

[0503] When in the second focus mode:

[0504] receiving imaging data of the physical environment surrounding the user using the set of sensors; and

[0505] The head mounted display is caused to display the extended reality environment including a modified representation of the second portion of the physical environment.

[0506] Clause 42. The wearable system of clause 41, wherein the processor is configured to:

[0507] determining a current activity of the user;

[0508] determining a level of concentration associated with the current activity;

[0509] In response to the concentration level exceeding a first threshold, determining that the first activation criterion has been met;

[0510] In response to the concentration level exceeding a second threshold, it is determined that the second activation criterion has been met.

[0511] Clause 43. The wearable system of clause 42, wherein:

[0512] The first threshold is smaller than the second threshold.

[0513] Clause 44. The wearable system of clause 41, wherein the processor is configured to:

[0514] determining that a candidate object in the first portion of the physical environment satisfies an interference criterion;

[0515] as well as

[0516] The candidate object is selected as the interfering object.

[0517] Clause 45. The wearable system of clause 44, wherein the processor is configured to:

[0518] determining the user's current activity; and

[0519] The interference criterion is selected based on the determined current activity.

[0520] Clause 46. The wearable system of clause 41, wherein the processor is configured to:

[0521] determining a current activity of the user;

[0522] determining that the second portion of the physical environment is not associated with the current activity; and

[0523] Determining that a third portion of the physical environment is associated with the current activity, wherein:

[0524] Causing the head mounted display to display the extended reality environment including the modified representation of the second portion of the physical environment includes causing the head mounted display to display the extended reality environment including a rendering of the third portion of the physical environment.

[0525] Clause 47. The wearable system of clause 41, wherein the processor is configured to:

[0526] determining a current activity of the user;

[0527] selecting a modification based on the determined current activity; and

[0528] The modification is applied to imaging data associated with the second portion of the physical environment to generate the modified representation of the second portion of the physical environment.

[0529] Clause 48. The wearable system of clause 47, wherein the processor is configured to:

[0530] determining a level of concentration associated with the determined current activity, wherein

[0531] Selecting the modification based on the current activity includes selecting the modification based on the determined level of concentration.

[0532] Clause 49. The wearable system of clause 41, wherein the processor is configured to:

[0533] receiving activation input from the user; and

[0534] In response to the received activation input being associated with the first focus mode, it is determined that the first activation criteria has been met.

[0535] Clause 50. The wearable system of clause 49, wherein the processor is configured to:

[0536] The user is prompted to select a target focus mode from a set of candidate focus modes.

[0537] Clause 51. A wearable system, the wearable system comprising:

[0538] Head-mounted displays;

[0539] a set of sensors; and

[0540] A processor, the processor being configured to:

[0541] receiving imaging data of a physical environment surrounding a user using the set of sensors;

[0542] Identify that the user is initiating the activity:

[0543] In response to identifying that the user is initiating the activity:

[0544] causing the head mounted display to display a plurality of selectable options, each option being associated with a corresponding focus mode for reducing distractions in an extended reality environment;

[0545] detecting input selecting one of the plurality of selectable options corresponding to the selected focus mode;

[0546] Enter the selected focus mode; and

[0547] When in Focus mode selected:

[0548] selecting a portion of the physical environment based on the selected focus mode; and

[0549] The head mounted display is caused to present the extended reality environment in which imaging data associated with the portion of the physical environment is replaced with additional content.

[0550] Clause 52. The wearable system of clause 51, wherein the processor is configured to:

[0551] The plurality of selectable options are selected based on the activity.

[0552] Clause 53. The wearable system of clause 52, wherein the processor is configured to:

[0553] Determine a level of concentration associated with the activity, where:

[0554] Selecting the plurality of selectable options based on the activity includes selecting the plurality of selectable options based on the determined level of concentration.

[0555] Clause 54. A wearable system as described in Clause 51, wherein the additional content is a modified representation of the portion of the physical environment.

[0556] Clause 55. A wearable system as described in Clause 51, wherein the additional content includes a virtual object.

[0557] Clause 56. The wearable system of clause 51, wherein the processor is configured to:

[0558] determining that the activity has changed; and

[0559] In response to determining that the activity has changed, the selected focus mode is exited.

[0560] Clause 57. A wearable system, the wearable system comprising:

[0561] Head-mounted displays;

[0562] a set of sensors; and

[0563] A processor, the processor being configured to:

[0564] receiving imaging data of a physical environment surrounding a user using the set of sensors;

[0565] In response to determining that the activation criteria have been met, determining a first attention state of the user;

[0566] selecting a first focus mode to reduce distractions in an extended reality environment, the first focus mode selected based on the first attention state;

[0567] Entering the first focus mode, wherein the processor is configured to:

[0568] selecting a first portion of the physical environment based on a first criterion; and

[0569] causing the head mounted display to present the extended reality environment in which imaging data associated with the first portion of the physical environment is replaced with first additional content;

[0570] determining that the first attention state has changed to a second attention state;

[0571] selecting a second focus mode that reduces distractions in the extended reality environment, the second focus mode selected based on the second attention state;

[0572] changing from the first focus mode to the second focus mode, wherein the processor is configured to:

[0573] selecting a second portion of the physical environment based on a second criterion; and

[0574] The head mounted display is caused to present the extended reality environment in which imaging data associated with the second portion of the physical environment is replaced with second additional content.

[0575] Clause 58. The wearable system of clause 57, wherein:

[0576] The first additional content is a virtual object; and

[0577] The second additional content is a modified representation of the second portion of the physical environment.

[0578] Clause 59. The wearable system of clause 57, wherein the processor is configured to:

[0579] determining the user's current activity; and

[0580] A determination is made as to whether the activation criteria have been met based on the determined current activity.

[0581] Clause 60. The wearable system of clause 57, wherein:

[0582] Selecting the first portion of the physical environment based on the first criteria includes determining that the first portion of the physical environment is not associated with the determined current activity.

[0583] Clause 61. A wearable system, the wearable system comprising:

[0584] Head-mounted displays;

[0585] a set of sensors; and

[0586] A processor, the processor being configured to:

[0587] causing the wearable system to enter a focus mode that reduces distractions in an extended reality environment; and

[0588] In focus mode:

[0589] receiving imaging data of a physical environment surrounding a user using the set of sensors;

[0590] selecting an area of ​​the physical environment that includes an object that satisfies an interference criterion;

[0591] causing the head mounted display to display the extended reality environment in which imaging data associated with the area of ​​the physical environment is replaced with additional content;

[0592] detecting user engagement corresponding to the additional content satisfying an interaction criterion; and

[0593] In response to detecting the user engagement corresponding to the additional content, the augmented reality environment is updated to include a rendering of a portion of the object.

[0594] Clause 62. A wearable system as described in Clause 61, wherein the additional content includes a virtual object.

[0595] Clause 63. The wearable system of clause 62, wherein the processor is configured to:

[0596] identifying a category associated with the object; and

[0597] The virtual object is selected using the identified category.

[0598] Clause 64. The wearable system of clause 62, wherein:

[0599] The object is a display screen; and

[0600] The virtual object is a display screen on which predetermined content is displayed.

[0601] Clause 65. The wearable system of clause 61, wherein the processor is configured to:

[0602] determining a current activity of the user;

[0603] determining a level of concentration associated with the determined current activity; and

[0604] The distraction criterion is selected based on the determined level of concentration.

[0605] Clause 66. A wearable system as described in Clause 61, wherein the additional content includes a modified representation of the area.

[0606] Clause 67. A wearable system as described in Clause 61, wherein the extended reality environment includes a rendering of an additional area of ​​the physical environment.

[0607] Clause 68. The wearable system of clause 61, wherein:

[0608] Detecting user engagement with the additional content includes determining an amount of time that a gaze position of the user corresponds to the additional content; and

[0609] The interaction criterion is a time threshold.

[0610] Clause 69. The wearable system of clause 61, wherein:

[0611] Detecting user engagement with the additional content includes detecting a predefined gesture of the user corresponding to the additional content.

[0612] Clause 70. The wearable system of clause 61, wherein:

[0613] Detecting user engagement with the additional content includes detecting a voice command corresponding to the additional content.

[0614] Clause 71. A wearable system, the wearable system comprising:

[0615] Head-mounted displays;

[0616] a set of sensors; and

[0617] A processor, the processor being configured to:

[0618] In response to determining that the first activation criteria have been met, entering a focus mode that reduces distractions in the extended reality environment; and

[0619] When in the Focus Mode:

[0620] receiving imaging data of the physical environment surrounding the user using the set of sensors; and

[0621] causing the head mounted display to display the extended reality environment, the extended reality environment comprising a reproduction of a portion of the physical environment, wherein objects in the portion of the physical environment are replaced with additional content;

[0622] detecting a change in the object using the set of sensors; and

[0623] In response to the change to the object satisfying an update criterion, the rendering of the portion of the physical environment is updated to remove the additional content.

[0624] Clause 72. The wearable system of clause 71, wherein:

[0625] detecting the change in the object comprises movement of the object; and

[0626] The update criteria include one or more movement criteria.

[0627] Clause 73. The wearable system of clause 71, wherein:

[0628] Detecting the change in the object includes movement of the object includes detecting a change in the appearance of the object.

[0629] Clause 74. The wearable system of clause 72, wherein:

[0630] Updating the reproduction of the portion of the physical environment to remove the additional content includes replacing the additional content with updated additional content.

[0631] Clause 75. The wearable system of clause 71, wherein:

[0632] The updated additional content includes a modified representation of the object.

[0633] Clause 76. A wearable system, the wearable system comprising:

[0634] Head-mounted displays;

[0635] a set of sensors; and

[0636] A processor, the processor being configured to:

[0637] Operate in multiple focus modes to reduce distractions in extended reality environments

[0638] In each focus mode of the plurality of focus modes:

[0639] receiving imaging data of a physical environment surrounding a user using the set of sensors;

[0640] identifying objects in the physical environment that meet interference criteria;

[0641] causing the head mounted display to display the extended reality environment, the extended reality environment comprising a first area reproducing the physical environment and a second area replacing the objects in the physical environment with additional content; and determining a user engagement corresponding to the second area;

[0642] In a first focus mode among the plurality of focus modes:

[0643] In response to the determined user engagement satisfying a first criterion, updating the second area of ​​the extended reality environment to render the object; and

[0644] In a second focus mode among the plurality of focus modes:

[0645] In response to the determined user engagement satisfying a second criterion different from the first criterion, the second area of ​​the augmented reality environment is updated to render the object.

[0646] Clause 77. The wearable system of clause 76, wherein the processor is configured to:

[0647] detecting the user's attention state; and

[0648] In response to determining that the detected attention state satisfies a focus threshold, entering the second focus mode.

[0649] Clause 78. The wearable system of clause 76, wherein the processor is configured to:

[0650] detecting a current activity of the user;

[0651] In response to determining that the detected current activity is a first activity, entering the first focus mode; and

[0652] In response to determining that the detected current activity is a second activity, entering the second focus mode.

[0653] Clause 79. The wearable system of clause 76, wherein:

[0654] Detecting user engagement corresponding to the second area includes determining an amount of time a gaze location of the user corresponds to the second area; and

[0655] The first criterion is a first time threshold; and

[0656] The second criterion is a second time threshold.

[0657] Clause 80. The wearable system of clause 76, wherein the processor is configured to:

[0658] switching from the first focus mode to the second focus mode in response to satisfying a switching criterion; and

[0659] In response to switching from the first focus mode to the second focus mode, the additional content is updated.

[0660] Clause 81. A wearable system, the wearable system comprising:

[0661] Head-mounted displays;

[0662] a set of sensors; and

[0663] A processor, the processor being configured to:

[0664] Determining that the user is initiating a first activity in the extended reality environment;

[0665] In response to determining that the user is initiating the first activity:

[0666] selecting a focus criterion associated with the first activity;

[0667] detecting the user's attention state using the set of sensors;

[0668] determining whether the detected attention state satisfies the focus criterion; and

[0669] In response to the detected attention state failing to satisfy the focus criterion,

[0670] The head mounted display is caused to display a notification in the extended reality environment.

[0671] Clause 82. The wearable system of clause 81, wherein:

[0672] The notification includes a first affordance; and

[0673] The processor is configured to initiate a second activity in the extended reality environment in response to user selection of the first affordance.

[0674] Clause 83. The wearable system of clause 82, wherein:

[0675] The second activity is selected based on the detected attention state.

[0676] Clause 84. The wearable system of clause 82, wherein:

[0677] The processor is configured to resume the first activity after the second activity is terminated.

[0678] Clause 85. The wearable system of clause 82, wherein:

[0679] The notification includes a second affordance; and

[0680] The processor is configured to resume the first activity in response to the user selection of the second affordance.

[0681] Clause 86. The wearable system of clause 81, wherein:

[0682] The notification includes a first affordance; and

[0683] The processor is configured to initiate a focus mode that reduces distractions in the extended reality environment in response to user selection of the first affordance.

[0684] Clause 87. The wearable system of clause 86, wherein:

[0685] The focus mode is selected from a set of candidate focus modes based on the detected attention state.

[0686] Clause 88. The wearable system of clause 81, wherein selecting the focus criterion associated with the first activity comprises selecting the focus criterion using calibration information for the user.

[0687] Clause 89. A wearable system, the wearable system comprising:

[0688] Head-mounted displays;

[0689] a set of sensors; and

[0690] A processor, the processor being configured to:

[0691] receiving imaging data of a physical environment surrounding a user using the set of sensors;

[0692] determining estimated future activity of the user;

[0693] Based on the estimated future activity, selecting a focus mode from a set of candidate focus modes that reduce distractions in the extended reality environment; and

[0694] Enters the selected focus mode, during which the processor:

[0695] The head mounted display is caused to display the extended reality environment including a first area including a reproduction of a first portion of the physical environment and a second area including additional content.

[0696] Clause 90. The wearable system of clause 89, wherein the processor is configured to:

[0697] detecting the user's attention state; and

[0698] The additional content is selected based on the detected attention state.

[0699] Clause 91. The wearable system of clause 89, wherein:

[0700] Selecting the focus mode from the set of candidate focus modes includes selecting the focus mode based on the imaging data of the physical environment around the user.

[0701] Clause 92. The wearable system of clause 89, wherein the processor is configured to:

[0702] determining that the user has initiated a current activity that is different from the estimated future activity; and in response to determining that the user has initiated the current activity, exiting the selected focus mode.

[0703] Clause 93. The wearable system of clause 89, wherein the processor is configured to:

[0704] Estimated future activity is determined using the imaging data of the physical environment surrounding the user.

[0705] Clause 94. The wearable system of clause 93, wherein:

[0706] Determining the estimated future activity includes identifying a target object in the imaging data of the physical environment surrounding the user.

[0707] Clause 95. The wearable system of clause 89, wherein the processor is configured to:

[0708] Estimated future activities are determined based on scheduled events.

[0709] Clause 96. A wearable system, the wearable system comprising:

[0710] Head-mounted displays;

[0711] a set of sensors; and

[0712] A processor, the processor being configured to:

[0713] Determining that the user is performing a first activity in the extended reality environment;

[0714] When the user is performing the first activity:

[0715] detecting the user's attention state using the set of sensors;

[0716] determining whether the detected attention state satisfies a focus criterion associated with the first activity; and

[0717] In response to the detected attention state not satisfying the focus criterion:

[0718] pausing the first activity; and

[0719] A second activity is initiated in the extended reality environment.

[0720] Clause 97. A wearable system as described in Clause 96, wherein initiating the second activity includes generating a virtual environment in the extended reality environment.

[0721] Clause 98. The wearable system of clause 96, wherein the processor is configured to, in response to the detected attention state failing to satisfy the focus criterion:

[0722] presenting a list of candidate activities using the head mounted display;

[0723] receiving a user selection corresponding to the second activity; and

[0724] The second activity is initiated in response to receiving the user selection.

[0725] Clause 99. The wearable system of clause 98, wherein:

[0726] The candidate activity list is selected based on the detected attention state.

[0727] Clause 100. A wearable system as described in clause 96, wherein the concentration criterion changes with the duration of the first activity.

[0728] In different embodiments, the methods, devices and systems described herein can be implemented in software, hardware or a combination thereof. For the purpose of explanation, the foregoing description uses specific naming to provide a thorough understanding of the described embodiments. However, it will be apparent to those skilled in the art that specific details are not required in order to practice the described embodiments. Therefore, for the purpose of illustration and description, the foregoing description of the specific embodiments described herein is presented. They are not intended to be exhaustive or to limit the embodiments to the disclosed precise forms. It will be apparent to those of ordinary skill in the art that, in view of the above teachings, many modifications and variations are possible.

Claims

1. A wearable system, comprising: Head-mounted displays; A set of sensors; and A processor, the processor being configured to: determining whether activation criteria have been met; In response to satisfying the activation criteria, entering a focus mode that reduces distractions in the extended reality environment; and When in the Focus Mode: receiving imaging data of a physical environment using the set of sensors; using the imaging data to identify an object located within a first area of ​​the physical environment and satisfying an interference criterion; selecting additional content based on the identified object; generating the extended reality environment, the extended reality environment comprising a reproduction of the first area of ​​the physical environment, wherein the reproduction comprises a sub-area in which the imaging data associated with the identified object is replaced with the additional content; as well as The augmented reality environment is displayed using the head mounted display.

2. The wearable system of claim 1, wherein the processor is configured to: determining a current activity of the user; determining a level of concentration associated with the current activity; and The distraction criterion is selected based on the determined level of concentration.

3. The wearable system of claim 2, wherein the processor is configured to: A determination is made based on the current activity as to whether the activation criteria have been met.

4. The wearable system according to claim 1, wherein: The additional content includes a virtual environment representing the physical environment with the identified object removed.

5. The wearable system according to claim 1, wherein: The additional content includes a virtual object.

6. The wearable system according to claim 5, wherein: The virtual object is generated using the imaging data of the physical environment associated with the object.

7. The wearable system according to claim 1, wherein: Determining whether the activation criteria have been met includes: detecting the user's attention state; and It is determined whether the attention state satisfies an attention threshold.

8. The wearable system of claim 1 , wherein the processor is configured to: determining the user's attention state; and The distraction criterion is selected based on the determined attention state.

9. The wearable system of claim 1 , wherein selecting the additional content based on the identified object comprises: determining an object type of the identified object; as well as The additional content is selected using stored user preferences for the determined object type.

10. A head mounted device worn by a user, the head mounted device comprising: monitor; a first set of sensors configured to detect a physical environment surrounding the user; a second set of sensors configured to measure one or more physiological parameters of the user; and A processor, the processor being configured to: generating an extended reality environment comprising a first reproduction of a first portion of the physical environment; using the display to display the augmented reality environment; detecting user engagement with a candidate object in the first representation using the second set of sensors; In response to the detected user engagement satisfying the selection criteria, assigning a distraction type to the candidate object; In response to satisfying an activation criterion, entering a focus mode that reduces distractions in the extended reality environment; as well as When in the Focus Mode: receiving imaging data of the physical environment surrounding the user using the first set of sensors; using the imaging data to identify a target object associated with a selected disturbance type and located within a second area of ​​the physical environment; as well as The extended reality environment is generated, the extended reality environment comprising a second rendition of the second area of ​​the physical environment, wherein the target object is replaced with additional content.

11. The head mounted device of claim 10, wherein: Detecting the user's engagement with the candidate object includes determining an amount of time that the user's gaze location corresponds to the candidate object; and The selection criterion is a time threshold.

12. The head mounted device of claim 10, wherein the processor is configured to: Detecting the user's engagement with the candidate object while in the focus mode.

13. The head mounted device of claim 12, wherein: The target object is the candidate object.

14. The head mounted device of claim 10, wherein the additional content is selected based on the distraction type.

15. The head mounted device of claim 10, wherein the processor is configured to: during the focus mode: determining a current activity of the user; determining whether the target object is associated with the current activity; and In response to determining that the target object is not associated with the current activity, generating the extended reality environment including the second rendering.

16. The head mounted device of claim 10, wherein the processor is configured to: The user is prompted to confirm the selected interference type.

17. A method for operating a head mounted device during a focus mode to reduce distractions in an extended reality environment, the method comprising: Using a set of sensors to receive imaging data of the physical environment around the user; using the imaging data to identify a candidate object in a portion of the physical environment; Selecting a first interference criterion; determining that the candidate object does not satisfy the first interference criterion; generating the extended reality environment, the extended reality environment comprising a first rendition of the portion of the physical environment having the candidate object; Using a display to display the augmented reality environment; Selecting a second interference criterion; determining that the candidate object satisfies the second interference criterion; updating the extended reality environment to include a second rendition of the portion of the physical environment replacing the candidate object with additional content; and The updated augmented reality environment is displayed using the display.

18. The method according to claim 17, comprising: Determining that the current activity of the user is a first activity; as well as Determining that the current activity has changed from the first activity to a second activity, wherein: selecting the first interference criterion using the first activity; and The second interference criterion is selected using the second activity.

19. The method of claim 18, wherein: The additional content is selected using the second activity.

20. The method according to claim 17, comprising: Determining that the user's attention state is a first state; as well as determining that the attention state has changed from the first state to a second state, wherein: selecting the first interference criterion using the first state; and The second interference criterion is selected using the second state.

Images