Display of user interface based on context of electronic device

Abstract

The invention relates to display of a user interface based on a context of an electronic device. Some examples of the present disclosure relate to systems and methods for displaying one or more user interfaces based on a context of an electronic device within a physical environment. In some examples, optionally when a computer-generated environment is presented at the electronic device, the electronic device detects initiation of an exercise activity associated with a user of the electronic device. In some examples, in response to detecting the initiation of the exercise activity, the electronic device activates an exercise tracking mode of operation. In some examples, the electronic device captures one or more images of a physical environment while the exercise tracking mode of operation is in an active state. In some examples, the electronic device performs a first operation associated with the exercise tracking mode of operation in accordance with detecting a feature of the physical environment in the one or more images.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims the benefit of U.S. Provisional Application No. 63 / 583,567, filed on September 18, 2023, and U.S. Patent Application No. 18 / ---,---, filed on August ----, 2024, the contents of both applications are incorporated herein by reference in their entirety for all purposes. Technical Field

[0002] The present application generally relates to systems and methods for selectively controlling the display of a user electronic device based on the context of the electronic device within a computer-generated environment. Background Art

[0003] Some electronic devices are used to track a user's activities, such as exercise activities. In some examples, when a user is participating in an activity, the electronic device presents a user interface corresponding to the activity. Systems and methods are needed for selectively controlling and / or updating the display of a user interface corresponding to an activity based on changes in the context of the electronic device in a physical environment. Summary of the invention

[0004] Some examples of the present disclosure relate to systems and methods for displaying one or more user interfaces based on the context of an electronic device within a physical environment. In some examples, a method is performed at an electronic device that communicates with a display, one or more input devices, and one or more cameras. In some examples, optionally when a computer-generated environment is presented at the electronic device, the electronic device detects the initiation of an exercise activity associated with a user of the electronic device via the one or more input devices. In some examples, in response to detecting the initiation of the exercise activity, the electronic device activates an exercise tracking operation mode. In some examples, when the exercise tracking operation mode is active, the electronic device captures one or more images of the physical environment via the one or more cameras. In some examples, based on detecting features of the physical environment in the one or more images, the electronic device performs a first operation associated with the exercise tracking operation mode and for the computer-generated environment presented at the electronic device.

[0005] In some examples, activating the exercise tracking operating mode includes: displaying, via a display, one or more representations of one or more health metrics associated with the exercise activity and tracked by the electronic device during the exercise activity. In some examples, the physical environment of which one or more images are captured is the physical environment in which the user performs the exercise activity. In some examples, detecting a feature of the physical environment includes: detecting a physical object associated with a part of the user. In some such examples, performing a first operation includes: displaying one or more visual indications of information associated with the physical object in a computer-generated environment. In some examples, detecting a feature of the physical environment includes: detecting a physical object in the physical environment corresponding to a pause in the exercise activity. In some such examples, performing the first operation includes: temporarily stopping updating the display of the one or more representations of the one or more health metrics associated with the exercise activity (e.g., for the duration of the pause in the exercise activity).

[0006] In some examples, the one or more health metrics associated with the exercise activity include an intensity metric that measures and / or defines the intensity of the exercise activity, such as a relative difficulty of the exercise activity for the user. In some examples, detecting a characteristic of the physical environment includes detecting a change in terrain or other surface material and / or height or slope of the physical environment that corresponds to a change in the intensity metric, because the characteristic of the physical environment will cause the relative difficulty of the exercise activity to change. In some such examples, performing a first operation includes updating the intensity metric, and thereby updating a display of a representation of the intensity metric in the computer-generated environment.

[0007] A comprehensive description of these examples is provided in the drawings and detailed description, and it should be understood that this summary does not limit the scope of the present disclosure in any way. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] For a better understanding of the various examples described herein, reference should be made to the following detailed description and the following drawings. Throughout the drawings, like reference numerals generally refer to corresponding parts.

[0009] Figure 1 An electronic device presenting an extended reality environment according to some examples of the present disclosure is shown.

[0010] Figure 2 A block diagram illustrating an example architecture of a device according to some examples of the present disclosure.

[0011] FIG. 3A to FIG. 3O An example of an electronic device updating a display of a computer-generated environment based on changes in the context of the electronic device within a physical environment according to some examples of the present disclosure is shown.

[0012] Figure 4is a flow chart illustrating an example process for updating a display of a computer-generated environment based on changes in the context of an electronic device within a physical environment according to some examples of the present disclosure. DETAILED DESCRIPTION

[0013] Some examples of the present disclosure relate to systems and methods for displaying one or more user interfaces based on the context of an electronic device within a physical environment. In some examples, a method is performed at an electronic device that communicates with a display, one or more input devices, and one or more cameras. In some examples, optionally when a computer-generated environment is presented at the electronic device, the electronic device detects the initiation of an exercise activity associated with a user of the electronic device via the one or more input devices. In some examples, in response to detecting the initiation of the exercise activity, the electronic device activates an exercise tracking operation mode. In some examples, when the exercise tracking operation mode is active, the electronic device captures one or more images of the physical environment via the one or more cameras. In some examples, based on detecting features of the physical environment in the one or more images, the electronic device performs a first operation associated with the exercise tracking operation mode and for the computer-generated environment presented at the electronic device.

[0014] In some examples, activating the exercise tracking operating mode includes: displaying, via a display, one or more representations of one or more health metrics associated with the exercise activity and tracked by the electronic device during the exercise activity. In some examples, the physical environment of which one or more images are captured is the physical environment in which the user performs the exercise activity. In some examples, detecting a feature of the physical environment includes: detecting a physical object associated with a part of the user. In some such examples, performing a first operation includes: displaying one or more visual indications of information associated with the physical object in a computer-generated environment. In some examples, detecting a feature of the physical environment includes: detecting a physical object in the physical environment corresponding to a pause in the exercise activity. In some such examples, performing the first operation includes: temporarily stopping updating the display of the one or more representations of the one or more health metrics associated with the exercise activity (e.g., for the duration of the pause in the exercise activity).

[0015] In some examples, the one or more health metrics associated with the exercise activity include an intensity metric that measures and / or defines the intensity of the exercise activity, such as a relative difficulty of the exercise activity for the user. In some examples, detecting a characteristic of the physical environment includes detecting a change in terrain or other surface material and / or height or slope of the physical environment that corresponds to a change in the intensity metric, because the characteristic of the physical environment will cause the relative difficulty of the exercise activity to change. In some such examples, performing a first operation includes updating the intensity metric, and thereby updating a display of a representation of the intensity metric in the computer-generated environment.

[0016] Figure 1 An electronic device 101 is illustrated that presents an extended reality (XR) environment (e.g., a computer-generated environment that optionally includes representations of physical and / or virtual objects) according to some examples of the present disclosure. In some examples, such as Figure 1 As shown, the electronic device 101 is a head mounted display or other head mounted device configured to be worn on the head of the user of the electronic device 101. Figure 2 An example of an electronic device 101 is described by using an architectural block diagram of FIG. Figure 1 As shown, electronic device 101 and table 106 are located in a physical environment. The physical environment may include physical features, such as physical surfaces (e.g., floors, walls) or physical objects (e.g., tables, lights, etc.). In some examples, electronic device 101 may be configured to use display 120 to detect and / or capture an image of the physical environment including table 106 (shown in the field of view of electronic device 101).

[0017] In some examples, such as Figure 1 As shown, the electronic device 101 includes one or more internal image sensors 114a (eg, as described below with reference to FIG. 1 ) oriented toward the user's face. Figure 2 101 ). In some examples, internal image sensor 114a is used for eye tracking (e.g., detecting the gaze of a user). Internal image sensor 114a is optionally arranged on the left and right portions of electronic device 101 to enable eye tracking of the left and right eyes of the user. In some examples, electronic device 101 also includes external image sensors 114b and 114c facing outward from the user to detect and / or capture the physical environment of electronic device 101 and / or the movement of the user's hands or other body parts.

[0018] In some examples, the display 120 has a field of view visible to the user (e.g., it may or may not correspond to the field of view of the external image sensors 114b and 114c). Because the display 120 is optionally part of the head-mounted device, the field of view of the display 120 is optionally the same as or similar to the field of view of the user's eyes. In other examples, the field of view of the display 120 may be smaller than the field of view of the user's eyes. In some examples, the electronic device 101 may be an optical see-through device, in which the display 120 is a transparent or translucent display through which parts of the physical environment can be directly viewed. In some examples, the display 120 may be included in a transparent lens and may overlap all or only a portion of the transparent lens. In other examples, the electronic device may be a video pass-through device, in which the display 120 is an opaque display configured to display an image of the physical environment in which the electronic device 101 is located. Although a single display 120 is shown, it should be understood that the display 120 may include a stereo display pair.

[0019] In some examples, in response to a trigger, the electronic device 101 may be configured to display in the XR environment Figure 1 , which does not exist in the physical environment but is displayed in the XR environment on top of the real-world table 106 (or its representation). Optionally, in response to detecting the plane of the table 106 in the physical environment 100, the virtual object 104 can be displayed on the surface of the table 106 in the XR environment displayed via the display 120 of the electronic device 101.

[0020] It should be understood that virtual object 104 is a representative virtual object and may include and render one or more different virtual objects (e.g., virtual objects with various dimensions, such as two-dimensional or other three-dimensional virtual objects) in a three-dimensional XR environment. For example, a virtual object may represent an application or user interface displayed in an XR environment. In some examples, a virtual object may represent content corresponding to an application and / or displayed via a user interface in an XR environment. In some examples, virtual object 104 is optionally configured to be interactive and responsive to user input (e.g., air gestures, such as air pinch gestures, air tap gestures, and / or air touch gestures), allowing a user to virtually touch, tap, move, rotate, or otherwise interact with virtual object 104.

[0021] In some examples, displaying an object in a three-dimensional environment may include interaction with one or more user interface objects in the three-dimensional environment. For example, initiation of display of an object in a three-dimensional environment may include interaction with one or more virtual options / indicators displayed in the three-dimensional environment. In some examples, when display of an object is initiated in a three-dimensional environment, an electronic device may track the user's gaze as an input for identifying one or more virtual options / indicators as targets for selection. For example, gaze may be used to identify one or more virtual options / indicators as targets for selection using another selection input. In some examples, a virtual option / indicator may be selected using hand tracking input detected via an input device that communicates with the electronic device. In some examples, an object displayed in a three-dimensional environment may be moved and / or reoriented in the three-dimensional environment based on movement input detected via an input device.

[0022] In the following discussion, an electronic device is described that communicates with a display generation component and one or more input devices. It should be understood that the electronic device optionally communicates with one or more other physical user interface devices, such as a touch-sensitive surface, a physical keyboard, a mouse, a joystick, a hand tracking device, an eye tracking device, a stylus, and the like. In addition, as described above, it should be understood that the described electronic device, display, and touch-sensitive surface are optionally distributed between two or more devices. Therefore, as used in the present disclosure, information displayed on or by an electronic device is optionally used to describe information output by the electronic device for display on an independent display device (touch-sensitive or non-touch-sensitive). Similarly, as used in the present disclosure, input received on an electronic device (e.g., touch input received on a touch-sensitive surface of an electronic device, or touch input received on the surface of a stylus) is optionally used to describe input received on an independent input device, and the electronic device receives input information from the independent input device.

[0023] The device typically supports a variety of applications, such as one or more of the following applications: a drawing application, a presentation application, a word processing application, a website creation application, a disk editing application, a spreadsheet application, a gaming application, a telephony application, a video conferencing application, an email application, an instant messaging application, a fitness support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, a television channel browsing application, and / or a digital video player application.

[0024] Figure 2A block diagram of an example architecture of a device 201 according to some examples of the present disclosure is shown. In some examples, the device 201 includes one or more electronic devices. For example, the electronic device 201 can be a portable device, an auxiliary device that communicates with another device, a head-mounted display, etc. In some examples, the electronic device 201 corresponds to the above reference Figure 1 An electronic device 101 is described.

[0025] like Figure 2 As illustrated, the electronic device 201 optionally includes various sensors, such as one or more hand tracking sensors 202, one or more position sensors 204, one or more image sensors 206 (optionally corresponding to Figure 1 114a and / or external image sensors 114b and 114c in the example embodiment), one or more touch-sensitive surfaces 209, one or more motion and / or orientation sensors 210, one or more eye-tracking sensors 212, one or more microphones 213 or other audio sensors, one or more body tracking sensors (e.g., torso and / or head tracking sensors), one or more display generation components 214 (optionally corresponding to Figure 1 1), one or more speakers 216, one or more processors 218, one or more memories 220, and / or communication circuits 222. One or more communication buses 208 are optionally used for communication between the above components of the electronic device 201.

[0026] The communication circuit 222 optionally includes circuits for communicating with electronic devices, networks such as the Internet, intranets, wired networks and / or wireless networks, cellular networks, and wireless local area networks (LANs). The communication circuit 222 optionally includes circuits for using near field communication (NFC) and / or short-range communication such as Bluetooth. ® A circuit for communicating.

[0027] Processor 218 includes one or more general-purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some examples, memory 220 is a non-transitory computer-readable storage medium (e.g., flash memory, random access memory, or other volatile or non-volatile memory or storage device) storing computer-readable instructions, which are configured to be executed by processor 218 to perform the techniques, processes, and / or methods described below. In some examples, memory 220 may include more than one non-transitory computer-readable storage medium. A non-transitory computer-readable storage medium may be any medium (e.g., excluding signals) that can tangibly contain or store computer-executable instructions for use by or in conjunction with an instruction execution system, device, and apparatus. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media may include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical disks based on compact disc (CD), digital versatile disc (DVD) or Blu-ray technology, and persistent solid-state memory such as flash memory, solid-state drives, etc.

[0028] In some examples, the display generation component 214 includes a single display (e.g., a liquid crystal display (LCD), an organic light emitting diode (OLED), or other type of display). In some examples, the display generation component 214 includes multiple displays. In some examples, the display generation component 214 may include a display with touch capabilities (e.g., a touch screen), a projector, a holographic projector, a retinal projector, a transparent or translucent display, etc. In some examples, the electronic device 201 includes a touch-sensitive surface 209 for receiving user inputs (such as tap inputs and swipe inputs or other gestures). In some examples, the display generation component 214 and the touch-sensitive surface 209 form a touch-sensitive display (e.g., a touch screen integrated with the electronic device 201 or a touch screen that communicates with the electronic device 201 outside the electronic device 201).

[0029] The electronic device 201 optionally includes an image sensor 206. The image sensor 206 optionally includes one or more visible light image sensors (such as a charge coupled device (CCD) sensor) and / or a complementary metal oxide semiconductor (CMOS) sensor operable to obtain an image of a physical object from a real-world environment. The image sensor 206 also optionally includes one or more infrared (IR) sensors, such as a passive IR sensor or an active IR sensor, for detecting infrared light from the real-world environment. For example, an active IR sensor includes an IR emitter for emitting infrared light into the real-world environment. The image sensor 206 also optionally includes one or more cameras configured to capture the movement of physical objects in the real-world environment. The image sensor 206 also optionally includes one or more depth sensors configured to detect the distance of the physical object from the electronic device 201. In some examples, information from the one or more depth sensors may allow the device to identify an object in the real-world environment and distinguish it from other objects in the real-world environment. In some examples, the one or more depth sensors may allow the device to determine the texture and / or topography of an object in the real-world environment.

[0030] In some examples, the electronic device 201 uses a combination of a CCD sensor, an event camera, and a depth sensor to detect the physical environment around the electronic device 201. In some examples, the image sensor 206 includes a first image sensor and a second image sensor. The first image sensor and the second image sensor work in tandem and are optionally configured to capture different information of physical objects in the real-world environment. In some examples, the first image sensor is a visible light image sensor and the second image sensor is a depth sensor. In some examples, the electronic device 201 uses the image sensor 206 to detect the positioning and orientation of the electronic device 201 and / or the display generation component 214 in the real-world environment. For example, the electronic device 201 uses the image sensor 206 to track the positioning and orientation of the display generation component 214 relative to one or more fixed objects in the real-world environment.

[0031] In some examples, the electronic device 201 includes a microphone 213 or other audio sensor. The electronic device 201 optionally uses the microphone 213 to detect sounds from the user and / or the user's real-world environment. In some examples, the microphone 213 includes a microphone array (multiple microphones) that optionally operate in conjunction to identify ambient noise or locate a sound source in the space of the real-world environment.

[0032] The electronic device 201 includes a location sensor 204 for detecting the location of the electronic device 201 and / or the display generating component 214. For example, the location sensor 204 may include a global positioning system (GPS) receiver that receives data from one or more satellites and allows the electronic device 201 to determine the absolute location of the device in the physical world.

[0033] The electronic device 201 includes an orientation sensor 210 for detecting the orientation and / or movement of the electronic device 201 and / or the display generation component 214. For example, the electronic device 201 uses the orientation sensor 210 to track changes in the position and / or orientation of the electronic device 201 and / or the display generation component 214, such as relative to physical objects in the real world environment. The orientation sensor 210 optionally includes one or more gyroscopes and / or one or more accelerometers.

[0034] In some examples, the electronic device 201 includes a hand tracking sensor 202 and / or an eye tracking sensor 212 and / or other body tracking sensors, such as a leg tracking sensor, a torso tracking sensor, and / or a head tracking sensor. The hand tracking sensor 202 is configured to track the position / location of one or more parts of the user's hand, and / or the movement of one or more parts of the user's hand relative to the extended reality environment, relative to the display generation component 214, and / or relative to another defined coordinate system. The eye tracking sensor 212 is configured to track the position and movement of the user's gaze (more generally, eyes, face, or head) relative to the real world or extended reality environment and / or relative to the display generation component 214. In some examples, the hand tracking sensor 202 and / or the eye tracking sensor 212 are implemented together with the display generation component 214. In some examples, the hand tracking sensor 202 and / or the eye tracking sensor 212 are implemented separately from the display generation component 214.

[0035] In some examples, the hand tracking sensor 202 (and / or other body tracking sensors, such as leg, torso, and / or head tracking sensors) may use an image sensor 206 (e.g., one or more IR cameras, 3D cameras, depth cameras, etc.) that captures three-dimensional information from the real world including one or more body parts (e.g., the hands, legs, torso of a human user). In some examples, the hands may be resolved with sufficient resolution to distinguish fingers and their corresponding positioning. In some examples, one or more image sensors 206 are positioned relative to the user to define a field of view and an interaction space of the image sensor 206 in which finger / hand positions, orientations, and / or movements captured by the image sensor are used as input (e.g., to distinguish from the user's resting hand or other hands of other people in the real-world environment). Tracking fingers / hands for input (e.g., gestures, touches, taps, etc.) may be advantageous because it does not require the user to touch, hold, or wear any type of beacon, sensor, or other marker.

[0036] In some examples, eye tracking sensor 212 includes at least one eye tracking camera (e.g., an infrared (IR) camera) and / or an illumination source (e.g., an IR light source such as an LED) that emits light toward the user's eyes. The eye tracking camera may be pointed toward the user's eyes to receive reflected IR light from the light source directly or indirectly from the eyes. In some examples, both eyes are tracked separately by corresponding eye tracking cameras and illumination sources, and focus / gaze may be determined by tracking both eyes. In some examples, one eye (e.g., the dominant eye) is tracked by one or more corresponding eye tracking cameras / illumination sources.

[0037] The electronic device 201 is not limited to Figure 2 Rather than components and configurations of the electronic device 201, it may include fewer components, other components, or additional components in a variety of configurations. In some examples, the electronic device 201 may be implemented between two electronic devices (e.g., as a system). In some such examples, each (or more) electronic device may each include one or more of the same components discussed above, such as various sensors, one or more display generation components, one or more speakers, one or more processors, one or more memories, and / or communication circuits. One or more people using the electronic device 201 are optionally referred to herein as one or more users of the device.

[0038]

[0013] Attention is now directed to examples of selectively controlling and / or displaying at an electronic device one or more user interfaces associated with user activity detected within a computer-generated environment based on a change in the context of the electronic device within a physical environment.

[0039] FIG. 3A to FIG. 3OAn example of an electronic device updating a display of a computer-generated environment based on changes in the context of the electronic device within a physical environment according to some examples of the present disclosure is shown. The electronic device 301 may be similar to the device 101 or device 201 discussed above, and / or may be a head-mounted system / device and / or a projection-based system / device (including a hologram-based system / device) configured to generate and present a three-dimensional environment, such as a head-up display (HUD), a head-mounted display (HMD), a window with integrated display capabilities, a display formed as a lens designed to be placed on a person's eye (e.g., similar to a contact lens). FIG. 3A to FIG. 3O In the example of , the user optionally wears the electronic device 301 so that the three-dimensional environment 350 (e.g., a computer-generated environment) can be defined by X, Y, and Z axes viewed from the perspective of the electronic device (e.g., a viewpoint associated with the user of the electronic device 301). Therefore, as used herein, the electronic device 301 is configured to be able to move with six degrees of freedom based on the movement of the user (e.g., the user's head), so that the electronic device 301 can move in a roll direction, a pitch direction, and / or a yaw direction.

[0040] like Figure 3A As shown in , the electronic device 301 can be positioned in a physical environment (eg, an outdoor environment) including a plurality of real-world objects. Figure 3A In some examples, the electronic device 301 may be positioned in an urban environment or a physical environment 340 including a plurality of buildings, sidewalks, roads, greenery (e.g., flowers, grass, bushes, trees, plants, etc.), streetlights, street lamps, etc. (e.g., the user of the electronic device 301 is standing or walking on a sidewalk in a physical urban environment). Thus, in some examples, the three-dimensional environment 350 presented using the electronic device 301 optionally includes a captured portion of the physical environment (e.g., the urban environment 340) surrounding the electronic device 301, such as one or more representations of one or more buildings in the field of view of the three-dimensional environment 350. In addition, as Figure 3A As shown, three-dimensional environment 350 may include representations of sidewalks, roads, greenery, streetlights, and / or street lamps in an urban environment 340 in which electronic device 301 is located. In some examples, these representations may include portions of the physical environment viewed through a transparent or semi-transparent display of electronic device 301.

[0041] exist Figure 3B In the example, electronic device 301 detects the initiation of an exercise activity associated with a user of electronic device 301. FIG. 3A to FIG. 3B , the electronic device 301 detects the presence of a sensor via one or more sensors (e.g., such as a reference Figure 2The sensor described above detects movement of electronic device 301 within physical environment 340 caused by movement of a user of electronic device 301. In some examples, the exercise activity corresponds to a walking activity, a running activity, a cycling activity, a lunging activity, and other possibilities that produce movement of electronic device 301 in urban environment 340. In some examples, detecting the initiation of the exercise activity includes: detecting user input via an exercise application operating on electronic device 301. For example, electronic device 301 detects user input for recording an exercise activity at electronic device 301 (e.g., selection of a fitness "start" option). In some examples, detecting the initiation of the exercise activity includes: detecting user input at a second electronic device different from electronic device 301. For example, a user provides user input directed to a mobile electronic device (such as a smart phone or smart watch) associated with the user and in communication with electronic device 301, so that electronic device 301 determines that the exercise activity has been initiated.

[0042] In some examples, such as Figure 3B As shown, in response to detecting the initiation of the exercise activity, the electronic device 301 activates the exercise tracking operating mode. In some examples, when the exercise tracking operating mode is active, the electronic device 301 tracks (e.g., records) one or more health metrics associated with the exercise activity, as discussed in more detail below. In some examples, such as Figure 3B As shown, when electronic device 301 activates the exercise tracking mode of operation, electronic device 301 displays a visual indication 310 in three-dimensional environment 350 that the exercise tracking mode of operation has been activated (eg, “FITNESS ACTIVATED”).

[0043] In some examples, such as Figure 3C As shown, when the exercise tracking operating mode is active, the electronic device 301 displays a first user interface 315 associated with an exercise activity. Figure 3C As shown, the first user interface 315 includes one or more representations of one or more health metrics associated with the exercise activity. Figure 3C , the detected exercise activity is running. Figure 3CAs shown, the first user interface 315 includes a representation (305-1) of the duration of the exercise activity (e.g., 3 minutes and 2 seconds), a representation (305-2) of the user's currently determined heart rate during the exercise activity (e.g., 140 beats per minute (BPM)), a representation (305-3) of the user's average running pace during the exercise activity (e.g., 9 minutes and 24 seconds per mile), a representation (305-4) of the distance associated with the exercise activity (e.g., 0.32 miles), and a representation (305-5) of the user's stride length during the exercise activity (e.g., 1.05 meters). In some examples, the electronic device 301 determines the one or more health metrics associated with the exercise activity based on detected vital signs of the user (e.g., heart rate) and / or detected movements of the user. In some examples, a user's vital signs and / or movements are detected via one or more sensors integrated with electronic device 301 and / or one or more sensors integrated with a second electronic device (such as a mobile electronic device) that is worn on a portion of the user (e.g., a wrist or arm) and communicates with electronic device 301.

[0044] In some examples, the electronic device 301 updates the one or more health metrics associated with the exercise activity according to the progress of the exercise activity. Figure 3D In the example, according to the progress of the running activity discussed above, the electronic device 301 updates the representation of the health metric in the first user interface 315 in the three-dimensional environment 350 (305-1 to 305-5). Figure 3D As shown, the electronic device 301 optionally updates the representation 305-1 of the duration of the exercise activity according to the progress of the exercise activity (for example, in Figure 3D 21 seconds in the duration) and / or updating the representation of the user's current heart rate 305-2 as the exercise activity progresses (e.g., in Figure 3D In some examples, the representation of the health metric is updated in real time in the first user interface 315 .

[0045] In some examples, the electronic device 301 updates the display of the three-dimensional environment 350 based on the detected change in the context of the electronic device 301. As used herein, the context of the electronic device 301 may include the location of the electronic device 301 within the physical environment (e.g., the urban environment 340), the orientation of the electronic device 301 within the physical environment, and / or the relationship between the electronic device 301 and a feature of the physical environment (e.g., one or more real-world objects in the physical environment, the terrain of the physical environment, and / or the surface height of the physical environment). In some examples, detecting the feature of the physical environment includes: visually detecting one or more real-world objects in the field of view of the three-dimensional environment 350 and / or a change in the appearance of the one or more real-world objects in the field of view of the three-dimensional environment 350, as discussed below. As discussed herein, the electronic device 301 optionally visually detects the feature of the physical environment based on images captured by one or more cameras of the electronic device 301 (e.g., captured when the exercise tracking operation mode is active and / or when the exercise tracking operation mode is inactive).

[0046] exist Figure 3E , the electronic device 301 visually detects one or more real-world objects associated with corresponding parts of the user 306 of the electronic device 301. For example, Figure 3E As shown, user 306 is looking down at the ground of urban environment 340, which causes the orientation of electronic device 301 to change within urban environment 340 (and thus the context of electronic device 301 to change within urban environment 340). Figure 3E As shown, when the orientation of the electronic device 301 changes, the shoes 308 of the user 306 are optionally visible in the three-dimensional environment 350. For example, the electronic device 301 visually detects a first shoe 308-1 worn on the left foot of the user 306 and a second shoe 308-2 worn on the right foot of the user 306 via one or more cameras of the electronic device 301.

[0047] In some examples, when the electronic device 301 visually detects the first shoe 308-1 and / or the second shoe 308-2 of the user 306, the electronic device 301 initiates a process of tracking (e.g., recording) the service life of the first shoe and / or the second shoe (which is optionally the same). For example, visually detecting the first shoe 308-1 and / or the second shoe 308-2 includes: identifying the first shoe 308-1 and the second shoe 308-2 as being associated with the user 306 (e.g., belonging to the user and / or previously worn by the user) via one or more processors of the electronic device 301 (e.g., using computer vision, optical recognition, and / or other techniques). In some examples, whenever the user 306 wears a given pair of shoes associated with the user and the shoes are visible in the field of view of the electronic device 301 (e.g., so that the electronic device 301 can visually detect the pair of shoes, as similar to the above discussion), the electronic device 301 automatically tracks the shoe service life of the pair of shoes. In some examples, tracking the shoe life of the first shoe 308-1 and / or the second shoe 308-2 includes tracking / recording the traveled (e.g., walked, run, etc.) distance of the first shoe 308-1 and / or the second shoe 308-2 (e.g., by attributing the distance 305-4 at the end of the activity to the detected shoe 308). In some examples, the electronic device 301 tracks the shoe life of the first shoe 308-1 and / or the second shoe 308-2 in the manner discussed above, regardless of whether the exercise tracking operating mode is active and / or regardless of whether the user 306 is participating in an exercise activity.

[0048] In some examples, such as Figure 3F As shown, when the electronic device 301 visually detects the first shoe 308-1 and / or the second shoe 308-2 in the three-dimensional environment 350, the electronic device 301 displays one or more visual indications associated with shoe tracking of the first shoe 308-1 and / or the second shoe 308-2. Figure 3F As shown, the electronic device 301 displays a first user interface element 311 in the three-dimensional environment 350, which indicates the recorded shoe life (e.g., "30 miles") of the first shoe 308-1 and the second shoe 308-2. In addition, in some examples, the electronic device 301 displays a second user interface element 312, which indicates the brand of the shoe (e.g., "Brand") and / or the shoe type associated with the shoe (e.g., "Running Shoe").

[0049] In some examples, based on determining that the first shoe 308-1 and / or the second shoe 308-2 are a new pair of shoes (e.g., a newly purchased pair of shoes (e.g., purchased via a web browsing application or an online market application on the electronic device 301), a pair of shoes worn by the user for the first time (e.g., visually detected by the electronic device 301 for the first time), etc.), the electronic device 301 initiates new shoe life tracking for the first shoe 308-1 and / or the second shoe 308-2. In some examples, the electronic device 301 provides a prompt to the user 306 asking whether to enable shoe life tracking according to the process discussed above (e.g., the electronic device 301 displays a notification or other user interface element in the three-dimensional environment 350, which includes a selectable option for enabling shoe life tracking for the new pair of shoes and a selectable option for denying shoe life tracking for the new pair of shoes. In some examples, the electronic device 301 automatically enables shoe life tracking for the new pair of shoes (e.g., and displays a visual confirmation that the shoe life of the new pair of shoes is being tracked).

[0050] In some examples, as implied above, the electronic device 301 updates the shoe life of the first shoe 308-1 and / or the second shoe 308-2 based on determining that the progress of the exercise activity causes the shoe life of the first shoe 308-1 and / or the second shoe 308-2 to change. Figure 3G In some examples, the electronic device 301 detects the progress of the running activity, which causes the electronic device 301 to update one or more of the representations of the health metrics in the first user interface 315 in the three-dimensional environment 350, as previously discussed above. Figure 3G The progress of the exercise activity detected in the above embodiment causes the shoe life of the first shoe 308-1 and / or the second shoe 308-2 to increase. Figure 3H in Figure 3GAfter detecting the progress of the running activity in the three-dimensional environment 350, the electronic device 301 visually detects the first shoe 308-1 and / or the second shoe 308-2 in the three-dimensional environment 350, as similar to the discussion above. In some examples, when the electronic device 301 displays the first user interface element 311 in response to visually detecting the first shoe 308-1 and / or the second shoe 308-2, the electronic device 301 updates the shoe life in the first user interface element 311 according to the progress of the exercise activity (e.g., the shoe life is increased by 1 mile to 31 miles according to the progress that the user 306 ran another mile in the urban environment 340). It should be understood that in some examples, the above-described methods of tracking the shoe life of a pair of shoes can be similarly applied to other equipment and / or sportswear associated with other exercise activities, such as weightlifting gloves, cleats (e.g., baseball cleats, track cleats, and / or soccer cleats), tennis rackets, golf clubs, snow / ski pants, etc., to allow users to track the use of such equipment and / or sportswear, which helps users make informed decisions about replacing and / or updating equipment and / or sportswear.

[0051] In some examples, detecting a change in the context of the electronic device 301 includes detecting a change in the visual appearance of one or more real-world objects in the urban environment 340 visible in the three-dimensional environment 350. Fig. 3I As shown, when the user of the electronic device 301 is running in the urban environment 340, the user approaches the traffic light 341 in the urban environment 340, which includes a red light 342-1, a yellow light 342-2, and a green light 342-3. In some examples, when the user of the electronic device 301 approaches the traffic light 341 in the urban environment 340, the electronic device 301 visually detects that the red light 342-1 of the traffic light 341 in the urban environment 340 is on, indicating that the user of the electronic device 301 is not allowed to cross the crosswalk and therefore the user of the electronic device 301 will have to stop at the crosswalk. For example, the electronic device 301 determines via one or more processors that the red light 342-1 will correspond to an interruption / pause of the running activity (e.g., based on optical recognition and / or machine learning, etc.). In some examples, the electronic device 301 alternatively visually detects a stop sign, a crosswalk, a pedestrian signal, oncoming traffic (e.g., one or more vehicles), or other changes in the visual appearance of the urban environment 340 that correspond to an interruption / pause of the exercise activity.

[0052] In some examples, in response to visually detecting that a red light 342-1 of a traffic light 341 in an urban environment 340 is on, the electronic device 301 suspends the exercise tracking operation mode, such that the electronic device 301 abandons updating the one or more health metrics associated with the exercise activity. Figure 3JAs shown, the electronic device 301 displays a visual indication 310 in the three-dimensional environment 350 indicating that the exercise tracking operation mode has been paused (e.g., "Fitness Paused"), and abandons updating the representation 305-1 of the duration of the exercise activity, the representation 305-3 of the running pace of the exercise activity, the representation 305-4 of the distance associated with the exercise activity, and / or the representation 305-5 of the stride length of the user during the exercise activity.

[0053] Additionally, in some examples, the electronic device 301 detects a pause in the movement of the electronic device 301. Figure 3J In some examples, because the user stops moving at a crosswalk in the urban environment 340, the electronic device 301 is no longer moving in the urban environment 340 (e.g., and / or moves at a state below a movement threshold (e.g., 0m / s, 0.1m / s, 0.5m / s, 0.75m / s, 1m / s, 1.5m / s, etc.)). In some examples, the electronic device 301 suspends the exercise tracking operation mode for a threshold amount of time 322 (e.g., 30 seconds, 1 minute, 2 minutes, 3 minutes, 5 minutes, 10 minutes, etc.) before initiating termination of the exercise tracking operation mode. For example, if the electronic device 301 detects that the threshold amount of time 322 has passed since the end of the movement of the electronic device 301 was detected, the electronic device 301 automatically deactivates the exercise tracking operation mode or displays a visual indication in the three-dimensional environment 350 prompting the user to confirm that the exercise activity has ended. In some examples, deactivating the exercise tracking operation mode includes: stopping the display of the first user interface 315 in the three-dimensional environment 350. Figure 3J As shown, time bar 321 is below threshold amount of time 322, and thus electronic device 301 continues to pause the workout tracking mode of operation.

[0054] exist Figure 3K , the electronic device 301 visually detects a change in the visual appearance of the traffic light 341, which indicates that the user of the electronic device 301 will resume the exercise activity. Figure 3K As shown, the electronic device 301 visually detects that the red light 342-1 is no longer on and the green light 342-3 is now on, indicating that the user is allowed to cross the crosswalk and continue the running activity. Figure 3K As shown, the electronic device 301 resumes the exercise tracking operation mode. Figure 3KAs shown, the electronic device 301 updates and / or displays a visual indication 310 indicating that the exercise tracking operating mode is resumed (e.g., "Fitness Resume"), and resumes tracking / recording the one or more health metrics associated with the running activity, as indicated by updating one or more of the representations 305-1 to 305-5 in the first user interface 315 as similar to that described above. Additionally, in some examples, the electronic device 301 resumes the exercise tracking operating mode in response to visually detecting that a green light 342-3 in the urban environment 340 is illuminated based on determining that the threshold amount of time 322 discussed above has not passed since the exercise tracking operating mode was first paused (as indicated by the time bar 321). Figure 3K Thus, as an advantage, automatically pausing exercise tracking based on a change in the context of the electronic device in the physical environment while the user is exercising enables more accurate tracking of health metrics associated with the exercise activity, thereby enhancing user-device interaction and enabling the user to more accurately track and / or meet exercise goals using the electronic device.

[0055] In some examples, the response to the change in context discussed above (e.g., a change in the visual appearance of the traffic light 341) can be similarly applied to other changes in the context that prevent the user from making progress. For example, the electronic device 301 responds to visually detecting a physical object or obstacle (such as one or more people, vehicles, road work, animals, etc.) in the user's field of view that causes the user's motion to stop, and suspends the tracking of the exercise activity as discussed above. On the other hand, if the user intentionally stops moving (which also stops the movement of the electronic device 301), the electronic device 301 optionally does not suspend the tracking of the exercise activity in the manner discussed above. For example, if the user stops running due to exhaustion or fatigue or interacting with the electronic device 301 (or another electronic device, such as a smart phone or smart watch), the electronic device 301 continues to track the running activity and updates the health metrics associated with the running activity, because such user actions do not correspond to changes in the context of the electronic device 301 that prevent the user from making progress in the running activity.

[0056] In some examples, tracking one or more health metrics associated with the exercise activity includes tracking an intensity metric associated with the exercise activity. Figure 3LAs shown, the electronic device 301 displays a second user interface 330 corresponding to the intensity measure in the three-dimensional environment 350. In some examples, the intensity measure measures and / or defines the intensity of the exercise activity, such as the relative difficulty of the exercise activity. In some examples, the relative difficulty of the exercise activity is based on environmental factors. For example, the electronic device 301 determines the relative difficulty of the exercise activity based on the terrain of the urban environment 340 in which the user is running (such as the flatness or consistency of the running path (e.g., concrete for a sidewalk versus sand on a beach) and / or the slope of the running path), the weather of the urban environment 340 in which the user is running, the altitude of the urban environment 340, and / or other environmental factors that contribute to the difficulty of the running activity. Figure 3L In some examples, the relative difficulty of the exercise activity is based on the user's health and / or fitness profile. For example, electronic device 301 determines the relative difficulty of the exercise activity based on a determination of the "health" and / or "shape" of the user of electronic device 301, such as based on the user's height and / or weight, the user's activity log (e.g., how often the user exercises), one or more health metrics discussed above (e.g., the user's average pace and / or running distance), the user's known health status, and / or other aspects of the user's health and / or fitness profile that contribute to the difficulty of the running activity. Figure 3L In some examples, the determination of the intensity measure is based on the calories burned by the user during the exercise activity and / or the average heart rate during the exercise activity.

[0057] In some examples, such as Figure 3L As shown, the electronic device 301 presents the intensity measure according to level or zone. Figure 3L , second user interface 330 includes a representation 331-1 of a first intensity level, a representation 331-2 of a second intensity level (eg, greater than the first intensity level), and a representation 331-3 of a third intensity level (eg, greater than the first intensity level and the second intensity level). Figure 3L As shown, the electronic device 301 visually emphasizes (e.g., highlights, bolds, and / or changes color) a representation 331-1 of the first intensity level and a representation 331-2 of the second intensity level, indicating that the user is currently performing a running activity at the second intensity level. It should be understood that in some examples, the intensity measure discussed above may be expressed in an additional and / or alternative manner in the three-dimensional environment 350 (e.g., within the second user interface 330). For example, the electronic device 301 may quantify the intensity measure based on calories burned per unit time or per unit distance. In addition, it should be understood that in some examples, the representation of the intensity measure may alternatively be displayed in the three-dimensional environment 350 as one of the health measures in the first user interface 315 rather than in a separate second user interface 330.

[0058] In some examples, such as Figure 3M As shown, the electronic device 301 updates the intensity measure according to the change in the difficulty of the determined exercise activity. Figure 3M As shown, electronic device 301 visually detects an upward slope of running path 345 in physical environment 340. In some examples, the upward slope of running path 345 constitutes Figure 3M In addition, the electronic device 301 optionally detects a change in one or more of the health metrics associated with the exercise activity corresponding to the increase in the difficulty of the running activity. For example, as determined by Figure 3M As indicated by the fitness metrics in the first user interface 315 in , the electronic device 301 detects an increase in the user's heart rate (e.g., to 143 BPM in representation 305-2) and / or a decrease in the average pace (e.g., to 9 minutes 30 seconds in representation 305-3), which indicates an increase in the difficulty of the running activity due to the upward slope of the running path 345. Other examples of changes in the physical characteristics of the physical environment that can change the difficulty of the exercise activity include changes in altitude, changes in terrain (e.g., from flat concrete or pavement to sand or grass), changes in weather, and / or changes in scenery (e.g., from an urban environment to a park environment).

[0059] In some examples, when the electronic device 301 determines that the difficulty of the exercise activity increases as discussed above, the electronic device 301 updates the intensity measure associated with the exercise activity. For example, the electronic device 301 updates the second user interface 330 in the three-dimensional environment 350 so that the representation 331-3 of the third intensity level is visually emphasized, which indicates that the user of the electronic device 301 is running at the third intensity level.

[0060] Similarly, the electronic device 301 optionally updates the intensity measure based on determining that the difficulty of the exercise activity has decreased. Figure 3N As shown, electronic device 301 visually detects a downward slope of running path 345 in physical environment 340, which indicates that the difficulty of the running activity has decreased. In addition, in some examples, electronic device 301 detects a change in one or more of the health metrics associated with the exercise activity that indicates a decrease in the difficulty of the exercise activity. For example, Figure 3N As indicated by the fitness metric in the first user interface 315 in , the electronic device 301 detects a decrease in the user's heart rate (eg, to 139 BPM in representation 305 - 2 ), which indicates a decrease in the difficulty of the running activity due to the downward slope of the running path 345 .

[0061] In some examples, such as Figure 3NAs shown, the electronic device 301 updates the second user interface 330 in the three-dimensional environment 350 so that only the representation 331-1 of the first intensity level is visually emphasized, which indicates that the user is running at the first intensity level. In some examples, based on determining that a reduction in the difficulty of the exercise activity causes the intensity level associated with the exercise activity to drop below a threshold intensity level (e.g., below the second intensity level) and / or below some other indication of intensity (e.g., less than a threshold number of average calories burned per unit time or unit distance and / or less than a threshold difficulty (e.g., 50%, 60%, 65%, 70% or 75% exercise difficulty), which is optionally based on the user's heart rate), the electronic device 301 prompts the user of the electronic device 301 to increase the difficulty of the exercise activity to thereby increase the intensity. For example, as Figure 3N As shown, the electronic device 301 displays a message element 332 in the three-dimensional environment 350 prompting the user to adjust (e.g., increase) one or more characteristics of the exercise activity (e.g., prompting the user to increase his running pace when running downhill along the running path 345). For another example, the electronic device 301 optionally displays the message element 332 (or similar indication) in the three-dimensional environment 350 based on determining that increasing the difficulty of the exercise activity will enable the user to reach and / or exceed an exercise goal or record for the running activity (such as an average pace record or goal, a mile time record or goal, a calorie burn goal or record, an intensity record or goal, etc.).

[0062] In some examples, as previously mentioned above, the electronic device 301 determines an intensity measure associated with the exercise activity based at least in part on the topography, surface material, and / or slope of the physical environment in which the exercise activity is being performed. Fig.3O , the user of the electronic device 301 is alternatively performing a running activity in a beach environment including sand 347. In some examples, such as Fig.3O As shown, during the exercise activity, the electronic device 301 displays a first user interface 315 that includes representations 305-1 to 305-5 of fitness metrics associated with the exercise activity in the three-dimensional environment 350 as previously discussed herein. Fig.3O As shown, electronic device 301 optionally displays a second user interface 330 corresponding to an intensity measure associated with an exercise activity in three-dimensional environment 350. Fig.3O , the electronic device 301 optionally determines that running on sand 347 is a difficult activity (eg, based on the factors previously discussed above), and therefore visually emphasizes the representation 331 - 3 of the third intensity level in the second user interface 330 .

[0063] In some examples, displaying second user interface 330 corresponding to the intensity measure is based on an intensity contest between a user of electronic device 301 and a second user different from the user of a second electronic device different from electronic device 301. Fig.3O As shown, the user of electronic device 301 is competing with Megan in a running competition. In some examples, electronic device 301 displays a third user interface 335 that includes a representation of a health metric associated with Megan's exercise activity (e.g., "Megan's run") in three-dimensional environment 350. For example, Fig.3O As shown, third user interface 335 includes representations 309-1 to 309-3 of intensity levels for Megan's run and representations 307-1 to 307-5 of running metrics associated with Megan's run (e.g., similar to the running metrics associated with a user's run discussed previously above). In some examples, electronic device 301 is displaying third user interface 335 in three-dimensional environment 350, optionally in real-time, based on workout data provided by a second electronic device associated with a second user (e.g., Megan).

[0064] As previously described herein, the electronic device 301 determines the intensity measure based on the relative difficulty of the exercise activity (eg, determined based on environmental factors and / or the user's health and / or health profile). Fig.3O As shown, the user of electronic device 301 is running at a third intensity level (e.g., indicated by visual emphasis on representations 331-1 through 331-3), and a second user (e.g., Megan) is running at a first intensity level (e.g., indicated by visual emphasis on representation 309-1). Fig.3O , the user of electronic device 301 is running on more difficult terrain (e.g., sand 347) than the terrain Megan is running on. Therefore, even though Megan is running at a faster average pace (e.g., 7 minutes 50 seconds) and at a faster heart rate (e.g., 150 BPM versus 146 BPM) than the user of electronic device 301 (e.g., 9 minutes 35 seconds), the user of electronic device 301 is currently winning the intensity race over Megan. Therefore, as an advantage, providing an intensity metric that takes into account environmental factors as well as the user's health and / or health profile enables a more comprehensive workout summary to be provided to the user, thereby enhancing user-device interaction and enabling the user to more accurately track and / or meet workout goals using the electronic device. It should be understood that in some examples, intensity metrics for users (e.g., the user of electronic device 301 and / or Megan) may be accumulated over time to provide an overall intensity score (e.g., Fig.3OThe cumulative intensity measure may be presented as the sum of the instantaneous intensity measures shown in the first user interface element 309 and the second user interface element 330 in FIG. 1 . For example, the cumulative intensity measure may be presented as Fig.3O 309 and / or a second intensity metric element in the second user interface element 330.

[0065] It should be understood that the examples shown and described herein are merely exemplary, and additional and / or alternative elements related to the display and tracking of user exercise activities may be provided within a three-dimensional environment. It should be understood that the appearance, shape, form, and size of each of the various user interface elements and objects shown and described herein are exemplary, and alternative appearances, shapes, forms, and / or sizes may be provided. For example, a virtual object representing a user interface (e.g., user interface 315, 330, and 335) may be provided in an alternative shape (such as a circular shape, a triangular shape, etc.) other than a rectangular shape. Additionally or alternatively, in some examples, the various user interface elements described herein may be selected and / or manipulated via user input received by one or more independent input devices communicating with an electronic device. For example, where applicable, a selection input (e.g., for initiating tracking of exercise activities) may be received via a physical input device (such as a mouse, a trackpad, a keyboard, etc.) communicating with an electronic device.

[0066] Figure 4 is a flowchart illustrating an example process for updating a display of a computer-generated environment based on a change in the context of an electronic device within a physical environment according to some examples of the present disclosure. In some examples, process 400 begins at an electronic device in communication with a display, one or more input devices, and one or more cameras. In some examples, the electronic device is optionally similar to or corresponding to Figure 2 The head mounted display of the device 201. Figure 4 As shown, in some examples, at 402, the electronic device detects, via the one or more input devices, the initiation of an exercise activity associated with a user of the electronic device. Figure 3B As described above, the electronic device 301 detects movement of the electronic device caused by the user's movement corresponding to a running or walking activity.

[0067] In some examples, at 404, in response to detecting the initiation of the exercise activity, the electronic device activates the exercise tracking operating mode. Figure 3CAs shown, the electronic device 301 displays a first user interface 315 in a three-dimensional environment 350, the first user interface including one or more representations 305-1 to 305-5 of one or more health metrics associated with the exercise activity (e.g., exercise duration, detected average heart rate, exercise distance, etc.). In some examples, at 406, when the exercise tracking operation mode is active, the electronic device captures one or more images of the physical environment via the one or more cameras. For example, as shown in reference Figure 3D As described, electronic device 301 captures one or more images of physical environment 340 in which a user is performing an exercise activity.

[0068] In some examples, at 410, based on detecting a feature of the physical environment in the one or more images, the electronic device performs a first operation associated with the exercise tracking operating mode and directed to a computer-generated environment presented at the electronic device. Figure 3E As described, the electronic device 301 visually detects the first shoe 308-1 and / or the second shoe 308-2 worn on the foot of the user 306, which causes the electronic device 301 to display a first user interface element 311 indicating the recorded shoe service life of the first shoe 308-1 and / or the second shoe 308-2 and / or a second user interface element 312 indicating the brand of the shoe and / or the shoe type associated with the shoe in the three-dimensional environment 350, as shown in FIG. Figure 3F As shown. For example, as reference Fig. 3I As described, the electronic device 301 detects a physical object (such as a traffic light 341) that will cause the user to temporarily pause the exercise activity (for example, because the red light 342-1 is on), which causes the electronic device 301 to temporarily stop updating the one or more representations 305-1 to 305-5 of the one or more health metrics in the three-dimensional environment 350. In some examples, based on not detecting a feature of the physical environment in the one or more images, the electronic device abandons performing a first operation associated with the exercise tracking operation mode and directed to the computer-generated environment.

[0069] It should be understood that process 400 is an example and more, fewer or different operations may be performed in the same or different order. In addition, the operations in process 400 described above are optionally performed by running an information processing device such as a general-purpose processor (e.g., as described in relation to Figure 2 or one or more functional modules in a dedicated chip and / or through Figure 2 to be implemented by other components.

[0070] Therefore, according to the above, some examples of the present disclosure relate to a method comprising: at an electronic device that communicates with a display, one or more input devices, and one or more cameras: detecting, via the one or more input devices, the initiation of an exercise activity associated with a user of the electronic device; activating an exercise tracking operation mode in response to detecting the initiation of the exercise activity; and when the exercise tracking operation mode is active, capturing one or more images of a physical environment via the one or more cameras, and based on features of the physical environment detected in the one or more images, performing a first operation associated with the exercise tracking operation mode and for a computer-generated environment presented at the electronic device.

[0071] Additionally or alternatively, in some examples, the method further includes: when the exercise tracking operation mode is active, displaying one or more indications associated with one or more health metrics corresponding to the exercise activity in the computer-generated environment via the display. Additionally or alternatively, in some examples, the method further includes: when the exercise tracking operation mode is active and when the one or more indications are displayed in the computer-generated environment, detecting progress in the exercise activity; and updating the display of the one or more indications via the display based on the progress in the exercise activity in response to detecting the progress in the exercise activity. Additionally or alternatively, in some examples, detecting a feature of the physical environment includes: detecting a physical object in the physical environment, wherein the physical object includes at least one of a stop sign, a traffic signal, and a vehicle. Additionally or alternatively, in some examples, detecting a feature of the physical environment includes: when the physical object is detected in the physical object, detecting a pause in the exercise activity via the one or more input devices or the one or more cameras. Additionally or alternatively, in some examples, performing the first operation includes: abandoning updating the display of the one or more indications. Additionally or alternatively, in some examples, the method further includes: after performing the first operation, detecting progress in the exercise activity via the one or more input devices, the progress including movement of the electronic device; and updating the display of the one or more indications based on the progress in the exercise activity in response to detecting the progress in the exercise activity.

[0072] Additionally or alternatively, in some examples, detecting a feature of the physical environment includes detecting an object associated with a portion of the user. Additionally or alternatively, in some examples, the object corresponds to a shoe worn on a foot of the user, and performing the first operation includes displaying an indication of a shoe life associated with the shoe in a computer-generated environment. Additionally or alternatively, in some examples, the object corresponds to a shoe worn on a foot of the user, and performing the first operation includes displaying an indication of a shoe type of the shoe. Additionally or alternatively, in some examples, the method further includes detecting, via the one or more input devices, termination of the exercise activity when the exercise tracking operation mode is active; and deactivating the exercise tracking operation mode in response to detecting termination of the exercise activity. Additionally or alternatively, in some examples, the method further includes visually detecting, via the one or more cameras, the shoe worn on the foot of the user after deactivating the exercise tracking operation mode; and displaying, via the display in the computer-generated environment, an indication of information associated with the shoe in response to visually detecting the shoe. Additionally or alternatively, in some examples, the method further includes, when the exercise tracking operating mode is active, displaying, via a display in a computer-generated environment, one or more indications associated with an intensity measure corresponding to the exercise activity, wherein the intensity measure measures the relative difficulty of the exercise activity for the user based on the physical environment.

[0073] Additionally or alternatively, in some examples, detecting a feature of the physical environment includes: detecting a terrain in the physical environment that produces a change in the intensity measure. Additionally or alternatively, in some examples, detecting a feature of the physical environment includes: detecting a change in the height or slope of a surface of the physical environment that produces a change in the intensity measure. Additionally or alternatively, in some examples, performing a first operation includes: updating an intensity measure corresponding to the exercise activity, including updating a display of the one or more indications associated with the intensity measure in the computer-generated environment. Additionally or alternatively, in some examples, updating the intensity measure corresponding to the exercise activity includes: based on determining that the feature of the physical environment corresponds to a reduction in the intensity measure because the feature of the physical environment will reduce the relative difficulty of the exercise activity to below a threshold difficulty for the user, displaying a user interface object in the computer-generated environment via a display, the user interface object prompting the user to adjust one or more characteristics of the exercise activity to increase the relative difficulty of the exercise activity. Additionally or alternatively, in some examples, the exercise activity includes a running activity. Additionally or alternatively, in some examples, the exercise activity includes a cycling activity. Additionally or alternatively, in some examples, the electronic device includes a head-mounted display.

[0074] Some examples of the present disclosure relate to an electronic device comprising: one or more processors; a memory; and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for executing any of the above methods.

[0075] Some examples of the present disclosure relate to a non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform any of the above methods.

[0076] Some examples of the present disclosure relate to an electronic device comprising one or more processors, a memory, and a component for performing any of the above methods.

[0077] Some examples of the present disclosure relate to an information processing apparatus used in an electronic device, the information processing apparatus including a component for executing any one of the above methods.

[0078] For the purpose of explanation, the foregoing description is described by reference to specific examples. However, the illustrative discussion above is not intended to be exhaustive or to limit the present disclosure to the precise form disclosed. According to the above teachings, many modifications and variations are possible. The examples are selected and described in order to best explain the principles of the present disclosure and its practical application, so that other persons skilled in the art can best use the present disclosure and the various described examples with various modifications as suitable for the specific purpose envisioned.

Claims

1. A method comprising: At an electronic device in communication with a display, one or more input devices, and one or more cameras: detecting, via the one or more input devices, initiation of an exercise activity associated with a user of the electronic device; activating an exercise tracking mode of operation in response to detecting said initiation of said exercise activity; as well as When the described exercise tracking operating mode is active: capturing, via the one or more cameras, one or more images of a physical environment; as well as Based on detecting a feature of the physical environment in the one or more images, a first operation associated with the exercise tracking mode of operation and directed to a computer-generated environment presented at the electronic device is performed.

2. The method according to claim 1, further comprising: When the exercise tracking mode of operation is active, one or more indicators associated with one or more health metrics corresponding to the exercise activity are displayed in the computer-generated environment via the display.

3. The method according to claim 2, further comprising: detecting a progress of the exercise activity while the exercise tracking mode of operation is active and while the one or more indications are displayed in the computer-generated environment; as well as In response to detecting the progress of the exercise activity, display of the one or more indications via the display is updated based on the progress of the exercise activity.

4. The method of claim 1 , wherein detecting the characteristic of the physical environment comprises: A physical object in the physical environment is detected, wherein the physical object includes at least one of a stop sign, a traffic signal, and a vehicle.

5. The method of claim 4, wherein detecting the characteristic of the physical environment comprises: When the physical object is detected in the physical objects, a pause in the exercise activity is detected via the one or more input devices or the one or more cameras.

6. The method of claim 2, wherein performing the first operation comprises: Updating the display of the one or more indications is abandoned.

7. The method according to claim 6, further comprising: After performing the first operation, detecting, via the one or more input devices, a progress of the exercise activity, the progress comprising movement of the electronic device; as well as In response to detecting the progress of the exercise activity, display of the one or more indications is updated based on the progress of the exercise activity.

8. The method of claim 1 , wherein detecting the characteristic of the physical environment comprises: An object associated with a portion of the user is detected.

9. The method according to claim 8, wherein: The object corresponds to a shoe worn on a foot of the user; and Performing the first operation includes displaying, in the computer-generated environment, an indication of a shoe useful life associated with the shoe.

10. The method according to claim 8, wherein: The object corresponds to a shoe worn on a foot of the user; and Performing the first operation includes displaying an indication of a shoe type of the shoe.

11. The method according to claim 1, further comprising: detecting, via the one or more input devices, termination of the exercise activity while the exercise tracking mode of operation is active; as well as The exercise tracking mode of operation is deactivated in response to detecting the termination of the exercise activity.

12. The method according to claim 11, further comprising: after deactivating the exercise tracking mode of operation, visually detecting via the one or more cameras a shoe worn on a foot of the user; as well as An indication of information associated with the shoe is displayed in the computer-generated environment via the display in response to visually detecting the shoe.

13. The method according to claim 1, further comprising: When the exercise tracking operating mode is active, one or more indicators associated with an intensity metric corresponding to the exercise activity are displayed via the display in the computer-generated environment, wherein the intensity metric measures the relative difficulty of the exercise activity for the user based on the physical environment.

14. The method of claim 13, wherein detecting the characteristic of the physical environment comprises: A terrain in the physical environment that produces a change in the intensity measure is detected.

15. The method of claim 13, wherein detecting the characteristic of the physical environment comprises: A change in height or slope of a surface of the physical environment that produces a change in the intensity measure is detected.

16. The method of claim 13, wherein performing the first operation comprises: Updating the intensity measure corresponding to the exercise activity includes updating a display of the one or more indicators associated with the intensity measure in the computer-generated environment.

17. The method of claim 16, wherein updating the intensity measure corresponding to the exercise activity comprises: Based on determining that the characteristic of the physical environment corresponds to a reduction in the intensity measure because the characteristic of the physical environment will cause the relative difficulty of the exercise activity to decrease below a threshold difficulty for the user, displaying a user interface object in the computer-generated environment via the display, the user interface object prompting the user to adjust one or more characteristics of the exercise activity to increase the relative difficulty of the exercise activity. The method of claim 1 , wherein the exercise activity comprises a running activity or a cycling activity.

19. An electronic device comprising: one or more processors; Memory; and One or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for executing the method according to any one of claims 1 to 18.

20. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions which, when executed by one or more processors of an electronic device, cause the electronic device to perform the method according to any one of claims 1 to 18.

Images