Electronic device presenting guided meditation session

Abstract

The invention relates to an electronic device presenting a guided meditation session. Specifically, a head-mounted device may include: one or more cameras that detect a physical object in a physical environment around the head-mounted device; and one or more microphones, the one or more microphones detecting sound in the physical environment. The head-mounted device may present a guided meditation session that references one of the physical objects in the physical environment and / or one of the sounds in the physical environment. One or more sensors in the head-mounted device may be used to determine when to advance the guided meditation session between different portions.

Description

[0001] This application claims priority to U.S. Patent Application No. 19 / 272,892, filed July 17, 2025, and U.S. Provisional Patent Application No. 63 / 688,679, filed August 29, 2024, the entire contents of which are incorporated herein by reference. Technical Field

[0002] This article relates generally to electronic devices, and more specifically to electronic devices with sensors. Background Technology

[0003] Some electronic devices can be used to assist users in guided meditation. These devices can provide audio instructions for guided meditation. However, guided meditation may not be as interactive as desired.

[0004] It is against this backdrop that the implementation scheme presented in this paper was developed. Summary of the Invention

[0005] An electronic device may include one or more cameras, one or more speakers, one or more processors, and memory storing instructions configured to be executed by the one or more processors for: obtaining user input; determining an intent based on the user input; and, based on the determined intent, indicating an intent to provide guided meditation: using the one or more cameras to capture one or more images of a physical environment; identifying at least one physical object in the physical environment based on the one or more images; and using the one or more speakers to present a guided meditation session. The guided meditation session may reference the at least one physical object in the physical environment. Attached Figure Description

[0006] Figure 1 This is a schematic diagram of an exemplary head-mounted device based on some implementation schemes.

[0007] Figure 2 This is a schematic diagram of a trained model that receives input and generates guided meditation sessions based on some implementation schemes.

[0008] Figure 3 This is a flowchart illustrating an exemplary method for operating a head-mounted device to present a guided meditation session, according to some implementation schemes.

[0009] Figure 4 This is a flowchart illustrating an exemplary method for operating a head-mounted device during an interactive guided meditation session, according to some implementations. Detailed Implementation

[0010] Head-mounted displays can show users different types of extended reality content. One type of display can show virtual objects perceived at apparent depth within the user's physical environment. These virtual objects can sometimes be displayed at a fixed location relative to the user's physical environment. For example, consider an example where the user's physical environment includes a table. A virtual object can be displayed to the user such that it appears to be stationary on the table. As the user moves their head and otherwise interacts with the XR environment, the virtual object remains in the same fixed position on the table (e.g., as if the virtual object were another physical object in the XR environment). This type of content can be called world-locked content (because the virtual object's position is fixed relative to the user's physical environment).

[0011] Other virtual objects can be displayed at a position relative to the head-mounted device or defined by the user of the head-mounted device. First, consider an example of a virtual object displayed at a position defined by the head-mounted device. When the head-mounted device moves (e.g., as the user's head rotates), the virtual object remains in a fixed position relative to the head-mounted device. For example, the virtual object may be displayed at a specific distance in front of and central to the head-mounted device (e.g., at the center of the device's field of view or the user's field of view). As the user moves their head left and right, their view of their physical environment changes accordingly. However, when the user moves their head, the virtual object may remain fixed at a specific distance in the center of the device's field of view or the user's field of view (assuming the gaze direction remains constant). This type of content can be called head-locked content. Head-locked content is fixed in a given position relative to the head-mounted device (and therefore relative to the user's head supporting the head-mounted device). Head-locked content may not be adjusted based on the user's gaze direction. In other words, if the user's head position remains constant and their gaze is directed away from the head-locked content, the head-locked content will remain in the same apparent position.

[0012] Secondly, consider an example of a virtual object displayed at a position defined relative to a portion of the user of the head-mounted device (e.g., relative to the user's torso). This type of content can be referred to as body-locked content. For example, a virtual object may be displayed in front of and to the left of the user's body (e.g., at a position defined by a distance and angular offset from the user's torso in a forward direction), regardless of which direction the user's head is facing. If the user's body is facing a first direction, the virtual object will be displayed in front of and to the left of the user's body. When facing the first direction, the virtual object will remain in the same fixed position relative to the user's body in the XR environment, regardless of whether the user rotates their head left and right (to view towards and away from the virtual object). However, the virtual object may move within the device's field of view or the user's field of view in response to the user rotating their head. If the user turns around and their body faces a second direction opposite to the first direction, the virtual object will be repositioned within the XR environment such that the virtual object is still displayed in front of and to the left of the user's body. When facing the second direction, the virtual object will remain in the same fixed position relative to the user's body in the XR environment, regardless of whether the user rotates their head left and right (to view towards and away from the virtual object).

[0013] In the previously mentioned example, even when the user's body rotates, body-locked content is displayed at a fixed position / orientation relative to the user's body. For example, a virtual object may be displayed at a fixed distance in front of the user's body. If the user is facing north, the virtual object is at a fixed distance in front of the user's body (northward). If the user turns around and faces south, the virtual object is at a fixed distance in front of the user's body (southward).

[0014] Alternatively, the distance offset between the body-locked content and the user can be fixed relative to the user, while the orientation of the body-locked content can remain fixed relative to the physical environment. For example, when the user is facing north, the virtual object can be displayed in front of the user at a fixed distance. If the user turns around and faces south, the virtual object remains north of the user at a fixed distance.

[0015] Body-locked content can also be configured to always maintain gravity or horizontal alignment, so that changes in head and / or body orientation during scrolling will not cause the body-locked content to move within the XR environment. Translation movement allows the body-locked content to be repositioned within the XR environment to maintain a fixed distance from the user. Further descriptions of body-locked content may include both of the types described above.

[0016] exist Figure 1 A schematic diagram of an illustrative head-mounted device is shown. For example... Figure 1As shown, the head-mounted device 10 (sometimes referred to as electronics 10, system 10, head-mounted display 10, etc.) may have control circuitry 14. Control circuitry 14 may be configured to perform operations within the head-mounted device 10 using hardware (e.g., dedicated hardware or circuitry), firmware, and / or software. Software code and other data used to perform operations within the head-mounted device 10 are stored on a non-transitory computer-readable storage medium (e.g., a tangible computer-readable storage medium) within control circuitry 14. Software code may sometimes be referred to as software, data, program instructions, commands, or code. The non-transitory computer-readable storage medium (sometimes commonly referred to as memory) may include non-volatile memory such as non-volatile random access memory (NVRAM), one or more hard disk drives (e.g., disk drives or solid-state drives), one or more removable flash drives, or other removable media. The software stored on the non-transitory computer-readable storage medium may be executed on processing circuitry of control circuitry 14. Processing circuitry may include an application-specific integrated circuit (ASIC) with processing circuitry, one or more microprocessors, digital signal processors, graphics processing units, central processing units (CPUs), or other processing circuitry.

[0017] The head-mounted device 10 may include input-output circuitry 20. Input-output circuitry 20 can be used to allow the head-mounted device 10 to receive data from external equipment (e.g., a tethered computer, portable devices such as handheld devices or laptops, or other electrical equipment) and to allow the user to provide user input to the head-mounted device 10. Input-output circuitry 20 can also be used to acquire information about the environment in which the head-mounted device 10 is operating. Output components in circuitry 20 can allow the head-mounted device 10 to provide output to the user and can be used to communicate with external electrical equipment.

[0018] like Figure 1As shown, the input-output circuitry 20 may include a display, such as display 32. Display 32 can be used to display images to a user of the head-mounted device 10. Display 32 may be a transparent display (sometimes referred to as a see-through display), allowing the user to view physical objects through the display while overlaying computer-generated content onto the physical objects by presenting computer-generated images on the display. The transparent display may be formed from a transparent pixel array (e.g., a transparent organic light-emitting diode display panel), or it may be formed from a display device that provides images to the user via a beam splitter, holographic coupler, or other optical coupler (e.g., a display device such as a liquid crystal on silicon). Alternatively, display 32 may be an opaque display that blocks light from the physical objects when the user operates the head-mounted device 10. In this type of arrangement, a see-through camera may be used to display physical objects to the user. The see-through camera may capture images of the physical environment, and these images may be displayed on the display for the user to view. Additional computer-generated content (e.g., text, game content, other visual content, etc.) may optionally be overlaid on the physical environment image to provide the user with an extended reality environment. When monitor 32 is opaque, the monitor may also optionally display the entire computer-generated content (e.g., not displaying an image of the physical environment).

[0019] Display 32 may include one or more optical systems (e.g., lenses) that allow a viewer to view an image on display 32. A single display 32 may generate images for both eyes, or a pair of displays 32 may be used to display images. In a configuration with multiple displays (e.g., a left-eye display and a right-eye display), the focal length and positioning of the lenses may be selected such that any gaps between the displays will be invisible to the user (e.g., so that the images of the left and right displays seamlessly overlap or merge). A display module that generates different images for the user's left and right eyes may be referred to as a stereoscopic display. A stereoscopic display may be able to present two-dimensional content (e.g., user notifications with text) and three-dimensional content (e.g., simulations of physical objects such as cubes).

[0020] The input-output circuitry 20 may include various other input-output devices for acquiring data and user input, as well as for providing output to the user. For example, the input-output circuitry 20 may include one or more speakers 34 configured to play audio.

[0021] Input-output circuitry 20 may include one or more cameras 36. Cameras 36 may include one or more outward-facing cameras (as an example, when the electronic device is mounted on a user's head, the one or more outward-facing cameras face the physical environment surrounding the user). Cameras 36 may capture visible light images, infrared images, or any other desired type of image. If desired, the camera may be a stereo camera. The outward-facing camera may capture perspective video for device 10. Camera 22 may also include an inward-facing camera (e.g., for gaze detection).

[0022] The input-output circuitry 20 may include a gaze tracker 40 (sometimes referred to as a gaze tracking system or gaze tracking camera). The gaze tracker 40 can be used to obtain gaze input from the user during operation of the head-mounted device 10.

[0023] The gaze tracker 40 may include a camera and / or other gaze tracking system components (e.g., a light source emitting a light beam such that reflections of the light beam from the user's eye can be detected) to monitor the user's eyes. The gaze tracker 40 may be oriented towards the user's eyes and may track the user's gaze. The camera in the gaze tracking system may determine the position of the user's eyes (e.g., the center of the user's pupil), determine the orientation direction of the user's eyes (the direction of the user's gaze), determine the user's pupil size (e.g., such that light modulation and / or other optical parameters, and / or the sequential amount used to spatially adjust one or more of these parameters, and / or the area in which one or more of these optical parameters are adjusted based on the pupil size), may be used to monitor the current focal length of the lens in the user's eyes (e.g., whether the user is focusing on the near or far field, which can be used to assess whether the user is daydreaming or thinking strategically or tactically), and / or other gaze information. The camera in the gaze tracking system may sometimes be referred to as an inward-facing camera, a gaze detection camera, an eye-tracking camera, a gaze-tracking camera, or an eye monitoring camera. If needed, other types of image sensors (e.g., infrared and / or visible light LEDs and photodetectors) can also be used to monitor the user's gaze. The use of the gaze detection camera in gaze tracker 40 is merely illustrative.

[0024] like Figure 1As shown, the input-output circuitry 20 may include positioning and motion sensors 38 (e.g., a compass, gyroscope, accelerometer, and / or other devices for monitoring the position, orientation, and movement of the head-mounted device 10, satellite navigation system circuitry such as GPS circuitry for monitoring the user's location, etc.). The gyroscope can measure the orientation and angular velocity of the electronic device. As an example, the electronic device 10 may include: a first gyroscope configured to measure rotation about a first axis; a second gyroscope configured to measure rotation about a second axis orthogonal to the first axis; and a third gyroscope configured to measure rotation about a third axis orthogonal to the first and second axes. The accelerometer can measure acceleration sensed by the electronic device. As an example, electronic device 10 may include: a first accelerometer configured to measure acceleration along a first axis; a second accelerometer configured to measure acceleration along a second axis orthogonal to the first axis; and a third accelerometer configured to measure acceleration along a third axis orthogonal to the first and second axes. Multiple sensors may optionally be included in a single sensor package referred to as an inertial measurement unit (IMU). Electronic device 10 may include one or more magnetometers configured to measure magnetic fields. As an example, three magnetometers may be included in an IMU having three accelerometers and three gyroscopes.

[0025] For example, control circuitry 14 may use sensor 38 to monitor the current orientation of the user's head relative to the surrounding environment (e.g., the user's head posture). In one example, positioning and motion sensor 38 may include one or more outward-facing cameras (e.g., capturing images of the physical environment surrounding the user). Outward-facing cameras may be used for face tracking (e.g., capturing images of the user's chin, mouth, etc., when the device is worn on the user's head), body tracking (e.g., capturing images of the user's torso, arms, hands, legs, etc., when the device is worn on the user's head), and / or for positioning (e.g., using visual ranging, visual-inertial ranging, or other simultaneous localization and mapping (SLAM) techniques). In addition to positioning and motion sensing, outward-facing cameras may also capture perspective video of device 10.

[0026] Input-output circuitry 20 may include one or more depth sensors 42. Each depth sensor may be a pixelated depth sensor (e.g., configured to measure multiple depths across a physical environment) or a point sensor (configured to measure a single depth in a physical environment). Camera images (e.g., from one of the cameras 36) may also be used for monocular and / or stereo depth estimation. Each depth sensor (whether pixelated or point-based) may use phase detection (e.g., phase detection autofocus pixels) or light detection and ranging (LIDAR) to measure depth. Any combination of depth sensors may be used to determine the depth of a physical object in the physical environment.

[0027] The input-output circuitry 20 may include a tactile output device 44. The tactile output device 44 may include actuators such as electromagnetic actuators, motors, piezoelectric actuators, electroactive polymer actuators, vibrators, linear actuators (e.g., linear resonant actuators), rotary actuators, actuators that bend bend a flexible member, etc. The tactile output device 44 may be controlled to provide any desired vibration mode.

[0028] If needed, the input-output circuit 20 may also include other sensors and input-output components (e.g., ambient light sensor, force sensor, temperature sensor, touch sensor, button, capacitive proximity sensor, light-based proximity sensor, other proximity sensor, strain gauge, gas sensor, pressure sensor, humidity sensor, magnetic sensor, microphone, light-emitting diode, other light source, heart rate sensor, electroencephalogram (EEG) sensor, wired and / or wireless communication circuitry, etc.).

[0029] The head-mounted device 10 may also include communication circuitry 56 to allow the head-mounted device to communicate with external equipment (e.g., a tethered computer, portable electronic device, one or more external servers, or other electrical equipment). Communication circuitry 56 can be used for both wired and wireless communication with external equipment.

[0030] The communication circuit 56 may include a radio frequency (RF) transceiver circuit, which is formed by one or more integrated circuits, a power amplifier circuit, a low-noise input amplifier, passive RF components, one or more antennas, transmission lines, and other circuitry for processing RF wireless signals. The wireless signals may also be transmitted using light (e.g., using infrared communication).

[0031] For example, the radio frequency transceiver circuit in wireless communication circuit 56 can handle wireless local area network (WLAN) communication frequency bands, such as 2.4 GHz and 5 GHz. (IEEE 802.11) band; Wireless Personal Area Network (WPAN) communication bands, such as 2.4 GHz. Communication frequency bands; cellular telephone communication frequency bands, such as the cellular low frequency band (LB) (e.g., 600MHz to 960MHz), the cellular low intermediate frequency band (LMB) (e.g., 1400MHz to 1550MHz), the cellular intermediate frequency band (MB) (e.g., 1700MHz to 2200MHz), the cellular high frequency band (HB) (e.g., 2300MHz to 2700MHz), the cellular ultra-high frequency band (UHB) (e.g., 3300MHz to 5000MHz) or other cellular communication frequency bands between approximately 600MHz and approximately 5000MHz (e.g., 3G bands, 4G LTE bands, the 5G New Radio Frequency Range 1 (FR1) band below 10GHz, etc.); near field communication (NFC) bands (e.g., 13.56MHz); satellite navigation bands (e.g., the L1 Global Positioning System (GPS) band at 1575MHz, the L5 at 1176MHz). GPS bands, GLONASS bands, BDS bands, etc.; ultra-wideband (UWB) communication bands supported by the IEEE 802.15.4 protocol and / or other UWB communication protocols (e.g., a first UWB communication band of 6.5 GHz and / or a second UWB communication band of 8.0 GHz); and / or any other desired communication bands.

[0032] Radio frequency transceiver circuits may include millimeter-wave / centimeter-wave transceiver circuits that support communications at frequencies between approximately 10 GHz and 300 GHz. For example, millimeter-wave / centimeter-wave transceiver circuits may support communications in extremely high frequency (EHF) or millimeter-wave communication bands between approximately 30 GHz and 300 GHz and / or in centimeter-wave communication bands (sometimes referred to as ultra-high frequency (SHF) bands) between approximately 10 GHz and 30 GHz. For example, millimeter-wave / centimeter-wave transceiver circuits may support communications in the following communication bands: the IEEE K communication band between approximately 18 GHz and 27 GHz, and the K band between approximately 26.5 GHz and 40 GHz. a Communication frequency band, between approximately 12 GHz and 18 GHz K u Communication bands, including the V communication band between approximately 40 GHz and 75 GHz, the W communication band between approximately 75 GHz and 110 GHz, or any other desired band between approximately 10 GHz and 300 GHz. If required, millimeter-wave / centimeter-wave transceiver circuitry can support IEEE 802.11ad communication at 60 GHz (e.g., the WiGig or 60 GHz Wi-Fi band between approximately 57 GHz and 61 GHz) and / or the 5G mobile network or 5G wireless system (5G) New Radio (NR) Frequency Range 2 (FR2) communication band between approximately 24 GHz and 90 GHz.

[0033] The antenna in the wireless communication circuit 56 may include an antenna with a resonant element, which is formed by a loop antenna structure, patch antenna structure, inverted F-shaped antenna structure, slot antenna structure, planar inverted F-shaped antenna structure, helical antenna structure, dipole antenna structure, monopole antenna structure, and combinations of these designs. Different types of antennas can be used in different frequency bands and combinations of frequency bands. For example, one type of antenna can be used to form a local wireless link, and another type of antenna can be used to form a long-range wireless link antenna.

[0034] During operation, the head-mounted device 10 can use communication circuitry 56 to communicate with one or more external servers 60 via network 58. Examples of communication networks 58 include local area networks (LANs) and wide area networks (WANs) (e.g., the Internet). Communication network 58 can be implemented using any known network protocol, including various wired or wireless protocols such as, for example, Ethernet, Universal Serial Bus (USB), FireWire, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Wi-Fi, Voice over Internet Protocol (VoIP), Wi-MAX, or any other suitable communication protocol.

[0035] External server 60 may be implemented on one or more stand-alone data processing devices or a distributed network of computers. External server 60 may include a trained model 62 such as a large language model (LLM). The trained model 62 may generate guided meditation sessions presented using head-mounted device 10 based on various inputs provided by head-mounted device 10.

[0036] Consider an example where a user of head-mounted device 10 provides input indicating a request for guided meditation. The user may request a specific type of guided meditation, identify the target duration of the guided meditation session, provide the purpose of the guided meditation, etc. Based on this information, a trained model 62 can generate a guided meditation session. Head-mounted device 10 may use speaker 34 to play audio and / or use display 32 to present visual objects as part of the guided meditation session.

[0037] Guided meditation sessions may optionally reference one or more physical objects or sounds in the user's physical environment. A trained model 62 can identify one or more physical objects or sounds in the user's physical environment (or receive information identifying them). Guided mediation sessions generated by the trained model may reference one or more physical objects or sounds in the physical environment.

[0038] As a concrete example, consider a scenario where a user of a head-mounted device requests a ten-minute guided meditation session. In this scenario, the user is sitting at a table next to a window, with a glass of water on the table. Sunlight streams through the window and illuminates the glass. When the user requests the ten-minute guided meditation session, the head-mounted device can use camera 36 to capture an image. Using the captured image, head-mounted device 10 can identify the sunlit glass of water as a physical object well-suited for inclusion in the guided meditation session. The guided meditation session generated by the trained model 62 may include audio prompts such as asking the user to look at the glass of water (e.g., patterns of refraction and reflection caused by the water), asking the user to pick up the glass, asking the user to rotate the glass, etc. In this example, the guided meditation session includes references to physical objects present in the user's physical environment.

[0039] Guided meditation sessions may alternatively or additionally include references to one or more sounds present in the user's physical environment. In this scenario, the physical environment includes a bird chirping outside a window. When a user requests a ten-minute guided meditation session, the headset can use one or more microphones to capture audio. Using the captured audio, the headset 10 can identify the chirping bird's sound. Guided meditation sessions generated by the trained model 62 may include audio instructing the user to listen to the chirping bird. In this example, the guided meditation session includes references to sounds present in the user's physical environment.

[0040] The trained model 62 can be a large language model. A large language model (LLM) is an artificial intelligence system designed to understand and generate human language text. Large language models (LLMs) belong to a broader category of natural language processing (NLP) models and have the ability to process and generate coherent, context-sensitive, and grammatically accurate text. Large language models can be built using deep learning techniques (e.g., neural networks), which enable these models to learn patterns and associations within large amounts of text data. Training LLMs on datasets containing billions of words allows them to capture the nuances and complexities of human language. Large language models are characterized by their massive scale (e.g., having at least 100 million parameters, at least one billion parameters, at least ten billion parameters, at least one hundred billion parameters, etc.).

[0041] Therefore, the trained model 62 may sometimes be referred to as an artificial intelligence (AI) system 62, a language model 62, a large-scale language model 62, a natural language processing model 62, etc. The trained model 62 can be configured to output human language text in response to input. The trained model 62 may include at least one billion parameters, at least ten billion parameters, at least one hundred billion parameters, etc.

[0042] Figure 1The example of the trained model 62 stored in the external server 60 is merely illustrative. The trained model 62 may be stored in an accompanying electronic device that communicates wirelessly with the head-mounted device 10. In other words, the external server 60 may include an electronic device (e.g., a cellular phone, laptop computer, tablet computer, etc.) storing the trained model 62. Alternatively, the trained model 62 may be stored in the control circuitry 14 of the head-mounted device 10.

[0043] Figure 2 The display can be provided Figure 1 A schematic diagram of the input to the trained model 62. (See diagram below.) Figure 2 As shown, the trained model 62 can generate guided meditation sessions based on various inputs. Inputs to the trained model may include information about one or more images of the physical environment, information about one or more sounds in the physical environment, one or more session length parameters, contextual information, sensor data, and / or virtual object information.

[0044] Information about one or more images of the physical environment may include images of the physical environment captured by camera 36 of head-mounted device 10. Alternatively or additionally, control circuitry 14 may perform image recognition on one or more images captured by camera 36 of head-mounted device 10 to identify one or more physical objects in the physical environment. Control circuitry 14 may provide the identification of one or more physical objects in the physical environment to trained model 62.

[0045] Certain types of physical objects may be well-suited for inclusion in a guided meditation session. Control circuitry 14 may optionally identify physical objects well-suited for inclusion in a guided meditation session and provide these identifications to a trained model. Alternatively, trained model 62 may determine which physical objects in the physical environment are best suited for inclusion in a guided meditation session.

[0046] Control circuitry 14 and / or trained model 62 may store a set of physical objects highly suitable for incorporation into a guided meditation session. Alternatively or additionally, control circuitry 14 and / or trained model 62 may identify physical objects in the physical environment that satisfy one or more criteria. For example, a physical object may be highly suitable for incorporation into a guided meditation session when it satisfies a reflectivity criterion. Control circuitry 14 and / or trained model 62 may identify physical objects in the physical environment that satisfy a reflectivity criterion. Physical objects satisfying a reflectivity criterion may be referenced in a guided meditation session generated by trained model 62.

[0047] Information about one or more sounds in the physical environment may include audio of the physical environment captured by one or more microphones in the head-mounted device 10. Alternatively or additionally, the control circuitry 14 may perform sound recognition on the audio captured by the microphones of the head-mounted device 10 to identify one or more sounds in the physical environment. The control circuitry 14 may provide the identification of one or more sounds in the physical environment to the trained model 62.

[0048] Certain types of sounds are well-suited for inclusion in guided meditation sessions. Control circuitry 14 can optionally identify sounds well-suited for inclusion in guided meditation sessions and provide these sound identifiers to a trained model. Alternatively, trained model 62 can determine which sounds in the physical environment are well-suited for inclusion in guided meditation sessions.

[0049] Control circuitry 14 and / or trained model 62 may store a set of sounds highly suitable for incorporation into guided meditation sessions. Alternatively or additionally, control circuitry 14 and / or trained model 62 may identify sounds in the physical environment that satisfy one or more criteria. Sounds that satisfy the criteria may be referenced in guided meditation sessions generated by trained model 62.

[0050] The session length parameter may include one or more parameters associated with the length of a guided meditation session. Session length parameters may include minimum duration, maximum duration, target duration, etc. When providing input requesting guided meditation, the user may provide additional input identifying one or more session length parameters.

[0051] The contextual information provided by the head-mounted device 10 to the trained model 62 may include information such as location information, cultural information, age information, user preference information, time information, calendar information, meditation experience information, etc.

[0052] Location information may include the user's city of residence, the current city where the head-mounted device 10 is located, etc. All other things being equal, the trained model 62 may provide a different guided meditation session to a first user in a first location than to a second user in a second location, or may provide a different guided mediation session to a first user in a first city of residence than to a second user in a second city of residence. The current location information included in the location information provided to the trained model 62 may be obtained using a Global Positioning System (GPS) sensor in the head-mounted device 10, or may be provided directly to the head-mounted device 10 by the user, etc.

[0053] Cultural information may include the cultural background of the user of the head-mounted device 10, cultural information associated with the current location of the head-mounted device 10, etc. For example, a user with a first cultural background may receive a guided meditation session that references cultural customizations associated with the first cultural background. A second user with a second cultural background that does not include cultural customizations may receive a second guided meditation session that does not reference cultural customizations.

[0054] Age information may include the age of the user of the head-mounted device. The complexity of the guided meditation session provided by the trained model 62 can be adjusted based on the age of the user of the head-mounted device. For example, all other things being equal, a first user of a first age may receive a first guided meditation session, while a second user of a second age older than the first age may receive a second guided meditation session that is more complex than the first guided meditation.

[0055] User preference information may include any desired user preferences regarding the tone, length, and / or type of guided meditation provided by the trained model 62. One or more input components may be used to provide user preferences to the head-mounted device 10.

[0056] Time information may include information about the current time of day or the current time of year. All other things being equal, the trained model can output a first guided meditation session at the first time of day and a second different guided meditation session at a second different time of day. Similarly, all other things being equal, the trained model can output a first guided meditation session at the first time of year and a second different guided meditation session for a given text at a second different time of year.

[0057] Calendar information can include information from the user's calendar, such as upcoming appointments, previous appointments, trips, etc. If the calendar information identifies an upcoming holiday at a given location, the guided meditation session output by the trained model can differ from the case where there is no upcoming holiday at the given location. If the calendar information identifies an upcoming appointment, the guided meditation session output by the trained model can differ from the case where there is no upcoming appointment.

[0058] Meditation experience information may include information about the user's past meditation experiences. This information may include information about previous guided meditation sessions provided by the head-mounted device 10 (e.g., the frequency, length, and type of previous sessions). Meditation experience information may also include information input by the user. For example, the user may provide input identifying their experience level as beginner, intermediate, expert, etc. The user may also provide input identifying the types of meditations they have practiced (if any).

[0059] The sensor data provided by the head-mounted device 10 to the trained model 62 may include data from any desired sensor in the input-output circuitry 20. The sensor data may include data from a heart rate sensor, an electroencephalogram (EEG) sensor, a blood pressure sensor, a depth sensor 42, a gaze tracking sensor 40, a positioning and motion sensor 38, and / or another desired sensor.

[0060] The head-mounted device 10 may use the display 32 to present virtual objects. These virtual objects may be part of an XR environment. Virtual objects may include head-locked virtual objects, body-locked virtual objects, and / or world-locked virtual objects. Virtual object information provided to the trained model 62 may include information identifying the location, type, and appearance of one or more virtual objects presented by the display 32. Guided meditation sessions may reference one or more virtual objects (e.g., have instructions for viewing one or more virtual objects). Guided meditation sessions may also include displaying new virtual objects on the display 32 when the guided meditation session is presented.

[0061] Depend on Figure 2 The guided meditation session generated by the trained model 62 may include audio and / or visual components. Audio components may include verbal instructions uttered by the virtual coach, background music / sounds, audio feedback in response to the user's actions, etc. Visual components may include a virtual reality environment presented to the user during the guided meditation session and / or virtual objects presented in the virtual environment or XR environment (e.g., virtual objects may be presented to appear in the user's physical environment).

[0062] The guided meditation session output by the trained model 62 can be a predefined guided meditation session that does not involve real-time interaction with the user. In these types of examples, verbal instructions from the virtual coach can be delivered at predetermined times (regardless of how the user behaves during the guided meditation session).

[0063] Alternatively, the guided meditation session output by the trained model 62 can be dynamically updated and / or generated throughout the session. For example, the guided meditation session may include verbal instructions from a virtual coach to perform deep breathing. The trained model may receive real-time sensor data, such as heart rate sensor data. The guided meditation session may only proceed to subsequent instructions after the user's heart rate has slowed down by a threshold amount or fallen below the target.

[0064] Another example of a dynamically updated guided meditation session is one that relies on user interaction with physical objects in the user's physical environment. For example, a guided meditation session may include verbal instructions from a virtual coach to look at a physical object. The trained model may receive real-time sensor data, such as gaze detection data. The guided meditation session may proceed to subsequent instructions only after the user's gaze aligns with the physical object. The guided meditation session may then include verbal instructions from the virtual coach to pick up the physical object. The trained model may receive information about one or more images of the physical environment in real time. For example, the trained model may receive one or more images of the physical environment in real time, or the control circuit 14 may provide information to the trained model when it detects that the user has picked up a virtual object. The guided meditation session may proceed to subsequent instructions only after the user has picked up a physical object. The guided meditation session may then include verbal instructions from the virtual coach to rotate a physical object. The trained model may receive information about one or more images of the physical environment in real time. For example, the trained model may receive one or more images of the physical environment in real time, or the control circuit 14 may provide information to the trained model when it detects that the user has rotated a virtual object. Guided meditation sessions can proceed to subsequent instructions only after the user has rotated a physical object.

[0065] Figure 3 This is a flowchart illustrating an exemplary method for operating a head-mounted device that presents a guided meditation session. During operation at block 102, the head-mounted device 10 (e.g., control circuitry 14) may receive user input. User input may include gaze gestures obtained using gaze tracking sensor 40, head gestures (e.g., nodding or head movement) obtained using positioning and motion sensors 38, voice commands obtained using a microphone, gestures (e.g., pointing with a finger) obtained using one or more cameras 36, button presses obtained using buttons, and / or touch input obtained using touch sensors.

[0066] User input received during operation of box 102 may also include user input received at an external electronic device and transmitted to the head-mounted device 10 using communication circuitry 56. The head-mounted device 10 can wirelessly communicate with external electronic devices (such as tablet computers, cellular phones, laptops, watches, etc.). The user may provide user input to the external electronic device (e.g., voice commands provided to a microphone in the external electronic device, touch input to a touch-sensitive display in the external electronic device, etc.), which is wirelessly transmitted to the head-mounted device 10.

[0067] During operation of box 104, head-mounted device 10 (e.g., control circuitry 14) may determine an intent based on user input. The intent may be, for example, an intent to provide guided meditation.

[0068] During operation at box 106, based on the determined user intent indicating an intention to provide guided meditation, the head-mounted device 10 (e.g., control circuitry 14) may use camera 36 to capture one or more images of the physical environment. At box 106, based on the determined user intent indicating an intention to provide guided meditation, one or more cameras 36 may be activated (or their sampling rate may be increased). At box 106, based on the determined user intent indicating an intention to provide guided meditation, one or more additional sensors (e.g., depth sensor, heart rate sensor, gaze tracking sensor, etc.) may be activated (or their sampling rate may be increased).

[0069] During operation of block 108, control circuitry 14 may identify at least one physical object in the physical environment based on one or more images captured during operation of block 106. Control circuitry 14 may optionally provide information about the one or more images to trained model 62, and the trained model may identify at least one physical object in the physical environment.

[0070] During the operation of block 108, control circuitry 14 and / or trained model 62 may identify one or more physical objects that are highly suitable for inclusion in guided meditation. Control circuitry 14 and / or trained model 62 may identify physical objects highly suitable for inclusion in guided meditation by comparing the identification of each physical object with a set of physical objects highly suitable for inclusion in guided meditation or by determining whether each identified physical object satisfies one or more criteria (e.g., a reflectivity criterion).

[0071] After the operation of boxes 106 and / or 108, the power consumption of the camera can be reduced (e.g., the camera can be turned off or the camera's sampling rate can be reduced).

[0072] During operation of block 110, based on the determination of the user's intent to provide guided meditation, head-mounted device 10 (e.g., control circuitry 14) may use one or more microphones to capture one or more sounds in the physical environment. At block 110, based on the determination of the user's intent to provide guided meditation, one or more microphones may be turned on (or the sampling rate may be increased).

[0073] During operation of block 112, control circuitry 14 may identify at least one sound in the physical environment based on one or more sounds captured during operation of block 110. Control circuitry 14 may optionally provide information about one or more sounds to trained model 62, and trained model may identify at least one sound in the physical environment.

[0074] During operation of block 112, control circuitry 14 may identify one or more sounds that are highly suitable for incorporation into guided meditation. Control circuitry and / or trained model 62 may identify sounds highly suitable for incorporation into guided meditation by comparing the identification of each sound with a set of sounds highly suitable for incorporation into guided meditation or by determining whether each identified sound meets one or more criteria.

[0075] Following the operation of boxes 110 and / or 112, the power consumption of the microphone can be reduced (e.g., the microphone can be turned off or the sampling rate of the microphone can be reduced).

[0076] During the operation of box 114, based on the determined user intent indicating an intention to provide guided meditation, head-mounted device 10 may use one or more displays to present virtual objects. Prior to the operation of box 102, head-mounted device 10 may have already presented one or more virtual objects on display 32. After requesting user input for guided meditation, one or more virtual objects on display 32 may remain on display 32 during the guided meditation session. Alternatively or additionally, during the operation of box 114, display 32 may newly present one or more virtual objects as part of the guided meditation session.

[0077] As an example, during the operation at box 102, display 32 may display a first virtual object when it receives user input. The first virtual object may be displayed throughout the guided meditation session. Additionally, during the operation at box 114, based on the determination of the user's intent to provide guided meditation (during the operation at box 104), display 32 may display a second virtual object after the operation at box 102.

[0078] During operation of box 116, head-mounted device 10 may use one or more speakers 34 and / or display 32 to present guided meditation. The guided meditation session may reference at least one physical object in the physical environment identified during operation of box 108, at least one of one or more sounds identified during operation of box 112, and / or virtual objects on display 32 (e.g., from operation of box 114).

[0079] Figure 3One or more operations in the operation can be performed using the trained model 62. The trained model 62 can perform the operations of box 108 and / or box 112. The trained model 62 can also generate a guided meditation session presented by the head-mounted device 10 during the operation of box 116. The trained model 62 can output audio information and / or display information for the guided meditation session. The head-mounted device 10 can play audio for guided meditation based on the audio information generated by the trained model. The head-mounted device 10 can display one or more virtual objects for guided meditation based on the display information generated by the trained model.

[0080] Guided meditation sessions generated by trained model 62 (and presented by head-mounted device 10 during operation of box 116) can be based on information about one or more images of the physical environment, information about one or more sounds in the physical environment, one or more session length parameters, contextual information, sensor data, and / or virtual object information (such as combined with...). Figure 2 (As shown and discussed).

[0081] Figure 2 The example of using a trained model to generate guided meditation sessions is merely illustrative. In another possible arrangement, the head-mounted device 10 may use one or more stored guided meditation sessions to generate guided meditation sessions. The stored guided meditation sessions may have characteristics such as length, meditation type, physical object references, sound references, virtual object references, etc. The control circuitry 14 may select an appropriate guided meditation session from the stored guided meditation sessions based on real-time conditions (e.g., session length parameter, user input, requested meditation type, physical objects identified in the physical environment, sounds identified in the physical environment, etc.).

[0082] As a first example, during operation at box 102, a user may provide a voice command to head-mounted device 10, detected using microphones in head-mounted device 10. The voice command may include a request for a five-minute guided meditation session (without any other specific parameters). During operation at box 104, head-mounted device 10 may determine an intent based on the user's input to provide guided meditation. During operation at box 106, the power consumption of one or more cameras 36 in head-mounted device 10 may be increased (e.g., the cameras are turned on or their sampling rate is increased), and the cameras capture one or more images of the user's physical environment. During operation at box 108, control circuitry 14 in head-mounted device 10 may identify a bunch of flowers in the physical environment based on one or more images captured by the cameras 36. During operation at box 110, the power consumption of one or more microphones in head-mounted device 10 may be increased (e.g., the microphones are turned on or their sampling rate is increased), and the microphones capture one or more sounds of the user's physical environment. During operation of box 112, the control circuitry 14 in the head-mounted device 10 can identify the ticking analog clock based on the audio captured by the microphone.

[0083] In the first example, the head-mounted device 10 wirelessly communicates with a trained model 62 stored on an external server 60 (which may include paired companion electronics). The head-mounted device 10 can wirelessly transmit various inputs to the trained model, such as information about one or more images of the physical environment (e.g., a bouquet of flowers exists in the user's physical environment), information about one or more sounds in the physical environment (e.g., a ticking analog clock exists in the user's physical environment), session length parameters (e.g., the target length of a guided meditation session is five minutes), contextual information (e.g., the user is at home, it is currently 8:00 AM, and the user has a work meeting at 9:00 AM), and sensor data (e.g., the user's real-time heart rate data). The head-mounted device 10 then wirelessly receives audio and visual information (generated by the trained model) for the guided meditation session. The audio information includes verbal instructions such as listening to a ticking clock, looking at the bouquet of flowers, looking at a specific flower in the bouquet, looking at a specific part of a single flower in the bouquet, picking up the bouquet, and rotating the bouquet. During operation of frame 116, head-mounted device 10 uses speaker 34 to present a guided meditation session.

[0084] As a second example, a user may provide touch input to their cellular phone during operation of box 102. Touch input may include a request for a 25- to 35-minute guided meditation session incorporated into a physical object from their physical environment. User input provided to the cellular phone may be wirelessly transmitted to head-mounted device 10. During operation of box 104, head-mounted device 10 may determine an intent based on the user's input to provide guided meditation. During operation of box 106, the power consumption of one or more cameras 36 in head-mounted device 10 may be increased (e.g., the cameras are turned on or their sampling rate is increased), and the cameras capture one or more images of the user's physical environment. During operation of box 108, control circuitry 14 in head-mounted device 10 may identify objects in the physical environment that meet reflectivity criteria (e.g., a glass of water) based on one or more images captured by the cameras 36. In this example, operations of boxes 110, 112, and 114 may be omitted.

[0085] In the second example, the head-mounted device 10 stores the trained model 62 in the control circuitry 14. The control circuitry 14 can provide the trained model with various inputs, such as information about one or more images of the physical environment (e.g., a glass of water exists in the user's physical environment), session length parameters (e.g., the minimum length of a guided meditation session is 25 minutes, and the maximum length is 35 minutes), contextual information (e.g., the user is in a park and recently finished a full-day work meeting), and sensor data (e.g., the user's real-time heart rate data). The trained model 62 then generates audio and visual information for guided meditation. The audio information includes verbal instructions for looking at the glass of water, picking up the glass of water, rotating the glass of water, etc. During the operation of box 116, the head-mounted device 10 uses speaker 34 to present the guided meditation session.

[0086] As a third example, during operation of box 102, the user may perform a gaze gesture. During operation of box 104, the head-mounted device 10 may determine an intention based on the gaze gesture to provide guided meditation based on background noise in the user's physical environment. In this example, operations of boxes 106 and 108 may be omitted. During operation of box 110, the power consumption of one or more microphones in the head-mounted device 10 may be increased (e.g., the microphones are turned on or the sampling rate of the microphones is increased), and the microphones capture one or more sounds from the user's physical environment. During operation of box 112, control circuitry 14 in the head-mounted device 10 may identify birdsong based on the audio captured by the microphones. During operation of box 114, display 32 may present virtual objects associated with the guided meditation session.

[0087] In the third example, the head-mounted device 10 has multiple guided meditation sessions stored in the control circuitry 14. The head-mounted device 10 can select one of the multiple stored guided meditation sessions based at least on the detected noise of birdsong. During operation of block 116, the head-mounted device 10 can present the selected guided meditation session from the multiple stored guided meditation sessions. The selected guided meditation session may include a display 32 that presents a virtual reality environment. As an example, the display 32 may present a virtual reality environment including a forest (e.g., settings associated with the identified birdsong sounds). The guided meditation session may include audible instructions for listening to the birdsong. The guided meditation session may also include audible instructions for viewing virtual objects presented during operation of block 114, viewing various parts of the virtual reality environment, etc.

[0088] Figure 4 This is a flowchart illustrating an exemplary method for operating a head-mounted device during an interactive guided meditation session. During operation at block 122, the head-mounted device 10 may present references to physical objects in the user's physical environment during the first part of the guided meditation session. As a specific example, the speaker 34 may present instructions to the user for viewing the physical objects.

[0089] Next, during the operation of box 124, the head-mounted device 10 may present instructions for the user to interact with a physical object referenced during the operation of box 122, while in the first part of the guided meditation session. As a specific example, the speaker 34 may present instructions to the user for picking up the physical object.

[0090] During operation of box 126, and after an instruction is presented during operation of box 124, the head-mounted device 10 may increase the power consumption of one or more sensors. One or more sensors may be activated (or may have an increased sampling rate during operation of box 126). The activated sensors may include sensors capable of detecting user interaction with a physical object (individually or in combination). For example, at box 126, one or more cameras 36 may be activated (or the sampling rate may be increased) to detect a user interacting with an object. At box 126, gaze-tracking sensor 40 and / or depth sensor 42 may be activated (or the sampling rate may be increased) to detect a user interacting with an object.

[0091] The example of increasing the power consumption of one or more sensors during the operation of box 126 is merely illustrative. In some cases, user interaction can be detected without increasing the power consumption of one or more sensors, and the operation of box 126 can be omitted.

[0092] During operation of box 128, head-mounted device 10 may use one or more sensors from operation of box 126 to detect user interaction (as indicated during operation of box 124).

[0093] During operation of box 130, head-mounted device 10 may advance a guided meditation session from a first part to a second part in response to detecting user interaction with a physical object during operation of box 128. As an example, the first part of a guided meditation session may include verbal instructions focusing on looking at (without touching) the physical object, while the second part of a guided meditation session may include verbal instructions focusing on physically holding the physical object.

[0094] The head-mounted device 130 may present a notification indicating the transition from the first part of a guided meditation session to the second part of the guided meditation session. This notification may include an audible notification (e.g., a bell) presented by the speaker 34, a haptic notification presented by the haptic output device 44, a visual notification presented by the display 32, and so on.

[0095] The power consumption of one or more sensors may be varied multiple times before and / or during a guided meditation session. For example, camera 36 may be turned on to detect physical objects (e.g., before the operation of box 122). After a physical object is detected, camera 36 may be turned off. The camera may then be turned on during the operation of box 126. After an interaction is detected during the operation of box 128, camera 36 may be turned off. One or more sensors may be turned on and off (or have their sampling rates increased and decreased) at various times during the guided meditation session to identify triggers for transitions between different parts of the guided meditation session.

[0096] As an example, head-mounted device 10 can detect physical objects suitable for a guided meditation session. A trained model 62 can generate a guided meditation session with multiple parts associated with the physical object. During the first part, the guided meditation session can provide instructions associated with looking at the physical object. During the second part, the guided meditation session can provide instructions associated with holding and / or rotating the physical object. During the third part, the guided meditation session can provide instructions associated with feeling the physical object. During operation at box 122, head-mounted device 10 can present a reference to the physical object (e.g., an audible instruction for looking at the physical object). Then, during operation at box 124, the head-mounted device can present instructions to the user for picking up and rotating the physical object. After presenting the instructions to pick up and rotate the physical object to the user, the power consumption of camera 36 is increased during operation at box 126. During operation at box 128, one or more cameras are used to detect the user picking up and rotating the physical object. Detection of this interaction acts as a trigger for the guided meditation session to progress from the first part to the second part. During operation of frame 130, the head-mounted device 10 may advance the guided meditation session from the first part to the second part in response to detecting that the user picks up and rotates a physical object. After operation of frame 130, additional instructions associated with the second part of the guided meditation session may be provided. Also during operation of frame 130, the power consumption of camera 36 may be reduced (until the guided meditation session provides another instruction associated with transitioning from the second part to the third part).

[0097] Figure 3 and Figure 4 The order of operations presented is merely illustrative, and operations can be performed in any desired order. One or more operations may be omitted if necessary.

[0098] As described above, one aspect of the present invention is the collection and use of information, such as sensor information. This disclosure contemplates that, in some cases, data including personal information data may be collected, which uniquely identifies or can be used to contact or locate specific individuals. Such personal information data may include demographic data, location-based data, telephone numbers, email addresses, Twitter IDs, home addresses, data or records related to a user's health or fitness level (e.g., vital sign measurements, medication information, exercise information), date of birth, username, password, biometric information, or any other identifying or personal information.

[0099] This disclosure recognizes that the use of such personal information in the present invention can be used to benefit users. For example, the personal information data can be used to deliver targeted content that is of interest to the user. Therefore, the use of such personal information data enables the user to have control over the delivered content. Furthermore, this disclosure also anticipates other uses of personal information data that are beneficial to the user. For example, health and fitness data can be used to provide insights into the user's overall health status or can be used as positive feedback for individuals using the technology to pursue health goals.

[0100] This disclosure anticipates that entities responsible for the collection, analysis, disclosure, transmission, storage, or other use of such personal information data will comply with robust privacy policies and / or privacy measures. Specifically, such entities should implement and adhere to privacy policies and measures that are recognized as meeting or exceeding industry or governmental requirements for maintaining the privacy and security of personal information data. Such policies should be easily accessible to users and should be updated as the collection and / or use of data changes. Personal information from users should be collected for legitimate and reasonable entity purposes and should not be shared or sold outside of these legitimate purposes. Furthermore, such collection / sharing should be conducted only after receiving informed consent from users. Additionally, such entities should consider taking any necessary steps to protect and safeguard the right to access such personal information data and ensure that other entities with access to such personal information data comply with the privacy policies and procedures of those other entities. Moreover, such entities may subject themselves to third-party assessments to demonstrate their compliance with widely accepted privacy policies and privacy practices. Furthermore, policies and practices should be adapted to the specific types of personal information data collected and / or accessed, and to applicable laws and standards, including considerations of specific jurisdictions. For example, in the United States, the collection or access to certain health data may be governed by federal and / or state laws such as the Health Insurance and Accountability Act (HIPAA), while in other countries health data may be subject to other regulations and policies and should be processed accordingly. Therefore, different privacy measures should be advocated for different types of personal data in each country.

[0101] Regardless of the foregoing, this disclosure also contemplates implementation schemes for users to selectively block the use or access to personal information data. That is, this disclosure contemplates hardware and / or software components to prevent or block access to such personal information data. For example, the inventive technology can be configured to allow a user to opt-in or opt-out at any time during or after registering for the service, choosing to participate in the collection of personal information data. In another example, a user may choose not to provide certain types of user data. In yet another example, a user may choose to limit the length of time specific user data is retained. In addition to providing opt-in and opt-out options, this disclosure also contemplates providing notifications related to access to or use of personal information. For example, a user may be notified when downloading an application (“app”) that their personal information data will be accessed, and subsequently reminded again before the personal information data is accessed by the app.

[0102] Furthermore, the intent of this disclosure is that personal information data should be managed and processed in a manner that minimizes the risk of unintentional or unauthorized access or use. Once data is no longer needed, this risk can be minimized by restricting data collection and deleting data. Additionally, and where applicable, including in certain health-related applications, data de-identification can be used to protect user privacy. Where appropriate, de-identification can be facilitated by removing specific identifiers (e.g., date of birth, etc.), controlling the amount or characteristics of stored data (e.g., collecting location data at the city level rather than address level), controlling how data is stored (e.g., aggregating data among users), and / or other methods.

[0103] Therefore, while this disclosure broadly covers the use of information that may include personal information data to implement one or more of the various disclosed embodiments, it is also contemplated that various embodiments can be implemented without accessing personal information data. In other words, various embodiments of the present invention will not become inoperable due to the absence of all or part of such personal information data.

[0104] According to one embodiment, an electronic device includes one or more cameras, one or more speakers, one or more processors, and a memory storing instructions configured to be executed by the one or more processors for: obtaining user input; determining an intent based on the user input; and, based on the determined intent, indicating an intent to provide guided meditation: using the one or more cameras to capture one or more images of a physical environment; identifying at least one physical object in the physical environment based on the one or more images; and using the one or more speakers to present a guided meditation session, wherein the guided meditation session references the at least one physical object in the physical environment.

[0105] According to another embodiment, the electronic device optionally includes one or more sensors, wherein obtaining the user input optionally includes using the one or more sensors to obtain the user input, and the one or more sensors optionally include a microphone, a touch sensor, a button, or an accelerometer.

[0106] According to another embodiment, obtaining the user input optionally includes: wirelessly receiving user input information from an external electronic device, wherein the external electronic device is optionally a tablet computer, a laptop computer, a cellular phone, or a watch.

[0107] According to another embodiment, identifying the at least one physical object in the physical environment based on the one or more images optionally includes: providing information about the one or more images of the physical environment to a trained model, wherein the guided meditation session is generated by the trained model, and providing information about the one or more images of the physical environment to the trained model optionally includes: providing the one or more images of the physical environment to the trained model.

[0108] According to another implementation, the guided meditation session is optionally based on one or more session length parameters and contextual information, which optionally includes location information, cultural information, age information, user preference information, time information, or calendar information.

[0109] According to another embodiment, the electronic device optionally includes one or more microphones, wherein the instructions optionally include instructions for performing the following actions based on determining that the intention represents an intention to provide guided meditation: using the one or more microphones to capture one or more sounds in the physical environment, wherein the guided meditation session references at least one of the one or more sounds in the physical environment.

[0110] According to another embodiment, the at least one physical object in the physical environment optionally satisfies the reflectivity criterion.

[0111] According to another embodiment, the instruction optionally includes instructions to perform the following operations: when presenting the first part of the guided meditation session: using one or more cameras to detect user interaction with the at least one physical object in the physical environment; and based on the detected user interaction with the at least one physical object in the physical environment, advancing the guided meditation session from the first part to the second part.

[0112] According to another embodiment, the electronic device optionally includes one or more displays, wherein the instructions optionally include instructions for performing the following: using the one or more displays to present a virtual object, wherein the guided meditation session references the virtual object.

[0113] According to one embodiment, a method of operating an electronic device including one or more cameras and one or more speakers includes: obtaining user input; determining an intent based on the user input; and, based on determining the intent, indicating an intent to provide guided meditation: using the one or more cameras to capture one or more images of a physical environment; identifying at least one physical object in the physical environment based on the one or more images; and using the one or more speakers to present a guided meditation session, wherein the guided meditation session references the at least one physical object in the physical environment.

[0114] According to another embodiment, the electronic device optionally includes one or more sensors, wherein obtaining the user input optionally includes using the one or more sensors to obtain the user input, and the one or more sensors optionally include a microphone, a touch sensor, a button, or an accelerometer.

[0115] According to another embodiment, obtaining the user input optionally includes: wirelessly receiving user input information from an external electronic device, which is optionally a tablet computer, a laptop computer, a cellular phone, or a watch.

[0116] According to another embodiment, identifying the at least one physical object in the physical environment based on the one or more images optionally includes: providing information about the one or more images of the physical environment to a trained model, wherein the guided meditation session is optionally generated by the trained model, and providing information about the one or more images of the physical environment to the trained model optionally includes: providing the one or more images of the physical environment to the trained model.

[0117] According to another implementation, the guided meditation session is optionally based on one or more session length parameters and contextual information, which optionally includes location information, cultural information, age information, user preference information, time information, or calendar information.

[0118] According to another embodiment, the electronic device optionally includes one or more microphones, and the method optionally includes: based on determining the intention to provide guided meditation, using the one or more microphones to capture one or more sounds in the physical environment, the guided meditation session referencing at least one of the one or more sounds in the physical environment.

[0119] According to another embodiment, the at least one physical object in the physical environment optionally satisfies the reflectivity criterion.

[0120] According to another embodiment, the method optionally includes: when presenting a first part of the guided meditation session: using one or more cameras to detect user interaction with the at least one physical object in the physical environment; and based on the detected user interaction with the at least one physical object in the physical environment, advancing the guided meditation session from the first part to a second part.

[0121] According to another embodiment, the electronic device optionally includes one or more displays, and the method optionally includes using the one or more displays to present a virtual object, wherein the guided meditation session references the virtual object.

[0122] According to one embodiment, a non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device including one or more cameras and one or more speakers. The one or more programs include instructions for performing: obtaining user input; determining an intent based on the user input; and, based on the determined intent, indicating an intent to provide guided meditation: using the one or more cameras to capture one or more images of a physical environment; identifying at least one physical object in the physical environment based on the one or more images; and using the one or more speakers to present a guided meditation session, wherein the guided meditation session references the at least one physical object in the physical environment.

[0123] According to another embodiment, the electronic device optionally includes one or more sensors, wherein obtaining the user input optionally includes using the one or more sensors to obtain the user input, and the one or more sensors optionally include a microphone, a touch sensor, a button, or an accelerometer.

[0124] According to another embodiment, obtaining the user input optionally includes: wirelessly receiving user input information from an external electronic device, which is optionally a tablet computer, a laptop computer, a cellular phone, or a watch.

[0125] According to another embodiment, identifying the at least one physical object in the physical environment based on the one or more images optionally includes: providing information about the one or more images of the physical environment to a trained model, wherein the guided meditation session is generated by the trained model, and providing information about the one or more images of the physical environment to the trained model optionally includes: providing the one or more images of the physical environment to the trained model.

[0126] According to another implementation, the guided meditation session is optionally based on one or more session length parameters and contextual information, which optionally includes location information, cultural information, age information, user preference information, time information, or calendar information.

[0127] According to another embodiment, the electronic device optionally includes one or more microphones, and the instructions optionally include instructions for performing the following based on the determination that the intention represents an intention to provide guided meditation: using the one or more microphones to capture one or more sounds in the physical environment, wherein the guided meditation session references at least one of the one or more sounds in the physical environment.

[0128] According to another embodiment, the at least one physical object in the physical environment optionally satisfies the reflectivity criterion.

[0129] According to another embodiment, the instruction optionally includes instructions to perform the following operations: when presenting the first part of the guided meditation session: using one or more cameras to detect user interaction with the at least one physical object in the physical environment; and based on the detected user interaction with the at least one physical object in the physical environment, advancing the guided meditation session from the first part to the second part.

[0130] According to another embodiment, the electronic device optionally includes one or more displays, and the instructions optionally include instructions for performing the following: using the one or more displays to present a virtual object, wherein the guided meditation session references the virtual object.

[0131] The foregoing is merely illustrative and various modifications can be made to the described implementation scheme. The foregoing implementation scheme can be implemented individually or in any combination.

Claims

1. An electronic device, said electronic device comprising: one or more cameras; one or more speakers; one or more processors; and memory storing instructions configured to be executed by the one or more processors for: obtaining user input; determining an intent based on the user input; and in accordance with a determination that the intent represents an intent to provide guided meditation: capturing one or more images of a physical environment using the one or more cameras; identifying at least one physical object in the physical environment based on the one or more images; and presenting a guided meditation session using the one or more speakers, wherein the guided meditation session references the at least one physical object in the physical environment.

2. The electronic device of claim 1, said electronic device further comprising: one or more sensors, wherein obtaining the user input includes obtaining the user input using the one or more sensors, and wherein the one or more sensors include a microphone, a touch sensor, a button, or an accelerometer. wirelessly receiving user input information from an external electronic device, wherein the external electronic device is a tablet computer, a laptop computer, a cellular telephone, or a watch. providing information about the one or more images of the physical environment to a trained model, wherein the guided meditation session is generated by the trained model, and wherein providing the information about the one or more images of the physical environment to the trained model includes providing the one or more images of the physical environment to the trained model.

5. The electronic device of claim 1, wherein the guided meditation session is based on one or more session length parameters and contextual information, and wherein the contextual information includes location information, cultural information, age information, user preference information, time information, or calendar information.

3. The electronic device of claim 1, wherein obtaining the user input includes:

6. The electronic device of claim 1, said electronic device further comprising:

4. The electronic device of claim 1, wherein identifying the at least one physical object in the physical environment based on the one or more images comprises: one or more microphones, wherein the instructions further include instructions for: in accordance with a determination that the intent represents the intent to provide guided meditation: capturing one or more sounds in the physical environment using the one or more microphones, wherein the guided meditation session references at least one of the one or more sounds in the physical environment.

7. The electronic device of claim 1, wherein the at least one physical object in the physical environment satisfies a reflectivity criterion.

8. The electronic device of claim 1, wherein the instructions further include instructions for: while presenting a first portion of the guided meditation session: detecting, using the one or more cameras, a user interaction with the at least one physical object in the physical environment; and in accordance with detecting the user interaction with the at least one physical object in the physical environment, advancing the guided meditation session from the first portion to a second portion.

9. The electronic device of claim 1, said electronic device further comprising: ​ ​ one or more displays, wherein the instructions further include instructions to: present, using the one or more displays, a virtual object, wherein the guided meditation session references the virtual object.

10. A method of operating an electronic device, the electronic device including one or more cameras and one or more speakers, the method comprising: obtaining user input; determining an intent based on the user input; and in accordance with a determination that the intent represents an intent to provide guided meditation: capturing, using the one or more cameras, one or more images of a physical environment; identifying, based on the one or more images, at least one physical object in the physical environment; and presenting, using the one or more speakers, a guided meditation session, wherein the guided meditation session references the at least one physical object in the physical environment.

11. The method of claim 10, wherein the electronic device further comprises one or more sensors, wherein obtaining the user input comprises: obtaining the user input using the one or more sensors, and wherein the one or more sensors include a microphone, a touch sensor, a button, or an accelerometer.

12. The method of claim 10, wherein obtaining the user input comprises: wirelessly receiving user input information from an external electronic device, and wherein the external electronic device is a tablet computer, a laptop computer, a cellular telephone, or a watch.

13. The method of claim 10, wherein identifying the at least one physical object in the physical environment based on the one or more images comprises: providing information regarding the one or more images of the physical environment to a trained model, wherein the guided meditation session is generated by the trained model, and wherein providing the information regarding the one or more images of the physical environment to the trained model includes providing the one or more images of the physical environment to the trained model.

14. The method of claim 10, wherein the guided meditation session is based on one or more session length parameters and contextual information, and wherein the contextual information includes location information, cultural information, age information, user preference information, time information, or calendar information.

15. The method of claim 10, wherein the electronic device further comprises one or more microphones and wherein the method further comprises: in accordance with a determination that the intent represents the intent to provide guided meditation: capturing, using the one or more microphones, one or more sounds in the physical environment, wherein the guided meditation session references at least one of the one or more sounds in the physical environment.

16. The method of claim 10, wherein the at least one physical object in the physical environment satisfies a reflectivity criterion.

17. The method of claim 10, the method further comprising: while presenting a first portion of the guided meditation session: detecting, using the one or more cameras, a user interaction with the at least one physical object in the physical environment; and in accordance with detecting the user interaction with the at least one physical object in the physical environment, advancing the guided meditation session from the first portion to a second portion.

18. The method of claim 10, wherein the electronic device further includes one or more displays and wherein the method further comprises: presenting, using the one or more displays, a virtual object, wherein the guided meditation session references the virtual object.

19. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device that includes one or more cameras and one or more speakers, the one or more programs including instructions for: obtaining user input; determining an intent based on the user input; and in accordance with a determination that the intent represents an intent to provide a guided meditation: capturing, using the one or more cameras, one or more images of a physical environment; identifying, based on the one or more images, at least one physical object in the physical environment; and presenting, using the one or more speakers, a guided meditation session, wherein the guided meditation session references the at least one physical object in the physical environment.

20. The non-transitory computer-readable storage medium of claim 19, wherein the electronic device further comprises one or more sensors, wherein obtaining the user input comprises: obtaining the user input using the one or more sensors, and wherein the one or more sensors include a microphone, a touch sensor, a button, or an accelerometer.

Images