Electronic device for providing extended reality content and operation method thereof

The integration of XR technology in a head-mounted device with meditation guides addresses the lack of effective mental health support by generating personalized VR or AR meditation content, enhancing user experience and stress management.

WO2025249680A1PCT designated stage Publication Date: 2025-12-04SAMSUNG ELECTRONICS CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/021151
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-06-11
Filing Date
2024-12-26
Publication Date
2025-12-04

AI Technical Summary

Technical Problem

Existing electronic devices do not effectively integrate extended reality (XR) functionalities with meditation guide services to enhance personal mental health management and stress management.

Method used

A head-mounted electronic device equipped with a display, processor, and memory that collects user status data to generate personalized virtual or augmented reality meditation content based on user information, using pre-stored images and real-space imagery to provide guided meditation.

Benefits of technology

Enhances the effectiveness of meditation by providing personalized XR content tailored to individual user needs, improving mental health management and stress relief.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2024021151_04122025_PF_FP_ABST
    Figure KR2024021151_04122025_PF_FP_ABST
Patent Text Reader

Abstract

Disclosed are an electronic device for providing extended reality content and an operation method thereof. The electronic device may be a head-mounted type electronic device. The electronic device may collect user state data through at least one collection device. The electronic device may identify basic information for meditation guidance on the basis of the user state data. The electronic device may determine at least one recommended image among a plurality of pre-stored user images on the basis of the basic information for the meditation guidance. The electronic device may generate VR meditation content for personalized meditation guidance by using one or more objects or a background extracted from the at least one recommended image. The electronic device may display the VR meditation content through a display. Various other embodiments identified through the present document are also possible.
Need to check novelty before this filing date? Find Prior Art

Description

Electronic device providing extended reality content and method of operating the same

[0001] The present disclosure relates to an electronic device providing extended reality (XR) content and a method of operating the same.

[0002] Recently, electronic devices are being developed that provide extended reality (XR) services, encompassing augmented reality (AR), virtual reality (VR), and mixed reality (MR). For example, users can enjoy various XR services related to cameras, games, video streaming, and navigation while wearing a head-mounted display (HMD)-type electronic device.

[0003] Meanwhile, meditation, a practice of maintaining a stable yet conscious state through cessation of movement, concentration, and perception, can be utilized for personal mental health management, self-development, and stress management. Integrating XR functionality into meditation guide services provided to users via electronic devices is expected to enhance the effectiveness of meditation.

[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0005] A head-mounted type electronic device according to one embodiment may include a display, at least one processor including processing circuitry, and a memory storing instructions. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to collect user status data of a user wearing the electronic device through at least one collection device, identify basic information for a meditation guide based on the user status data, determine at least one recommended image from among a plurality of pre-stored user images based on the basic information, generate virtual reality (VR) meditation content for a personalized meditation guide using a background or one or more objects extracted from the at least one recommended image, and display the VR meditation content through the display.

[0006] A method for operating a head-mounted type electronic device according to one embodiment may include an operation of collecting user status data of a user wearing the electronic device through at least one collection device, an operation of identifying basic information for a meditation guide based on the user status data, an operation of determining at least one recommended image from among a plurality of user images stored in advance based on the basic information, an operation of generating virtual reality (VR) meditation content for a personalized meditation guide using a background or one or more objects extracted from the at least one recommended image, and an operation of displaying the VR meditation content through a display of the electronic device.

[0007] A computer-readable recording medium according to one embodiment may record a program executable on a computer. When the program is executed, the program may cause a head-mounted type electronic device to perform an operation method including an operation of collecting user status data of a user wearing the electronic device through at least one collection device, an operation of identifying basic information for a meditation guide based on the user status data, an operation of determining at least one recommended image from among a plurality of user images stored in advance based on the basic information, an operation of generating virtual reality (VR) meditation content for a personalized meditation guide using a background or one or more objects extracted from the at least one recommended image, and an operation of displaying the VR meditation content through a display of the electronic device.

[0008] A head-mounted type electronic device according to one embodiment may include a display, at least one camera, at least one processor including processing circuitry, and a memory storing instructions. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to collect user status data of a user wearing the electronic device through at least one collection device, identify basic information for a meditation guide based on the user status data, acquire an image of the real space through the at least one camera, generate augmented reality (AR) meditation content for a personalized meditation guide based on the basic information and the image of the real space, and display the AR meditation content through the display.

[0009] A method of operating a head-mounted type electronic device according to one embodiment may include an operation of collecting user status data of a user wearing the electronic device through at least one collection device, an operation of identifying basic information for a meditation guide based on the user status data, an operation of acquiring an image of the actual space through the at least one camera, an operation of generating augmented reality (AR) meditation content for a personalized meditation guide based on the basic information and the image of the actual space, and an operation of displaying the AR meditation content through the display.

[0010] A computer-readable recording medium according to one embodiment may record a program executable on a computer. When the program is executed, the program may cause a head-mounted type electronic device to perform an operation method including an operation of collecting user status data of a user wearing the electronic device, an operation of identifying basic information for a meditation guide based on the user status data, an operation of acquiring an image of the actual space through the at least one camera, an operation of generating augmented reality (AR) meditation content for a personalized meditation guide based on the basic information and the image of the actual space, and an operation of displaying the AR meditation content through the display.

[0011] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0012] FIG. 2 is a block diagram of an electronic device according to one embodiment.

[0013] FIG. 3A is a front view of a head mounted display (HMD) type electronic device according to one embodiment.

[0014] FIG. 3b is a rear view of an HMD type electronic device according to one embodiment.

[0015] FIG. 4A is a flowchart illustrating a method by which an electronic device provides virtual reality (VR) meditation content according to one embodiment.

[0016] FIG. 4b is a flowchart illustrating a method for an electronic device to provide VR meditation content according to one embodiment.

[0017] FIG. 4c is a flowchart illustrating a method for an electronic device to provide VR meditation content according to one embodiment.

[0018] FIG. 5A is an example of a user interface for describing how an electronic device provides VR meditation content according to one embodiment.

[0019] FIG. 5b is an example of a user interface for describing sequences of VR meditation content provided by an electronic device according to one embodiment.

[0020] FIG. 6A is a flowchart illustrating a method for an electronic device to provide augmented reality (AR) meditation content according to one embodiment.

[0021] FIG. 6b is a flowchart illustrating a method for an electronic device to provide AR meditation content according to one embodiment.

[0022] FIG. 7 is an example of a user interface for describing sequences of AR meditation content provided by an electronic device according to one embodiment.

[0023] FIG. 8 is a flowchart illustrating a method for an electronic device to provide mixed reality (MR) meditation content according to one embodiment.

[0024] FIG. 9 is an example of a user interface for describing sequences of MR meditation content provided by an electronic device according to one embodiment.

[0025] FIG. 10 is a flowchart illustrating a method for controlling a video see-through (VST) mode of an electronic device according to one embodiment.

[0026] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0027] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with the electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0028] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0029] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, in the electronic device (101) itself where artificial intelligence is performed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0030] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0031] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0032] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0033] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0034] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0035] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0036] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0037] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0038] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0039] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0040] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0041] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0042] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0043] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0044] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0045] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0046] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0047] At least some of the above components may be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)).

[0048] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0049] FIG. 2 is a block diagram of an electronic device (200) according to one embodiment.

[0050] An electronic device according to one embodiment may be the electronic device (200) of FIG. 2. The electronic device (200) may be configured to provide (e.g., display or output) extended reality content. The electronic device (200) may be configured to provide meditation content in an extended reality environment.

[0051] Referring to FIG. 2, the electronic device (200) may include a processor (210), a display (220), and a memory (230). The electronic device (200) may further include at least one of a camera module (240), a sensor module (250), a communication circuit (260), a speaker (270), and a microphone (280). The electronic device (200) may include additional components in addition to the components illustrated in FIG. 2. Some of the components of the electronic device (200) illustrated in FIG. 2 may be omitted, replaced, or integrated with each other.

[0052] In one embodiment, the electronic device (200) may correspond to the electronic device (101) of FIG. 1.

[0053] In one embodiment, the components of the electronic device (200) illustrated in FIG. 2 may correspond to the components of the electronic device (101) illustrated in FIG. 1. For example, the processor (210) may correspond to one of the processors (120, 121, or 123) of FIG. 1. The display (220) may correspond to the display module (160) of FIG. 1. The memory (230) may correspond to the memory (130) of FIG. 1. The camera module (240) may correspond to the camera module (180) of FIG. 1. The sensor module (250) may correspond to the sensor module (176) of FIG. 1. The communication circuit (260) may correspond to the communication module (190) of FIG. 1. The speaker (270) may correspond to the audio output module (155) of FIG. 1. The microphone (280) can correspond to the input module (150) of Fig. 1.

[0054] According to one embodiment, components included in the electronic device (200) may be electrically and / or operatively connected to each other to exchange signals (e.g., commands or data) with each other.

[0055] According to one embodiment, the memory (230) may store instructions that, when executed by the processor (210), cause the electronic device (200) to perform various operations. The processor (210) may execute the instructions stored in the memory (230) to cause the electronic device (200) to perform a specified function (or logic) or control at least one other component within the electronic device (200). For example, the processor (210) may control the electronic device (200) or components of the electronic device (200) to perform operations for an XR function and / or a meditation guide function, thereby providing a user of the electronic device (200) with XR meditation content (e.g., at least one of VR meditation content, AR meditation content, and MR meditation content).

[0056] According to one embodiment, the processor (210) may include processing circuitry. The number of processors (210) may be one or more. For example, the processor (210) may have a multi-core processor structure, such as a dual core, quad core, or hexa core.

[0057] According to one embodiment, the processor (210) may control operations of the electronic device (200) by executing instructions stored in the memory (230). For example, the processor (210) may correspond to a plurality of processors that collectively perform a plurality of operations by dividing them among the processors.

[0058] According to one embodiment, the processor (210) may include at least one of a central processing unit (CPU), an application processor, a graphics processing unit (GPU), a neural network processing unit (NPU), an image signal processor (ISP), a sensor hub processor, a communication processor, an application specific integrated circuit (ASIC), or a field programmable gate array (FPGA). The processor (210) may have one or more cores.

[0059] According to one embodiment, the camera module (240) may include at least one camera. For example, the camera module (240) may include at least some of the plurality of cameras (341, 342, 343, 344) illustrated in FIGS. 3A and 3B described below.

[0060] In one embodiment, each camera included in the camera module (240) may include a lens assembly and an image sensor. The lens assembly may collect light emitted from a subject to be photographed. The lens assembly may include one or more lenses. The image sensor may convert light emitted or reflected from the subject and transmitted through the lens assembly into an electrical signal, thereby obtaining an image corresponding to the subject. For example, the image sensor may include one image sensor selected from among image sensors with different properties, such as an RGB sensor, a BW (black and white) sensor, an IR sensor, or a UV sensor, a plurality of image sensors having the same properties, or a plurality of image sensors having different properties. Each image sensor included in the image sensor may be implemented using, for example, a CCD (charged coupled device) sensor or a CMOS (complementary metal oxide semiconductor) sensor.

[0061] In one embodiment, the camera module (240) can capture (or take pictures of) an image (e.g., a still image or a moving image or video) of a subject (e.g., a specific object, a person, a background, a user's eyes, or a real space). The camera module (240) can transmit the captured image to the processor (210) or store it in the memory (230). For example, the camera module (240) (or image sensor) can recognize at least one eye of the user's left eye or right eye, and track the direction in which the recognized user's eye is looking. The camera module (240) can also obtain an image of a real space (or the real world) and provide it to the user.

[0062] According to one embodiment, the display (220) may include at least one display. The display (220) may include at least one of a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED), a light emitting diode (LED), an active matrix organic LED (AMOLED), a flexible display, and a three-dimensional display. In addition, some of these displays may be configured as transparent or light-transmitting so that the outside may be viewed through them. The transparent or light-transmitting display may be configured as a transparent display including a TOLED (transparent OLED).

[0063] According to one embodiment, the display (220) (e.g., the display (330) of FIG. 3) may be in a form in which a display for the user's left eye (e.g., the first display area (331) of FIG. 3) and a display for the user's right eye (e.g., the second display area (332) of FIG. 3) are separated. Alternatively, the display (220) may be in the form of an integrated display in which the left and right displays are not separated.

[0064] In one embodiment, the processor (210) may generate (e.g., render) visual content (e.g., VR content, AR content, and / or MR content) that includes an XR object (e.g., VR object, AR object, and / or MR object) in an image stored in the memory (230) or an image acquired through the camera module (240), and display the content in real time through the display (220) or store the content in the memory (230).

[0065] In one embodiment, the display (220) may display visual content corresponding to an execution screen of an application (e.g., an XR application, a meditation application) executed by the processor (210), and / or visual content (e.g., a still image or video including an XR object) transmitted in real time from the processor (210) or stored in the memory (230). For example, the display (220) may correspond to the display (330) of FIGS. 3A and 3B described below.

[0066] According to one embodiment, the sensor module (250) may include at least one sensor.

[0067] For example, the sensor module (250) may include at least one of the first sensor (351) (e.g., an infrared sensor for depth detection of an external object) and the second sensor (352) (e.g., an infrared sensor for wearing detection) illustrated in FIGS. 3A and 3B described below.

[0068] For example, the sensor module (250) may include at least one of a first sensor (e.g., a biometric sensor) for measuring biometric data, a second sensor (e.g., an acceleration sensor, a gyro sensor) for measuring movement data, a third sensor (e.g., a GNSS (Global Navigation Satellite System) sensor, a TOF (time of flight) sensor, an UWB (ultra wideband) sensor) for measuring location data, a fourth sensor (e.g., a temperature sensor, a humidity sensor, an illuminance sensor, an altitude sensor) for measuring surrounding environment data, and a fifth sensor (e.g., an infrared sensor for detecting wearing) for measuring the wearing time of the electronic device (200).

[0069] According to one embodiment, the display (220) may display visual content (e.g., still images or videos containing XR objects) for a meditation guide service under the control of the processor (210). For example, the visual content may be XR meditation content, and may include at least one of VR meditation content, AR meditation content, or MR meditation content.

[0070] According to one embodiment, the visual content displayed on the display (220) may be an image captured in real time through a camera module (240), an image stored in a memory (230), or an image received from an external electronic device (e.g., a server (108) of FIG. 1) that has been processed to include an XR object in at least some of the images.

[0071] In one embodiment, the memory (230) may refer to one or more sets of memories. The memory (230) may store data and / or commands received from or generated by other components (e.g., a processor (210), a display (220), a camera module (240), a sensor module (250), or a microphone (280)).

[0072] According to one embodiment, the processor (210) may collect user status data of a user wearing the electronic device (200) through at least one collection device. The user status data may include at least some of biometric data, movement data, stress data, surrounding environment data, activity routine data, schedule data, and data regarding the wearing time of the electronic device (200).

[0073] According to one embodiment, the at least one collection device may include an electronic device (200) or one or more external electronic devices (e.g., electronic device (102) of FIG. 1).

[0074] According to one embodiment, the processor (210) may identify basic information for a meditation guide based on the user status data. The processor (210) may determine at least one recommended image from among a plurality of pre-stored user images based on the basic information for the meditation guide.

[0075] According to one embodiment, the basic information for the meditation guide may be information indicating one meditation type among a plurality of meditation types.

[0076] According to one embodiment, the processor (210) may determine at least one recommended image based on a comparison between basic information for a meditation guide and meta information of each of a plurality of pre-stored user images.

[0077] According to one embodiment, the processor (210) may determine at least one recommended image based on basic information for the meditation guide and pre-stored user history data.

[0078] In one embodiment, the processor (210) may extract one or more keywords corresponding to the background or one or more objects in the recommended image by an image captioning technique that converts the image into text. In one embodiment, the processor (210) may input the extracted one or more keywords into an artificial intelligence (AI) model and receive a response to the one or more keywords from the AI ​​model. The AI ​​model may be included in a generative artificial intelligence (AI) server or stored in the memory (230) of the electronic device (200).

[0079] In one embodiment, the processor (210) may transmit one or more keywords extracted from at least one recommended image as an input prompt to a generative artificial intelligence (AI) server (e.g., server (108) of FIG. 1) via the communication circuit (260). The processor (210) may receive a response to the input prompt from the generative AI server via the communication circuit (260). The response may include one or more sentences (sentences in natural language, e.g., sentences expressing changes in time relative to a background or describing movement of an object, expressions guiding a meditation stage in conjunction with a background or an object) related to the one or more keywords used as the input prompt.

[0080] In one embodiment, the processor (210) may provide one or more keywords extracted from at least one recommended image as input prompts to an internal on-device AI model and obtain a response. The response may include one or more sentences (in natural language) related to the one or more keywords used as input prompts.

[0081] In one embodiment, the processor (210) may generate VR meditation content using one or more sentences associated with one or more keywords from a response from a generative AI server or an on-device AI model.

[0082] According to one embodiment, the processor (210) may generate VR meditation content for a personalized meditation guide using a background or one or more objects extracted from at least one recommended image. For example, the processor (210) may generate a first sequence based on the extracted background. The processor (210) may generate a second sequence based on a person object among the extracted one or more objects. The processor (210) may generate a third sequence based on an environment object among the extracted one or more objects. The processor (210) may generate the VR meditation content by synthesizing the first sequence, the second sequence, and the third sequence.

[0083] According to one embodiment, the processor (210) may update the VR meditation content so that at least one of the background, the person object, and the environment object changes over time.

[0084] According to one embodiment, the processor (210) may update user status data through at least one collection device. The processor (210) may adjust the playback time of the VR meditation content based on the updated user status data.

[0085] According to one embodiment, the processor (210) can display the VR meditation content through the display (220).

[0086] According to one embodiment, the processor (210) can output a guide sound corresponding to VR meditation content displayed on the display (220) through the speaker (270).

[0087] According to one embodiment, the processor (210) can display the VR meditation content through the display while the electronic device (200) operates in VR mode. The processor (210) can acquire an image of an actual space through the camera module (240) while the electronic device (200) operates in AR mode. The processor (210) can generate AR meditation content using basic information for a meditation guide and the image of the actual space. The processor (210) can display the generated AR meditation content through the display (220).

[0088] According to one embodiment, the processor (210) can acquire sounds related to a real space (e.g., an image of the user's surrounding space) through a microphone (280). Based on the sounds related to the real space, the processor (210) can generate guide sounds corresponding to AR meditation content. The processor (210) can output the guide sounds through a speaker (270).

[0089] According to one embodiment, the processor (210) may monitor changes in user status data via at least one collection device and generate a feedback guide based on the monitoring results. The processor (210) may update VR meditation content based on the feedback guide.

[0090] According to one embodiment, the processor (210) can acquire an image of a real space through at least one camera within the camera module (240). The processor (210) can generate AR meditation content for a personalized meditation guide based on basic information for the meditation guide and the image of the real space. The processor (210) can display the generated AR meditation content through the display (220).

[0091] According to one embodiment, the operation mode of the electronic device (200) may include two or more modes among a VR mode, an AR mode, and an MR mode. For example, when the electronic device (200) is an HMD type electronic device (300) of FIGS. 3A and 3B , the video see-through (VST) mode of the HMD type electronic device (300) may include two or more modes among a VR mode, an AR mode, and an MR mode.

[0092] In one embodiment, the VR mode may be a mode that separates the user from the real world, immerses the user in a virtual world, and supports the user to experience the virtual environment. For example, the viewpoint in the virtual environment may change depending on the user's head movement. The electronic device (200) may recognize the user's hand movements through the camera module (240) and / or the sensor module (250) and may interact in the virtual world based on the hand movements. For example, when the VR mode is activated, the electronic device (200) may turn off some of the cameras in the camera module (240) (e.g., front cameras such as the first camera (341) and the second camera (342) illustrated in FIGS. 3A and 3B ), thereby allowing the user to enter a completely virtual world.

[0093] In one embodiment, the AR mode may be a mode that supports a user to experience the real world and the virtual world simultaneously by providing AR content that combines the real world and virtual objects. For example, the electronic device (200) may recognize the real world using the camera module (240) and display an augmented object synthesized on the real world. The augmented object may interact with the real world, and the properties (e.g., position, size, graphics) of the augmented object may change according to the user's movement or gaze. For example, when the AR mode is activated, the electronic device (200) may turn on all cameras within the camera module (240) (e.g., a front camera such as the first camera (341) and the second camera (342) illustrated in FIGS. 3A and 3B , a downward camera such as the third camera (343), and a rear camera such as the fourth camera (344).

[0094] In one embodiment, the MR mode may be a mode that combines the VR mode and the AR mode. For example, while operating in the MR mode, the electronic device (200) may alternately activate a VR mode that only displays the virtual world and an AR mode that displays both the real world and the virtual world.

[0095] According to one embodiment, the electronic device (200) can display VR meditation content through the display (220) while operating in VR mode. The electronic device (200) can acquire an image of a real space (or the real world) through at least one camera in the camera module (240) while operating in AR mode. The electronic device (200) can generate AR meditation content using the image of the real space or a background or one or more objects extracted from the image of the real space. The electronic device (200) can display the generated AR meditation content through the display (220).

[0096] According to one embodiment, an electronic device (200) (e.g., a processor (210)) can acquire sounds related to a real space (or the real world) through a microphone (280). The electronic device (200) can generate guide sounds corresponding to AR meditation content to be provided based on the sounds related to the real space. The electronic device (200) can output the generated guide sounds through a speaker (270).

[0097] According to one embodiment, the electronic device (200) may monitor changes in user status data through at least one collection device while displaying VR meditation content through the display (220). The electronic device (200) may generate a feedback guide based on the monitoring results. The electronic device (200) may update the VR meditation content being displayed based on the generated feedback guide.

[0098] According to one embodiment, the electronic device (200) may be a wearable electronic device configured to be worn on a part of the user's body (e.g., head, face, around the eyes). FIGS. 3A and 3B are drawings illustrating the mechanical configuration of an HMD type electronic device (300) when the electronic device (200) according to one embodiment is an HMD type electronic device (300).

[0099] In the present disclosure, embodiments are mainly described in which the electronic device (200) is an HMD type electronic device (300), but this is merely an example and the scope of the embodiments of the present disclosure is not limited to this type of electronic device.

[0100] According to various embodiments of the present document, the electronic device (200) may be a variety of devices that provide XR content. The electronic device (200) may include, for example, a wearable electronic device (e.g., an HMD type electronic device (300) illustrated in FIGS. 3A and 3B , a glass type electronic device), a portable communication device (e.g., a smartphone, a tablet, a laptop), a home appliance (e.g., a smart television), or a computer device (e.g., a laptop computer). The electronic device (200) according to embodiments of the present document is not limited to the aforementioned devices.

[0101] FIG. 3a is a front view of an HMD type electronic device (300) according to one embodiment. FIG. 3b is a rear view of an HMD type electronic device (300) according to one embodiment.

[0102] According to one embodiment, the electronic device (200) of FIG. 2 may be an HMD type electronic device (300) as illustrated in FIGS. 3A and 3B . The HMD type electronic device (300) may correspond to a sealed wearable electronic device that can be worn on a user's head or face (e.g., around the eyes). The movement of the HMD type electronic device (300) may occur according to the movement of the head.

[0103] Referring to FIGS. 3A and 3B, an HMD type electronic device (300) (e.g., electronic device (200) of FIG. 2) may include a main frame (310), a wearing part (320), a face form (315), a display (330) (e.g., display (220) of FIG. 2), at least one camera (341, 342, 343, 344) (e.g., camera module (240) of FIG. 2), at least one sensor (351, 352) (e.g., sensor module (250) of FIG. 2), a speaker (370) (e.g., speaker (270) of FIG. 2), or a microphone (380) (e.g., microphone (280) of FIG. 2).

[0104] The front side of the HMD type electronic device (300) illustrated in FIG. 3a may be the first side facing outward when worn. The rear side of the HMD type electronic device (300) illustrated in FIG. 3b may be the second side that comes into contact with the user's face when worn.

[0105] In one embodiment, a user may use the HMD type electronic device (300) while wearing the HMD type electronic device (300) on his or her face or head (e.g., around the eyes). In one embodiment, the display (330) may be positioned at a position facing the user's eyes (left and right eyes) while the user is wearing the HMD type electronic device (300) to display visual content corresponding to XR content.

[0106] In one embodiment, the main frame (310) may be worn on the user's face (e.g., around the eyes) and supported on the face by various components. In one embodiment, the wearable part (320) may adjust the length of a band formed of an elastic material to ensure that the main frame (310) fits snugly against the user's face.

[0107] The main frame (310) can be combined with a display (330) for displaying visual content, a wearing part (320) for fixing the HMD type electronic device (300) to the user's head or face, or a face form (315) that comes into contact with the user's face when worn.

[0108] In one embodiment, a display (330) may be arranged on the main frame (310). A user may view visual content (e.g., images, videos) displayed on the display (330).

[0109] In one embodiment, a lens assembly (335) including a first lens (e.g., a left lens) and a second lens (e.g., a right lens) may be disposed on the main frame (300). The lens assembly (335) may have a function of adjusting a focus so that a screen output through the display (330) can be viewed by the user's eyes while the HMD type electronic device (300) is worn by the user. The lens assembly (335) may include one or more lenses (e.g., a Fresnel lens, a Pancake lens, or a multi-channel lens) to implement this function.

[0110] In one embodiment, the display (330) may include a first display area (331) (e.g., a left display area) visible through a first lens (e.g., a left lens) of the lens assembly (335), and a second display area (332) (e.g., a right display area) visible through a second lens (e.g., a right lens) of the lens assembly (335).

[0111] In one embodiment, the main frame (310) may be arranged with a plurality of cameras (341, 342, 343, 344) and / or at least one sensor (351, 352).

[0112] In one embodiment, the plurality of cameras (341, 342, 343, 344) may include a first camera (341) (e.g., a depth camera), a second camera (342) (e.g., a side camera), a third camera (343) (e.g., a down word camera), and a fourth camera (344) (e.g., an infrared camera).

[0113] In one embodiment, a first camera (341) (e.g., a depth camera) and a second camera (342) (e.g., a side camera), which are some of the plurality of cameras (341, 342, 343, 344), may be arranged on a first surface (e.g., a front or an outer surface) of the HMD type electronic device (300). For example, the first camera (341) may be arranged to face the front center direction (the first angular direction) of the HMD type electronic device (300). The second camera (342) may be arranged to face the front side direction (the second angular direction) of the HMD type electronic device (300).

[0114] In one embodiment, a third camera (343) (e.g., a downward-facing camera), which is another part of the plurality of cameras (341, 342, 343, 344), may be placed on a third side (e.g., a bottom side) of the HMD type electronic device (300) so as to face downward (or in the ground direction, in the third angular direction) of the HMD type electronic device (300).

[0115] In one embodiment, a fourth camera (344), which is another part of the plurality of cameras (341, 342, 343, 344), may be positioned on a second side (e.g., a rear or inner side) of the HMD type electronic device (300) so as to face the rear (or user direction, fourth angular direction) of the HMD type electronic device (300).

[0116] In one embodiment, at least one sensor (351, 352) may include a first sensor (351) (e.g., an infrared sensor for depth detection of an external object) and / or a second sensor (352) (e.g., an infrared sensor for wearing detection).

[0117] In one embodiment, the first camera (341) (e.g., a depth camera) may be used for head tracking, hand tracking, and / or real-space recognition. The first camera (341) may include a left-eye camera and a right-eye camera. The left-eye camera and the right-eye camera may be identical cameras with substantially equivalent performance and specifications. For example, the first camera (341) may include a stereo camera capable of capturing images with depth information. The stereo camera may include two or more GS (global shutter) cameras.

[0118] In one embodiment, the first camera (341) may be linked to or include the first sensor (351). The first sensor (351) may be configured to detect a distance to an external object (e.g., a hand, an object, an external person). For example, the first sensor (351) may be a depth sensor, a three-dimensional sensor, a time of flight (ToF) sensor. The ToF sensor may measure the distance between the HMD type electronic device (300) and the external object using a signal (e.g., near-infrared, ultrasonic, laser, etc.). The ToF sensor may detect the distance between the HMD type electronic device (300) and the external object using ToF information, which is information about the time it takes for light emitted from a transmitter to the external object to be reflected and return to a receiver.

[0119] In one embodiment, the first camera (341), the second camera (342), and / or the third camera (343) may be for external photography. The first camera (341), the second camera (342), and / or the third camera (343) may each include a left-eye camera and a right-eye camera. For example, the first camera (341), the second camera (342), and / or the third camera (343) may include a color camera (e.g., an RGB camera) corresponding to a high-resolution camera (e.g., a high-resolution (HR) or photo video (PV) camera). For example, the first camera (341), the second camera (342), and / or the third camera (343) may be a color camera having an auto-focus function and an image stabilization function.

[0120] In one embodiment, the fourth camera (344) may be for iris recognition or eye tracking. The fourth camera (344) may include a left-eye camera and a right-eye camera. The left-eye camera and the right-eye camera may be cameras of substantially the same type (same performance and specifications). The fourth camera (344) may capture an image of the eye of a user wearing the HMD type electronic device (300) and may use the image to recognize the iris or detect and / or track the pupil. The HMD type electronic device (300) may use the fourth camera (344) to detect the direction in which the user's pupil is looking (or the direction of the gaze) and position the center of the visual content (e.g., an image or video provided as XR content) projected on the display (330) according to the direction. For example, the fourth camera (344) may include a GS camera. Using a GS camera can be beneficial for pupil detection and tracking rapid eye movements.

[0121] In one embodiment, the fourth camera (344) may be used for face tracking. For example, the fourth camera (344) may capture a portion of the user's face (e.g., the area around the eyes). For example, the fourth camera (344) may be used to detect and / or track the facial expressions of a user wearing the HMD-type electronic device (300).

[0122] The configuration of the above-described plurality of cameras (341, 342, 343, 344) (e.g., camera module (240) of FIG. 2) and / or at least one sensor (351, 352) (e.g., sensor module (250) of FIG. 2) is merely an example for explanation, and the scope of the embodiments is not limited thereto. Various modifications, applications, or expansions may be possible with respect to the configuration of the camera module (240) and / or the sensor module (250) (e.g., total number of cameras, positions of each camera, mechanical configuration, function, or type of each camera).

[0123] In one embodiment, the main frame (310) may be equipped with a microphone (380) for sound input (e.g., an array microphone) and / or a speaker (370) for sound output.

[0124] In one embodiment, the display (330) can display different images on the first display area (331) and the second display area (332), respectively. For example, a right-eye image to be transmitted to the user's left eye can be displayed on the first display area (331) (e.g., the left display area) visible through the first lens (e.g., the left lens) of the lens assembly (335) of the display (330). A right-eye image to be transmitted to the user's right eye can be displayed on the second display area (332) (e.g., the right display area) visible through the second lens (e.g., the right lens) of the lens assembly (335) of the display (330). The display (330) can provide the user with a three-dimensional effect by displaying different left-eye images and right-eye images, respectively. The display (330) can display images under the control of a processor (e.g., the processor (210) of FIG. 2).

[0125] In one embodiment, a user wearing an HMD type electronic device (300) can view visual content corresponding to XR content through a display (330). Through this, the HMD type electronic device (300) can implement virtual reality (VR), augmented reality (AR), or fusion reality (XR) within a virtual three-dimensional (3D) space.

[0126] Hereinafter, with reference to FIGS. 4A, 4B, 4C, 5A, 5B, 6A, 6B, 7, 8, 9, and 10, methods for an electronic device (200) to provide XR meditation content (e.g., at least one of VR meditation content, AR meditation content, or MR meditation content) according to various embodiments will be described. The operations illustrated in the embodiments may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the illustrated operations may be changed, and at least two operations may be performed in parallel. Alternatively, at least one of the illustrated operations may be omitted, the order of some operations may be changed, some operations may be combined, or other operations may be added. At least some of the operations of the methods for providing XR meditation content of an electronic device (200) according to various embodiments described below may be performed in correspondence with each other or in combination with each other.

[0127] The user interfaces illustrated in FIGS. 5a, 5b, 7, and 9 are merely examples for explanation, and the scope of the embodiments of the present disclosure is not limited thereto and may be applied, modified, and / or expanded in various ways.

[0128] FIG. 4A is a flowchart illustrating a method for an electronic device (200) to provide VR meditation content according to one embodiment. For example, the electronic device (200) may be a wearable electronic device (e.g., the HMD type electronic device (300) of FIGS. 3A and 3B).

[0129] According to one embodiment, the electronic device (200) may operate in VR mode. While the electronic device (200) operates in VR mode, the electronic device (200) may perform an operation of displaying VR meditation content through the display (220) and / or an operation of outputting a guide sound corresponding to the VR meditation content through the speaker (270).

[0130] Referring to FIG. 4a, a method of providing VR meditation content by an electronic device (200) may include operations 411, 412, 413, 414, and 415.

[0131] In operation 411, the electronic device (200) can collect user status data of a user wearing the electronic device (200) through at least one collection device.

[0132] According to one embodiment, the user status data may include at least some of biometric data, movement data, stress data, environmental data, activity routine data, schedule data, and data regarding the wearing time of the electronic device (200).

[0133] According to one embodiment, at least one collection device for collecting user biometric data may include at least one sensor, for example, a sensor module (250) within the electronic device (200) or an external sensor (not shown).

[0134] According to one embodiment, at least one collection device may include at least some of a first sensor for measuring biometric data, a second sensor for measuring movement data, a third sensor for measuring location data, a fourth sensor for measuring environmental data, and a fifth sensor for measuring wearing time of the electronic device (200).

[0135] In one embodiment, the first sensor may be a biosensor, and may include at least one of a bioelectrode sensor, a photoplethysmogram (PPG) sensor, an electrocardiography (ECG) sensor, a galvanic skin response (GSR) sensor, an electroencephalography (EEG) sensor, a bioelectrical impedance analysis (BIA) sensor, or an iris sensor. The electronic device (200) may use the first sensor to measure biometric data of the user (e.g., data such as heart rate, heart rate variability, electrocardiogram, respiration, blood pressure, blood sugar, body temperature, body composition, calorie consumption, blood oxygen saturation, and galvanic skin response).

[0136] In one embodiment, the second sensor may include at least one of an acceleration sensor, a gyro sensor, or a proximity sensor. The electronic device (200) may measure user movement data using the second sensor. For example, the movement data may include data such as rotation of the electronic device (200), change in direction of the electronic device (200), inclination of the electronic device (200), measurement values ​​for changes in physical quantities due to the approach of an external object (e.g., the user's hand, an object), whether the user is moving, the user's movement speed, the user's movement pattern, and the user's posture.

[0137] In one embodiment, the third sensor may include at least one of a Global Navigation Satellite System (GNSS) sensor, a time of flight (TOF) sensor, or an ultra wideband (UWB) sensor. The electronic device (200) may use the third sensor to measure location data, such as the location of the user (or the electronic device (200)), the location of the user (or the electronic device (200)), or the distance between the user (or the electronic device (200)) and an external object.

[0138] In one embodiment, the fourth sensor may include at least one of a temperature sensor, a humidity sensor, an illuminance sensor, an altitude sensor, a noise sensor, a gas sensor, or a fine dust sensor. The electronic device (200) may use the fourth sensor to measure the user's surrounding environment data (e.g., data such as ambient brightness, temperature, humidity, altitude, noise level, and fine dust concentration).

[0139] In one embodiment, the fifth sensor may include a wear detection sensor (e.g., an infrared sensor). The electronic device (200) may use the fifth sensor to measure data regarding the wearing time of the electronic device (200) (e.g., a wearing time value, whether the wearing time value exceeds a specified reference value).

[0140] According to one embodiment, each sensor used as a collection device may be configured within a sensor module (250) of the electronic device (200) or may be configured within an external electronic device (e.g., the electronic device (102) of FIG. 1) that is distinct from the electronic device (200).

[0141] In one embodiment, the electronic device (200) may obtain stress data based on biometric data measured via the first sensor. For example, the electronic device (200) may calculate a stress level (e.g., intensity) based on heart rate variability data measured via the first sensor. For example, the electronic device (200) may analyze biometric components (e.g., lactic acid, glucose, etc.) in blood measured via the first sensor to determine the type of stress (e.g., mental stress, physical stress, etc.).

[0142] In one embodiment, the electronic device (200) may obtain user activity routine data (e.g., sleep time, wake-up time, total sleep time, or data such as whether the user is performing any activity among sleep, wake-up, going out, exercising, resting, working, and traveling) based on at least some of the biometric data measured through the first sensor, the movement data measured through the second sensor, the location data measured through the third sensor, and the surrounding environment data measured through the fourth sensor.

[0143] In one embodiment, the electronic device (200) can obtain the user's schedule data. For example, when a first application (e.g., a meditation application) is running on the electronic device (200), the first application can load the user's schedule data stored in conjunction with a second application (e.g., a calendar application) from the memory (230) or an external electronic device (e.g., the electronic device (102) of FIG. 1 , the user's smart phone).

[0144] According to one embodiment, at least one collection device for collecting user biometric data may include the electronic device (200) of FIG. 2.

[0145] According to one embodiment, at least one collection device for collecting user biometric data may include one or more external electronic devices. For example, at least one collection device may include the electronic device (102) or the server (108) of FIG. 1. For example, at least one collection device may include at least one of a portable communication device that is easy to carry (e.g., a smartphone, a tablet, a laptop), a wearable electronic device that can be worn on a part of the user's body (e.g., an electronic device in the form of a watch, a ring, a bracelet, an anklet, clothing, glasses, or a necklace), and an electronic device that can recognize and communicate with nearby electronic devices (e.g., an electronic sticker, a smart speaker, a scale, a blood pressure monitor, a blood glucose meter, a remote camera). However, this is merely an example, and embodiments of the present disclosure are not limited thereto. For example, the at least one collection device may include a body-attached electronic device (e.g., a skin pad or an electrode) that can be attached to a part of the user's body. According to one embodiment, at least one collection device may be set to a group based on the user's account.

[0146] In operation 412, the electronic device (200) can identify basic information for meditation guidance based on the user status data collected through operation 411.

[0147] In one embodiment, the basic information for a meditation guide may be information indicating one meditation type among a plurality of meditation types. For example, the plurality of meditation types may include two or more types of concentration meditation, compassion meditation, insight meditation, and mantra meditation. For example, the basic information for a meditation guide may include at least one of an identifier, a keyword, or basic meditation content (e.g., an image, a video) corresponding to the identifier or keyword for one of the plurality of meditation types (e.g., the first image (510) of FIG. 5A ).

[0148] According to one embodiment, the electronic device (200) may classify the meditation type required by the user into one of a plurality of meditation types (e.g., two or more of concentration meditation, compassion meditation, insight meditation, and mantra meditation) based on user status data. Concentration meditation may be a type of meditation that aims for concentration. Compassion meditation may be a type of meditation that aims to cultivate love and kindness toward oneself and others. Insight meditation may be a type of meditation that aims to reduce stress or enhance emotional stability. Mantra images may be a type of meditation that aims to achieve harmony between the mind and the heart.

[0149] For example, when a first application (e.g., a meditation application) is executed, the electronic device (200) may read the stored schedule data from the memory (230) or an external electronic device (e.g., the electronic device (102) of FIG. 1) in conjunction with a second application (e.g., a calendar application). The electronic device (200) may identify whether there is an important schedule for today from the schedule data, and if there is an important schedule, may classify the type of meditation required by the user as a concentration meditation that increases concentration. In this case, the basic information for the meditation guide may be information indicating concentration meditation.

[0150] For example, the electronic device (200) may obtain the user's activity routine data when a designated meditation time (e.g., 7:00 AM or 10:00 PM every day) arrives. The electronic device (200) may identify whether the user has woken up from the activity routine data, and if the user has woken up, may classify the type of meditation required for the user as a mantra image to start the day. The electronic device (200) may identify whether the user is about to sleep from the activity routine data (e.g., whether the location of the electronic device (200) is at home), and if the user is about to sleep, may classify the type of meditation required for the user as compassion meditation for sleep. In this case, the basic information for the meditation guide may be information indicating compassion meditation.

[0151] For example, if the user's stress level exceeds a reference value, the electronic device (200) may classify the user's desired meditation type as insight meditation for stress relief. In this case, the basic information for the meditation guide may be information indicating insight meditation.

[0152] For example, if the wearing time of the electronic device (200) exceeds a reference time or the runtime of a third-party application (e.g., a game application) exceeds a reference time, the electronic device (200) may classify the type of meditation required by the user as insight meditation for relaxation or mantra meditation. In this case, the basic information for the meditation guide may be information indicating insight meditation or mantra images.

[0153] In operation 413, the electronic device (200) may determine at least one recommended image from among a plurality of pre-stored user images based on the basic information identified through operation 412.

[0154] In one embodiment, the plurality of user images may be images pre-stored in conjunction with a designated application (e.g., a gallery application).

[0155] In one embodiment, the plurality of user images may be stored in the memory (230) of the electronic device (200).

[0156] In one embodiment, the plurality of user images may be stored in an external electronic device (e.g., the electronic device (102) of FIG. 1, the user's smart phone) connected to the electronic device (200) via short-range wireless communication (e.g., Bluetooth, WiFi). For example, the plurality of user images may be images stored in the external electronic device in conjunction with a gallery application installed in the external electronic device.

[0157] In one embodiment, the plurality of user images may be stored in an external electronic device (e.g., server (108) of FIG. 1) connected to the electronic device (200) via long-distance communication (e.g., cellular communication, the Internet). For example, the plurality of user images may be images registered in a user's account managed by the external electronic device (e.g., server (108) of FIG. 1).

[0158] According to one embodiment, the electronic device (200) may determine a recommended image based on a comparison between basic information for a meditation guide and meta information (or meta information per image) of each of a plurality of pre-stored user images.

[0159] According to one embodiment, the meta information may include information about at least one of the shooting location, shooting position, shooting time, properties (e.g., viewpoint, file name, date, size, resolution, brightness), and category (e.g., classified as background-oriented / person-oriented / object-oriented, classified as outdoor / indoor, classified as mountain / valley / sea / city / countryside, classified as morning / lunch / evening / night / dawn, and geographical classification) of each image.

[0160] In one embodiment, the meta information of an image may be stored as a single file together with the image when the image is stored (e.g., photographed) in an external electronic device (e.g., the electronic device (102) of FIG. 1, the user's smart phone). Alternatively, a meta information list specifying image-specific meta information in relation to multiple user images (e.g., image-file name matching information) may be stored in the memory (230) of the electronic device (200) as a separate database.

[0161] According to one embodiment, the electronic device (200) can identify an image suitable for a meditation type indicated by basic information for a meditation guide based on image-specific meta information for a plurality of user images, and select the identified image as a recommended image.

[0162] For example, if the basic information for a meditation guide indicates focused meditation, the electronic device (200) may identify an image among multiple user images whose shooting location / position corresponds to a lake or a quiet beach, based on image-specific meta information. The electronic device (200) may select the identified image as a recommended image.

[0163] For example, if the basic information for a meditation guide indicates insight meditation, the electronic device (200) may identify, based on image-specific metadata, an image among multiple user images whose shooting location / location corresponds to a home, a cozy living room, a garden, or a veranda. The electronic device (200) may select the identified image as a recommended image.

[0164] For example, if the basic information for a meditation guide indicates mantra meditation, the electronic device (200) can identify, based on image-specific meta information, among a plurality of user images, an image whose shooting location / position corresponds to a park, a forest, a beach where a sunrise or sunset can be seen, or an image taken in the morning.

[0165] For example, if the basic information for a meditation guide indicates compassion meditation, the electronic device (200) may identify, based on image-specific meta information, an image of a shooting location / position corresponding to a mountain peak, a wide field, a cliff over the sea, or an image shot in the evening among a plurality of user images, and select the identified image as a recommended image.

[0166] In operation 414, the electronic device (200) may generate VR meditation content for a personalized meditation guide by using a background (e.g., background (551) of FIG. 5A) and / or one or more objects (e.g., person objects (552, 553) and environment objects (554) of FIG. 5A) extracted from the recommended image determined through operation 413. For example, the VR meditation content may correspond to a user interface including a first image (561), a second image (562), and a third image (563) of FIG. 5B.

[0167] According to one embodiment, the electronic device (200) may generate a first sequence (e.g., a first sequence (506) of FIG. 5B) based on a background (e.g., a background (551) of FIG. 5A) in the recommended image. The electronic device (200) may generate a second sequence (e.g., a second sequence (507) of FIG. 5B) based on a person object (e.g., a person object (552, 553) of FIG. 5A) among one or more objects in the recommended image. The electronic device (200) may generate a third sequence (e.g., a third sequence (508) of FIG. 5B) based on an environment object (e.g., an environment object (554) of FIG. 5A) among one or more objects in the recommended image. The electronic device (200) can generate VR meditation content (e.g., a user interface including the first sequence (506), the second sequence (507), and the third sequence (508) of FIG. 5b) by synthesizing the first sequence, the second sequence, and the third sequence into one.

[0168] In one embodiment, the electronic device (200) may extract one or more keywords corresponding to the background or one or more objects in the recommended image by using an image captioning technique that converts the image into text. In one embodiment, the electronic device (200) may input the extracted one or more keywords into an artificial intelligence (AI) model and receive a response to the one or more keywords from the AI ​​model. The AI ​​model may be included in a generative artificial intelligence (AI) server or may be included within the electronic device (200).

[0169] In one embodiment, the electronic device (200) may transmit one or more keywords extracted from at least one recommended image as an input prompt to a generative artificial intelligence (AI) server (e.g., server (108) of FIG. 1) via the communication circuit (260). The electronic device (200) may receive a response to the input prompt from the generative AI server via the communication circuit (260). The response may include one or more sentences (sentences in natural language, e.g., sentences expressing changes in time relative to a background or describing movement of an object, expressions guiding meditation steps in conjunction with a background or an object) related to the one or more keywords used as the input prompt.

[0170] In one embodiment, the electronic device (200) may provide one or more keywords extracted from at least one recommended image as input prompts to an internal on-device AI model and obtain a response. The response may include one or more sentences (sentences in natural language) related to the one or more keywords used as the input prompts.

[0171] In one embodiment, the electronic device (200) may generate VR meditation content using one or more sentences associated with one or more keywords from a response from a generative AI server or an on-device AI model. An example of the operation of generating VR meditation content is further described in FIGS. 5A and 5B .

[0172] In operation 415, the electronic device (200) may display the generated VR meditation content (e.g., a user interface including the first image (561), the second image (562), and the third image (563) of FIG. 5b) through the display (220).

[0173] According to one embodiment, the electronic device (200) can update VR meditation content so that changes in at least one of the background, character object, and environment object appear over time.

[0174] According to one embodiment, the electronic device (200) can adjust the playback time of VR meditation content provided to the user.

[0175] In one embodiment, the electronic device (200) can update user status data through at least one collection device. The electronic device (200) can adjust the playback time of VR meditation content based on the updated user status data. For example, if, while the VR meditation content is being played, the user's location identified from the movement data falls outside a specified range or the stress level identified from the stress data falls below a specified standard, the electronic device (200) can shorten the total meditation time by setting the playback time of the VR meditation content to a value lower than a default value.

[0176] In one embodiment, the electronic device (200) may adjust the playback time of VR meditation content in response to user input. For example, the electronic device (200) may display a user interface element (e.g., a timer icon) for setting the playback time of the VR meditation content, receive user input for the user interface element, and set the playback time of the VR meditation content based on the user input.

[0177] According to one embodiment, the electronic device (200) can output guide sounds (e.g., sound sources synchronized to each image of a video) corresponding to VR meditation content displayed on the display (220) through the speaker (270).

[0178] FIG. 4B is a flowchart illustrating a method for an electronic device to provide VR meditation content according to one embodiment. For example, the electronic device (200) may be a wearable electronic device (e.g., the HMD type electronic device (300) of FIGS. 3A and 3B).

[0179] According to one embodiment, the electronic device (200) can operate in VR mode.

[0180] Referring to FIG. 4b, a method of providing VR meditation content by an electronic device (200) may include operations 421, 422, 423, 424, 425, 426, 427, 428, and 429.

[0181] In operation 421, the electronic device (200) (e.g., the HMD type electronic device (300) of FIGS. 3A and 3B) can collect user status data of a user wearing the electronic device (200) through at least one collection device.

[0182] According to one embodiment, the user status data may include at least some of biometric data, movement data, stress data, environmental data, activity routine data, schedule data, and data about the wearing time of the electronic device (200).

[0183] In operation 422, the electronic device (200) may execute a meditation application.

[0184] According to one embodiment, the electronic device (200) may execute a meditation application in response to a meditation triggering event occurring.

[0185] For example, the electronic device (200) may determine that a meditation triggering event has occurred when at least one of a first condition in which a user input requesting execution of a first application (e.g., a meditation application) on the electronic device (200) is detected, a second condition in which a designated meditation time (e.g., 7:00 AM every day) arrives, a third condition in which a user's stress level exceeds a reference value, a fourth condition in which a wearing time of the electronic device (200) exceeds a reference time, or a fifth condition in which a runtime of a third application (e.g., a game application) running on the electronic device (200) exceeds a reference time is satisfied.

[0186] In operation 423, the electronic device (200) can identify basic information for meditation guidance based on the user status data collected in operation 421 as the meditation application is executed.

[0187] In one embodiment, the basic information for a meditation guide may be information indicating one meditation type among multiple meditation types. For example, the basic information for a meditation guide may include an identifier, a keyword, or basic meditation content (e.g., an image, a video) corresponding to the identifier or keyword for one of the multiple meditation types (e.g., the first image (510) of FIG. 5A ).

[0188] In operation 424, the electronic device (200) may determine a recommended image based on the basic information and the gallery application identified through operation 423.

[0189] In one embodiment, the electronic device (200) may select a recommended image that matches the basic information for the meditation guide from among a plurality of user images pre-stored by the gallery application. For example, the electronic device (200) may compare the basic information for the meditation guide with the metadata of each of the user images pre-stored in conjunction with the gallery application, and select a recommended image based on the comparison results.

[0190] In operation 425, the electronic device (200) may generate a virtual 3D space (e.g., the third image (530) of FIG. 5A) based on the recommended image determined through operation 424. For example, the electronic device (200) may generate the virtual 3D space by rendering the recommended image into a 3D space using a stereoscopic technique that imparts a three-dimensional effect (or depth) to a flat surface.

[0191] In operation 426, the electronic device (200) can extract one or more separable objects (e.g., person objects (552, 553) and environment objects (554) of FIG. 5A) from the recommended image determined through operation 424.

[0192] In operation 427, the electronic device (200) may generate sequences (e.g., the first sequence (506), the second sequence (507), and the third sequence (508) of FIG. 5B) for generating VR meditation content by an image captioning technique.

[0193] In one embodiment, the electronic device (200) may extract one or more keywords corresponding to the background or one or more objects in the recommended image by an image captioning technique that converts the image into text. In one embodiment, the electronic device (200) may input the extracted one or more keywords into an AI model and receive a response to the one or more keywords from the AI ​​model. The AI ​​model may be included in a generative AI server (e.g., server (108) of FIG. 1). Alternatively, the AI ​​model may be included in the electronic device (200) as an on-device AI model.

[0194] In operation 428, the electronic device (200) can generate VR meditation content (e.g., a user interface including the first sequence (506), the second sequence (507), and the third sequence (508) of FIG. 5B) by synthesizing the sequences generated through operation 427. The electronic device (200) can provide (e.g., display or output) the generated VR content to the user.

[0195] In operation 429, the electronic device (200) may adjust the playback time of the VR meditation content provided to the user. In one embodiment, the electronic device (200) may update user status data through at least one collection device. The electronic device (200) may adjust the playback time of the VR meditation content based on the updated user status data. In one embodiment, the electronic device (200) may adjust the playback time of the VR meditation content in response to a user input.

[0196] FIG. 4c is a flowchart illustrating a method for an electronic device to provide VR meditation content according to one embodiment.

[0197] Referring to FIG. 4c, a method of providing VR meditation content by an electronic device (200) may include operations 431, 432, 433, 434, and 435.

[0198] In operation 431, the electronic device (200) (e.g., the HMD type electronic device (300) of FIGS. 3A and 3B) can collect user status data of a user wearing the electronic device (200) through at least one collection device.

[0199] According to one embodiment, the user status data may include at least some of biometric data, movement data, stress data, environmental data, activity routine data, schedule data, and data about the wearing time of the electronic device (200).

[0200] In operation 432, the electronic device (200) can identify basic information for meditation guidance based on the user status data collected through operation 431.

[0201] In one embodiment, the basic information for a meditation guide may be information indicating one meditation type among multiple meditation types. For example, the basic information for a meditation guide may include an identifier, a keyword, or basic meditation content (e.g., an image, a video) corresponding to the identifier or keyword for one of the multiple meditation types (e.g., the first image (510) of FIG. 5A ).

[0202] In operation 433, the electronic device (200) may determine at least one recommended image from among a plurality of pre-stored user images based on the basic information identified through operation 432.

[0203] According to one embodiment, the electronic device (200) may determine a recommended image based on basic information for a meditation guide and pre-stored user history data. In one embodiment, the user history data may be stored in the memory (230) of the electronic device (200) or an external electronic device (e.g., the electronic device (102), the server (108) of FIG. 1, or the user's smart phone connected to the electronic device (200) via short-range wireless communication). According to one embodiment, the user history data may include at least a portion of previous user status data. According to one embodiment, the user history data may include information on at least one of the user's biometric data, movement data, stress data, activity routine data, emotion data, preference data, and user status classification categories (e.g., classification into high / medium / low based on stress level, classification into good / calm / anxious based on emotional state, classification into exercise / rest / after waking up / before sleep / daily / work based on activity state, and classification into good / average / bad based on preference).

[0204] According to one embodiment, the electronic device (200) can identify an image suitable for a meditation type indicated by basic information for a meditation guide based on user history data, and select the identified image as a recommended image.

[0205] For example, if the basic information for a meditation guide indicates insight meditation that requires stress relief or mood change, the electronic device (200) may, based on user history data (e.g., biometric data, stress data, and surrounding environment data), identify a time period during which the user's stress level is low, the user's heart rate shows a stable pattern, or the user maintains a good mood among a plurality of user images, and select an image captured during the time period as a recommended image. The electronic device (200) may select the identified image as a recommended image.

[0206] For example, if the basic information for a meditation guide indicates a concentration image requiring concentration or a mantra image after waking up, the electronic device (200) may identify a time period during which the user's breathing maintained a stable pattern or a calm state among a plurality of user images based on user history data (e.g., biometric data, movement data, activity routine data, schedule data), and select an image related to the user's location (or place) during the time period as a recommended image.

[0207] In operation 434, the electronic device (200) may generate VR meditation content (e.g., a user interface including a first image (561), a second image (562), and a third image (563) in FIG. 5b) for a personalized meditation guide using a background (e.g., a background (551) in FIG. 5a) and / or one or more objects (e.g., a person object (552, 553), an environmental object (554) in FIG. 5a) extracted from the recommended image determined through operation 433.

[0208] In operation 435, the electronic device (200) may display the generated VR meditation content (e.g., a user interface including the first image (561), the second image (562), and the third image (563) of FIG. 5b) through the display (220).

[0209] According to one embodiment, the electronic device (200) can update VR meditation content so that changes in at least one of the background, character object, and environment object appear over time.

[0210] According to one embodiment, the electronic device (200) can adjust the playback time of VR meditation content provided to the user.

[0211] In one embodiment, the electronic device (200) can update user status data through at least one collection device. The electronic device (200) can adjust the playback time of VR meditation content based on the updated user status data.

[0212] According to one embodiment, the electronic device (200) can output guide sounds (e.g., sound sources synchronized to each image of a video) corresponding to VR meditation content displayed on the display (220) through the speaker (270).

[0213] FIG. 5A is an example of a user interface for explaining how an electronic device (200) provides VR meditation content according to one embodiment.

[0214] According to one embodiment, the electronic device (200) may execute a meditation application or induce execution of the meditation application in response to the occurrence of a meditation triggering event.

[0215] For example, if the user's stress level exceeds a reference value, or if the runtime of a specific application (e.g., a foreground application, a game application, a video streaming application) running on the electronic device (200) exceeds a reference time, the electronic device (200) may display and / or output a message (e.g., a pop-up window, a sound) saying, "I need a break now. Would you like to go on a mindfulness trip to a snowy mountain for a while?" The electronic device (200) may execute the meditation application in response to a user input (e.g., a touch, a gesture, a voice) that approves the execution of the meditation application.

[0216] In operation 501, the electronic device (200) may initiate a meditation program by displaying a first image (510), which is basic meditation content, and guiding basic breathing as the meditation application is executed. The first image (510) is intended for stress relief and may be an image corresponding to "snow-capped mountains" or "insight meditation," which are basic information for the meditation guide.

[0217] In operation 502, the electronic device (200) may be connected to an external electronic device (e.g., the electronic device (102) of FIG. 1 , the user's smart phone) via short-range wireless communication. The electronic device (200) may link with the external electronic device and use images from a gallery application installed on the external electronic device for a meditation program. The electronic device (200) may select a second image (520) matching "snow-capped mountains" or "insight meditation" from among the images in the gallery application as a 2D recommended image.

[0218] In operation 503, the electronic device (200) can generate a third image (530), which is a 3D image, by rendering a second image (520), which is a 2D recommendation image, into a virtual 3D space using a stereoscopic technique.

[0219] In operation 504, the electronic device (200) may extract a background and / or one or more separable objects from the third image (530). Accordingly, as illustrated in operation 505, a background (551), a first person object (552), a second person object (553), and an environment object (554) may be extracted.

[0220] FIG. 5b is an example of a user interface for describing sequences of VR meditation content provided by an electronic device (200) according to one embodiment.

[0221] Referring to FIG. 5b, the electronic device (200) can configure sequences (506, 507, 508) for VR meditation content using the background (551), the first person object (552), the second person object (553), and the environment object (554) extracted through operation 505 of FIG. 5a.

[0222] The electronic device (200) can configure a first sequence (506) using a background (551) of a recommended image. The first sequence (506) can include a first image (561) and a first sound (571). For example, the first image (561) can be a virtual 3D space corresponding to the background (551), which can be a virtual 3D space rendering of the background (551) or a 3D image of a snow-covered mountain having a high similarity to the background (551). The first sound (571) can be a guide voice (e.g., a voice saying, “Now, we are going on a trip to a quiet place in the snow-covered mountain. Listen to the sound of the cold wind hitting your face.”) including sentences generated using a keyword (e.g., snow-covered mountain) corresponding to the background (551).

[0223] The electronic device (200) can use the first and second person objects (552, 553) of the recommended image to form a second sequence (507) that is continuous with the first sequence (506). The second sequence (507) can include a second image (562) and a second sound (572). For example, the second image (562) can be obtained by adding 3D virtual objects corresponding to the first and second person objects (552, 553) to the first image (561). The second sound (572) can include a virtual sound (e.g., children's laughter) generated using keywords (e.g., children) corresponding to the first and second person objects (552, 553) and / or a guide voice including sentences related to the keywords (e.g., "You are watching children having fun skiing. You can hear their happy laughter. Your breathing is becoming more comfortable.").

[0224] The electronic device (200) can use the environmental object (554) of the recommended image to form a third sequence (508) that is continuous with the second sequence (507). The third sequence (508) can include a third image (563) and a third sound (573). For example, the third image (563) can be a 3D virtual object corresponding to the environmental object (554) added to the second image (562). The third sound (573) can include a virtual sound (e.g., a bird sound) generated using a keyword (e.g., a bird) corresponding to the environmental object (554) and / or a guide voice including sentences related to the keyword (e.g., a voice saying, “The morning sunlight is shining on your face, and birds are singing beautifully on the branches of trees.”).

[0225] FIG. 6A is a flowchart illustrating a method for an electronic device to provide augmented reality (AR) meditation content according to one embodiment. For example, the electronic device (200) may be a wearable electronic device (e.g., the HMD type electronic device (300) of FIGS. 3A and 3B ).

[0226] According to one embodiment, the electronic device (200) may operate in AR mode. While the electronic device (200) operates in AR mode, the electronic device (200) may perform an operation of displaying AR meditation content through the display (220) and / or an operation of outputting a guide sound corresponding to the AR meditation content through the speaker (270).

[0227] Referring to FIG. 6a, a method for an electronic device (200) to provide AR meditation content may include operations 611, 612, 613, 614, and 615.

[0228] In operation 611, the electronic device (200) (e.g., the HMD type electronic device (300) of FIGS. 3A and 3B) can collect user status data of a user wearing the electronic device (200) through at least one collection device.

[0229] According to one embodiment, the user status data may include at least some of biometric data, movement data, stress data, environmental data, activity routine data, schedule data, and data about the wearing time of the electronic device (200).

[0230] According to one embodiment, at least one collection device for collecting user biometric data may include the electronic device (200) of FIG. 2 or one or more external electronic devices (e.g., the electronic device (102) of FIG. 1, the server (108)).

[0231] In operation 612, the electronic device (200) may identify basic information for a meditation guide based on the user status data collected through operation 611. In one embodiment, the basic information for the meditation guide may be information indicating one meditation type among a plurality of meditation types.

[0232] In operation 613, the electronic device (200) may acquire an image of a real space. The image of the real space may be a 2D image. For example, the electronic device (200) may capture an image of the user's surrounding space using a camera module (240).

[0233] In operation 614, the electronic device (200) may generate AR meditation content (e.g., a user interface including the first image (711), the second image (712), and the third image (713) of FIG. 7) for a personalized meditation guide based on the basic information identified through operation 612 and the image of the actual space acquired through operation 613.

[0234] In operation 615, the electronic device (200) can display the AR meditation content generated through operation 614 through the display (220).

[0235] According to one embodiment, the electronic device (200) can extract one or more keywords from an image of an actual space by image captioning that converts the image into text. The electronic device (200) can transmit the one or more keywords as an input prompt to a generative AI server (e.g., server (108) of FIG. 1) through a communication circuit (260). The electronic device (200) can receive a response to the input prompt from the generative AI server through the communication circuit (260). The electronic device (200) can generate AR meditation content using one or more sentences (sentences in natural language, e.g., sentences expressing changes in time relative to a background or describing movement of an object, expressions guiding meditation steps in conjunction with a background or an object) related to the one or more keywords among the responses.

[0236] FIG. 6B is a flowchart illustrating a method for an electronic device to provide AR meditation content according to one embodiment. For example, the electronic device (200) may be a wearable electronic device (e.g., the HMD type electronic device (300) of FIGS. 3A and 3B ).

[0237] According to one embodiment, the electronic device (200) can operate in AR mode.

[0238] Referring to FIG. 6b, a method of providing AR meditation content by an electronic device (200) may include operations 621, 622, 623, 624, 625, 626, and 627.

[0239] In operation 621, the electronic device (200) can collect user status data of a user wearing the electronic device (200) through at least one collection device.

[0240] According to one embodiment, the user status data may include at least some of biometric data, movement data, stress data, environmental data, activity routine data, schedule data, and data about the wearing time of the electronic device (200).

[0241] In operation 622, the electronic device (200) may execute a meditation application.

[0242] According to one embodiment, the electronic device (200) may execute a meditation application in response to the occurrence of a meditation triggering event. For example, the electronic device (200) may determine that a meditation triggering event has occurred when at least one of a first condition in which a user input requesting execution of a first application (e.g., a meditation application) is detected on the electronic device (200), a second condition in which a designated meditation time (e.g., 7:00 AM every day) arrives, a third condition in which a user's stress level exceeds a reference value, a fourth condition in which the wearing time of the electronic device (200) exceeds a reference time, or a fifth condition in which the runtime of a third application (e.g., a game application) running on the electronic device (200) exceeds a reference time is satisfied.

[0243] In operation 623, the electronic device (200) can identify basic information for meditation guidance based on the user status data collected in operation 421 as the meditation application is executed.

[0244] In one embodiment, the basic information for a meditation guide may be information indicating one meditation type among multiple meditation types. For example, the basic information for a meditation guide may include an identifier, keyword, or basic meditation content (e.g., an image or video) corresponding to the identifier or keyword for one meditation type among multiple meditation types.

[0245] In operation 624, the electronic device (200) may acquire an image of an actual space. For example, the electronic device (200) may capture an image of the user's surrounding space using a camera module (240). The captured image may be a 2D image.

[0246] In operation 624, the electronic device (200) may additionally acquire content sources related to real space (e.g., augmented sound, augmented object, guide voice). For example, the electronic device (200) may activate the microphone (280) to record real sounds from the user's surrounding space through the microphone (280) and generate augmented sounds from the real sounds. For example, the electronic device (200) may acquire information about the position or location of the electronic device (200) (or the user) through the sensor module (250) and generate augmented objects and / or guide voices to be included in the AR meditation content based on the acquired information.

[0247] In operation 625, the electronic device (200) may generate AR meditation content including a virtual 3D space. For example, the electronic device (200) may generate a virtual 3D space by rendering an image of an actual space acquired through operation 624 into a 3D space using a stereoscopic technique. For example, the electronic device (200) may generate AR meditation content by synthesizing a content source (e.g., augmented sound, augmented object, guide voice) of an actual space acquired through operation 624 into a virtual 3D space generated from an image of an actual space.

[0248] In operation 626, the electronic device (200) may provide (e.g., display or output) the AR meditation content generated through operation 625 to the user.

[0249] In one embodiment, the electronic device (200) may display images of the generated VR meditation content (e.g., a user interface including the first image (711), the second image (712), and the third image (713) of FIG. 7) through the display (220). In one embodiment, the electronic device (200) may output sounds of the generated VR meditation content (e.g., the first sound (721), the second sound (722), and the third sound (723) of FIG. 7) through the speaker (270).

[0250] According to one embodiment, the electronic device (200) can update the AR meditation content so that at least one of the background, character object, and environment object changes over time.

[0251] In operation 627, the electronic device (200) can adjust the playback time of the AR meditation content provided to the user.

[0252] In one embodiment, the electronic device (200) can update user status data through at least one collection device. The electronic device (200) can adjust the playback time of AR meditation content based on the updated user status data. For example, if, while the AR meditation content is being played, the user's location identified from the movement data falls outside a specified range or the stress level identified from the stress data falls below a specified standard, the electronic device (200) can shorten the total meditation time by setting the playback time of the VR meditation content to a value lower than a default value.

[0253] In one embodiment, the electronic device (200) may adjust the playback time of AR meditation content in response to user input. For example, the electronic device (200) may display a user interface element (e.g., a timer icon) for setting the playback time of the AR meditation content, receive user input for the user interface element, and set the playback time of the VR meditation content based on the user input.

[0254] FIG. 7 is an example of a user interface for explaining sequences of AR meditation content provided by an electronic device (200) according to one embodiment.

[0255] Referring to FIG. 7, the electronic device (200) may provide (e.g., display or output) AR meditation content including a first sequence (701), a second sequence (702), and a third sequence (703). The first sequence (701) may include a first image (711) and a first sound (721). The second sequence (702) may include a second image (712) and a second sound (722). The third sequence (703) may include a third image (713) and a third sound (723).

[0256] In one embodiment, the electronic device (200) may execute a meditation application or induce execution of the meditation application in response to the occurrence of a meditation triggering event. For example, if a user input (e.g., touch, gesture, or voice) requesting execution of the meditation application is detected, the electronic device (200) may execute the meditation application in response to the user input.

[0257] The electronic device (200) can output a first sequence (701) including a first image (711) and a first sound (721). For example, the electronic device (200) can start a meditation program by outputting the first image (711) and the first sound (721) of the first sequence (701) for an actual space as the meditation application is executed. The first image (711) may be an image captured of the user's surrounding space. The first sound (721) may be a guide voice guiding the first step of breathing and may be basic meditation content matching the basic meditation type of the meditation application.

[0258] The electronic device (200) may output a second sequence (702) including a second image (712) and a second sound (722). For example, the second image (712) may be a 2D image of an actual space, the first image (711), converted into a 3D image using a stereoscopic technique. The second sound (722) may include a guide voice guiding two-step breathing. The second sound (722) may include a content source (e.g., augmented sound, voice guide) related to an actual space. For example, the content source may include an augmented sound generated based on an actual sound recorded from a space surrounding the user and / or a voice guide generated based on a location or place of the electronic device (200) (or the user).

[0259] The electronic device (200) may output a third sequence (703) including a third image (713) and a third sound (723). For example, the third image (713) may include a content source (e.g., an augmented object) related to a real space. For example, the third image (713) may include an augmented object (731, 732) created to suit the location or place of the electronic device (200) (or the user). The third image (713) may be an updated version of the second image (712) so that changes in the background and / or one or more objects included in the second image (712) appear over time. The third sound (723) may include a guide voice that guides three-step breathing suitable for the third image (713).

[0260] FIG. 8 is a flowchart illustrating a method for an electronic device (200) to provide mixed reality (MR) meditation content according to one embodiment.

[0261] Referring to FIG. 8, a method for an electronic device (200) to provide MR meditation content may include operations 810, 820, 830, 840, and 850.

[0262] In operation 810, the electronic device (200) may execute an AR mode as the meditation application is executed. Here, the AR mode may be for initial stage meditation.

[0263] While operating in AR mode, the electronic device (200) may provide the user with first AR meditation content (e.g., first AR meditation content (901) of FIG. 9 ). For example, the electronic device (200) may provide the first meditation content by performing at least some of the operations described in FIG. 6A or FIG. 6B . For example, the first AR meditation content may be intended to guide the user through an initial meditation experience.

[0264] In operation 820, the electronic device (200) may determine whether a triggering event for a mode change has occurred. In one embodiment, the electronic device (200) may determine whether a triggering event for a mode change has occurred based on user status data (e.g., biometric data, stress data) and / or meditation duration. For example, the electronic device (200) may determine that the triggering event has occurred when the user's heart rate or breathing becomes stable. For example, the electronic device (200) may determine that the triggering event has occurred when a specified time has elapsed since the meditation application was launched.

[0265] If no triggering event occurs, AR mode can be maintained.

[0266] If a triggering event occurs, the electronic device (200) may proceed to operation 830 to execute VR mode. The VR mode may be for the next stage of meditation.

[0267] In operation 840, while operating in VR mode, the electronic device (200) may provide VR meditation content (e.g., VR meditation content (902) of FIG. 9). In one embodiment, the VR meditation content may be provided based on the first AR meditation content (or previous AR meditation content) provided in operation 810. For example, the VR meditation content may be content that has continuity with the first AR meditation content provided before the mode change. For example, the VR meditation content may be generated by placing one or more new virtual objects within the 3D virtual space of the first AR meditation content. For example, the VR meditation content may be intended to guide a next stage (advanced stage) of a meditation experience guided by the initial stage of the first AR meditation content.

[0268] At step 850, the electronic device (200) may return to AR mode. Here, the AR mode may be for final stage meditation.

[0269] In AR mode, the electronic device (200) may provide second AR meditation content (e.g., second AR meditation content (903) of FIG. 9). In one embodiment, the second AR meditation content may be provided based on the first AR meditation content provided in operation 810 and / or the VR meditation content provided in operation 840. For example, the second AR meditation content may be intended to guide an initial stage meditation experience guided by the first AR meditation content and a final stage meditation experience concluding an in-depth stage guided by the VR meditation content.

[0270] FIG. 9 is an example of a user interface for describing sequences of MR meditation content provided by an electronic device according to one embodiment.

[0271] Referring to FIG. 9, the electronic device (200) can sequentially provide first AR meditation content (901), VR meditation content (902), and second AR meditation content (903) according to the mode change operation of FIG. 8.

[0272] The first AR meditation content (901) may be intended to guide the user through an initial meditation experience. The first AR meditation content (901) may include a first image (911) and a first sound (921). For example, the first image (911) may be an image of an actual space (e.g., an image captured in real time of the user's surroundings) in which augmented objects (931, 932) are placed within a 3D virtual space. The first sound (921) may include a guide voice guiding initial breathing. The first sound (921) may include a content source related to the actual space (e.g., an augmented sound, a voice guide).

[0273] The VR meditation content (902) may be intended to guide the next stage of the meditation experience following the initial stage guided by the first AR meditation content (901). The VR meditation content (902) may include a second image (912) and a second sound (922). For example, the second image (912) may be an image representing a new 3D virtual space distinct from the first image (911). The second sound (922) may include a guide voice guiding the next (deepened) stage of breathing following the initial stage guided by the first AR meditation content (901).

[0274] The second AR meditation content (903) may be intended to guide the final stage of meditation experience. The second AR meditation content (903) may include a third image (913) and a third sound (923). For example, the third image (913) may be an image of an augmented object (933) placed within a 3D virtual space transformed from the 3D virtual space of the first AR meditation content (901). The third sound (923) may include a guide voice concluding a meditation program that includes the initial stage breathing guided by the first sound (921) and the deepened stage breathing guided by the second sound (922).

[0275] FIG. 10 is a flowchart illustrating a method for controlling a video see-through (VST) mode of an electronic device (200) (e.g., the HMD type electronic device (200) of FIGS. 3A and 3B) according to one embodiment.

[0276] Referring to FIG. 10, the VST mode control method of the electronic device (200) may include operations 1010, 1020, 1030, 1040, 1050, 1060, and 1070.

[0277] In operation 1010, the electronic device (200) may collect user status data of a user wearing the electronic device (200) through at least one collection device. In one embodiment, the user status data may include at least some of biometric data, movement data, stress data, surrounding environment data, activity routine data, schedule data, and data regarding the wearing time of the electronic device (200).

[0278] In operation 1020, the electronic device (200) can execute a meditation application.

[0279] In operation 1030, the electronic device (200) may select a VST mode of the electronic device (200). In one embodiment, the VST mode of the electronic device (200) may include a VR mode and an AR mode. In one embodiment, the electronic device (200) may select the VST mode as one of the VR mode and the AR mode in response to a user input.

[0280] If the VST mode of the electronic device (200) is selected as the VR mode, the electronic device (200) may proceed to operation 1040 and execute the VR mode. In operation 1040, while the electronic device (200) is operating in the VR mode, the electronic device (200) may provide the user with first VR meditation content. For example, the electronic device (200) may provide the first VR meditation content by performing at least some of the operations illustrated in FIGS. 4A, 4B, and 4C.

[0281] When the VST mode of the electronic device (200) is selected as the AR mode, the electronic device (200) can proceed to operation 1050 to execute the AR mode.

[0282] In operation 1050, while the electronic device (200) is operating in AR mode, the electronic device (200) may provide the user with first AR meditation content. For example, the electronic device (200) may provide the first AR meditation content by performing at least some of the operations illustrated in FIG. 6A or FIG. 6B .

[0283] At operation 1060, the electronic device (200) may switch from AR mode to deep AR mode. While the electronic device (200) operates in deep VR mode, the electronic device (200) may provide second VR meditation content. For example, the second VR meditation content may be content that is continuous with the first AR meditation content. For example, the second VR meditation content may be intended to guide the next stage (deep stage) of the meditation experience after the initial stage guided by the first AR meditation content.

[0284] In operation 1070, the electronic device (200) may return from the deep AR mode to the AR mode. When the electronic device (200) returns to the AR mode, the electronic device (200) may provide second AR meditation content. For example, the second AR meditation content may be provided based on the first AR meditation content provided in operation 1050 and / or the second VR meditation content provided in operation 1060. For example, the second AR meditation content may be intended to guide a final stage meditation experience that concludes an initial stage meditation experience guided by the first AR meditation content and an advanced stage guided by the second VR meditation content.

[0285] In order to provide a meditation guide service using meditation content to a user, the electronic device can select one meditation program according to the user's settings from among multiple pre-registered meditation programs and play meditation content corresponding to the selected meditation program.

[0286] In such cases, users may experience the inconvenience of having to select from numerous meditation programs each time. Furthermore, the selected meditation program's playback time may be fixed, making it impossible to adjust the content playback time. Furthermore, since meditation content is provided invariably according to a specific meditation program regardless of the user's situation, users may experience monotony or boredom, resulting in a degraded user experience.

[0287] The present disclosure provides various embodiments that enable implementing meditation content or user-customized meditation content that is dynamically applied according to a user's situation in an XR environment, thereby improving user experience and meditation effects.

[0288] According to one embodiment, a head-mounted type electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2, head-mounted type electronic device (300) of FIG. 3) may include a display (e.g., display module (160) of FIG. 1, display (220) of FIG. 2, display (330) of FIG. 3), at least one processor including processing circuitry (e.g., processor (120) of FIG. 1, processor (210) of FIG. 2), and a memory storing instructions (e.g., memory (130) of FIG. 1, memory (230) of FIG. 2). The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to collect user status data of a user wearing the electronic device through at least one collection device, identify basic information for a meditation guide based on the user status data, determine at least one recommended image from among a plurality of pre-stored user images based on the basic information, generate virtual reality (VR) meditation content for a personalized meditation guide using a background or one or more objects extracted from the at least one recommended image, and display the VR meditation content through the display.

[0289] In one embodiment, the basic information may be information indicating one meditation type among a plurality of meditation types. The at least one recommended image may be determined based on a comparison between the basic information and the meta information of each of the plurality of user images.

[0290] In one embodiment, the basic information may be information indicating one meditation type among multiple meditation types. The at least one recommended image may be determined based on the basic information and pre-stored user history data.

[0291] According to one embodiment, the head-mounted type electronic device may further include a communication circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to extract one or more keywords corresponding to the background or the one or more objects by image captioning that converts an image into text, transmit the one or more keywords as an input prompt to a generative artificial intelligence (AI) server through the communication circuit, receive a response to the input prompt from the generative AI server through the communication circuit, and generate the VR meditation content using one or more sentences related to the one or more keywords among the responses.

[0292] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to generate a first sequence based on the background, a second sequence based on a person object among the one or more objects, a third sequence based on an environment object among the one or more objects, and generate the VR meditation content by synthesizing the first sequence, the second sequence, and the third sequence.

[0293] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to update the VR meditation content so that changes in at least one of the background, the person object, and the environment object appear over time.

[0294] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to update the user state data through the at least one collection device and adjust the playback time of the VR meditation content based on the updated user state data.

[0295] According to one embodiment, the user status data may include at least some of biometric data, movement data, stress data, surrounding environment data, activity routine data, schedule data, and data regarding the wearing time of the electronic device.

[0296] According to one embodiment, the at least one collection device may include the electronic device or one or more external electronic devices.

[0297] According to one embodiment, the head-mounted type electronic device may further include a speaker. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to output a guide sound corresponding to the VR meditation content through the speaker.

[0298] According to one embodiment, the head-mounted type electronic device may further include at least one camera. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the VR meditation content through the display while operating in a VR mode, and to acquire an image of a real space through the at least one camera while operating in an augmented reality (AR) mode, generate AR meditation content using the basic information and the image of the real space, and display the AR meditation content through the display.

[0299] According to one embodiment, the head-mounted type electronic device may further include a speaker and a microphone. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to acquire a sound related to the real space through the microphone, generate a guide sound corresponding to the AR meditation content based on the sound related to the real space, and output the guide sound through the speaker.

[0300] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to monitor changes in the user state data through the at least one collection device, generate a feedback guide based on the monitoring result, and update the VR meditation content based on the feedback guide.

[0301] According to one embodiment, a method for operating a head-mounted type electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2, and the head-mounted type electronic device (300) of FIG. 3) may include an operation of collecting user status data of a user wearing the electronic device through at least one collection device, an operation of identifying basic information for a meditation guide based on the user status data, an operation of determining at least one recommended image from among a plurality of pre-stored user images based on the basic information, an operation of generating virtual reality (VR) meditation content for a personalized meditation guide using a background or one or more objects extracted from the at least one recommended image, and an operation of displaying the VR meditation content through a display of the electronic device.

[0302] In one embodiment, the basic information may be information indicating one meditation type among a plurality of meditation types. The at least one recommended image may be determined based on a comparison between the basic information and the meta information of each of the plurality of user images.

[0303] In one embodiment, the basic information may be information indicating one meditation type among multiple meditation types. The at least one recommended image may be determined based on the basic information and pre-stored user history data.

[0304] According to one embodiment, the operation of generating the VR meditation content may include an operation of extracting one or more keywords corresponding to the background or the one or more objects by image captioning that converts an image into text, an operation of transmitting the one or more keywords as an input prompt to a generative artificial intelligence (AI) server, an operation of receiving a response to the input prompt from the generative AI server, and an operation of generating the VR meditation content using one or more sentences related to the one or more keywords among the responses.

[0305] According to one embodiment, the operation of generating the VR meditation content may include an operation of generating a first sequence based on the background, an operation of generating a second sequence based on a person object among the one or more objects, an operation of generating a third sequence based on an environment object among the one or more objects, and an operation of generating the VR meditation content by synthesizing the first sequence, the second sequence, and the third sequence.

[0306] A computer-readable recording medium according to one embodiment may be a computer-executable program recorded thereon. The program, when executed, may cause a head-mounted type electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2, and the head-mounted type electronic device (300) of FIG. 3) to perform an operation method including an operation of collecting user status data of a user wearing the electronic device through at least one collection device, an operation of identifying basic information for a meditation guide based on the user status data, an operation of determining at least one recommended image from among a plurality of pre-stored user images based on the basic information, an operation of generating virtual reality (VR) meditation content for a personalized meditation guide using a background or one or more objects extracted from the at least one recommended image, and an operation of displaying the VR meditation content through a display of the electronic device.

[0307] A head-mounted type electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2, the head-mounted type electronic device (300) of FIG. 3) may include a display (e.g., the display module (160) of FIG. 1, the display (220) of FIG. 2, the display (330) of FIG. 3), at least one camera (e.g., the camera module (180) of FIG. 1, the camera module (240) of FIG. 2, the cameras (341, 342, 343, 344) of FIG. 3), at least one processor including processing circuitry (e.g., the processor (120) of FIG. 1, the processor (210) of FIG. 2), and a memory storing instructions (e.g., the memory (130) of FIG. 1, the memory (230) of FIG. 2). The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to collect user status data of a user wearing the electronic device through at least one collection device, identify basic information for a meditation guide based on the user status data, acquire an image of the real space through the at least one camera, generate augmented reality (AR) meditation content for a personalized meditation guide based on the basic information and the image of the real space, and display the AR meditation content through the display.

[0308] According to one embodiment, the head-mounted type electronic device may further include a communication circuit. The instructions, when executed by the at least one processor, may cause the electronic device to extract one or more keywords from an image of the real space by image captioning that converts the image into text, transmit the one or more keywords as an input prompt to a generative artificial intelligence (AI) server through the communication circuit, receive a response to the input prompt from the generative AI server through the communication circuit, and generate the AR meditation content using one or more sentences related to the one or more keywords among the responses.

[0309] According to one embodiment, a method for operating a head-mounted type electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2, and the head-mounted type electronic device (300) of FIG. 3) may include an operation of collecting user status data of a user wearing the electronic device through at least one collection device, an operation of identifying basic information for a meditation guide based on the user status data, an operation of acquiring an image of the actual space through the at least one camera, an operation of generating augmented reality (AR) meditation content for a personalized meditation guide based on the basic information and the image of the actual space, and an operation of displaying the AR meditation content through the display.

[0310] A computer-readable recording medium according to one embodiment may record a program executable on a computer. When the program is executed, the program may cause a head-mounted type electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2, and the head-mounted type electronic device (300) of FIG. 3) to perform an operation method including an operation of collecting user status data of a user wearing the electronic device, an operation of identifying basic information for a meditation guide based on the user status data, an operation of acquiring an image of the actual space through the at least one camera, an operation of generating augmented reality (AR) meditation content for a personalized meditation guide based on the basic information and the image of the actual space, and an operation of displaying the AR meditation content through the display.

[0311] According to various embodiments of the present disclosure, meditation content or user-customized meditation content that is dynamically applied according to a user's situation in an XR environment can be implemented, thereby improving user experience and meditation effects.

[0312] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the art to which the present disclosure belongs from the above description.

[0313] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable electronic devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0314] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0315] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0316] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0317] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0318] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In a head-mounted type electronic device, display; At least one processor comprising processing circuitry; and Contains memory that stores instructions, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Collecting user status data of a user wearing the electronic device through at least one collection device, Identify basic information for meditation guidance based on the above user status data, Based on the above basic information, at least one recommended image is determined from among a plurality of pre-stored user images, Generate virtual reality (VR) meditation content for personalized meditation guide using backgrounds or one or more objects extracted from at least one recommended image, An electronic device that displays the VR meditation content through the display.

2. In claim 1, The above basic information is information indicating one meditation type among multiple meditation types, An electronic device in which at least one recommended image is determined based on a comparison between the basic information and the meta information of each of the plurality of user images.

3. In claim 1, The above basic information is information indicating one meditation type among multiple meditation types, An electronic device in which at least one recommended image is determined based on the above basic information and pre-stored user history data.

4. In claim 1, Further including communication circuits, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Extracting one or more keywords corresponding to the background or one or more objects by image captioning that converts the image into text, Through the above communication circuit, one or more keywords are transmitted as input prompts to a generative artificial intelligence (AI) server, Through the above communication circuit, a response to the input prompt is received from the generative AI server, An electronic device that generates the VR meditation content using one or more sentences related to one or more keywords among the above responses.

5. In claim 1, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the above background, a first sequence is generated, Generate a second sequence based on a person object among the one or more objects above, Generate a third sequence based on an environment object among one or more of the above objects, An electronic device that generates the VR meditation content by synthesizing the first sequence, the second sequence, and the third sequence.

6. In claim 5, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device that updates the VR meditation content so that at least one of the background, the character object, and the environment object changes over time.

7. In claim 1, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Updating the user status data through at least one collection device; An electronic device that adjusts the playback time of the VR meditation content based on the updated user status data.

8. In claim 1, The above user status data is, An electronic device comprising at least some of biometric data, movement data, stress data, environmental data, activity routine data, schedule data, and data regarding the wearing time of the electronic device.

9. In claim 1, At least one collecting device, An electronic device comprising the electronic device or one or more external electronic devices.

10. In claim 1, Including more speakers, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device that outputs a guide sound corresponding to the VR meditation content through the speaker.

11. In claim 1, Including at least one more camera, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: While operating in VR mode, the VR meditation content is displayed through the display, An electronic device that, while operating in augmented reality (AR) mode, acquires an image of a real space through at least one camera, generates AR meditation content using the basic information and the image of the real space, and displays the AR meditation content through the display.

12. In claim 11, Includes additional speakers and microphones, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device that acquires a sound related to the actual space through the microphone, generates a guide sound corresponding to the AR meditation content based on the sound related to the actual space, and outputs the guide sound through the speaker.

13. In claim 1, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Monitor changes in the user status data through at least one collection device, Generate a feedback guide based on the above monitoring results, An electronic device that updates the VR meditation content based on the above feedback guide.

14. In the operating method of a head-mounted type electronic device, An action of collecting user status data of a user wearing the electronic device through at least one collection device; An action to identify basic information for meditation guidance based on the above user status data; An operation of determining at least one recommended image from among a plurality of pre-stored user images based on the above basic information; An operation of generating virtual reality (VR) meditation content for a personalized meditation guide using a background or one or more objects extracted from at least one recommended image; and A method comprising an action of displaying the VR meditation content through a display of the electronic device.

15. In a head-mounted type electronic device, display; At least one camera; At least one processor comprising processing circuitry; and Contains memory that stores instructions, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Collecting user status data of a user wearing the electronic device through at least one collection device, Identify basic information for meditation guidance based on the above user status data, Obtaining an image of a real space through at least one camera, Generate augmented reality (AR) meditation content for personalized meditation guide based on the above basic information and images of the actual space, An electronic device that displays the AR meditation content through the display.

Citation Information

Patent Citations

  • Method of synthesizing images based on mutual interlocking of object and background images

    KR101969864B1

  • Virtual reality mindfulness meditation system and method of the same

    KR102157019B1

  • System for providing digital therapy service using meditation simulation

    KR102508601B1

  • KR20200061020A