system

Abstract

We provide the system. [Solution] A means of providing a virtual relaxation environment generated based on the user's individual profile, A means of monitoring the user's biometric data in real time within that virtual environment, A means of analyzing acquired biometric data and adjusting the virtual environment, A means of dynamically providing visual and acoustic information via smart devices based on biometric data, Methods for personalizing relaxation experiences for the elderly, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, and includes steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In modern society, many people are exposed to a high - stress environment, resulting in problems such as sleep deprivation, decreased concentration, and increased health risks. There is a need for technology that can effectively reduce problems caused by such stress and promote relaxation. However, it has been difficult for conventional relaxation technologies to provide experiences suitable for individual users, and it has been a challenge to deploy them on a large scale.

Means for Solving the Problems

[0005] This invention provides a system that offers a virtual relaxation environment generated based on the user's individual profile. This system monitors the user's biometric data in real time within the virtual environment and evaluates the user's stress level based on the acquired biometric data. Furthermore, by performing emotional analysis, it enables the dynamic adjustment of ambient sounds and visual effects according to the user's level of relaxation. This provides a personalized relaxation experience and reduces stress.

[0006] A "user profile" is a dataset that includes information about a user's past usage history, preferences, and health status.

[0007] A "virtual relaxation environment" is a virtual reality space designed to allow users to relax, providing sensory experiences through sight and sound.

[0008] "Biometric data" refers to data that indicates the user's physiological state, such as heart rate, skin potential, and brain waves.

[0009] "Real-time monitoring" is the process of collecting data sequentially and analyzing it immediately.

[0010] "Sentiment analysis" is a method of evaluating a person's emotional state based on biometric data and user responses.

[0011] "Dynamic adjustment" refers to a method of changing environment settings and provided content on the fly based on real-time evaluations. [Brief explanation of the drawing]

[0012] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3]It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which a plurality of emotions are mapped. [Figure 10] It shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.

MODE FOR CARRYING OUT THE INVENTION

[0013] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0014] First, the language used in the following description will be explained.

[0015] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0016] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0017] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.

[0018] In the following embodiments, the numbered communication I / F (Interface) is an interface that includes a communication processor and an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark), and the like.

[0019] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0020] [First Embodiment]

[0021] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0022] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0023] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0024] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0025] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0026] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0027] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0028] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0029] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0030] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0031] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0032] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0033] The present invention is a system that provides a virtual relaxation environment generated based on the user's individual profile. This system aims to relax the user, particularly through visual and auditory experiences. Specific embodiments for carrying out the present invention are described below.

[0034] First, when a user puts on a VR device, the device authenticates the user, and based on the result, the server retrieves the user's individual profile. This profile includes information such as the user's past usage history and relaxation preferences.

[0035] Next, the server uses AI to generate a relaxation scenario based on the user's profile. This scenario includes selected visual elements (e.g., forest or ocean scenery) and auditory elements (e.g., nature sounds or calming music). The scenario generated by the server is then provided to the user through their device.

[0036] Within this virtual environment, the terminal monitors the user's biometric data in real time. The data acquired includes physiological signals such as heart rate, skin potential, and electroencephalogram (EEG). This data is sent to a server, which uses it to perform emotional analysis and evaluate the user's level of relaxation.

[0037] Based on the evaluation results, the server optimizes the user's relaxation experience by changing the music selection within the virtual environment and instructing appropriate color and motion changes in the video. In this way, the user experiences personalized relaxation and reduces stress.

[0038] As an example of a specific scenario, a user could experience being at a virtual beach in their home. They could hear the sound of gentle waves and see a sunset spreading across the sky. If the user's heart rate increases during this time, the server would instruct the device to select calmer music and reduce the background noise.

[0039] This invention is a system that helps relieve daily stress and provides a comfortable experience through such dynamic environmental adjustments.

[0040] The following describes the processing flow.

[0041] Step 1:

[0042] The terminal detects that the user is wearing a VR device and sends the user's login information to the server. This authenticates the user.

[0043] Step 2:

[0044] The server retrieves the individual profile of the authenticated user from the database and analyzes the user's past experience history and relaxation preferences.

[0045] Step 3:

[0046] The server uses a generative AI to automatically generate virtual relaxation scenarios based on the user's profile. Specific selection options include visual scenery, auditory music, and nature sounds.

[0047] Step 4:

[0048] The terminal receives scenario data generated from the server and sets up the virtual environment on the user's VR device based on it. The user becomes immersed in the virtual space and begins relaxation through sight and sound.

[0049] Step 5:

[0050] The device monitors the user's biometric data in real time during the session. It transmits heart rate and skin potential data obtained from sensors to the server.

[0051] Step 6:

[0052] The server evaluates the user's stress level and performs emotional analysis based on the received biometric data. Based on the analysis results, the server sends instructions to the terminal to adjust the environment (e.g., change the music, adjust the video).

[0053] Step 7:

[0054] The device adjusts the virtual environment according to instructions from the server, optimizing the user's relaxation experience. The user continues to relax in the adjusted virtual environment.

[0055] Step 8:

[0056] When a user finishes a relaxation session, the device prompts the user for feedback on the experience and sends the results to the server. The server analyzes the feedback and accumulates data to improve future experiences.

[0057] (Example 1)

[0058] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0059] Many people experience stress in their daily lives, and there is a need for effective ways to alleviate this stress. However, many conventional relaxation methods are general and fail to reflect the individual preferences and physiological states of users, thus creating a need for more personalized approaches. In addition, there is a lack of functionality that can instantly grasp the user's state and optimize the relaxation experience on the spot.

[0060] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0061] In this invention, the server includes means for providing a virtual environment based on the user's individual profile, means for monitoring biometric information in real time, and means for optimizing the virtual environment based on that information. This makes it possible to provide a personalized relaxation experience for each user and enhance stress reduction.

[0062] A "user's individual profile" is a collection of data that includes information about each individual user, such as their past usage history and relaxation preferences.

[0063] A "virtual environment" is a computer-controlled, synthesized environment created for a user to experience specific visual and auditory elements.

[0064] "Biometric information" refers to physiological signals such as the user's heart rate, skin potential, and brain waves, and is data acquired in real time.

[0065] A "generative AI model" refers to an algorithm that uses machine learning techniques to automatically generate relaxation scenarios based on the user's profile.

[0066] "Sentiment analysis" is a process that evaluates a user's current psychological state based on their biometric information.

[0067] "Visual elements" refer to all visual information, such as images and videos, that a user observes within a virtual environment.

[0068] "Auditory elements" refer to all auditory information, such as music and natural sounds, that a user can hear within the virtual environment.

[0069] "Real-time monitoring" refers to the process of instantly acquiring a user's biometric information and processing the data immediately.

[0070] "Means for optimizing the virtual environment" refers to technologies that dynamically adjust the visual and auditory elements within the virtual environment based on the user's biometric information and emotional analysis results.

[0071] This invention provides a system that offers a virtual relaxation environment generated based on the user's individual profile. The system enables users to use VR devices to enjoy an immersive relaxation experience.

[0072] First, the user puts on a VR device. This initiates user authentication, and the server retrieves the user's individual profile. This profile stores past relaxation usage history and preferences.

[0073] The server generates relaxation scenarios using a generative AI model based on the acquired profile. This process selects visual elements (e.g., forest or ocean scenery) and auditory elements (e.g., nature sounds or calming music) that match the user's preferences. Specifically, this generation process involves inputting prompt sentences into the generative AI model, which then constructs an appropriate scenario.

[0074] Once a scenario is generated, it is provided to the user via the device, allowing the user to begin a relaxing experience within the virtual environment. During the virtual environment, the device monitors the user's biometric information in real time. This biometric information includes heart rate, skin potential, and electroencephalogram (EEG).

[0075] The server receives this biometric information and performs emotional analysis to determine the user's level of relaxation. Based on the results, it adjusts the visual and auditory elements of the virtual environment to optimize the relaxation experience. For example, if the user's heart rate increases, the server instructs the device to change the music being played to something calmer and reduce visual noise.

[0076] As a concrete example, when a user is experiencing a virtual beach at home and their heart rate increases, the server generates prompts to play quiet piano music on the device and maintain the visual effect of gentle wave movements. Prompts such as, "Generate a relaxing virtual beach scenario based on the user's profile. Use visual and auditory elements including sunsets and the sound of waves, and adjust the music according to the heart rate," are provided to the generating AI model.

[0077] This invention aims to provide a comfortable relaxation experience that contributes to reducing daily stress through dynamic environmental adjustments that respond to the user's physiological and psychological state.

[0078] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0079] Step 1:

[0080] The user puts on a VR device.

[0081] As input, the user's biometric authentication information (e.g., fingerprint or face) is provided to the terminal.

[0082] The terminal authenticates the user based on this information and sends the authentication result to the server, which then prepares the server to retrieve the user's individual profile from the database. The output is the user authentication result.

[0083] Step 2:

[0084] The server retrieves the user's individual profile.

[0085] The input is the user's authentication information sent from the terminal.

[0086] The server uses this information to retrieve the user's past usage history and relaxation preferences from the database, and outputs profile data.

[0087] Step 3:

[0088] The server generates relaxation scenarios using an AI model.

[0089] The input is the acquired profile data.

[0090] Based on the profile, the server inputs prompt messages into the generated AI model.

[0091] This generates a relaxation scenario incorporating visual and auditory elements. The output is the constructed scenario.

[0092] Step 4:

[0093] The device provides the user with a virtual environment.

[0094] The input is a relaxation scenario sent from the server.

[0095] The device displays this scenario on a VR device, providing the user with an immersive experience. As output, the user receives the experience in the virtual environment.

[0096] Step 5:

[0097] The device monitors the user's biometric information in real time.

[0098] The sensors acquire data such as the user's heart rate, skin potential, and electroencephalogram (EEG) as input.

[0099] The device collects this data and immediately sends it to the server. As output, biometric data is obtained in real time.

[0100] Step 6:

[0101] The server performs emotional analysis based on biometric information and evaluates the degree of relaxation.

[0102] The input is biometric information transmitted from the device.

[0103] The server analyzes this information and evaluates the user's psychological state. The output is an evaluation of the level of relaxation.

[0104] Step 7:

[0105] The server issues instructions to the terminal to optimize the virtual environment.

[0106] The input is the result of sentiment analysis.

[0107] Based on the analysis results, the server sends instructions to the terminal to adjust the visual and auditory elements of the virtual environment, and the output is an adjustment instruction sheet. For example, if the user's heart rate is high, the server will instruct the terminal to play calming music.

[0108] These steps allow users to enjoy a personalized relaxation experience and reduce stress.

[0109] (Application Example 1)

[0110] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0111] For the elderly, there is a need to effectively reduce daily stress and anxiety and promote mental and physical relaxation. However, existing methods are not well-suited to individual conditions and preferences, making it difficult to provide an effective relaxation experience.

[0112] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0113] In this invention, the server includes means for dynamically providing visual and auditory information via a smart device based on biometric data, means for personalizing the relaxation experience for the elderly, and means for dynamically changing ambient sounds and visual effects based on the user's emotional analysis results to optimize the relaxation state of the elderly. This makes it possible to provide a relaxation experience that meets the individual needs of the elderly.

[0114] An "individual profile" is a collection of data that includes personal information about each user, such as their past usage history and relaxation preferences.

[0115] A "virtual relaxation environment" is a digital space that combines visual and auditory information to provide users with a relaxation experience.

[0116] "Biometric data" refers to measurements related to the user's physical and psychological state, such as heart rate, skin potential, and electroencephalography (EEG).

[0117] A "smart device" refers to an electronic device that, when worn or used by a user, displays information and enables interaction.

[0118] "Emotional analysis results" refer to information about the user's current psychological state and stress level, analyzed based on their biometric data.

[0119] "Personalizing the relaxation experience" is the process of optimizing the relaxation content provided to each user based on their individual profile and biometric data.

[0120] "Dynamically changing" refers to adjusting or switching scenarios and content on the fly based on the user's real-time state.

[0121] To implement this invention, the user must first wear a smart device, such as smart glasses. The device identifies the user's individual profile and begins monitoring biometric data. This data includes heart rate, skin potential, and electroencephalography (EEG). The device transmits this biometric data to a server.

[0122] The server uses a generative AI model to generate optimal visual and auditory information based on the user's individual profile and real-time biometric data. This includes scenery, nature sounds, and relaxation music. This generated relaxation environment is dynamically adjusted in response to the user's reactions.

[0123] For example, if a user's heart rate increases, the server will prompt the user to view calming natural scenery or listen to soothing music, and then display this on the device. This allows the user to enjoy a personalized relaxation experience and effectively reduce stress.

[0124] As a concrete example, consider a situation where a user is looking at a flower field and listening to birdsong. In this case, if the user is relaxed, the environment is maintained as is; if stress levels rise, the music is adjusted to a calmer tempo.

[0125] An example of a prompt is, "How can I use AI to generate and provide an optimal relaxation scenario based on the user's heart rate in real time?" This is used to achieve relaxation tailored to the user's state using an AI model.

[0126] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0127] Step 1:

[0128] The user wears a smart device. At this time, the device authenticates the user and obtains a specific individual profile. The input is the user's ID information, and the output is the corresponding individual profile. This profile includes the user's preferences and past usage history, and is used to identify their physical and psychological characteristics.

[0129] Step 2:

[0130] The terminal monitors the user's biometric data in real time and transmits this data to a server. The input is the user's biosignals (heart rate, skin potential, electroencephalogram, etc.), and the output is a temporary file containing this aggregated data. The terminal acquires this data using sensors and transmits it to the server via a communication interface.

[0131] Step 3:

[0132] The server uses a generative AI model to generate an optimal relaxation scenario based on acquired biometric data and individual profiles. The input is biometric data and individual profiles, while the output is a relaxation scenario including visual and auditory information. The server analyzes the data using the generative AI model and generates prompt messages.

[0133] Step 4:

[0134] The server sends the generated relaxation scenario to the terminal, which then provides it to the user. The input is the relaxation scenario, and the output is the visual and audio content played on the smart device. The terminal delivers the relaxation experience to the user through its display and speakers.

[0135] Step 5:

[0136] Based on user reactions, if biometric data changes, the server re-evaluates it and adjusts the relaxation scenario as needed. The input is the updated biometric data, and the output is the adjusted relaxation scenario. This process occurs in real time, continuously providing an experience optimized for the user's state.

[0137] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0138] This invention relates to a virtual relaxation system that combines an emotion engine that recognizes the user's emotions. The system provides a virtual relaxation environment generated based on the user's individual profile and offers a personalized relaxation experience by monitoring the user's biometric and emotional data in real time.

[0139] First, when a user puts on the VR device, the device connects to the server using the user's login information and performs user authentication. If authentication is successful, the server retrieves the user's individual profile from the database and analyzes information about the user's past relaxation experiences and preferences.

[0140] Next, the server uses a generative AI to automatically generate an appropriate relaxation scenario based on the user's profile. This scenario includes visual scenery (e.g., forest or ocean) and auditory elements such as music or nature sounds. The scenario data generated by the server is then provided to the user via the terminal.

[0141] Furthermore, the emotion engine acquires real-time emotional data from the user. This data is based on an analysis of the user's facial recognition information and voice tone, and is used to evaluate the user's emotional state. The device sends this emotional data to the server, which is then used as material to provide a virtual environment that reflects the user's current emotional state.

[0142] The server performs sentiment analysis based on biometric and emotional data. Based on the analysis results, it sends instructions to the terminal to dynamically adjust elements of the virtual environment (e.g., music tempo and video color tone). This allows for customization tailored to the user's level of relaxation.

[0143] For example, if a user is feeling anxious, the emotion engine recognizes that emotion, and the server adjusts the environment to help the user relax by selecting calming visual elements and slow-tempo music.

[0144] This system deeply understands the user's emotional state and provides appropriate relaxation techniques tailored to those emotions, thereby efficiently reducing stress and helping to restore concentration.

[0145] The following describes the processing flow.

[0146] Step 1:

[0147] The moment the user puts on the VR device, the terminal starts up and connects to the server using the user's login information. At this time, the terminal authenticates the user and sends the authentication information to the server.

[0148] Step 2:

[0149] Based on the authentication information received by the server, the user's individual profile is retrieved from the database. This includes the user's past experience history and relaxation preferences. The server uses this information to analyze the user's needs.

[0150] Step 3:

[0151] The server automatically generates relaxation scenarios using AI based on acquired profile data. These scenarios include visual and auditory elements, each customized to the user's preferences.

[0152] Step 4:

[0153] The terminal receives scenario data from the server and sets up the virtual environment on the VR device. The user then begins relaxation within the set-up environment.

[0154] Step 5:

[0155] The device monitors the user's biometric data, such as heart rate and skin potential, in real time via biosensors and transmits this data to a server.

[0156] Step 6:

[0157] In addition to the biometric data received by the server, the system also processes emotional data from the terminal's emotion engine. This emotional data is used to perform emotion analysis based on changes in the user's facial expressions and voice tone.

[0158] Step 7:

[0159] The server evaluates the user's emotional state based on biometric and emotional data and adjusts the virtual environment as needed. For example, if the emotional data indicates that the user is stressed, the server sends instructions to the terminal to change the colors to ones that provide visual calming effects or increase the volume of pleasant sounds.

[0160] Step 8:

[0161] The device adjusts the virtual environment based on instructions from the server, providing a relaxation experience optimized for the user. This allows the user to continue relaxing in an environment that is tailored to their own emotions.

[0162] Step 9:

[0163] When a user finishes a relaxation session, the device collects feedback from the user and sends that data to the server. The server analyzes this feedback and uses it to further improve future experiences.

[0164] (Example 2)

[0165] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0166] Against the backdrop of increasing stress and fatigue in modern society, many people are seeking mental and physical relaxation. However, conventional relaxation technologies have the challenge of not being able to provide an optimal relaxation environment in real time that is tailored to the individual user's emotional state and preferences. In particular, there is a lack of means to analyze each user's different emotional state in real time and dynamically adjust the virtual environment based on the results, which makes it difficult to provide a consistent relaxation effect.

[0167] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0168] In this invention, the server includes means for providing a multi-sensory virtual environment generated based on the user's individual profile, means for monitoring the user's biological state in real time, and means for analyzing the acquired biological state and adaptively adjusting the virtual environment. This makes it possible to provide an optimal relaxation environment according to the user's emotional state.

[0169] A "user's individual profile" is a unique dataset based on each user's past relaxation experiences and preferences, and serves as foundational information used to customize the virtual environment.

[0170] A "multisensory virtual environment" is a virtual space expressed using multiple senses such as sight and hearing, and is a field that provides a relaxation experience that is dynamically adjusted according to the user's emotional state.

[0171] A "generative AI model" is an algorithm or program that uses machine learning techniques to automatically generate optimal relaxation scenarios based on a user's individual profile and emotional state.

[0172] "Simulation elements" are components of visual and auditory content presented to the user within a virtual environment that can be modified in real time according to the user's emotional state.

[0173] "Emotional state detection" refers to the process of identifying a user's current emotions through technologies such as facial recognition and voice tone analysis.

[0174] "Adaptive adjustment" means adjusting elements of the virtual environment according to the situation at the time, based on the acquired user emotional data and biometric state.

[0175] The embodiments for carrying out the present invention will be described below.

[0176] When a user puts on a VR device, the terminal connects to the server using the user's login information and performs authentication. The hardware used includes the VR device and its corresponding terminal device, which are equipped with high-performance CPUs and GPUs. The software running is an authentication system that handles the user authentication protocol.

[0177] After successful authentication, the server retrieves the user's individual profile from the database. The user's profile includes information on past relaxation experiences, music preferences, and visual preferences, and a generation AI model automatically generates relaxation scenarios based on this information. The server uses advanced machine learning algorithms and, in response to the prompt "Generate a scenario based on natural scenery," generates simulations of forests and oceans.

[0178] The generated scenario data is sent to the terminal and provided to the user through the VR device. During this process, the terminal performs processing to present the virtual environment to the user in real time. For example, if the user prefers a quiet environment, a combination of sounds such as waves and birdsong will be provided.

[0179] Simultaneously, the device collects real-time user biometric and emotional data using an emotion engine. This includes user facial recognition information and voice tone analysis. This information is sent to a server, which uses a generative AI model to perform emotion analysis and adaptively adjust the visual and auditory elements of the virtual environment according to the user's emotions.

[0180] This system allows users to experience personalized relaxation tailored to their individual emotional state, potentially reducing stress and restoring concentration.

[0181] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0182] Step 1:

[0183] When a user puts on a VR device, the terminal sends the user's login information to the server. The input includes the user's authentication information (username and password). The server receives the authentication information and performs authentication by matching it against the database. If authentication is successful, it generates a user session ID as output and sends it to the terminal.

[0184] Step 2:

[0185] Based on successful authentication, the server retrieves the user's individual profile from the database. The input is the user's session ID, and the output is a dataset of the user's past relaxation experiences and preferences. This data is then used to design the optimal relaxation environment for the user.

[0186] Step 3:

[0187] The server uses a generation AI model to automatically generate relaxation scenarios based on the user profile. The input is user profile data, and the prompt "Generate a scenario based on natural scenery" is used. The output is relaxation scenario data, including visual and auditory simulations, which is sent to the terminal.

[0188] Step 4:

[0189] The terminal delivers relaxation scenario data received from the server to the VR device. The input is the scenario data, and the output is the virtual environment that the user experiences. During this process, the terminal performs processing to ensure that the simulation on the VR device runs smoothly. Specifically, this includes rendering video and playing sound.

[0190] Step 5:

[0191] The device uses an emotion engine to collect real-time biometric and emotional data from the user. This data is based on inputs such as facial recognition and voice tone, and serves as an indicator of the user's current emotional state. The acquired data is sent to a server for analysis.

[0192] Step 6:

[0193] The server analyzes the received emotional data using a generative AI model to evaluate the user's emotional state. The input is the user's emotional data, and the output is an analysis showing the user's emotional state. Based on this result, the server sends instructions to the terminal to dynamically adjust the visual and auditory elements of the virtual environment. This personalizes the user's relaxation experience.

[0194] (Application Example 2)

[0195] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0196] Conventional relaxation systems have struggled to provide appropriate customization tailored to each user's individual emotional state, making it difficult to offer a sufficient relaxation experience for elderly users or those requiring care. Furthermore, there was a lack of technology to analyze users' biometric and emotional data in real time and dynamically adjust the virtual environment based on that analysis. As a result, it was difficult to provide optimal relaxation scenarios tailored to individual needs, hindering improvements in users' quality of life.

[0197] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0198] In this invention, the server includes means for providing a virtual relaxation environment generated based on the user's individual profile, means for monitoring the user's biometric and emotional data in real time within the virtual environment, and means for analyzing the acquired biometric and emotional data and dynamically adjusting the virtual environment. This makes it possible to provide a different relaxation experience for each user in a care environment.

[0199] A "user's individual profile" is a set of data compiled based on a user's past relaxation experiences and preferences, and is used to create a relaxation environment optimized for that individual.

[0200] A "virtual relaxation environment" is a virtual space designed to provide users with a relaxation experience through visual and auditory content generated on a computer.

[0201] "Biometric data" refers to data that indicates the user's physical condition, such as heart rate and body temperature, and is monitored in real time.

[0202] "Emotional data" refers to data that indicates the user's emotional state, inferred from facial expressions, voice tone, and other factors.

[0203] "Means for dynamically adjusting the virtual environment" refers to a function that modifies the visual and auditory elements within the virtual environment in real time based on the results of an analysis of the user's biometric and emotional data.

[0204] A "generative AI model" is a model that uses machine learning technology to automatically generate optimal relaxation scenarios based on the user's individual profile.

[0205] This invention embodies a system for providing a virtual relaxation environment based on a user's individual profile. The system begins with the user wearing a device such as smart glasses or a head-mounted display. The device connects to a server using the user's login information and performs authentication. The server then retrieves the user's individual profile from a database and analyzes their past relaxation experiences and preferences.

[0206] The server uses a generative AI model to automatically generate appropriate relaxation scenarios based on the user's profile. These scenarios include visual scenery, auditory music, and nature sounds to provide relaxation to the user. The generated scenarios are then transmitted to the user via the device.

[0207] The device acquires real-time emotional data from the user via an emotion engine. This emotional data includes analysis of facial expressions and voice tone, which is used to obtain information that evaluates the user's emotional state. The device sends this emotional data to a server, which then adapts the virtual environment to reflect the user's current emotional state.

[0208] The server sends instructions to the terminal to dynamically adjust the visual and auditory elements of the virtual environment based on the analysis results of biometric and emotional data. For example, if the user is feeling anxious, the server will create a relaxing environment by selecting calming visual elements and slow-tempo music. This mechanism allows for optimization according to the user's level of relaxation.

[0209] A concrete example of its implementation is in elderly care facilities. Here, a relaxation experience is provided that is structured based on individual profiles and real-time emotional data. An example of a prompt would be, "Generate a relaxation environment based on the emotional data (anxiety) of elderly user A, and provide it with calm scenery and soothing music." The generating AI model uses this information to effectively create an environment tailored to the user.

[0210] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0211] Step 1:

[0212] The device detects that the user is wearing smart glasses or a head-mounted display. It receives the user's login information as input and connects to the server to perform user authentication. If authentication is successful, the server retrieves the user's individual profile from the database. The authentication result and profile data are obtained as output.

[0213] Step 2:

[0214] The server uses a generative AI model to analyze the acquired user profile as input data. Based on the user's past relaxation experiences and preferences, it generates an optimized relaxation scenario. This process outputs scenario data that includes visual and auditory elements.

[0215] Step 3:

[0216] The device collects user emotional data and takes it as input. In this process, the device's camera and microphone are used to recognize facial expressions and voice tone, obtaining data to evaluate the user's emotional state in real time. The collected emotional data is then sent to a server as output.

[0217] Step 4:

[0218] The server receives biometric and emotional data as input and performs data analysis. It utilizes a generative AI model to optimize the environment to suit the user's current emotional state. Based on this, it outputs instruction data for the dynamically adjusted virtual environment.

[0219] Step 5:

[0220] The terminal receives instruction data from the server and adjusts the virtual environment. It plays visual and auditory elements to provide the user with a relaxation experience. Finally, it operates to achieve a state of relaxation optimized for the user and produces adjusted virtual environment data as output.

[0221] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0222] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0223] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0224] [Second Embodiment]

[0225] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0226] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0227] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0228] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0229] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0230] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0231] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0232] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0233] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0234] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0235] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0236] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0237] The present invention is a system that provides a virtual relaxation environment generated based on the user's individual profile. This system aims to relax the user, particularly through visual and auditory experiences. Specific embodiments for carrying out the present invention are described below.

[0238] First, when a user puts on a VR device, the device authenticates the user, and based on the result, the server retrieves the user's individual profile. This profile includes information such as the user's past usage history and relaxation preferences.

[0239] Next, the server uses AI to generate a relaxation scenario based on the user's profile. This scenario includes selected visual elements (e.g., forest or ocean scenery) and auditory elements (e.g., nature sounds or calming music). The scenario generated by the server is then provided to the user through their device.

[0240] Within this virtual environment, the terminal monitors the user's biometric data in real time. The data acquired includes physiological signals such as heart rate, skin potential, and electroencephalogram (EEG). This data is sent to a server, which uses it to perform emotional analysis and evaluate the user's level of relaxation.

[0241] Based on the evaluation results, the server optimizes the user's relaxation experience by changing the music selection within the virtual environment and instructing appropriate color and motion changes in the video. In this way, the user experiences personalized relaxation and reduces stress.

[0242] As an example of a specific scenario, a user could experience being at a virtual beach in their home. They could hear the sound of gentle waves and see a sunset spreading across the sky. If the user's heart rate increases during this time, the server would instruct the device to select calmer music and reduce the background noise.

[0243] This invention is a system that helps relieve daily stress and provides a comfortable experience through such dynamic environmental adjustments.

[0244] The following describes the processing flow.

[0245] Step 1:

[0246] The terminal detects that the user is wearing a VR device and sends the user's login information to the server. This authenticates the user.

[0247] Step 2:

[0248] The server retrieves the individual profile of the authenticated user from the database and analyzes the user's past experience history and relaxation preferences.

[0249] Step 3:

[0250] The server uses a generative AI to automatically generate virtual relaxation scenarios based on the user's profile. Specific selection options include visual scenery, auditory music, and nature sounds.

[0251] Step 4:

[0252] The terminal receives scenario data generated from the server and sets up the virtual environment on the user's VR device based on it. The user becomes immersed in the virtual space and begins relaxation through sight and sound.

[0253] Step 5:

[0254] The device monitors the user's biometric data in real time during the session. It transmits heart rate and skin potential data obtained from sensors to the server.

[0255] Step 6:

[0256] The server evaluates the user's stress level and performs emotional analysis based on the received biometric data. Based on the analysis results, the server sends instructions to the terminal to adjust the environment (e.g., change the music, adjust the video).

[0257] Step 7:

[0258] The device adjusts the virtual environment according to instructions from the server, optimizing the user's relaxation experience. The user continues to relax in the adjusted virtual environment.

[0259] Step 8:

[0260] When a user finishes a relaxation session, the device prompts the user for feedback on the experience and sends the results to the server. The server analyzes the feedback and accumulates data to improve future experiences.

[0261] (Example 1)

[0262] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0263] Many people experience stress in their daily lives, and there is a need for effective ways to alleviate this stress. However, many conventional relaxation methods are general and fail to reflect the individual preferences and physiological states of users, thus creating a need for more personalized approaches. In addition, there is a lack of functionality that can instantly grasp the user's state and optimize the relaxation experience on the spot.

[0264] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0265] In this invention, the server includes means for providing a virtual environment based on the user's individual profile, means for monitoring biometric information in real time, and means for optimizing the virtual environment based on that information. This makes it possible to provide a personalized relaxation experience for each user and enhance stress reduction.

[0266] A "user's individual profile" is a collection of data that includes information about each individual user, such as their past usage history and relaxation preferences.

[0267] A "virtual environment" is a computer-controlled, synthesized environment created for a user to experience specific visual and auditory elements.

[0268] "Biometric information" refers to physiological signals such as the user's heart rate, skin potential, and brain waves, and is data acquired in real time.

[0269] A "generative AI model" refers to an algorithm that uses machine learning techniques to automatically generate relaxation scenarios based on the user's profile.

[0270] "Sentiment analysis" is a process that evaluates a user's current psychological state based on their biometric information.

[0271] "Visual elements" refer to all visual information, such as images and videos, that a user observes within a virtual environment.

[0272] "Auditory elements" refer to all auditory information, such as music and nature sounds, that a user can hear within the virtual environment.

[0273] "Real-time monitoring" refers to the process of instantly acquiring a user's biometric information and processing the data immediately.

[0274] "Means for optimizing the virtual environment" refers to technologies that dynamically adjust the visual and auditory elements within the virtual environment based on the user's biometric information and emotional analysis results.

[0275] This invention provides a system that offers a virtual relaxation environment generated based on the user's individual profile. The system enables users to enjoy an immersive relaxation experience using a VR device.

[0276] First, the user puts on a VR device. This initiates user authentication, and the server retrieves the user's individual profile. This profile stores past relaxation usage history and preferences.

[0277] The server generates relaxation scenarios using a generative AI model based on the acquired profile. This process selects visual elements (e.g., forest or ocean scenery) and auditory elements (e.g., nature sounds or calming music) that match the user's preferences. Specifically, this generation process involves inputting prompt sentences into the generative AI model, which then constructs an appropriate scenario.

[0278] Once a scenario is generated, it is provided to the user via the device, allowing the user to begin a relaxing experience within the virtual environment. During the virtual environment, the device monitors the user's biometric information in real time. This biometric information includes heart rate, skin potential, and electroencephalogram (EEG).

[0279] The server receives this biometric information and performs emotional analysis to determine the user's level of relaxation. Based on the results, it adjusts the visual and auditory elements of the virtual environment to optimize the relaxation experience. For example, if the user's heart rate increases, the server instructs the device to change the music being played to something calmer and reduce visual noise.

[0280] As a concrete example, when a user is experiencing a virtual beach at home and their heart rate increases, the server generates prompts to play quiet piano music on the device and maintain the visual effect of gentle wave movements. Prompts such as, "Generate a relaxing virtual beach scenario based on the user's profile. Use visual and auditory elements including sunsets and the sound of waves, and adjust the music according to the heart rate," are provided to the generating AI model.

[0281] This invention aims to provide a comfortable relaxation experience that contributes to reducing daily stress through dynamic environmental adjustments that respond to the user's physiological and psychological state.

[0282] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0283] Step 1:

[0284] The user wears a VR device.

[0285] As input, the user's biometric information (e.g., fingerprint or face) is provided to the terminal.

[0286] Based on this, the terminal authenticates the user and sends the authentication result to the server, enabling the server to prepare to retrieve the user's individual profile from the database. As output, the user authentication result is obtained.

[0287] Step 2:

[0288] The server retrieves the user's individual profile.

[0289] The input is the user's authentication information sent from the terminal.

[0290] Using this information, the server retrieves the user's past usage history and relaxation preference profile from the database and obtains profile data as output.

[0291] Step 3:

[0292] The server generates a relaxation scenario using a generative AI model.

[0293] The input is the obtained profile data.

[0294] Based on the profile, the server inputs a prompt sentence into the generative AI model.

[0295] As a result, a relaxation scenario incorporating visual and auditory elements is generated. As output, the constructed scenario is obtained.

[0296] Step 4:

[0297] The terminal provides a virtual environment to the user.

[0298] The input is a relaxation scenario sent from the server.

[0299] The terminal displays this scenario on the VR device and provides an immersive experience to the user. As an output, the experience in the virtual environment reaches the user.

[0300] Step 5:

[0301] The terminal monitors the user's biometric information in real time.

[0302] As input, the sensor obtains data such as the user's heart rate, skin potential, and brain waves.

[0303] The terminal collects this data and immediately sends it to the server. As an output, biometric data is obtained in real time.

[0304] Step 6:

[0305] The server performs sentiment analysis based on the biometric information and evaluates the degree of relaxation.

[0306] The input is the biometric information sent from the terminal.

[0307] The server analyzes this information and evaluates the user's mental state. As an output, the evaluation result of the relaxation degree is obtained.

[0308] Step 7:

[0309] The server issues an instruction to the terminal to optimize the virtual environment.

[0310] The input is the result of the sentiment analysis.

[0311] Based on the analysis results, the server sends instructions to the terminal to adjust the visual and auditory elements of the virtual environment, and the output is an adjustment instruction sheet. For example, if the user's heart rate is high, the server will instruct the terminal to play calming music.

[0312] These steps allow users to enjoy a personalized relaxation experience and reduce stress.

[0313] (Application Example 1)

[0314] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0315] For the elderly, there is a need to effectively reduce daily stress and anxiety and promote mental and physical relaxation. However, existing methods are not well-suited to individual conditions and preferences, making it difficult to provide an effective relaxation experience.

[0316] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0317] In this invention, the server includes means for dynamically providing visual and auditory information via a smart device based on biometric data, means for personalizing the relaxation experience for the elderly, and means for dynamically changing ambient sounds and visual effects based on the user's emotional analysis results to optimize the relaxation state of the elderly. This makes it possible to provide a relaxation experience that meets the individual needs of the elderly.

[0318] An "individual profile" is a collection of data that includes personal information about each user, such as their past usage history and relaxation preferences.

[0319] A "virtual relaxation environment" is a digital space that combines visual and auditory information to provide users with a relaxation experience.

[0320] "Biometric data" refers to measurements related to the user's physical and psychological state, such as heart rate, skin potential, and electroencephalography (EEG).

[0321] A "smart device" refers to an electronic device that, when worn or used by a user, displays information and enables interaction.

[0322] "Emotional analysis results" refer to information about the user's current psychological state and stress level, analyzed based on their biometric data.

[0323] "Personalizing the relaxation experience" is the process of optimizing the relaxation content provided to each user based on their individual profile and biometric data.

[0324] "Dynamically changing" refers to adjusting or switching scenarios and content on the fly based on the user's real-time state.

[0325] To implement this invention, the user must first wear a smart device, such as smart glasses. The device identifies the user's individual profile and begins monitoring biometric data. This data includes heart rate, skin potential, and electroencephalography (EEG). The device transmits this biometric data to a server.

[0326] The server uses a generative AI model to generate optimal visual and auditory information based on the user's individual profile and real-time biometric data. This includes scenery, nature sounds, and relaxation music. This generated relaxation environment is dynamically adjusted in response to the user's reactions.

[0327] For example, if a user's heart rate increases, the server will prompt the user to view calming natural scenery or listen to soothing music, and then display this on the device. This allows the user to enjoy a personalized relaxation experience and effectively reduce stress.

[0328] As a concrete example, consider a situation where a user is looking at a flower field and listening to birdsong. In this case, if the user is relaxed, the environment is maintained as is; if stress levels rise, the music is adjusted to a calmer tempo.

[0329] An example of a prompt is, "How can I use AI to generate and provide an optimal relaxation scenario based on the user's heart rate in real time?" This is used to achieve relaxation tailored to the user's state using an AI model.

[0330] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0331] Step 1:

[0332] The user wears a smart device. At this time, the device authenticates the user and obtains a specific individual profile. The input is the user's ID information, and the output is the corresponding individual profile. This profile includes the user's preferences and past usage history, and is used to identify their physical and psychological characteristics.

[0333] Step 2:

[0334] The terminal monitors the user's biometric data in real time and transmits this data to a server. The input is the user's biosignals (heart rate, skin potential, electroencephalogram, etc.), and the output is a temporary file containing this aggregated data. The terminal acquires this data using sensors and transmits it to the server via a communication interface.

[0335] Step 3:

[0336] The server uses a generative AI model to generate an optimal relaxation scenario based on acquired biometric data and individual profiles. The input is biometric data and individual profiles, while the output is a relaxation scenario including visual and auditory information. The server analyzes the data using the generative AI model and generates prompt messages.

[0337] Step 4:

[0338] The server sends the generated relaxation scenario to the terminal, which then provides it to the user. The input is the relaxation scenario, and the output is the visual and audio content played on the smart device. The terminal delivers the relaxation experience to the user through its display and speakers.

[0339] Step 5:

[0340] Based on user reactions, if biometric data changes, the server re-evaluates it and adjusts the relaxation scenario as needed. The input is the updated biometric data, and the output is the adjusted relaxation scenario. This process occurs in real time, continuously providing an experience optimized for the user's state.

[0341] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0342] This invention relates to a virtual relaxation system that combines an emotion engine that recognizes the user's emotions. The system provides a virtual relaxation environment generated based on the user's individual profile and offers a personalized relaxation experience by monitoring the user's biometric and emotional data in real time.

[0343] First, when a user puts on the VR device, the device connects to the server using the user's login information and performs user authentication. If authentication is successful, the server retrieves the user's individual profile from the database and analyzes information about the user's past relaxation experiences and preferences.

[0344] Next, the server uses a generative AI to automatically generate an appropriate relaxation scenario based on the user's profile. This scenario includes visual scenery (e.g., forest or ocean) and auditory elements such as music or nature sounds. The scenario data generated by the server is then provided to the user via the terminal.

[0345] Furthermore, the emotion engine acquires real-time emotional data from the user. This data is based on an analysis of the user's facial recognition information and voice tone, and is used to evaluate the user's emotional state. The device sends this emotional data to the server, which is then used as material to provide a virtual environment that reflects the user's current emotional state.

[0346] The server performs sentiment analysis based on biometric and emotional data. Based on the analysis results, it sends instructions to the terminal to dynamically adjust elements of the virtual environment (e.g., music tempo and video color tone). This allows for customization tailored to the user's level of relaxation.

[0347] For example, if a user is feeling anxious, the emotion engine recognizes that emotion, and the server adjusts the environment to help the user relax by selecting calming visual elements and slow-tempo music.

[0348] This system deeply understands the user's emotional state and provides appropriate relaxation techniques tailored to those emotions, thereby efficiently reducing stress and helping to restore concentration.

[0349] The following describes the processing flow.

[0350] Step 1:

[0351] The moment the user puts on the VR device, the terminal starts up and connects to the server using the user's login information. At this time, the terminal authenticates the user and sends the authentication information to the server.

[0352] Step 2:

[0353] Based on the authentication information received by the server, the user's individual profile is retrieved from the database. This includes the user's past experience history and relaxation preferences. The server uses this information to analyze the user's needs.

[0354] Step 3:

[0355] The server automatically generates relaxation scenarios using AI based on acquired profile data. These scenarios include visual and auditory elements, each customized to the user's preferences.

[0356] Step 4:

[0357] The terminal receives scenario data from the server and sets up the virtual environment on the VR device. The user then begins relaxation within the set-up environment.

[0358] Step 5:

[0359] The device monitors the user's biometric data, such as heart rate and skin potential, in real time via biosensors and transmits this data to a server.

[0360] Step 6:

[0361] In addition to the biometric data received by the server, the system also processes emotional data from the terminal's emotion engine. This emotional data is used to perform emotion analysis based on changes in the user's facial expressions and voice tone.

[0362] Step 7:

[0363] The server evaluates the user's emotional state based on biometric and emotional data and adjusts the virtual environment as needed. For example, if the emotional data indicates that the user is stressed, the server sends instructions to the terminal to change the colors to ones that provide visual calming effects or increase the volume of pleasant sounds.

[0364] Step 8:

[0365] The device adjusts the virtual environment based on instructions from the server, providing a relaxation experience optimized for the user. This allows the user to continue relaxing in an environment that is tailored to their emotions.

[0366] Step 9:

[0367] When a user finishes a relaxation session, the device collects feedback from the user and sends that data to the server. The server analyzes this feedback and uses it to further improve future experiences.

[0368] (Example 2)

[0369] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0370] Against the backdrop of increasing stress and fatigue in modern society, many people are seeking mental and physical relaxation. However, conventional relaxation technologies have the challenge of not being able to provide an optimal relaxation environment in real time that is tailored to the individual user's emotional state and preferences. In particular, there is a lack of means to analyze each user's different emotional state in real time and dynamically adjust the virtual environment based on the results, which makes it difficult to provide a consistent relaxation effect.

[0371] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0372] In this invention, the server includes means for providing a multi-sensory virtual environment generated based on the user's individual profile, means for monitoring the user's biological state in real time, and means for analyzing the acquired biological state and adaptively adjusting the virtual environment. This makes it possible to provide an optimal relaxation environment according to the user's emotional state.

[0373] A "user's individual profile" is a unique dataset based on each user's past relaxation experiences and preferences, and serves as foundational information used to customize the virtual environment.

[0374] A "multisensory virtual environment" is a virtual space expressed using multiple senses such as sight and hearing, and is a field that provides a relaxation experience that is dynamically adjusted according to the user's emotional state.

[0375] A "generative AI model" is an algorithm or program that uses machine learning techniques to automatically generate optimal relaxation scenarios based on a user's individual profile and emotional state.

[0376] "Simulation elements" are components of visual and auditory content presented to the user within a virtual environment that can be modified in real time according to the user's emotional state.

[0377] "Emotional state detection" refers to the process of identifying a user's current emotions through technologies such as facial recognition and voice tone analysis.

[0378] "Adaptive adjustment" means adjusting elements of the virtual environment according to the situation at the time, based on the acquired user emotional data and biometric state.

[0379] The embodiments for carrying out the present invention will be described below.

[0380] When a user puts on a VR device, the terminal connects to the server using the user's login information and performs authentication. The hardware used includes the VR device and its corresponding terminal device, which are equipped with high-performance CPUs and GPUs. The software running is an authentication system that handles the user authentication protocol.

[0381] After successful authentication, the server retrieves the user's individual profile from the database. The user's profile includes information on past relaxation experiences, music preferences, and visual preferences, and a generation AI model automatically generates relaxation scenarios based on this information. The server uses advanced machine learning algorithms and, in response to the prompt "Generate a scenario based on natural scenery," generates simulations of forests and oceans.

[0382] The generated scenario data is sent to the terminal and provided to the user through the VR device. During this process, the terminal performs processing to present the virtual environment to the user in real time. For example, if the user prefers a quiet environment, a combination of sounds such as waves and birdsong will be provided.

[0383] Simultaneously, the device collects real-time user biometric and emotional data using an emotion engine. This includes user facial recognition information and voice tone analysis. This information is sent to a server, which uses a generative AI model to perform emotion analysis and adaptively adjust the visual and auditory elements of the virtual environment according to the user's emotions.

[0384] This system allows users to experience personalized relaxation tailored to their individual emotional state, potentially reducing stress and restoring concentration.

[0385] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0386] Step 1:

[0387] When a user puts on a VR device, the terminal sends the user's login information to the server. The input includes the user's authentication information (username and password). The server receives the authentication information and performs authentication by matching it against the database. If authentication is successful, it generates a user session ID as output and sends it to the terminal.

[0388] Step 2:

[0389] Based on successful authentication, the server retrieves the user's individual profile from the database. The input is the user's session ID, and the output is a dataset of the user's past relaxation experiences and preferences. This data is then used to design the optimal relaxation environment for the user.

[0390] Step 3:

[0391] The server uses a generation AI model to automatically generate relaxation scenarios based on the user profile. The input is user profile data, and the prompt "Generate a scenario based on natural scenery" is used. The output is relaxation scenario data, including visual and auditory simulations, which is sent to the terminal.

[0392] Step 4:

[0393] The terminal delivers relaxation scenario data received from the server to the VR device. The input is the scenario data, and the output is the virtual environment that the user experiences. During this process, the terminal performs processing to ensure that the simulation on the VR device runs smoothly. Specifically, this includes rendering video and playing sound.

[0394] Step 5:

[0395] The device uses an emotion engine to collect real-time biometric and emotional data from the user. This data is based on inputs such as facial recognition and voice tone, and serves as an indicator of the user's current emotional state. The acquired data is sent to a server for analysis.

[0396] Step 6:

[0397] The server analyzes the received emotional data using a generative AI model to evaluate the user's emotional state. The input is the user's emotional data, and the output is an analysis showing the user's emotional state. Based on this result, the server sends instructions to the terminal to dynamically adjust the visual and auditory elements of the virtual environment. This personalizes the user's relaxation experience.

[0398] (Application Example 2)

[0399] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0400] Conventional relaxation systems have struggled to provide appropriate customization tailored to each user's individual emotional state, making it difficult to offer a sufficient relaxation experience for elderly users or those requiring care. Furthermore, there was a lack of technology to analyze users' biometric and emotional data in real time and dynamically adjust the virtual environment based on that analysis. As a result, it was difficult to provide optimal relaxation scenarios tailored to individual needs, hindering improvements in users' quality of life.

[0401] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0402] In this invention, the server includes means for providing a virtual relaxation environment generated based on the user's individual profile, means for monitoring the user's biometric and emotional data in real time within the virtual environment, and means for analyzing the acquired biometric and emotional data and dynamically adjusting the virtual environment. This makes it possible to provide a different relaxation experience for each user in a care environment.

[0403] A "user's individual profile" is a set of data compiled based on a user's past relaxation experiences and preferences, and is used to create a relaxation environment optimized for that individual.

[0404] A "virtual relaxation environment" is a virtual space designed to provide users with a relaxation experience through visual and auditory content generated on a computer.

[0405] "Biometric data" refers to data that indicates the user's physical condition, such as heart rate and body temperature, and is monitored in real time.

[0406] "Emotional data" refers to data that indicates the user's emotional state, inferred from facial expressions, voice tone, and other factors.

[0407] "Means for dynamically adjusting the virtual environment" refers to a function that modifies the visual and auditory elements within the virtual environment in real time based on the results of an analysis of the user's biometric and emotional data.

[0408] A "generative AI model" is a model that uses machine learning technology to automatically generate optimal relaxation scenarios based on the user's individual profile.

[0409] This invention embodies a system for providing a virtual relaxation environment based on a user's individual profile. The system begins with the user wearing a device such as smart glasses or a head-mounted display. The device connects to a server using the user's login information and performs authentication. The server then retrieves the user's individual profile from a database and analyzes their past relaxation experiences and preferences.

[0410] The server uses a generative AI model to automatically generate appropriate relaxation scenarios based on the user's profile. These scenarios include visual scenery, auditory music, and nature sounds to provide relaxation to the user. The generated scenarios are then transmitted to the user via the device.

[0411] The device acquires real-time emotional data from the user via an emotion engine. This emotional data includes analysis of facial expressions and voice tone, which is used to obtain information that evaluates the user's emotional state. The device sends this emotional data to a server, which then adapts the virtual environment to reflect the user's current emotional state.

[0412] The server sends instructions to the terminal to dynamically adjust the visual and auditory elements of the virtual environment based on the analysis results of biometric and emotional data. For example, if the user is feeling anxious, the server will create a relaxing environment by selecting calming visual elements and slow-tempo music. This mechanism allows for optimization according to the user's level of relaxation.

[0413] A concrete example of its implementation is in elderly care facilities. Here, a relaxation experience is provided that is structured based on individual profiles and real-time emotional data. An example of a prompt would be, "Generate a relaxation environment based on the emotional data (anxiety) of elderly user A, and provide it with calm scenery and soothing music." The generating AI model uses this information to effectively create an environment tailored to the user.

[0414] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0415] Step 1:

[0416] The device detects that the user is wearing smart glasses or a head-mounted display. It receives the user's login information as input and connects to the server to perform user authentication. If authentication is successful, the server retrieves the user's individual profile from the database. The authentication result and profile data are obtained as output.

[0417] Step 2:

[0418] The server uses a generative AI model to analyze the acquired user profile as input data. Based on the user's past relaxation experiences and preferences, it generates an optimized relaxation scenario. This process outputs scenario data that includes visual and auditory elements.

[0419] Step 3:

[0420] The device collects user emotional data and takes it as input. In this process, the device's camera and microphone are used to recognize facial expressions and voice tone, obtaining data to evaluate the user's emotional state in real time. The collected emotional data is then sent to a server as output.

[0421] Step 4:

[0422] The server receives biometric and emotional data as input and performs data analysis. It utilizes a generative AI model to optimize the environment to suit the user's current emotional state. Based on this, it outputs instruction data for the dynamically adjusted virtual environment.

[0423] Step 5:

[0424] The terminal receives instruction data from the server and adjusts the virtual environment. It plays visual and auditory elements to provide the user with a relaxation experience. Finally, it operates to achieve a state of relaxation optimized for the user and produces adjusted virtual environment data as output.

[0425] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0426] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0427] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0428] [Third Embodiment]

[0429] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0430] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0431] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0432] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0433] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0434] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0435] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0436] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0437] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0438] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0439] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0440] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0441] The present invention is a system that provides a virtual relaxation environment generated based on the user's individual profile. This system aims to relax the user, particularly through visual and auditory experiences. Specific embodiments for carrying out the present invention are described below.

[0442] First, when a user puts on a VR device, the device authenticates the user, and based on the result, the server retrieves the user's individual profile. This profile includes information such as the user's past usage history and relaxation preferences.

[0443] Next, the server uses AI to generate a relaxation scenario based on the user's profile. This scenario includes selected visual elements (e.g., forest or ocean scenery) and auditory elements (e.g., nature sounds or calming music). The scenario generated by the server is then provided to the user through their device.

[0444] Within this virtual environment, the terminal monitors the user's biometric data in real time. The data acquired includes physiological signals such as heart rate, skin potential, and electroencephalogram (EEG). This data is sent to a server, which uses it to perform emotional analysis and evaluate the user's level of relaxation.

[0445] Based on the evaluation results, the server optimizes the user's relaxation experience by changing the music selection within the virtual environment and instructing appropriate color and motion changes in the video. In this way, the user experiences personalized relaxation and reduces stress.

[0446] As an example of a specific scenario, a user could experience being at a virtual beach in their home. They could hear the sound of gentle waves and see a sunset spreading across the sky. If the user's heart rate increases during this time, the server would instruct the device to select calmer music and reduce the background noise.

[0447] This invention is a system that helps relieve daily stress and provides a comfortable experience through such dynamic environmental adjustments.

[0448] The following describes the processing flow.

[0449] Step 1:

[0450] The terminal detects that the user is wearing a VR device and sends the user's login information to the server. This authenticates the user.

[0451] Step 2:

[0452] The server retrieves the individual profile of the authenticated user from the database and analyzes the user's past experience history and relaxation preferences.

[0453] Step 3:

[0454] The server uses a generative AI to automatically generate virtual relaxation scenarios based on the user's profile. Specific selection options include visual scenery, auditory music, and nature sounds.

[0455] Step 4:

[0456] The terminal receives scenario data generated from the server and sets up the virtual environment on the user's VR device based on it. The user becomes immersed in the virtual space and begins relaxation through sight and sound.

[0457] Step 5:

[0458] The device monitors the user's biometric data in real time during the session. It transmits heart rate and skin potential data obtained from sensors to the server.

[0459] Step 6:

[0460] The server evaluates the user's stress level and performs emotional analysis based on the received biometric data. Based on the analysis results, the server sends instructions to the terminal to adjust the environment (e.g., change the music, adjust the video).

[0461] Step 7:

[0462] The device adjusts the virtual environment according to instructions from the server, optimizing the user's relaxation experience. The user continues to relax in the adjusted virtual environment.

[0463] Step 8:

[0464] When a user finishes a relaxation session, the device prompts the user for feedback on the experience and sends the results to the server. The server analyzes the feedback and accumulates data to improve future experiences.

[0465] (Example 1)

[0466] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0467] Many people experience stress in their daily lives, and there is a need for effective ways to alleviate this stress. However, many conventional relaxation methods are general and fail to reflect the individual preferences and physiological states of users, thus creating a need for more personalized approaches. In addition, there is a lack of functionality that can instantly grasp the user's state and optimize the relaxation experience on the spot.

[0468] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0469] In this invention, the server includes means for providing a virtual environment based on the user's individual profile, means for monitoring biometric information in real time, and means for optimizing the virtual environment based on that information. This makes it possible to provide a personalized relaxation experience for each user and enhance stress reduction.

[0470] A "user's individual profile" is a collection of data that includes information about each individual user, such as their past usage history and relaxation preferences.

[0471] A "virtual environment" is a computer-controlled, synthesized environment created for a user to experience specific visual and auditory elements.

[0472] "Biometric information" refers to physiological signals such as the user's heart rate, skin potential, and brain waves, and is data acquired in real time.

[0473] A "generative AI model" refers to an algorithm that uses machine learning techniques to automatically generate relaxation scenarios based on the user's profile.

[0474] "Sentiment analysis" is a process that evaluates a user's current psychological state based on their biometric information.

[0475] "Visual elements" refer to all visual information, such as images and videos, that a user observes within a virtual environment.

[0476] "Auditory elements" refer to all auditory information, such as music and nature sounds, that a user can hear within the virtual environment.

[0477] "Real-time monitoring" refers to the process of instantly acquiring a user's biometric information and processing the data immediately.

[0478] "Means for optimizing the virtual environment" refers to technologies that dynamically adjust the visual and auditory elements within the virtual environment based on the user's biometric information and emotional analysis results.

[0479] This invention provides a system that offers a virtual relaxation environment generated based on the user's individual profile. The system enables users to enjoy an immersive relaxation experience using a VR device.

[0480] First, the user puts on a VR device. This initiates user authentication, and the server retrieves the user's individual profile. This profile stores past relaxation usage history and preferences.

[0481] The server generates relaxation scenarios using a generative AI model based on the acquired profile. This process selects visual elements (e.g., forest or ocean scenery) and auditory elements (e.g., nature sounds or calming music) that match the user's preferences. Specifically, this generation process involves inputting prompt sentences into the generative AI model, which then constructs an appropriate scenario.

[0482] Once a scenario is generated, it is provided to the user via the device, allowing the user to begin a relaxing experience within the virtual environment. During the virtual environment, the device monitors the user's biometric information in real time. This biometric information includes heart rate, skin potential, and electroencephalogram (EEG).

[0483] The server receives this biometric information and performs emotional analysis to determine the user's level of relaxation. Based on the results, it adjusts the visual and auditory elements of the virtual environment to optimize the relaxation experience. For example, if the user's heart rate increases, the server instructs the device to change the music being played to something calmer and reduce visual noise.

[0484] As a concrete example, when a user is experiencing a virtual beach at home and their heart rate increases, the server generates prompts to play quiet piano music on the device and maintain the visual effect of gentle wave movements. Prompts such as, "Generate a relaxing virtual beach scenario based on the user's profile. Use visual and auditory elements including sunsets and the sound of waves, and adjust the music according to the heart rate," are provided to the generating AI model.

[0485] This invention aims to provide a comfortable relaxation experience that contributes to reducing daily stress through dynamic environmental adjustments that respond to the user's physiological and psychological state.

[0486] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0487] Step 1:

[0488] The user puts on a VR device.

[0489] As input, the user's biometric authentication information (e.g., fingerprint or face) is provided to the terminal.

[0490] The terminal authenticates the user based on this information and sends the authentication result to the server, which then prepares the server to retrieve the user's individual profile from the database. The output is the user authentication result.

[0491] Step 2:

[0492] The server retrieves the user's individual profile.

[0493] The input is the user's authentication information sent from the terminal.

[0494] The server uses this information to retrieve the user's past usage history and relaxation preferences from the database, and outputs profile data.

[0495] Step 3:

[0496] The server generates relaxation scenarios using an AI model.

[0497] The input is the acquired profile data.

[0498] Based on the profile, the server inputs prompt messages into the generated AI model.

[0499] This generates a relaxation scenario incorporating visual and auditory elements. The output is the constructed scenario.

[0500] Step 4:

[0501] The device provides the user with a virtual environment.

[0502] The input is a relaxation scenario sent from the server.

[0503] The device displays this scenario on a VR device, providing the user with an immersive experience. As output, the user receives the experience in the virtual environment.

[0504] Step 5:

[0505] The device monitors the user's biometric information in real time.

[0506] The sensors acquire data such as the user's heart rate, skin potential, and electroencephalogram (EEG) as input.

[0507] The device collects this data and immediately sends it to the server. As output, biometric data is obtained in real time.

[0508] Step 6:

[0509] The server performs emotional analysis based on biometric information and evaluates the degree of relaxation.

[0510] The input is biometric information transmitted from the device.

[0511] The server analyzes this information and evaluates the user's psychological state. The output is an evaluation of the level of relaxation.

[0512] Step 7:

[0513] The server issues instructions to the terminal to optimize the virtual environment.

[0514] The input is the result of sentiment analysis.

[0515] Based on the analysis results, the server sends instructions to the terminal to adjust the visual and auditory elements of the virtual environment, and the output is an adjustment instruction sheet. For example, if the user's heart rate is high, the server will instruct the terminal to play calming music.

[0516] These steps allow users to enjoy a personalized relaxation experience and reduce stress.

[0517] (Application Example 1)

[0518] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0519] For the elderly, there is a need to effectively reduce daily stress and anxiety and promote mental and physical relaxation. However, existing methods are not well-suited to individual conditions and preferences, making it difficult to provide an effective relaxation experience.

[0520] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0521] In this invention, the server includes means for dynamically providing visual and auditory information via a smart device based on biometric data, means for personalizing the relaxation experience for the elderly, and means for dynamically changing ambient sounds and visual effects based on the user's emotional analysis results to optimize the relaxation state of the elderly. This makes it possible to provide a relaxation experience that meets the individual needs of the elderly.

[0522] An "individual profile" is a collection of data that includes personal information about each user, such as their past usage history and relaxation preferences.

[0523] A "virtual relaxation environment" is a digital space that combines visual and auditory information to provide users with a relaxation experience.

[0524] "Biometric data" refers to measurements related to the user's physical and psychological state, such as heart rate, skin potential, and electroencephalography (EEG).

[0525] A "smart device" refers to an electronic device that, when worn or used by a user, displays information and enables interaction.

[0526] "Emotional analysis results" refer to information about the user's current psychological state and stress level, analyzed based on their biometric data.

[0527] "Personalizing the relaxation experience" is the process of optimizing the relaxation content provided to each user based on their individual profile and biometric data.

[0528] "Dynamically changing" refers to adjusting or switching scenarios and content on the fly based on the user's real-time state.

[0529] To implement this invention, the user must first wear a smart device, such as smart glasses. The device identifies the user's individual profile and begins monitoring biometric data. This data includes heart rate, skin potential, and electroencephalography (EEG). The device transmits this biometric data to a server.

[0530] The server uses a generative AI model to generate optimal visual and auditory information based on the user's individual profile and real-time biometric data. This includes scenery, nature sounds, and relaxation music. This generated relaxation environment is dynamically adjusted in response to the user's reactions.

[0531] For example, if a user's heart rate increases, the server will prompt the user to view calming natural scenery or listen to soothing music, and then display this on the device. This allows the user to enjoy a personalized relaxation experience and effectively reduce stress.

[0532] As a concrete example, consider a situation where a user is looking at a flower field and listening to birdsong. In this case, if the user is relaxed, the environment is maintained as is; if stress levels rise, the music is adjusted to a calmer tempo.

[0533] An example of a prompt is, "How can I use AI to generate and provide an optimal relaxation scenario based on the user's heart rate in real time?" This is used to achieve relaxation tailored to the user's state using an AI model.

[0534] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0535] Step 1:

[0536] The user wears a smart device. At this time, the device authenticates the user and obtains a specific individual profile. The input is the user's ID information, and the output is the corresponding individual profile. This profile includes the user's preferences and past usage history, and is used to identify their physical and psychological characteristics.

[0537] Step 2:

[0538] The terminal monitors the user's biometric data in real time and transmits this data to a server. The input is the user's biosignals (heart rate, skin potential, electroencephalogram, etc.), and the output is a temporary file containing this aggregated data. The terminal acquires this data using sensors and transmits it to the server via a communication interface.

[0539] Step 3:

[0540] The server uses a generative AI model to generate an optimal relaxation scenario based on acquired biometric data and individual profiles. The input is biometric data and individual profiles, while the output is a relaxation scenario including visual and auditory information. The server analyzes the data using the generative AI model and generates prompt messages.

[0541] Step 4:

[0542] The server sends the generated relaxation scenario to the terminal, which then provides it to the user. The input is the relaxation scenario, and the output is the visual and audio content played on the smart device. The terminal delivers the relaxation experience to the user through its display and speakers.

[0543] Step 5:

[0544] Based on user reactions, if biometric data changes, the server re-evaluates it and adjusts the relaxation scenario as needed. The input is the updated biometric data, and the output is the adjusted relaxation scenario. This process occurs in real time, continuously providing an experience optimized for the user's state.

[0545] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0546] This invention relates to a virtual relaxation system that combines an emotion engine that recognizes the user's emotions. The system provides a virtual relaxation environment generated based on the user's individual profile and offers a personalized relaxation experience by monitoring the user's biometric and emotional data in real time.

[0547] First, when a user puts on the VR device, the device connects to the server using the user's login information and performs user authentication. If authentication is successful, the server retrieves the user's individual profile from the database and analyzes information about the user's past relaxation experiences and preferences.

[0548] Next, the server uses a generative AI to automatically generate an appropriate relaxation scenario based on the user's profile. This scenario includes visual scenery (e.g., forest or ocean) and auditory elements such as music or nature sounds. The scenario data generated by the server is then provided to the user via the terminal.

[0549] Furthermore, the emotion engine acquires real-time emotional data from the user. This data is based on an analysis of the user's facial recognition information and voice tone, and is used to evaluate the user's emotional state. The device sends this emotional data to the server, which is then used as material to provide a virtual environment that reflects the user's current emotional state.

[0550] The server performs sentiment analysis based on biometric and emotional data. Based on the analysis results, it sends instructions to the terminal to dynamically adjust elements of the virtual environment (e.g., music tempo and video color tone). This allows for customization tailored to the user's level of relaxation.

[0551] For example, if a user is feeling anxious, the emotion engine recognizes that emotion, and the server adjusts the environment to help the user relax by selecting calming visual elements and slow-tempo music.

[0552] This system deeply understands the user's emotional state and provides appropriate relaxation techniques tailored to those emotions, thereby efficiently reducing stress and helping to restore concentration.

[0553] The following describes the processing flow.

[0554] Step 1:

[0555] The moment the user puts on the VR device, the terminal starts up and connects to the server using the user's login information. At this time, the terminal authenticates the user and sends the authentication information to the server.

[0556] Step 2:

[0557] Based on the authentication information received by the server, the user's individual profile is retrieved from the database. This includes the user's past experience history and relaxation preferences. The server uses this information to analyze the user's needs.

[0558] Step 3:

[0559] The server automatically generates relaxation scenarios using AI based on acquired profile data. These scenarios include visual and auditory elements, each customized to the user's preferences.

[0560] Step 4:

[0561] The terminal receives scenario data from the server and sets up the virtual environment on the VR device. The user then begins relaxation within the set-up environment.

[0562] Step 5:

[0563] The device monitors the user's biometric data, such as heart rate and skin potential, in real time via biosensors and transmits this data to a server.

[0564] Step 6:

[0565] In addition to the biometric data received by the server, the system also processes emotional data from the terminal's emotion engine. This emotional data is used to perform emotion analysis based on changes in the user's facial expressions and voice tone.

[0566] Step 7:

[0567] The server evaluates the user's emotional state based on biometric and emotional data and adjusts the virtual environment as needed. For example, if the emotional data indicates that the user is stressed, the server sends instructions to the terminal to change the colors to ones that provide visual calming effects or increase the volume of pleasant sounds.

[0568] Step 8:

[0569] The device adjusts the virtual environment based on instructions from the server, providing a relaxation experience optimized for the user. This allows the user to continue relaxing in an environment that is tailored to their emotions.

[0570] Step 9:

[0571] When a user finishes a relaxation session, the device collects feedback from the user and sends that data to the server. The server analyzes this feedback and uses it to further improve future experiences.

[0572] (Example 2)

[0573] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0574] Against the backdrop of increasing stress and fatigue in modern society, many people are seeking mental and physical relaxation. However, conventional relaxation technologies have the challenge of not being able to provide an optimal relaxation environment in real time that is tailored to the individual user's emotional state and preferences. In particular, there is a lack of means to analyze each user's different emotional state in real time and dynamically adjust the virtual environment based on the results, which makes it difficult to provide a consistent relaxation effect.

[0575] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0576] In this invention, the server includes means for providing a multi-sensory virtual environment generated based on the user's individual profile, means for monitoring the user's biological state in real time, and means for analyzing the acquired biological state and adaptively adjusting the virtual environment. This makes it possible to provide an optimal relaxation environment according to the user's emotional state.

[0577] A "user's individual profile" is a unique dataset based on each user's past relaxation experiences and preferences, and serves as foundational information used to customize the virtual environment.

[0578] A "multisensory virtual environment" is a virtual space expressed using multiple senses such as sight and hearing, and is a field that provides a relaxation experience that is dynamically adjusted according to the user's emotional state.

[0579] A "generative AI model" is an algorithm or program that uses machine learning techniques to automatically generate optimal relaxation scenarios based on a user's individual profile and emotional state.

[0580] "Simulation elements" are components of visual and auditory content presented to the user within a virtual environment that can be modified in real time according to the user's emotional state.

[0581] "Emotional state detection" refers to the process of identifying a user's current emotions through technologies such as facial recognition and voice tone analysis.

[0582] "Adaptive adjustment" means adjusting elements of the virtual environment according to the situation at the time, based on the acquired user emotional data and biometric state.

[0583] The embodiments for carrying out the present invention will be described below.

[0584] When a user puts on a VR device, the terminal connects to the server using the user's login information and performs authentication. The hardware used includes the VR device and its corresponding terminal device, which are equipped with high-performance CPUs and GPUs. The software running is an authentication system that handles the user authentication protocol.

[0585] After successful authentication, the server retrieves the user's individual profile from the database. The user's profile includes information on past relaxation experiences, music preferences, and visual preferences, and a generation AI model automatically generates relaxation scenarios based on this information. The server uses advanced machine learning algorithms and, in response to the prompt "Generate a scenario based on natural scenery," generates simulations of forests and oceans.

[0586] The generated scenario data is sent to the terminal and provided to the user through the VR device. During this process, the terminal performs processing to present the virtual environment to the user in real time. For example, if the user prefers a quiet environment, a combination of sounds such as waves and birdsong will be provided.

[0587] Simultaneously, the device collects real-time user biometric and emotional data using an emotion engine. This includes user facial recognition information and voice tone analysis. This information is sent to a server, which uses a generative AI model to perform emotion analysis and adaptively adjust the visual and auditory elements of the virtual environment according to the user's emotions.

[0588] This system allows users to experience personalized relaxation tailored to their individual emotional state, potentially reducing stress and restoring concentration.

[0589] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0590] Step 1:

[0591] When a user puts on a VR device, the terminal sends the user's login information to the server. The input includes the user's authentication information (username and password). The server receives the authentication information and performs authentication by matching it against the database. If authentication is successful, it generates a user session ID as output and sends it to the terminal.

[0592] Step 2:

[0593] Based on successful authentication, the server retrieves the user's individual profile from the database. The input is the user's session ID, and the output is a dataset of the user's past relaxation experiences and preferences. This data is then used to design the optimal relaxation environment for the user.

[0594] Step 3:

[0595] The server uses a generation AI model to automatically generate relaxation scenarios based on the user profile. The input is user profile data, and the prompt "Generate a scenario based on natural scenery" is used. The output is relaxation scenario data, including visual and auditory simulations, which is sent to the terminal.

[0596] Step 4:

[0597] The terminal delivers relaxation scenario data received from the server to the VR device. The input is the scenario data, and the output is the virtual environment that the user experiences. During this process, the terminal performs processing to ensure that the simulation on the VR device runs smoothly. Specifically, this includes rendering video and playing sound.

[0598] Step 5:

[0599] The device uses an emotion engine to collect real-time biometric and emotional data from the user. This data is based on inputs such as facial recognition and voice tone, and serves as an indicator of the user's current emotional state. The acquired data is sent to a server for analysis.

[0600] Step 6:

[0601] The server analyzes the received emotional data using a generative AI model to evaluate the user's emotional state. The input is the user's emotional data, and the output is an analysis showing the user's emotional state. Based on this result, the server sends instructions to the terminal to dynamically adjust the visual and auditory elements of the virtual environment. This personalizes the user's relaxation experience.

[0602] (Application Example 2)

[0603] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0604] Conventional relaxation systems have struggled to provide appropriate customization tailored to each user's individual emotional state, making it difficult to offer a sufficient relaxation experience for elderly users or those requiring care. Furthermore, there was a lack of technology to analyze users' biometric and emotional data in real time and dynamically adjust the virtual environment based on that analysis. As a result, it was difficult to provide optimal relaxation scenarios tailored to individual needs, hindering improvements in users' quality of life.

[0605] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0606] In this invention, the server includes means for providing a virtual relaxation environment generated based on the user's individual profile, means for monitoring the user's biometric and emotional data in real time within the virtual environment, and means for analyzing the acquired biometric and emotional data and dynamically adjusting the virtual environment. This makes it possible to provide a different relaxation experience for each user in a care environment.

[0607] A "user's individual profile" is a set of data compiled based on a user's past relaxation experiences and preferences, and is used to create a relaxation environment optimized for that individual.

[0608] A "virtual relaxation environment" is a virtual space designed to provide users with a relaxation experience through visual and auditory content generated on a computer.

[0609] "Biometric data" refers to data that indicates the user's physical condition, such as heart rate and body temperature, and is monitored in real time.

[0610] "Emotional data" refers to data that indicates the user's emotional state, inferred from facial expressions, voice tone, and other factors.

[0611] "Means for dynamically adjusting the virtual environment" refers to a function that modifies the visual and auditory elements within the virtual environment in real time based on the results of an analysis of the user's biometric and emotional data.

[0612] A "generative AI model" is a model that uses machine learning technology to automatically generate optimal relaxation scenarios based on the user's individual profile.

[0613] This invention embodies a system for providing a virtual relaxation environment based on a user's individual profile. The system begins with the user wearing a device such as smart glasses or a head-mounted display. The device connects to a server using the user's login information and performs authentication. The server then retrieves the user's individual profile from a database and analyzes their past relaxation experiences and preferences.

[0614] The server uses a generative AI model to automatically generate appropriate relaxation scenarios based on the user's profile. These scenarios include visual scenery, auditory music, and nature sounds to provide relaxation to the user. The generated scenarios are then transmitted to the user via the device.

[0615] The device acquires real-time emotional data from the user via an emotion engine. This emotional data includes analysis of facial expressions and voice tone, which is used to obtain information that evaluates the user's emotional state. The device sends this emotional data to a server, which then adapts the virtual environment to reflect the user's current emotional state.

[0616] The server sends instructions to the terminal to dynamically adjust the visual and auditory elements of the virtual environment based on the analysis results of biometric and emotional data. For example, if the user is feeling anxious, the server will create a relaxing environment by selecting calming visual elements and slow-tempo music. This mechanism allows for optimization according to the user's level of relaxation.

[0617] A concrete example of its implementation is in elderly care facilities. Here, a relaxation experience is provided that is structured based on individual profiles and real-time emotional data. An example of a prompt would be, "Generate a relaxation environment based on the emotional data (anxiety) of elderly user A, and provide it with calm scenery and soothing music." The generating AI model uses this information to effectively create an environment tailored to the user.

[0618] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0619] Step 1:

[0620] The device detects that the user is wearing smart glasses or a head-mounted display. It receives the user's login information as input and connects to the server to perform user authentication. If authentication is successful, the server retrieves the user's individual profile from the database. The authentication result and profile data are obtained as output.

[0621] Step 2:

[0622] The server uses a generative AI model to analyze the acquired user profile as input data. Based on the user's past relaxation experiences and preferences, it generates an optimized relaxation scenario. This process outputs scenario data that includes visual and auditory elements.

[0623] Step 3:

[0624] The device collects user emotional data and takes it as input. In this process, the device's camera and microphone are used to recognize facial expressions and voice tone, obtaining data to evaluate the user's emotional state in real time. The collected emotional data is then sent to a server as output.

[0625] Step 4:

[0626] The server receives biometric and emotional data as input and performs data analysis. It utilizes a generative AI model to optimize the environment to suit the user's current emotional state. Based on this, it outputs instruction data for the dynamically adjusted virtual environment.

[0627] Step 5:

[0628] The terminal receives instruction data from the server and adjusts the virtual environment. It plays visual and auditory elements to provide the user with a relaxation experience. Finally, it operates to achieve a state of relaxation optimized for the user and produces adjusted virtual environment data as output.

[0629] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0630] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0631] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0632] [Fourth Embodiment]

[0633] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0634] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0635] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0636] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0637] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0638] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0639] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0640] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0641] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0642] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0643] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0644] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0645] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0646] The present invention is a system that provides a virtual relaxation environment generated based on the user's individual profile. This system aims to relax the user, particularly through visual and auditory experiences. Specific embodiments for carrying out the present invention are described below.

[0647] First, when a user puts on a VR device, the device authenticates the user, and based on the result, the server retrieves the user's individual profile. This profile includes information such as the user's past usage history and relaxation preferences.

[0648] Next, the server uses AI to generate a relaxation scenario based on the user's profile. This scenario includes selected visual elements (e.g., forest or ocean scenery) and auditory elements (e.g., nature sounds or calming music). The scenario generated by the server is then provided to the user through their device.

[0649] Within this virtual environment, the terminal monitors the user's biometric data in real time. The data acquired includes physiological signals such as heart rate, skin potential, and electroencephalogram (EEG). This data is sent to a server, which uses it to perform emotional analysis and evaluate the user's level of relaxation.

[0650] Based on the evaluation results, the server optimizes the user's relaxation experience by changing the music selection within the virtual environment and instructing appropriate color and motion changes in the video. In this way, the user experiences personalized relaxation and reduces stress.

[0651] As an example of a specific scenario, a user could experience being at a virtual beach in their home. They could hear the sound of gentle waves and see a sunset spreading across the sky. If the user's heart rate increases during this time, the server would instruct the device to select calmer music and reduce the background noise.

[0652] This invention is a system that helps relieve daily stress and provides a comfortable experience through such dynamic environmental adjustments.

[0653] The following describes the processing flow.

[0654] Step 1:

[0655] The terminal detects that the user is wearing a VR device and sends the user's login information to the server. This authenticates the user.

[0656] Step 2:

[0657] The server retrieves the individual profile of the authenticated user from the database and analyzes the user's past experience history and relaxation preferences.

[0658] Step 3:

[0659] The server uses a generative AI to automatically generate virtual relaxation scenarios based on the user's profile. Specific selection options include visual scenery, auditory music, and nature sounds.

[0660] Step 4:

[0661] The terminal receives scenario data generated from the server and sets up the virtual environment on the user's VR device based on it. The user becomes immersed in the virtual space and begins relaxation through sight and sound.

[0662] Step 5:

[0663] The device monitors the user's biometric data in real time during the session. It transmits heart rate and skin potential data obtained from sensors to the server.

[0664] Step 6:

[0665] The server evaluates the user's stress level and performs emotional analysis based on the received biometric data. Based on the analysis results, the server sends instructions to the terminal to adjust the environment (e.g., change the music, adjust the video).

[0666] Step 7:

[0667] The device adjusts the virtual environment according to instructions from the server, optimizing the user's relaxation experience. The user continues to relax in the adjusted virtual environment.

[0668] Step 8:

[0669] When a user finishes a relaxation session, the device prompts the user for feedback on the experience and sends the results to the server. The server analyzes the feedback and accumulates data to improve future experiences.

[0670] (Example 1)

[0671] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0672] Many people experience stress in their daily lives, and there is a need for effective ways to alleviate this stress. However, many conventional relaxation methods are general and fail to reflect the individual preferences and physiological states of users, thus creating a need for more personalized approaches. In addition, there is a lack of functionality that can instantly grasp the user's state and optimize the relaxation experience on the spot.

[0673] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0674] In this invention, the server includes means for providing a virtual environment based on the user's individual profile, means for monitoring biometric information in real time, and means for optimizing the virtual environment based on that information. This makes it possible to provide a personalized relaxation experience for each user and enhance stress reduction.

[0675] A "user's individual profile" is a collection of data that includes information about each individual user, such as their past usage history and relaxation preferences.

[0676] A "virtual environment" is a computer-controlled, synthesized environment created for a user to experience specific visual and auditory elements.

[0677] "Biometric information" refers to physiological signals such as the user's heart rate, skin potential, and brain waves, and is data acquired in real time.

[0678] A "generative AI model" refers to an algorithm that uses machine learning techniques to automatically generate relaxation scenarios based on the user's profile.

[0679] "Sentiment analysis" is a process that evaluates a user's current psychological state based on their biometric information.

[0680] "Visual elements" refer to all visual information, such as images and videos, that a user observes within a virtual environment.

[0681] "Auditory elements" refer to all auditory information, such as music and nature sounds, that a user can hear within the virtual environment.

[0682] "Real-time monitoring" refers to the process of instantly acquiring a user's biometric information and processing the data immediately.

[0683] "Means for optimizing the virtual environment" refers to technologies that dynamically adjust the visual and auditory elements within the virtual environment based on the user's biometric information and emotional analysis results.

[0684] This invention provides a system that offers a virtual relaxation environment generated based on the user's individual profile. The system enables users to enjoy an immersive relaxation experience using a VR device.

[0685] First, the user puts on a VR device. This initiates user authentication, and the server retrieves the user's individual profile. This profile stores past relaxation usage history and preferences.

[0686] The server generates relaxation scenarios using a generative AI model based on the acquired profile. This process selects visual elements (e.g., forest or ocean scenery) and auditory elements (e.g., nature sounds or calming music) that match the user's preferences. Specifically, this generation process involves inputting prompt sentences into the generative AI model, which then constructs an appropriate scenario.

[0687] Once a scenario is generated, it is provided to the user via the device, allowing the user to begin a relaxing experience within the virtual environment. During the virtual environment, the device monitors the user's biometric information in real time. This biometric information includes heart rate, skin potential, and electroencephalogram (EEG).

[0688] The server receives this biometric information and performs emotional analysis to determine the user's level of relaxation. Based on the results, it adjusts the visual and auditory elements of the virtual environment to optimize the relaxation experience. For example, if the user's heart rate increases, the server instructs the device to change the music being played to something calmer and reduce visual noise.

[0689] As a concrete example, when a user is experiencing a virtual beach at home and their heart rate increases, the server generates prompts to play quiet piano music on the device and maintain the visual effect of gentle wave movements. Prompts such as, "Generate a relaxing virtual beach scenario based on the user's profile. Use visual and auditory elements including sunsets and the sound of waves, and adjust the music according to the heart rate," are provided to the generating AI model.

[0690] This invention aims to provide a comfortable relaxation experience that contributes to reducing daily stress through dynamic environmental adjustments that respond to the user's physiological and psychological state.

[0691] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0692] Step 1:

[0693] The user puts on a VR device.

[0694] As input, the user's biometric authentication information (e.g., fingerprint or face) is provided to the terminal.

[0695] The terminal authenticates the user based on this information and sends the authentication result to the server, which then prepares the server to retrieve the user's individual profile from the database. The output is the user authentication result.

[0696] Step 2:

[0697] The server retrieves the user's individual profile.

[0698] The input is the user's authentication information sent from the terminal.

[0699] The server uses this information to retrieve the user's past usage history and relaxation preferences from the database, and outputs profile data.

[0700] Step 3:

[0701] The server generates relaxation scenarios using an AI model.

[0702] The input is the acquired profile data.

[0703] Based on the profile, the server inputs prompt messages into the generated AI model.

[0704] This generates a relaxation scenario incorporating visual and auditory elements. The output is the constructed scenario.

[0705] Step 4:

[0706] The device provides the user with a virtual environment.

[0707] The input is a relaxation scenario sent from the server.

[0708] The device displays this scenario on a VR device, providing the user with an immersive experience. As output, the user receives the experience in the virtual environment.

[0709] Step 5:

[0710] The device monitors the user's biometric information in real time.

[0711] The sensors acquire data such as the user's heart rate, skin potential, and electroencephalogram (EEG) as input.

[0712] The device collects this data and immediately sends it to the server. As output, biometric data is obtained in real time.

[0713] Step 6:

[0714] The server performs emotional analysis based on biometric information and evaluates the degree of relaxation.

[0715] The input is biometric information transmitted from the device.

[0716] The server analyzes this information and evaluates the user's psychological state. The output is an evaluation of the level of relaxation.

[0717] Step 7:

[0718] The server issues instructions to the terminal to optimize the virtual environment.

[0719] The input is the result of sentiment analysis.

[0720] Based on the analysis results, the server sends instructions to the terminal to adjust the visual and auditory elements of the virtual environment, and the output is an adjustment instruction sheet. For example, if the user's heart rate is high, the server will instruct the terminal to play calming music.

[0721] These steps allow users to enjoy a personalized relaxation experience and reduce stress.

[0722] (Application Example 1)

[0723] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0724] For the elderly, there is a need to effectively reduce daily stress and anxiety and promote mental and physical relaxation. However, existing methods are not well-suited to individual conditions and preferences, making it difficult to provide an effective relaxation experience.

[0725] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0726] In this invention, the server includes means for dynamically providing visual and auditory information via a smart device based on biometric data, means for personalizing the relaxation experience for the elderly, and means for dynamically changing ambient sounds and visual effects based on the user's emotional analysis results to optimize the relaxation state of the elderly. This makes it possible to provide a relaxation experience that meets the individual needs of the elderly.

[0727] An "individual profile" is a collection of data that includes personal information about each user, such as their past usage history and relaxation preferences.

[0728] A "virtual relaxation environment" is a digital space that combines visual and auditory information to provide users with a relaxation experience.

[0729] "Biometric data" refers to measurements related to the user's physical and psychological state, such as heart rate, skin potential, and electroencephalography (EEG).

[0730] A "smart device" refers to an electronic device that, when worn or used by a user, displays information and enables interaction.

[0731] "Emotional analysis results" refer to information about the user's current psychological state and stress level, analyzed based on their biometric data.

[0732] "Personalizing the relaxation experience" is the process of optimizing the relaxation content provided to each user based on their individual profile and biometric data.

[0733] "Dynamically changing" refers to adjusting or switching scenarios and content on the fly based on the user's real-time state.

[0734] To implement this invention, the user must first wear a smart device, such as smart glasses. The device identifies the user's individual profile and begins monitoring biometric data. This data includes heart rate, skin potential, and electroencephalography (EEG). The device transmits this biometric data to a server.

[0735] The server uses a generative AI model to generate optimal visual and auditory information based on the user's individual profile and real-time biometric data. This includes scenery, nature sounds, and relaxation music. This generated relaxation environment is dynamically adjusted in response to the user's reactions.

[0736] For example, if a user's heart rate increases, the server will prompt the user to view calming natural scenery or listen to soothing music, and then display this on the device. This allows the user to enjoy a personalized relaxation experience and effectively reduce stress.

[0737] As a concrete example, consider a situation where a user is looking at a flower field and listening to birdsong. In this case, if the user is relaxed, the environment is maintained as is; if stress levels rise, the music is adjusted to a calmer tempo.

[0738] An example of a prompt is, "How can I use AI to generate and provide an optimal relaxation scenario based on the user's heart rate in real time?" This is used to achieve relaxation tailored to the user's state using an AI model.

[0739] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0740] Step 1:

[0741] The user wears a smart device. At this time, the device authenticates the user and obtains a specific individual profile. The input is the user's ID information, and the output is the corresponding individual profile. This profile includes the user's preferences and past usage history, and is used to identify their physical and psychological characteristics.

[0742] Step 2:

[0743] The terminal monitors the user's biometric data in real time and transmits this data to a server. The input is the user's biosignals (heart rate, skin potential, electroencephalogram, etc.), and the output is a temporary file containing this aggregated data. The terminal acquires this data using sensors and transmits it to the server via a communication interface.

[0744] Step 3:

[0745] The server uses a generative AI model to generate an optimal relaxation scenario based on acquired biometric data and individual profiles. The input is biometric data and individual profiles, while the output is a relaxation scenario including visual and auditory information. The server analyzes the data using the generative AI model and generates prompt messages.

[0746] Step 4:

[0747] The server sends the generated relaxation scenario to the terminal, which then provides it to the user. The input is the relaxation scenario, and the output is the visual and audio content played on the smart device. The terminal delivers the relaxation experience to the user through its display and speakers.

[0748] Step 5:

[0749] Based on user reactions, if biometric data changes, the server re-evaluates it and adjusts the relaxation scenario as needed. The input is the updated biometric data, and the output is the adjusted relaxation scenario. This process occurs in real time, continuously providing an experience optimized for the user's state.

[0750] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0751] This invention relates to a virtual relaxation system that combines an emotion engine that recognizes the user's emotions. The system provides a virtual relaxation environment generated based on the user's individual profile and offers a personalized relaxation experience by monitoring the user's biometric and emotional data in real time.

[0752] First, when a user puts on the VR device, the device connects to the server using the user's login information and performs user authentication. If authentication is successful, the server retrieves the user's individual profile from the database and analyzes information about the user's past relaxation experiences and preferences.

[0753] Next, the server uses a generative AI to automatically generate an appropriate relaxation scenario based on the user's profile. This scenario includes visual scenery (e.g., forest or ocean) and auditory elements such as music or nature sounds. The scenario data generated by the server is then provided to the user via the terminal.

[0754] Furthermore, the emotion engine acquires real-time emotional data from the user. This data is based on an analysis of the user's facial recognition information and voice tone, and is used to evaluate the user's emotional state. The device sends this emotional data to the server, which is then used as material to provide a virtual environment that reflects the user's current emotional state.

[0755] The server performs sentiment analysis based on biometric and emotional data. Based on the analysis results, it sends instructions to the terminal to dynamically adjust elements of the virtual environment (e.g., music tempo and video color tone). This allows for customization tailored to the user's level of relaxation.

[0756] For example, if a user is feeling anxious, the emotion engine recognizes that emotion, and the server adjusts the environment to help the user relax by selecting calming visual elements and slow-tempo music.

[0757] This system deeply understands the user's emotional state and provides appropriate relaxation techniques tailored to those emotions, thereby efficiently reducing stress and helping to restore concentration.

[0758] The following describes the processing flow.

[0759] Step 1:

[0760] The moment the user puts on the VR device, the terminal starts up and connects to the server using the user's login information. At this time, the terminal authenticates the user and sends the authentication information to the server.

[0761] Step 2:

[0762] Based on the authentication information received by the server, the user's individual profile is retrieved from the database. This includes the user's past experience history and relaxation preferences. The server uses this information to analyze the user's needs.

[0763] Step 3:

[0764] The server automatically generates relaxation scenarios using AI based on acquired profile data. These scenarios include visual and auditory elements, each customized to the user's preferences.

[0765] Step 4:

[0766] The terminal receives scenario data from the server and sets up the virtual environment on the VR device. The user then begins relaxation within the set-up environment.

[0767] Step 5:

[0768] The device monitors the user's biometric data, such as heart rate and skin potential, in real time via biosensors and transmits this data to a server.

[0769] Step 6:

[0770] In addition to the biometric data received by the server, the system also processes emotional data from the terminal's emotion engine. This emotional data is used to perform emotion analysis based on changes in the user's facial expressions and voice tone.

[0771] Step 7:

[0772] The server evaluates the user's emotional state based on biometric and emotional data and adjusts the virtual environment as needed. For example, if the emotional data indicates that the user is stressed, the server sends instructions to the terminal to change the colors to ones that provide visual calming effects or increase the volume of pleasant sounds.

[0773] Step 8:

[0774] The device adjusts the virtual environment based on instructions from the server, providing a relaxation experience optimized for the user. This allows the user to continue relaxing in an environment that is tailored to their emotions.

[0775] Step 9:

[0776] When a user finishes a relaxation session, the device collects feedback from the user and sends that data to the server. The server analyzes this feedback and uses it to further improve future experiences.

[0777] (Example 2)

[0778] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0779] Against the backdrop of increasing stress and fatigue in modern society, many people are seeking mental and physical relaxation. However, conventional relaxation technologies have the challenge of not being able to provide an optimal relaxation environment in real time that is tailored to the individual user's emotional state and preferences. In particular, there is a lack of means to analyze each user's different emotional state in real time and dynamically adjust the virtual environment based on the results, which makes it difficult to provide a consistent relaxation effect.

[0780] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0781] In this invention, the server includes means for providing a multi-sensory virtual environment generated based on the user's individual profile, means for monitoring the user's biological state in real time, and means for analyzing the acquired biological state and adaptively adjusting the virtual environment. This makes it possible to provide an optimal relaxation environment according to the user's emotional state.

[0782] A "user's individual profile" is a unique dataset based on each user's past relaxation experiences and preferences, and serves as foundational information used to customize the virtual environment.

[0783] A "multisensory virtual environment" is a virtual space expressed using multiple senses such as sight and hearing, and is a field that provides a relaxation experience that is dynamically adjusted according to the user's emotional state.

[0784] A "generative AI model" is an algorithm or program that uses machine learning techniques to automatically generate optimal relaxation scenarios based on a user's individual profile and emotional state.

[0785] "Simulation elements" are components of visual and auditory content presented to the user within a virtual environment that can be modified in real time according to the user's emotional state.

[0786] "Emotional state detection" refers to the process of identifying a user's current emotions through technologies such as facial recognition and voice tone analysis.

[0787] "Adaptive adjustment" means adjusting elements of the virtual environment according to the situation at the time, based on the acquired user emotional data and biometric state.

[0788] The embodiments for carrying out the present invention will be described below.

[0789] When a user puts on a VR device, the terminal connects to the server using the user's login information and performs authentication. The hardware used includes the VR device and its corresponding terminal device, which are equipped with high-performance CPUs and GPUs. The software running is an authentication system that handles the user authentication protocol.

[0790] After successful authentication, the server retrieves the user's individual profile from the database. The user's profile includes information on past relaxation experiences, music preferences, and visual preferences, and a generation AI model automatically generates relaxation scenarios based on this information. The server uses advanced machine learning algorithms and, in response to the prompt "Generate a scenario based on natural scenery," generates simulations of forests and oceans.

[0791] The generated scenario data is sent to the terminal and provided to the user through the VR device. During this process, the terminal performs processing to present the virtual environment to the user in real time. For example, if the user prefers a quiet environment, a combination of sounds such as waves and birdsong will be provided.

[0792] Simultaneously, the device collects real-time user biometric and emotional data using an emotion engine. This includes user facial recognition information and voice tone analysis. This information is sent to a server, which uses a generative AI model to perform emotion analysis and adaptively adjust the visual and auditory elements of the virtual environment according to the user's emotions.

[0793] This system allows users to experience personalized relaxation tailored to their individual emotional state, potentially reducing stress and restoring concentration.

[0794] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0795] Step 1:

[0796] When a user puts on a VR device, the terminal sends the user's login information to the server. The input includes the user's authentication information (username and password). The server receives the authentication information and performs authentication by matching it against the database. If authentication is successful, it generates a user session ID as output and sends it to the terminal.

[0797] Step 2:

[0798] Based on successful authentication, the server retrieves the user's individual profile from the database. The input is the user's session ID, and the output is a dataset of the user's past relaxation experiences and preferences. This data is then used to design the optimal relaxation environment for the user.

[0799] Step 3:

[0800] The server uses a generation AI model to automatically generate relaxation scenarios based on the user profile. The input is user profile data, and the prompt "Generate a scenario based on natural scenery" is used. The output is relaxation scenario data, including visual and auditory simulations, which is sent to the terminal.

[0801] Step 4:

[0802] The terminal delivers relaxation scenario data received from the server to the VR device. The input is the scenario data, and the output is the virtual environment that the user experiences. During this process, the terminal performs processing to ensure that the simulation on the VR device runs smoothly. Specifically, this includes rendering video and playing sound.

[0803] Step 5:

[0804] The device uses an emotion engine to collect real-time biometric and emotional data from the user. This data is based on inputs such as facial recognition and voice tone, and serves as an indicator of the user's current emotional state. The acquired data is sent to a server for analysis.

[0805] Step 6:

[0806] The server analyzes the received emotional data using a generative AI model to evaluate the user's emotional state. The input is the user's emotional data, and the output is an analysis showing the user's emotional state. Based on this result, the server sends instructions to the terminal to dynamically adjust the visual and auditory elements of the virtual environment. This personalizes the user's relaxation experience.

[0807] (Application Example 2)

[0808] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0809] Conventional relaxation systems have struggled to provide appropriate customization tailored to each user's individual emotional state, making it difficult to offer a sufficient relaxation experience for elderly users or those requiring care. Furthermore, there was a lack of technology to analyze users' biometric and emotional data in real time and dynamically adjust the virtual environment based on that analysis. As a result, it was difficult to provide optimal relaxation scenarios tailored to individual needs, hindering improvements in users' quality of life.

[0810] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0811] In this invention, the server includes means for providing a virtual relaxation environment generated based on the user's individual profile, means for monitoring the user's biometric and emotional data in real time within the virtual environment, and means for analyzing the acquired biometric and emotional data and dynamically adjusting the virtual environment. This makes it possible to provide a different relaxation experience for each user in a care environment.

[0812] A "user's individual profile" is a set of data compiled based on a user's past relaxation experiences and preferences, and is used to create a relaxation environment optimized for that individual.

[0813] A "virtual relaxation environment" is a virtual space designed to provide users with a relaxation experience through visual and auditory content generated on a computer.

[0814] "Biometric data" refers to data that indicates the user's physical condition, such as heart rate and body temperature, and is monitored in real time.

[0815] "Emotional data" refers to data that indicates the user's emotional state, inferred from facial expressions, voice tone, and other factors.

[0816] "Means for dynamically adjusting the virtual environment" refers to a function that modifies the visual and auditory elements within the virtual environment in real time based on the results of an analysis of the user's biometric and emotional data.

[0817] A "generative AI model" is a model that uses machine learning technology to automatically generate optimal relaxation scenarios based on the user's individual profile.

[0818] This invention embodies a system for providing a virtual relaxation environment based on a user's individual profile. The system begins with the user wearing a device such as smart glasses or a head-mounted display. The device connects to a server using the user's login information and performs authentication. The server then retrieves the user's individual profile from a database and analyzes their past relaxation experiences and preferences.

[0819] The server uses a generative AI model to automatically generate appropriate relaxation scenarios based on the user's profile. These scenarios include visual scenery, auditory music, and nature sounds to provide relaxation to the user. The generated scenarios are then transmitted to the user via the device.

[0820] The device acquires real-time emotional data from the user via an emotion engine. This emotional data includes analysis of facial expressions and voice tone, which is used to obtain information that evaluates the user's emotional state. The device sends this emotional data to a server, which then adapts the virtual environment to reflect the user's current emotional state.

[0821] The server sends instructions to the terminal to dynamically adjust the visual and auditory elements of the virtual environment based on the analysis results of biometric and emotional data. For example, if the user is feeling anxious, the server will create a relaxing environment by selecting calming visual elements and slow-tempo music. This mechanism allows for optimization according to the user's level of relaxation.

[0822] A concrete example of its implementation is in elderly care facilities. Here, a relaxation experience is provided that is structured based on individual profiles and real-time emotional data. An example of a prompt would be, "Generate a relaxation environment based on the emotional data (anxiety) of elderly user A, and provide it with calm scenery and soothing music." The generating AI model uses this information to effectively create an environment tailored to the user.

[0823] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0824] Step 1:

[0825] The device detects that the user is wearing smart glasses or a head-mounted display. It receives the user's login information as input and connects to the server to perform user authentication. If authentication is successful, the server retrieves the user's individual profile from the database. The authentication result and profile data are obtained as output.

[0826] Step 2:

[0827] The server uses a generative AI model to analyze the acquired user profile as input data. Based on the user's past relaxation experiences and preferences, it generates an optimized relaxation scenario. This process outputs scenario data that includes visual and auditory elements.

[0828] Step 3:

[0829] The device collects user emotional data and takes it as input. In this process, the device's camera and microphone are used to recognize facial expressions and voice tone, obtaining data to evaluate the user's emotional state in real time. The collected emotional data is then sent to a server as output.

[0830] Step 4:

[0831] The server receives biometric and emotional data as input and performs data analysis. It utilizes a generative AI model to optimize the environment to suit the user's current emotional state. Based on this, it outputs instruction data for the dynamically adjusted virtual environment.

[0832] Step 5:

[0833] The terminal receives instruction data from the server and adjusts the virtual environment. It plays visual and auditory elements to provide the user with a relaxation experience. Finally, it operates to achieve a state of relaxation optimized for the user and produces adjusted virtual environment data as output.

[0834] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0835] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0836] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0837] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0838] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0839] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0840] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0841] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0842] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0843] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0844] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0845] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0846] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0847] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0848] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0849] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0850] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0851] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0852] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0853] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0854] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[0855] The following is further disclosed regarding the embodiments described above.

[0856] (Claim 1)

[0857] A means of providing a virtual relaxation environment generated based on the user's individual profile,

[0858] A means of monitoring the user's biometric data in real time within that virtual environment,

[0859] A means of analyzing acquired biometric data and adjusting the virtual environment,

[0860] A system that includes this.

[0861] (Claim 2)

[0862] The system according to claim 1, wherein visual and auditory elements constituting the virtual environment are generated.

[0863] (Claim 3)

[0864] The system according to claim 1, wherein the adjustment means dynamically changes ambient sounds and visual effects based on the results of user emotion analysis.

[0865] "Example 1"

[0866] (Claim 1)

[0867] A device that provides a virtual environment generated based on the user's individual profile,

[0868] A device for monitoring the user's biometric information in real time within the virtual environment,

[0869] A device that analyzes acquired biometric information and adjusts the virtual environment,

[0870] A device that acquires the profile and generates a relaxation scenario using a generated AI model,

[0871] A device that performs emotional analysis based on the biometric information to evaluate the degree of relaxation and adaptively modifies the auditory and visual elements in the environment,

[0872] A system that includes this.

[0873] (Claim 2)

[0874] The system according to claim 1, wherein visual and auditory elements constituting the virtual environment are generated.

[0875] (Claim 3)

[0876] The system according to claim 1, wherein the adjustment device dynamically changes ambient sounds and visual effects based on the results of the user's emotion analysis.

[0877] "Application Example 1"

[0878] (Claim 1)

[0879] A means of providing a virtual relaxation environment generated based on the user's individual profile,

[0880] A means of monitoring the user's biometric data in real time within that virtual environment,

[0881] A means of analyzing acquired biometric data and adjusting the virtual environment,

[0882] A means of dynamically providing visual and acoustic information via smart devices based on biometric data,

[0883] Methods for personalizing relaxation experiences for the elderly,

[0884] A system that includes this.

[0885] (Claim 2)

[0886] The system according to claim 1, wherein visual and auditory elements constituting the virtual environment are generated and dynamically adjusted based on biometric data.

[0887] (Claim 3)

[0888] The system according to claim 1, wherein the adjustment means dynamically changes ambient sounds and visual effects based on the results of user emotion analysis to optimize the relaxation state of the elderly person.

[0889] "Example 2 of combining an emotion engine"

[0890] (Claim 1)

[0891] A means of providing a multi-sensory virtual environment generated based on the user's individual profile,

[0892] A means of monitoring the user's biological state in real time within that virtual environment,

[0893] A means for analyzing acquired biological states and adaptively adjusting the virtual environment,

[0894] A means for detecting the user's emotional state and dynamically generating relaxation scenarios using a generative AI model,

[0895] A means to customize simulation elements that reflect user emotional data,

[0896] A system that includes this.

[0897] (Claim 2)

[0898] The system according to claim 1, wherein the visual and auditory components constituting the virtual environment are automatically generated.

[0899] (Claim 3)

[0900] The system according to claim 1, wherein the adjustment means dynamically changes ambient sounds and visual effects based on the results of user emotion analysis.

[0901] "Application example 2 when combining with an emotional engine"

[0902] (Claim 1)

[0903] A means of providing a virtual relaxation environment generated based on the user's individual profile,

[0904] A means of monitoring the user's biometric and emotional data in real time within that virtual environment,

[0905] A means for analyzing acquired biometric and emotional data and dynamically adjusting the virtual environment,

[0906] A means of presenting the generated relaxation scenario,

[0907] A system that includes this.

[0908] (Claim 2)

[0909] The system according to claim 1, wherein visual and auditory elements constituting a virtual environment are generated, and a different relaxation experience is provided for each user in a care environment.

[0910] (Claim 3)

[0911] The system according to claim 1, wherein the adjustment means dynamically changes ambient sounds and visual effects based on the results of the user's emotion analysis, and automatically constructs a relaxation environment that is suited to the user's state using a generative AI model. [Explanation of symbols]

[0912] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of providing a virtual relaxation environment generated based on the user's individual profile, A means of monitoring the user's biometric data in real time within that virtual environment, A means of analyzing acquired biometric data and adjusting the virtual environment, A means of dynamically providing visual and acoustic information via smart devices based on biometric data, Methods for personalizing relaxation experiences for the elderly, A system that includes this.

2. The system according to claim 1, wherein visual and auditory elements constituting the virtual environment are generated and dynamically adjusted based on biometric data.

3. The system according to claim 1, wherein the adjustment means dynamically changes ambient sounds and visual effects based on the results of the user's emotion analysis to optimize the relaxation state of the elderly person.

Images