system

Abstract

We provide the system. [Solution] A means for the user to input the content of the dream they want, Means for analyzing the user's input and generating the content of the dream, means for converting the generated dream content into electrical signals, and means for transmitting the electrical signals to the user's brain, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Due to the increase in stress and irregular lifestyles in modern society, many people are troubled by nightmares and insomnia. As a result, the quality of sleep is deteriorating, increasing the likelihood of having an adverse impact on physical and mental health. To solve this problem, there is a need for a system that generates the dreams desired by users, reduces nightmares, and promotes comfortable sleep.

Means for Solving the Problems

[0005] This invention provides a system that alleviates nightmares and insomnia problems by allowing users to freely set their desired dreams, analyzing their content, and generating ideal dreams. Specifically, the system includes means for generating dreams by analyzing prompts entered by the user, means for converting the content of the generated dreams into electrical signals, and means for transmitting those electrical signals to the user's brain. With this system, users can sleep peacefully while experiencing their desired dreams, thereby achieving good quality sleep.

[0006] A "user" refers to a person who uses the system to set their desired dreams.

[0007] "Input" refers to the act of a user using a device to send the contents of their dream to the system in text format.

[0008] "Analysis" refers to the process of automatically analyzing prompts sent by users and extracting information to construct a dream storyline.

[0009] "Dream content" refers to information that describes the specific elements and scenes of the dream the user desires.

[0010] "Generation" refers to the process of constructing the user's desired dream based on analyzed data.

[0011] "Converting to electrical signals" refers to the process of transforming the generated dream content into electrical patterns suitable for stimulating specific areas of the brain.

[0012] "Transmission" refers to the act of transmitting a signal through appropriate means in order to deliver the converted electrical signal to the user.

[0013] A "system" refers to a device or collection of devices that comprehensively handles everything from dream generation to the transmission of electrical signals based on user input. [Brief explanation of the drawing]

[0014] [Figure 1]It is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] It is a conceptual diagram showing an example of the main functions of a data processing device and a smart device according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which multiple emotions are mapped. [Figure 10] It shows an emotion map to which multiple emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.

MODE FOR CARRYING OUT THE INVENTION

[0015] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described according to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), etc.

[0018] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0019] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0020] In the following embodiments, the numbered communication I / F (Interface) is an interface including a communication processor and an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark), etc.

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0022] [First Embodiment]

[0023] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0024] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0027] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0030] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0034] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0035] As an embodiment of this invention, a system for obtaining comfortable sleep while having desired dreams is described. This system includes a terminal, a server, and a user electroencephalogram (EEG) interface device.

[0036] First, the user uses a dedicated terminal application to input the details of the dream they want to see. This input can include scenes, characters, and plot developments from the dream. The entered data is received by the terminal and sent to the server in a secure manner.

[0037] The server analyzes the received data using natural language processing technology to understand the user's intentions. Based on the analysis results, it then generates a dream that aligns with the user's wishes. The generated dream storyline is converted into electrical signals and formed into a signal pattern suitable for stimulating the user's brain.

[0038] This electrical signal is sent back to the terminal and then to an EEG interface device worn by the user. The device transmits this signal to specific areas of the brain, allowing the user to experience the dream they desire.

[0039] As a concrete example, consider a user who wishes to dream of "enjoying a hike with friends under a clear blue sky on a mountaintop." The user inputs this into a terminal and sends it to the system. The server generates the dream based on this input, converts the signal, and transmits it via the terminal to the brainwave interface. The user can then experience this pre-set dream and wake up feeling refreshed. Through this process, we offer a new means of addressing nightmares and insomnia in today's stressful society.

[0040] The following describes the processing flow.

[0041] Step 1:

[0042] Users enter the details of their dreams in text format into an input screen of a dedicated application. They can describe specific scenes and desired outcomes of their dreams in detail.

[0043] Step 2:

[0044] The terminal receives the entered user data and securely transmits that data to the server using an encryption protocol.

[0045] Step 3:

[0046] The server analyzes the received data using a natural language processing engine to extract elements of the user's desired dream. An AI algorithm within the server then processes this data to generate a dream storyline.

[0047] Step 4:

[0048] The server converts the dream storyline it generates into a specific electrical signal pattern. This conversion uses an algorithm built on neuroscience theory.

[0049] Step 5:

[0050] The server transmits the converted electrical signal to the terminal. The terminal prepares to transfer this signal to the user's EEG interface device.

[0051] Step 6:

[0052] The device transmits electrical signals to the user's brain via an electroencephalogram (EEG) interface. Based on these signals, the device stimulates the brain to perceive the dreams the user desires.

[0053] Step 7:

[0054] Users can experience pre-set dreams and enjoy a comfortable sleep. This process aims to reduce nightmares and improve sleep quality.

[0055] (Example 1)

[0056] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0057] In today's stressful society, more and more people are suffering from unpleasant dreams and insomnia. Therefore, there is a need for a system that allows users to experience the dreams they desire while enjoying comfortable sleep. However, there are challenges in accurately generating the dreams desired by users and actually allowing them to experience them, particularly in signal generation and conversion, as well as secure and reliable data communication.

[0058] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0059] In this invention, the server includes means for inputting the content of a dream desired by the user, means for analyzing the user's input and generating the dream content, means for converting the generated dream content into electrical signals, and means for transmitting the electrical signals to an electroencephalogram (EEG) interface device via a terminal. This allows the user to enjoy sleep while experiencing the dream of their choice with peace of mind.

[0060] A "user" refers to a person who uses the system to input the content of their desired dream and then experiences it.

[0061] "Input means" refers to a method or device for a user to record the content of their dreams to the system.

[0062] "Analysis method" refers to the method or technique used to understand the content and meaning of a dream that has been input.

[0063] "Generative means" refers to methods or techniques for constructing the content of dreams based on analyzed data.

[0064] "Electrical signals" refer to the electrical representations used to convert the content of dreams into a form that users can experience.

[0065] "Transmission means" refers to a method or device for delivering the generated electrical signals to the user's brain.

[0066] "Terminal" refers to a computer device or apparatus used by a user to input the content of their dreams.

[0067] A "brainwave interface device" refers to a device that transmits electrical signals to the user to allow them to experience dreams.

[0068] This invention is a system for achieving comfortable sleep while experiencing the dreams a user desires. The system consists of three main components: a terminal, a server, and a user's brainwave interface device.

[0069] Users use a device with a dedicated application installed to input the content of their desired dream. The input is in text format, allowing for detailed descriptions of the scenes, characters, and storyline that make up the dream. For example, if a user wants to dream of "enjoying a barbecue with family on the beach," they would input this wish into their device.

[0070] The terminal receives data entered by the user and sends it to the server using a secure protocol. The server analyzes the received data using natural language processing technology managed in the cloud. Specifically, it utilizes a generative AI model to convert the user's input into structured data. Through this analysis, the system understands the specific content of the dream.

[0071] Next, the server moves on to the process of converting the generated dream elements into electrical signals. Here, a signal processor processes the dream content into a form corresponding to the brain, ultimately generating a signal. This signal is then sent back to the terminal using encryption technology.

[0072] Meanwhile, the user wears an electroencephalogram (EEG) interface device. The device interprets the received signals and guides them to specific areas of the user's brain. This allows the user to experience their desired dream. The device also monitors the user's physiological state, providing a safe and comfortable dream experience.

[0073] An example of a prompt message is, "User's desired dream scene: Enjoying a barbecue with family on the beach." In this way, the system reflects individual preferences and supports a comfortable sleep experience.

[0074] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0075] Step 1:

[0076] The user uses their device to input the content of their desired dream into a dedicated application. Specifically, they describe the dream's scenes, characters, and plot in text format. The input data at this stage is natural language text and is temporarily stored on the device. When the user presses the "Submit" button, the input is complete and the data is prepared to proceed to the next step.

[0077] Step 2:

[0078] The terminal sends data entered by the user to the server via a secure protocol (encrypted communication). The input in this step is the user's text data, and the output is securely encrypted data. Once the terminal confirms transmission is complete, it notifies the user that the server has received the information.

[0079] Step 3:

[0080] The server begins analyzing the received text data. Using natural language processing techniques, a generative AI model understands the user's intent and analyzes the specific structure of the dream. This analysis transforms the data into structured information. In this step, encrypted text data is received as input, and structured dream story information is generated as output.

[0081] Step 4:

[0082] The server converts the dream storyline into electrical signals based on the analysis. A signal processor is used to generate the storyline as a specific signal pattern. Here, structured dream information is taken as input, and electrical signals tailored to the user's brain are output. These signals are prepared for use in the next step.

[0083] Step 5:

[0084] The server sends the generated electrical signal back to the terminal. This transmission also uses an encryption protocol to ensure the signal's security. The input is an electrical signal, and the output arrives at the terminal as a securely transmitted signal. The terminal then enters a standby state, ready to transmit the received signal to the electroencephalogram (EEG) interface device.

[0085] Step 6:

[0086] The user wears an electroencephalogram (EEG) interface device. The device appropriately interprets the electrical signals sent back by the terminal and transmits them to the user's brain. The input is electrical signals, and the final output is the user experiencing a dream. As a result, the user can achieve deep sleep while experiencing the desired dream.

[0087] (Application Example 1)

[0088] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0089] While virtual experiences are widespread today, conventional technologies have struggled to satisfy users' desires for more realistic and personalized experiences. In particular, there is a need for technology that enables users to experience their desired experiences not just visually, but sensorily. Therefore, technology capable of realizing more immersive virtual experiences is essential.

[0090] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0091] In this invention, the server includes a device for inputting the content of a virtual experience desired by the user, a device for analyzing the user's input and generating the content of the virtual experience, and a device for converting the generated content of the virtual experience into electrical signals. This makes it possible for the user to experience the desired virtual experience in a more realistic and sensory way.

[0092] A "device for inputting the content of a virtual experience desired by the user" is a device that allows users to input specific experiences or virtual environments they desire in text format and processes that information.

[0093] "The device that analyzes user input and generates the content of the virtual experience" is a system that uses artificial intelligence and natural language processing technology to create a virtual experience based on information entered by the user.

[0094] "The device that converts the content of the generated virtual experience into electrical signals" refers to a device that converts the generated virtual experience into electrical signals in order to transmit it to the brain and nervous system.

[0095] "The device that transmits the electrical signals to the user's nervous system" is a device that directly inputs the converted electrical signals into the user's physiological system, allowing the virtual experience to be physically perceived.

[0096] This invention provides a system that allows users to realistically experience their desired virtual experiences through sight and touch. In one embodiment, the user starts by inputting the content of their desired virtual experience using a dedicated terminal. This terminal is equipped with an interface that allows information to be entered in text format.

[0097] After receiving the input, the server uses a generative AI model to analyze the user's input, extract the necessary elements, and then generate a virtual experience. This generation process utilizes natural language processing technology, shaping the user's intended experience into a concrete digital scene. For example, if a user inputs "I want to experience a vacation on a beach on a southern island," the server will construct a digital experience based on this input, including beach scenery and the sound of waves.

[0098] The generated virtual experience is converted into electrical signals necessary to directly affect the user's nervous system. Specialized conversion software is used for this conversion process. These converted electrical signals are then delivered to the user via an electroencephalogram (EEG) interface, enabling a deeply immersive virtual experience.

[0099] Hardware used includes VR devices and EEG interfaces. This allows users to enjoy a visually and sensory immersive experience. Key software includes Unity, Unreal Engine, and Python libraries and Azure Cognitive Services to ensure reliable natural language processing.

[0100] As an example of a prompt, if a user wants to experience a vacation on a southern island beach, the input would be: "The user wants to experience a vacation on a southern island beach. Based on this, generate a virtual experience that will give the user a sense of relaxation." Based on this prompt, the server will perform the process of generating the virtual experience.

[0101] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0102] Step 1:

[0103] The user uses a dedicated terminal to input specific details about the virtual experience. The entered data is temporarily stored on the terminal. In this step, an example prompt statement such as "I want to experience a vacation on a beach on a southern island" is entered, and this data is securely transferred to the next processing step.

[0104] Step 2:

[0105] The terminal sends the entered prompt text to the server. The server analyzes the received data. Using the prompt text received from the terminal as input, it applies a generative AI model to perform natural language processing and generates structured data of the user's desired experience. The output is the resulting dream scenario data.

[0106] Step 3:

[0107] The server designs the virtual experience based on the generated scenario data. Specifically, it uses development environments such as Unity to generate digital content to reproduce visual, auditory, and haptic feedback. In this step, each element is programmed, and processing is carried out to provide the user with a rich experience.

[0108] Step 4:

[0109] The process involves converting the generated virtual experience into electrical signals. The server analyzes the digital content and converts it into electrical signals that can be transmitted to the brain and nervous system. The input is the digital content, and the output is the converted electrical signal.

[0110] Step 5:

[0111] The device transmits the converted electrical signals to the user's EEG interface. The EEG interface uses these electrical signals to transmit them to the user's nervous system, providing them as a real virtual experience. By receiving these signals, the user can sensorially experience the desired experience.

[0112] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0113] This invention combines a system that enables users to have desired dreams and achieve comfortable sleep with an emotion engine that recognizes the user's emotions and reflects them in the content of the dreams. The system comprises a terminal, a server, an emotion engine, and an electroencephalogram (EEG) interface device.

[0114] First, the user uses a dedicated application on their device to input the content of the dream they want to have. Next, the user wears a biosensor device that detects emotions, which allows the emotion engine to recognize the user's current emotional state. The emotion engine analyzes the user's emotions based on this data and sends it to the server.

[0115] The server generates dreams by incorporating not only the dream prompts entered by the user, but also emotional data obtained from the emotion engine. Specifically, it uses natural language processing to analyze the prompts and constructs a storyline that incorporates the emotional data as feedback. The generated dream story is converted into electrical signals and transmitted in a format suitable for the user's brainwave interface.

[0116] For example, if a user wants to dream of "relaxing and meditating in a favorite landscape," and the emotion engine detects the user's stress, the server will generate a dream that further emphasizes the relaxing environment. This provides a dream optimized for the user's current emotions, leading to mental and physical refreshment and restful sleep.

[0117] Through this system, users can not only have the dreams they desire, but also experience dreams that best match their emotional state at the time, thereby achieving a higher level of mental well-being and health.

[0118] The following describes the processing flow.

[0119] Step 1:

[0120] The user launches a dedicated terminal application and enters the content of the dream they want to have. They describe specific scenes, situations, characters, and other details.

[0121] Step 2:

[0122] The user wears biosensors, and the emotion engine collects biometric data such as the user's pulse and skin electrical responses. This data is then used by the emotion engine to analyze the user's current emotional state.

[0123] Step 3:

[0124] The device sends the user's dream content and emotional data obtained from the emotion engine to the server. The data is encrypted to protect privacy.

[0125] Step 4:

[0126] The server analyzes the received data using a natural language processing engine to generate a dream storyline. It also considers emotional data and adjusts the dream according to the user's emotional state.

[0127] Step 5:

[0128] The server generates a dream story, which is then converted into electrical signals to be sent to an EEG interface device. This conversion uses an algorithm that optimizes neural stimulation.

[0129] Step 6:

[0130] The terminal receives electrical signals from the server and prepares to transfer them to the EEG interface device worn by the user.

[0131] Step 7:

[0132] The device transmits signals to an electroencephalogram (EEG) interface device, which then transmits these signals to the brain, allowing the user to experience the dream they desire.

[0133] Step 8:

[0134] Users can experience dreams tuned through an emotional engine, resulting in an overall feeling of refreshment and the benefits of restful sleep upon waking.

[0135] (Example 2)

[0136] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0137] In modern society, many people have difficulty getting restful sleep due to stress and anxiety. To solve this problem, there is a need for a system that allows users to have the dreams they desire and get restful sleep. However, conventional methods have not been able to reflect the user's emotional state in the content of their dreams, making it difficult to generate dreams that match the user's emotions.

[0138] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0139] In this invention, the server includes a device for inputting dream information desired by the user, a device for detecting the user's emotional state, and a device for analyzing the user's input and emotional state to generate dream information. This makes it possible to generate dreams optimized for the user's emotions and provide the user with a comfortable sleep experience.

[0140] A "device for inputting dream information desired by the user" refers to a terminal or software that has the function of allowing the user to input the specific content of the dream they want to see.

[0141] A "device for detecting a user's emotional state" refers to a sensor or analysis engine that acquires a user's biometric data and uses that data to determine their emotional state.

[0142] A "device that analyzes user input and emotional state to generate dream information" is a system that possesses data analysis and generation technology to generate dream scenarios and content based on information and emotional data entered by the user.

[0143] A "device that converts to signals" is a device that converts the generated dream information into an electrical signal format.

[0144] A "device that transmits signals to the user's brain" is a device that transmits electrical signals to the user's brain to convey the experience of dreams.

[0145] This invention is a system aimed at helping users achieve comfortable sleep by generating dreams that the user desires. The system consists of a device for inputting dream content, a device for detecting the user's emotional state, and a server that generates dreams using a generation AI model.

[0146] The user enters a dream prompt via the terminal. This prompt text represents the content of the dream the user desires, written in natural language. For example, a prompt text might be, "A dream of peacefully meditating in front of a beautiful waterfall."

[0147] Next, the user wears a biosensor to detect their emotional state. This sensor can acquire biometric data such as skin electrical activity and pulse rate in real time. The device sends this data to an emotion engine, which then analyzes the user's emotional state in detail.

[0148] The server receives prompt text from the user and emotion data from the emotion engine. The generative AI model generates dream content based on this information. This process utilizes natural language processing and machine learning to create dreams optimized for the user's current emotional state.

[0149] Finally, the generated dream information is converted into signals and transmitted via the user's brainwave interface. This process allows the user to experience their desired dreams, enjoy mental and physical refreshment, and achieve restful sleep. This system enables users to experience dreams tailored to their emotions, providing a sense of mental well-being.

[0150] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0151] Step 1:

[0152] The user uses a terminal to input a dream prompt. The input is a desired dream scenario expressed in natural language. This prompt is stored as digital data on the terminal and prepared for transmission to the server.

[0153] Step 2:

[0154] The user wears a biosensor, and the device acquires biometric data from this sensor in real time. The input data includes pulse rate and skin electrical activity, and this data is sent to an emotion engine. The emotion engine analyzes the acquired biometric data to recognize the user's current emotional state and sends the analysis results to a server.

[0155] Step 3:

[0156] The server receives prompt text sent by the user and emotion data obtained from the emotion engine. Based on this data, it generates dream content using a generative AI model. Specifically, it uses natural language processing techniques to analyze the prompt text and combines it with emotion data to create a personalized dream scenario. This output is stored as structured data.

[0157] Step 4:

[0158] The server performs a process of converting the generated dream scenario into electrical signals. This operation uses an algorithm that converts digital information into electrical signals in a format that can be recognized by an EEG interface device. The converted data is then transmitted to the user's EEG interface device.

[0159] Step 5:

[0160] The user's brainwave interface device receives electrical signals transmitted from a server and uses them to directly send dream images to the user's brain. Specifically, by decoding the signals and stimulating brainwaves related to vision and other senses, the user can experience the dream they desire.

[0161] (Application Example 2)

[0162] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0163] Conventional dream generation systems can only generate static dreams based solely on user input, making it difficult to provide a flexible dream experience that responds to the user's emotional state. Furthermore, there is a lack of means to optimize dream content based on the user's emotions, making it difficult to contribute to improving the user's mental health.

[0164] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0165] In this invention, the server includes means for inputting the content of a dream desired by the user, means for analyzing the user's input and generating the dream content, means for optimizing the generated dream content based on the user's emotional state, and means for acquiring emotional data via a biosensor that detects the emotional state. This makes it possible to provide a dynamically optimized dream according to the user's emotional state, thereby improving the user experience and supporting mental health.

[0166] A "user" is an individual who uses the system to input dream content and obtain a dream experience based on their emotions.

[0167] The "means for inputting dream content" refer to an interface that allows users to communicate the specific content and scenario of their desired dream to the system.

[0168] "Analysis" is the process of deriving meaning and patterns from input data and information, and using that to generate appropriate dream content.

[0169] "Generation" refers to the act of creating a specific storyline and content of a dream based on user input and emotional data.

[0170] "Optimization" is the process of adjusting dream content according to the user's emotional state to provide a more appropriate and comfortable dream experience.

[0171] "Emotional state" refers to the user's feelings, mood, and mental state at a given time, and is captured as emotional data by the system.

[0172] A "biosensor" is a device that senses a user's physical and physiological state and understands their emotional state.

[0173] "Converting to electrical signals" is the process of changing the content of the generated dream into a form that can be transmitted to the nervous system.

[0174] The "nervous system" refers to the central and peripheral nerve tissues in the human body that are responsible for transmitting information.

[0175] The system of this invention provides a series of processes for realizing the content of a user's desired dream. First, the user inputs the content of their desired dream using a dedicated application installed on their mobile device. The input prompts are initially analyzed by the device and sent to the server.

[0176] The server receives data from biosensors to recognize the user's emotional state in real time. This emotional data is analyzed using a deep learning model to understand the user's emotional state. Machine learning frameworks such as TENSORFLOW® are utilized in this process.

[0177] Based on the analyzed emotional data and user-inputted prompts, the server uses a generative AI model to generate a dream storyline optimized for the user. Using the OpenAI® API, a comfortable dream experience is constructed that responds to the user's emotional state. This generated storyline is then converted into electrical signals and prepared for transmission to a neural interface.

[0178] For example, if a user inputs "I want to relax" and a biosensor detects the user's stress level, the server will generate a dream with relaxing content to reduce stress. The following prompt is input to the generation AI model.

[0179] "If a user's emotional state indicates stress, recommend relaxing music or videos."

[0180] This system allows users to experience dreams optimized to their emotional state, enabling them to enjoy restful sleep.

[0181] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0182] Step 1:

[0183] The user launches the application on their device and enters the content of their desired dream as a prompt. The entered prompt is formatted into text data by the application for initial analysis and sent to the server.

[0184] Step 2:

[0185] The server receives and analyzes prompts sent by the user. Using natural language processing techniques, it analyzes the prompts and forms a dataset to build the foundation for the dream storyline. At this point, the output is a diverse set of candidate storylines.

[0186] Step 3:

[0187] Simultaneously, the user wears biosensors that record their current emotional state in real time. The biosensors collect physiological data such as heart rate and skin temperature and send it to the emotion engine as emotional data. The emotion engine performs emotional analysis based on this physiological data, quantifies the user's emotional state, and returns it to the server.

[0188] Step 4:

[0189] The server combines the analyzed prompts with emotional data obtained from the emotion engine and uses a generative AI model to generate an optimized dream storyline. Specifically, it uses the emotional data as feedback to adjust and enhance the prompt's storyline. In this process, the AI ​​model evaluates multiple story candidates and selects the one that best suits the emotional state.

[0190] Step 5:

[0191] The final selected dream storyline is prepared to be converted into electrical signals. This process is necessary to convert the digital story into a format that can be transmitted to the nervous system. The electrical signals are transmitted to the user's nervous system via the user's neural interface, initiating the dream as an experience.

[0192] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0193] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0194] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0195] [Second Embodiment]

[0196] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0197] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0198] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0199] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0200] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0201] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0202] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0203] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0204] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0205] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0206] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0207] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0208] As an embodiment of this invention, a system for obtaining comfortable sleep while having desired dreams is described. This system includes a terminal, a server, and a user electroencephalogram (EEG) interface device.

[0209] First, the user uses a dedicated terminal application to input the details of the dream they want to see. This input can include scenes, characters, and plot developments from the dream. The entered data is received by the terminal and sent to the server in a secure manner.

[0210] The server analyzes the received data using natural language processing technology to understand the user's intentions. Based on the analysis results, it then generates a dream that aligns with the user's wishes. The generated dream storyline is converted into electrical signals and formed into a signal pattern suitable for stimulating the user's brain.

[0211] This electrical signal is sent back to the terminal and then to an EEG interface device worn by the user. The device transmits this signal to specific areas of the brain, allowing the user to experience the dream they desire.

[0212] As a concrete example, consider a user who wishes to dream of "enjoying a hike with friends under a clear blue sky on a mountaintop." The user inputs this into a terminal and sends it to the system. The server generates the dream based on this input, converts the signal, and transmits it via the terminal to the brainwave interface. The user can then experience this pre-set dream and wake up feeling refreshed. Through this process, we offer a new means of addressing nightmares and insomnia in today's stressful society.

[0213] The following describes the processing flow.

[0214] Step 1:

[0215] Users enter the details of their dreams in text format into an input screen of a dedicated application. They can describe specific scenes and desired outcomes of their dreams in detail.

[0216] Step 2:

[0217] The terminal receives the entered user data and securely transmits that data to the server using an encryption protocol.

[0218] Step 3:

[0219] The server analyzes the received data using a natural language processing engine to extract elements of the user's desired dream. An AI algorithm within the server then processes this data to generate a dream storyline.

[0220] Step 4:

[0221] The server converts the dream storyline it generates into a specific electrical signal pattern. This conversion uses an algorithm built on neuroscience theory.

[0222] Step 5:

[0223] The server transmits the converted electrical signal to the terminal. The terminal prepares to transfer this signal to the user's EEG interface device.

[0224] Step 6:

[0225] The device transmits electrical signals to the user's brain via an electroencephalogram (EEG) interface. Based on these signals, the device stimulates the brain to perceive the dreams the user desires.

[0226] Step 7:

[0227] Users can experience pre-set dreams and enjoy a comfortable sleep. This process aims to reduce nightmares and improve sleep quality.

[0228] (Example 1)

[0229] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0230] In today's stressful society, more and more people are suffering from unpleasant dreams and insomnia. Therefore, there is a need for a system that allows users to experience the dreams they desire while enjoying comfortable sleep. However, there are challenges in accurately generating the dreams desired by users and actually allowing them to experience them, particularly in signal generation and conversion, as well as secure and reliable data communication.

[0231] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0232] In this invention, the server includes means for inputting the content of a dream desired by the user, means for analyzing the user's input and generating the dream content, means for converting the generated dream content into electrical signals, and means for transmitting the electrical signals to an electroencephalogram (EEG) interface device via a terminal. This allows the user to enjoy sleep while experiencing the dream of their choice with peace of mind.

[0233] A "user" refers to a person who uses the system to input the content of their desired dream and then experiences it.

[0234] "Input means" refers to a method or device for a user to record the content of their dreams to the system.

[0235] "Analysis method" refers to the method or technique used to understand the content and meaning of a dream that has been input.

[0236] "Generative means" refers to methods or techniques for constructing the content of dreams based on analyzed data.

[0237] "Electrical signals" refer to the electrical representations used to convert the content of dreams into a form that users can experience.

[0238] "Transmission means" refers to a method or device for delivering the generated electrical signals to the user's brain.

[0239] "Terminal" refers to a computer device or apparatus used by a user to input the content of their dreams.

[0240] A "brainwave interface device" refers to a device that transmits electrical signals to the user to allow them to experience dreams.

[0241] This invention is a system for achieving comfortable sleep while experiencing the dreams a user desires. The system consists of three main components: a terminal, a server, and a user's brainwave interface device.

[0242] Users use a device with a dedicated application installed to input the content of their desired dream. The input is in text format, allowing for detailed descriptions of the scenes, characters, and storyline that make up the dream. For example, if a user wants to dream of "enjoying a barbecue with family on the beach," they would input this wish into their device.

[0243] The terminal receives data entered by the user and sends it to the server using a secure protocol. The server analyzes the received data using natural language processing technology managed in the cloud. Specifically, it utilizes a generative AI model to convert the user's input into structured data. Through this analysis, the system understands the specific content of the dream.

[0244] Next, the server moves on to the process of converting the generated dream elements into electrical signals. Here, a signal processor processes the dream content into a form corresponding to the brain, ultimately generating a signal. This signal is then sent back to the terminal using encryption technology.

[0245] Meanwhile, the user wears an electroencephalogram (EEG) interface device. The device interprets the received signals and guides them to specific areas of the user's brain. This allows the user to experience their desired dream. The device also monitors the user's physiological state, providing a safe and comfortable dream experience.

[0246] An example of a prompt message is, "User's desired dream scene: Enjoying a barbecue with family on the beach." In this way, the system reflects individual preferences and supports a comfortable sleep experience.

[0247] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0248] Step 1:

[0249] The user uses their device to input the content of their desired dream into a dedicated application. Specifically, they describe the dream's scenes, characters, and plot in text format. The input data at this stage is natural language text and is temporarily stored on the device. When the user presses the "Submit" button, the input is complete and the data is prepared to proceed to the next step.

[0250] Step 2:

[0251] The terminal sends data entered by the user to the server via a secure protocol (encrypted communication). The input in this step is the user's text data, and the output is securely encrypted data. Once the terminal confirms transmission is complete, it notifies the user that the server has received the information.

[0252] Step 3:

[0253] The server begins analyzing the received text data. Using natural language processing techniques, a generative AI model understands the user's intent and analyzes the specific structure of the dream. This analysis transforms the data into structured information. In this step, encrypted text data is received as input, and structured dream story information is generated as output.

[0254] Step 4:

[0255] The server converts the dream storyline into electrical signals based on the analysis. A signal processor is used to generate the storyline as a specific signal pattern. Here, structured dream information is taken as input, and electrical signals tailored to the user's brain are output. These signals are prepared for use in the next step.

[0256] Step 5:

[0257] The server sends the generated electrical signal back to the terminal. This transmission also uses an encryption protocol to ensure the signal's security. The input is an electrical signal, and the output arrives at the terminal as a securely transmitted signal. The terminal then enters a standby state, ready to transmit the received signal to the electroencephalogram (EEG) interface device.

[0258] Step 6:

[0259] The user wears an electroencephalogram (EEG) interface device. The device appropriately interprets the electrical signals sent back by the terminal and transmits them to the user's brain. The input is electrical signals, and the final output is the user experiencing a dream. As a result, the user can achieve deep sleep while experiencing the desired dream.

[0260] (Application Example 1)

[0261] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0262] While virtual experiences are widespread today, conventional technologies have struggled to satisfy users' desires for more realistic and personalized experiences. In particular, there is a need for technology that enables users to experience their desired experiences not just visually, but sensorily. Therefore, technology capable of realizing more immersive virtual experiences is essential.

[0263] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0264] In this invention, the server includes a device for inputting the content of a virtual experience desired by the user, a device for analyzing the user's input and generating the content of the virtual experience, and a device for converting the generated content of the virtual experience into electrical signals. This makes it possible for the user to experience the desired virtual experience in a more realistic and sensory way.

[0265] A "device for inputting the content of a virtual experience desired by the user" is a device that allows users to input specific experiences or virtual environments they desire in text format and processes that information.

[0266] "The device that analyzes user input and generates the content of the virtual experience" is a system that uses artificial intelligence and natural language processing technology to create a virtual experience based on information entered by the user.

[0267] "The device that converts the content of the generated virtual experience into electrical signals" refers to a device that converts the generated virtual experience into electrical signals in order to transmit it to the brain and nervous system.

[0268] "The device that transmits the electrical signals to the user's nervous system" is a device that directly inputs the converted electrical signals into the user's physiological system, allowing the virtual experience to be physically perceived.

[0269] This invention provides a system that allows users to realistically experience their desired virtual experiences through sight and touch. In one embodiment, the user starts by inputting the content of their desired virtual experience using a dedicated terminal. This terminal is equipped with an interface that allows information to be entered in text format.

[0270] After receiving the input, the server uses a generative AI model to analyze the user's input, extract the necessary elements, and then generate a virtual experience. This generation process utilizes natural language processing technology, shaping the user's intended experience into a concrete digital scene. For example, if a user inputs "I want to experience a vacation on a beach on a southern island," the server will construct a digital experience based on this input, including beach scenery and the sound of waves.

[0271] The generated virtual experience is converted into electrical signals necessary to directly affect the user's nervous system. Specialized conversion software is used for this conversion process. These converted electrical signals are then delivered to the user via an electroencephalogram (EEG) interface, enabling a deeply immersive virtual experience.

[0272] The hardware used includes VR devices and EEG interfaces. This allows users to enjoy a visually and sensory immersive experience. Key software includes Unity and Unreal Engine, as well as Python libraries and Azure Cognitive Services to ensure reliable natural language processing.

[0273] As an example of a prompt, if a user wants to experience a vacation on a southern island beach, the input would be: "The user wants to experience a vacation on a southern island beach. Based on this, generate a virtual experience that will give the user a sense of relaxation." Based on this prompt, the server will perform the process of generating the virtual experience.

[0274] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0275] Step 1:

[0276] The user uses a dedicated terminal to specifically input the content of the virtual experience. The input data is temporarily stored in the terminal. In this step, for example, the prompt sentence "I want to experience a vacation on a beach on a southern island" is input, and the data is securely transferred to the next processing step.

[0277] Step 2:

[0278] The terminal sends the input prompt sentence to the server. The server analyzes the received data. Using the prompt sentence received from the terminal as input, the generation AI model is applied to perform natural language processing and generate structured data of the experience desired by the user. The output is the resulting dream scenario data.

[0279] Step 3:

[0280] The server designs a virtual experience based on the generated scenario data. As a specific operation, using a development environment such as Unity, digital content for reproducing visual, audio, and tactile feedback is generated. In this step, each element is programmed and processing is performed to provide a rich experience to the user.

[0281] Step 4:

[0282] The work of converting the generated virtual experience into an electrical signal is advanced. The server analyzes the digital content and executes a process of converting it into an electrical signal that can be transmitted to the brain and nervous system. The input is the digital content, and the output is the converted electrical signal.

[0283] Step 5:

[0284] The terminal sends the converted electrical signal to the user's brainwave interface. The brainwave interface uses this electrical signal to transmit it to the user's nervous system and provide it as an actual virtual experience. By receiving this signal, the user can sensually experience the desired experience.

[0285] Furthermore, an emotion engine for estimating the user's emotions may be combined. That is, the specific processing unit 290 may estimate the user's emotions using the emotion identification model 59 and perform specific processing using the user's emotions.

[0286] This invention combines an emotion engine that recognizes the user's emotions and reflects them in the content of the dream in a system that enables the user to have a comfortable sleep by dreaming the dreams they desire. The system is composed of a terminal, a server, an emotion engine, and an electroencephalogram interface device.

[0287] First, the user uses a dedicated application on the terminal to input the content of the dream they want to see. Next, the user wears a device of a biosensor that detects emotions, and thereby the current emotional state of the user is recognized by the emotion engine. The emotion engine analyzes the user's emotions based on these data and transmits them to the server.

[0288] The server generates a dream including the emotional data obtained from the emotion engine in addition to the dream prompt input by the user. Specifically, it analyzes the prompt using natural language processing and constructs a story line incorporating the emotional data as feedback. The generated dream story is converted into an electrical signal and transmitted in a form suitable for the user's electroencephalogram interface.

[0289] For example, if the user wants to see a dream of "meditating while relaxing in a favorite scenery" and the emotion engine detects the user's stress, the server generates a dream that further emphasizes a relaxing environment. As a result, a dream optimized for the emotions the user is currently experiencing can be provided, bringing mental refreshment and comfortable sleep.

[0290] Through this system, the user can not only simply dream the dreams they desire, but also experience dreams that are most suitable for their emotional state at that time, thereby obtaining a higher level of mental comfort and health.

[0291] The following describes the processing flow.

[0292] Step 1:

[0293] The user launches a dedicated terminal application and enters the content of the dream they want to have. They describe specific scenes, situations, characters, and other details.

[0294] Step 2:

[0295] The user wears biosensors, and the emotion engine collects biometric data such as the user's pulse and skin electrical responses. This data is then used by the emotion engine to analyze the user's current emotional state.

[0296] Step 3:

[0297] The device sends the user's dream content and emotional data obtained from the emotion engine to the server. The data is encrypted to protect privacy.

[0298] Step 4:

[0299] The server analyzes the received data using a natural language processing engine to generate a dream storyline. It also considers emotional data and adjusts the dream according to the user's emotional state.

[0300] Step 5:

[0301] The server generates a dream story, which is then converted into electrical signals to be sent to an EEG interface device. This conversion uses an algorithm that optimizes neural stimulation.

[0302] Step 6:

[0303] The terminal receives electrical signals from the server and prepares to transfer them to the EEG interface device worn by the user.

[0304] Step 7:

[0305] The terminal transmits a signal to the electroencephalogram interface device, and the device transmits this signal to the brain, enabling the user to experience the desired dream.

[0306] Step 8:

[0307] The user experiences the dream adjusted through the emotion engine and can obtain an overall refreshing feeling and the effect of comfortable sleep when waking up.

[0308] (Example 2)

[0309] Next, Example 2 will be described. In the following description, the data processing device 12 is referred to as a "server", and the smart glasses 214 are referred to as a "terminal".

[0310] In modern society, many people have difficulty obtaining comfortable sleep due to stress and anxiety. To solve this problem, a system that allows users to take comfortable sleep by dreaming the desired dream is required. However, in the conventional method, it is impossible to reflect the user's emotional state in the dream content, and it is difficult to generate a dream that suits the user's emotions.

[0311] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0312] In this invention, the server includes a device for inputting information about the dream desired by the user, a device for detecting the user's emotional state, and a device for analyzing the user's input and emotional state and generating dream information. Thereby, it becomes possible to generate a dream optimized for the user's emotions and provide the user with a comfortable sleep experience.

[0313] The "device for inputting information about the dream desired by the user" is a terminal or software having a function for specifically inputting the content of the dream the user wants to see.

[0314] A "device for detecting a user's emotional state" refers to a sensor or analysis engine that acquires a user's biometric data and uses that data to determine their emotional state.

[0315] A "device that analyzes user input and emotional state to generate dream information" is a system that possesses data analysis and generation technology to generate dream scenarios and content based on information and emotional data entered by the user.

[0316] A "device that converts to signals" is a device that converts the generated dream information into an electrical signal format.

[0317] A "device that transmits signals to the user's brain" is a device that transmits electrical signals to the user's brain to convey the experience of dreams.

[0318] This invention is a system aimed at helping users achieve comfortable sleep by generating dreams that the user desires. The system consists of a device for inputting dream content, a device for detecting the user's emotional state, and a server that generates dreams using a generation AI model.

[0319] The user enters a dream prompt via the terminal. This prompt text represents the content of the dream the user desires, written in natural language. For example, a prompt text might be, "A dream of peacefully meditating in front of a beautiful waterfall."

[0320] Next, the user wears a biosensor to detect their emotional state. This sensor can acquire biometric data such as skin electrical activity and pulse rate in real time. The device sends this data to an emotion engine, which then analyzes the user's emotional state in detail.

[0321] The server receives prompt text from the user and emotion data from the emotion engine. The generative AI model generates dream content based on this information. This process utilizes natural language processing and machine learning to create dreams optimized for the user's current emotional state.

[0322] Finally, the generated dream information is converted into signals and transmitted via the user's brainwave interface. This process allows the user to experience their desired dreams, enjoy mental and physical refreshment, and achieve restful sleep. This system enables users to experience dreams tailored to their emotions, providing a sense of mental well-being.

[0323] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0324] Step 1:

[0325] The user uses a terminal to input a dream prompt. The input is a desired dream scenario expressed in natural language. This prompt is stored as digital data on the terminal and prepared for transmission to the server.

[0326] Step 2:

[0327] The user wears a biosensor, and the device acquires biometric data from this sensor in real time. The input data includes pulse rate and skin electrical activity, and this data is sent to an emotion engine. The emotion engine analyzes the acquired biometric data to recognize the user's current emotional state and sends the analysis results to a server.

[0328] Step 3:

[0329] The server receives prompt text sent by the user and emotion data obtained from the emotion engine. Based on this data, it generates dream content using a generative AI model. Specifically, it uses natural language processing techniques to analyze the prompt text and combines it with emotion data to create a personalized dream scenario. This output is stored as structured data.

[0330] Step 4:

[0331] The server performs a process of converting the generated dream scenario into electrical signals. This operation uses an algorithm that converts digital information into electrical signals in a format that can be recognized by an EEG interface device. The converted data is then transmitted to the user's EEG interface device.

[0332] Step 5:

[0333] The user's brainwave interface device receives electrical signals transmitted from a server and uses them to directly send dream images to the user's brain. Specifically, by decoding the signals and stimulating brainwaves related to vision and other senses, the user can experience the dream they desire.

[0334] (Application Example 2)

[0335] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0336] Conventional dream generation systems can only generate static dreams based solely on user input, making it difficult to provide a flexible dream experience that responds to the user's emotional state. Furthermore, there is a lack of means to optimize dream content based on the user's emotions, making it difficult to contribute to improving the user's mental health.

[0337] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0338] In this invention, the server includes means for inputting the content of a dream desired by the user, means for analyzing the user's input and generating the dream content, means for optimizing the generated dream content based on the user's emotional state, and means for acquiring emotional data via a biosensor that detects the emotional state. This makes it possible to provide a dynamically optimized dream according to the user's emotional state, thereby improving the user experience and supporting mental health.

[0339] A "user" is an individual who uses the system to input dream content and obtain a dream experience based on their emotions.

[0340] The "means for inputting dream content" refer to an interface that allows users to communicate the specific content and scenario of their desired dream to the system.

[0341] "Analysis" is the process of deriving meaning and patterns from input data and information, and using that to generate appropriate dream content.

[0342] "Generation" refers to the act of creating a specific storyline and content of a dream based on user input and emotional data.

[0343] "Optimization" is the process of adjusting dream content according to the user's emotional state to provide a more appropriate and comfortable dream experience.

[0344] "Emotional state" refers to the user's feelings, mood, and mental state at a given time, and is captured as emotional data by the system.

[0345] A "biosensor" is a device that senses a user's physical and physiological state and understands their emotional state.

[0346] "Converting to electrical signals" is the process of changing the content of the generated dream into a form that can be transmitted to the nervous system.

[0347] The "nervous system" refers to the central and peripheral nerve tissues in the human body that are responsible for transmitting information.

[0348] The system of this invention provides a series of processes for realizing the content of a user's desired dream. First, the user inputs the content of their desired dream using a dedicated application installed on their mobile device. The input prompts are initially analyzed by the device and sent to the server.

[0349] The server receives data from biosensors to recognize the user's emotional state in real time. This emotional data is analyzed using a deep learning model to understand the user's emotional state. Machine learning frameworks such as TensorFlow are utilized in this process.

[0350] Based on the analyzed emotional data and user-inputted prompts, the server uses a generative AI model to generate a dream storyline optimized for the user. Using the OpenAI API, it constructs a comfortable dream experience tailored to the user's emotional state. This generated storyline is then converted into electrical signals and prepared for transmission to a neural interface.

[0351] For example, if a user inputs "I want to relax" and a biosensor detects the user's stress level, the server will generate a dream with relaxing content to reduce stress. The following prompt is input to the generation AI model.

[0352] "If a user's emotional state indicates stress, recommend relaxing music or videos."

[0353] This system allows users to experience dreams optimized to their emotional state, enabling them to enjoy restful sleep.

[0354] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0355] Step 1:

[0356] The user launches the application on their device and enters the content of their desired dream as a prompt. The entered prompt is formatted into text data by the application for initial analysis and sent to the server.

[0357] Step 2:

[0358] The server receives and analyzes prompts sent by the user. Using natural language processing techniques, it analyzes the prompts and forms a dataset to build the foundation for the dream storyline. At this point, the output is a diverse set of candidate storylines.

[0359] Step 3:

[0360] Simultaneously, the user wears biosensors that record their current emotional state in real time. The biosensors collect physiological data such as heart rate and skin temperature and send it to the emotion engine as emotional data. The emotion engine performs emotional analysis based on this physiological data, quantifies the user's emotional state, and returns it to the server.

[0361] Step 4:

[0362] The server combines the analyzed prompts with emotional data obtained from the emotion engine and uses a generative AI model to generate an optimized dream storyline. Specifically, it uses the emotional data as feedback to adjust and enhance the prompt's storyline. In this process, the AI ​​model evaluates multiple story candidates and selects the one that best suits the emotional state.

[0363] Step 5:

[0364] The final selected dream storyline is prepared to be converted into electrical signals. This process is necessary to convert the digital story into a format that can be transmitted to the nervous system. The electrical signals are transmitted to the user's nervous system via the user's neural interface, initiating the dream as an experience.

[0365] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0366] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0367] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0368] [Third Embodiment]

[0369] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0370] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0371] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0372] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0373] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0374] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0375] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0376] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0377] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0378] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0379] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0380] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0381] As an embodiment of this invention, a system for obtaining comfortable sleep while having desired dreams is described. This system includes a terminal, a server, and a user electroencephalogram (EEG) interface device.

[0382] First, the user uses a dedicated terminal application to input the details of the dream they want to see. This input can include scenes, characters, and plot developments from the dream. The entered data is received by the terminal and sent to the server in a secure manner.

[0383] The server analyzes the received data using natural language processing technology to understand the user's intentions. Based on the analysis results, it then generates a dream that aligns with the user's wishes. The generated dream storyline is converted into electrical signals and formed into a signal pattern suitable for stimulating the user's brain.

[0384] This electrical signal is sent back to the terminal and then to an EEG interface device worn by the user. The device transmits this signal to specific areas of the brain, allowing the user to experience the dream they desire.

[0385] As a concrete example, consider a user who wishes to dream of "enjoying a hike with friends under a clear blue sky on a mountaintop." The user inputs this into a terminal and sends it to the system. The server generates the dream based on this input, converts the signal, and transmits it via the terminal to the brainwave interface. The user can then experience this pre-set dream and wake up feeling refreshed. Through this process, we offer a new means of addressing nightmares and insomnia in today's stressful society.

[0386] The following describes the processing flow.

[0387] Step 1:

[0388] Users enter the details of their dreams in text format into an input screen of a dedicated application. They can describe specific scenes and desired outcomes of their dreams in detail.

[0389] Step 2:

[0390] The terminal receives the entered user data and securely transmits that data to the server using an encryption protocol.

[0391] Step 3:

[0392] The server analyzes the received data using a natural language processing engine to extract elements of the user's desired dream. An AI algorithm within the server then processes this data to generate a dream storyline.

[0393] Step 4:

[0394] The server converts the dream storyline it generates into a specific electrical signal pattern. This conversion uses an algorithm built on neuroscience theory.

[0395] Step 5:

[0396] The server transmits the converted electrical signal to the terminal. The terminal prepares to transfer this signal to the user's EEG interface device.

[0397] Step 6:

[0398] The device transmits electrical signals to the user's brain via an electroencephalogram (EEG) interface. Based on these signals, the device stimulates the brain to perceive the dreams the user desires.

[0399] Step 7:

[0400] Users can experience pre-set dreams and enjoy a comfortable sleep. This process aims to reduce nightmares and improve sleep quality.

[0401] (Example 1)

[0402] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0403] In today's stressful society, more and more people are suffering from unpleasant dreams and insomnia. Therefore, there is a need for a system that allows users to experience the dreams they desire while enjoying comfortable sleep. However, there are challenges in accurately generating the dreams desired by users and actually allowing them to experience them, particularly in signal generation and conversion, as well as secure and reliable data communication.

[0404] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0405] In this invention, the server includes means for inputting the content of a dream desired by the user, means for analyzing the user's input and generating the dream content, means for converting the generated dream content into electrical signals, and means for transmitting the electrical signals to an electroencephalogram (EEG) interface device via a terminal. This allows the user to enjoy sleep while experiencing the dream of their choice with peace of mind.

[0406] A "user" refers to a person who uses the system to input the content of their desired dream and then experiences it.

[0407] "Input means" refers to a method or device for a user to record the content of their dreams to the system.

[0408] "Analysis method" refers to the method or technique used to understand the content and meaning of a dream that has been input.

[0409] "Generative means" refers to methods or techniques for constructing the content of dreams based on analyzed data.

[0410] "Electrical signals" refer to the electrical representations used to convert the content of dreams into a form that users can experience.

[0411] "Transmission means" refers to a method or device for delivering the generated electrical signals to the user's brain.

[0412] "Terminal" refers to a computer device or apparatus used by a user to input the content of their dreams.

[0413] A "brainwave interface device" refers to a device that transmits electrical signals to the user to allow them to experience dreams.

[0414] This invention is a system for achieving comfortable sleep while experiencing the dreams a user desires. The system consists of three main components: a terminal, a server, and a user's brainwave interface device.

[0415] Users use a device with a dedicated application installed to input the content of their desired dream. The input is in text format, allowing for detailed descriptions of the scenes, characters, and storyline that make up the dream. For example, if a user wants to dream of "enjoying a barbecue with family on the beach," they would input this wish into their device.

[0416] The terminal receives data entered by the user and sends it to the server using a secure protocol. The server analyzes the received data using natural language processing technology managed in the cloud. Specifically, it utilizes a generative AI model to convert the user's input into structured data. Through this analysis, the system understands the specific content of the dream.

[0417] Next, the server moves on to the process of converting the generated dream elements into electrical signals. Here, a signal processor processes the dream content into a form corresponding to the brain, ultimately generating a signal. This signal is then sent back to the terminal using encryption technology.

[0418] Meanwhile, the user wears an electroencephalogram (EEG) interface device. The device interprets the received signals and guides them to specific areas of the user's brain. This allows the user to experience their desired dream. The device also monitors the user's physiological state, providing a safe and comfortable dream experience.

[0419] An example of a prompt message is, "User's desired dream scene: Enjoying a barbecue with family on the beach." In this way, the system reflects individual preferences and supports a comfortable sleep experience.

[0420] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0421] Step 1:

[0422] The user uses their device to input the content of their desired dream into a dedicated application. Specifically, they describe the dream's scenes, characters, and plot in text format. The input data at this stage is natural language text and is temporarily stored on the device. When the user presses the "Submit" button, the input is complete and the data is prepared to proceed to the next step.

[0423] Step 2:

[0424] The terminal sends data entered by the user to the server via a secure protocol (encrypted communication). The input in this step is the user's text data, and the output is securely encrypted data. Once the terminal confirms transmission is complete, it notifies the user that the server has received the information.

[0425] Step 3:

[0426] The server begins analyzing the received text data. Using natural language processing techniques, a generative AI model understands the user's intent and analyzes the specific structure of the dream. This analysis transforms the data into structured information. In this step, encrypted text data is received as input, and structured dream story information is generated as output.

[0427] Step 4:

[0428] The server converts the dream storyline into electrical signals based on the analysis. A signal processor is used to generate the storyline as a specific signal pattern. Here, structured dream information is taken as input, and electrical signals tailored to the user's brain are output. These signals are prepared for use in the next step.

[0429] Step 5:

[0430] The server sends the generated electrical signal back to the terminal. This transmission also uses an encryption protocol to ensure the signal's security. The input is an electrical signal, and the output arrives at the terminal as a securely transmitted signal. The terminal then enters a standby state, ready to transmit the received signal to the electroencephalogram (EEG) interface device.

[0431] Step 6:

[0432] The user wears an electroencephalogram (EEG) interface device. The device appropriately interprets the electrical signals sent back by the terminal and transmits them to the user's brain. The input is electrical signals, and the final output is the user experiencing a dream. As a result, the user can achieve deep sleep while experiencing the desired dream.

[0433] (Application Example 1)

[0434] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0435] While virtual experiences are widespread today, conventional technologies have struggled to satisfy users' desires for more realistic and personalized experiences. In particular, there is a need for technology that enables users to experience their desired experiences not just visually, but sensorily. Therefore, technology capable of realizing more immersive virtual experiences is essential.

[0436] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0437] In this invention, the server includes a device for inputting the content of a virtual experience desired by the user, a device for analyzing the user's input and generating the content of the virtual experience, and a device for converting the generated content of the virtual experience into electrical signals. This makes it possible for the user to experience the desired virtual experience in a more realistic and sensory way.

[0438] A "device for inputting the content of a virtual experience desired by the user" is a device that allows users to input specific experiences or virtual environments they desire in text format and processes that information.

[0439] "The device that analyzes user input and generates the content of the virtual experience" is a system that uses artificial intelligence and natural language processing technology to create a virtual experience based on information entered by the user.

[0440] "The device that converts the content of the generated virtual experience into electrical signals" refers to a device that converts the generated virtual experience into electrical signals in order to transmit it to the brain and nervous system.

[0441] "The device that transmits the electrical signals to the user's nervous system" is a device that directly inputs the converted electrical signals into the user's physiological system, allowing the virtual experience to be physically perceived.

[0442] This invention provides a system that allows users to realistically experience their desired virtual experiences through sight and touch. In one embodiment, the user starts by inputting the content of their desired virtual experience using a dedicated terminal. This terminal is equipped with an interface that allows information to be entered in text format.

[0443] After receiving the input, the server uses a generative AI model to analyze the user's input, extract the necessary elements, and then generate a virtual experience. This generation process utilizes natural language processing technology, shaping the user's intended experience into a concrete digital scene. For example, if a user inputs "I want to experience a vacation on a beach on a southern island," the server will construct a digital experience based on this input, including beach scenery and the sound of waves.

[0444] The generated virtual experience is converted into electrical signals necessary to directly affect the user's nervous system. Specialized conversion software is used for this conversion process. These converted electrical signals are then delivered to the user via an electroencephalogram (EEG) interface, enabling a deeply immersive virtual experience.

[0445] The hardware used includes VR devices and EEG interfaces. This allows users to enjoy a visually and sensory immersive experience. Key software includes Unity and Unreal Engine, as well as Python libraries and Azure Cognitive Services to ensure reliable natural language processing.

[0446] As an example of a prompt, if a user wants to experience a vacation on a southern island beach, the input would be: "The user wants to experience a vacation on a southern island beach. Based on this, generate a virtual experience that will give the user a sense of relaxation." Based on this prompt, the server will perform the process of generating the virtual experience.

[0447] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0448] Step 1:

[0449] The user uses a dedicated terminal to input specific details about the virtual experience. The entered data is temporarily stored on the terminal. In this step, an example prompt statement such as "I want to experience a vacation on a beach on a southern island" is entered, and this data is securely transferred to the next processing step.

[0450] Step 2:

[0451] The terminal sends the entered prompt text to the server. The server analyzes the received data. Using the prompt text received from the terminal as input, it applies a generative AI model to perform natural language processing and generates structured data of the user's desired experience. The output is the resulting dream scenario data.

[0452] Step 3:

[0453] The server designs the virtual experience based on the generated scenario data. Specifically, it uses development environments such as Unity to generate digital content to reproduce visual, auditory, and haptic feedback. In this step, each element is programmed, and processing is carried out to provide the user with a rich experience.

[0454] Step 4:

[0455] The process involves converting the generated virtual experience into electrical signals. The server analyzes the digital content and converts it into electrical signals that can be transmitted to the brain and nervous system. The input is the digital content, and the output is the converted electrical signal.

[0456] Step 5:

[0457] The device transmits the converted electrical signals to the user's EEG interface. The EEG interface uses these electrical signals to transmit them to the user's nervous system, providing them as a real virtual experience. By receiving these signals, the user can sensorially experience the desired experience.

[0458] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0459] This invention combines a system that enables users to have desired dreams and achieve comfortable sleep with an emotion engine that recognizes the user's emotions and reflects them in the content of the dreams. The system comprises a terminal, a server, an emotion engine, and an electroencephalogram (EEG) interface device.

[0460] First, the user uses a dedicated application on their device to input the content of the dream they want to have. Next, the user wears a biosensor device that detects emotions, which allows the emotion engine to recognize the user's current emotional state. The emotion engine analyzes the user's emotions based on this data and sends it to the server.

[0461] The server generates dreams by incorporating not only the dream prompts entered by the user, but also emotional data obtained from the emotion engine. Specifically, it uses natural language processing to analyze the prompts and constructs a storyline that incorporates the emotional data as feedback. The generated dream story is converted into electrical signals and transmitted in a format suitable for the user's brainwave interface.

[0462] For example, if a user wants to dream of "relaxing and meditating in a favorite landscape," and the emotion engine detects the user's stress, the server will generate a dream that further emphasizes the relaxing environment. This provides a dream optimized for the user's current emotions, leading to mental and physical refreshment and restful sleep.

[0463] Through this system, users can not only have the dreams they desire, but also experience dreams that best match their emotional state at the time, thereby achieving a higher level of mental well-being and health.

[0464] The following describes the processing flow.

[0465] Step 1:

[0466] The user launches a dedicated terminal application and enters the content of the dream they want to have. They describe specific scenes, situations, characters, and other details.

[0467] Step 2:

[0468] The user wears biosensors, and the emotion engine collects biometric data such as the user's pulse and skin electrical responses. This data is then used by the emotion engine to analyze the user's current emotional state.

[0469] Step 3:

[0470] The device sends the user's dream content and emotional data obtained from the emotion engine to the server. The data is encrypted to protect privacy.

[0471] Step 4:

[0472] The server analyzes the received data using a natural language processing engine to generate a dream storyline. It also considers emotional data and adjusts the dream according to the user's emotional state.

[0473] Step 5:

[0474] The server generates a dream story, which is then converted into electrical signals to be sent to an EEG interface device. This conversion uses an algorithm that optimizes neural stimulation.

[0475] Step 6:

[0476] The terminal receives electrical signals from the server and prepares to transfer them to the EEG interface device worn by the user.

[0477] Step 7:

[0478] The device transmits signals to an electroencephalogram (EEG) interface device, which then transmits these signals to the brain, allowing the user to experience the dream they desire.

[0479] Step 8:

[0480] Users can experience dreams tuned through an emotional engine, resulting in an overall feeling of refreshment and the benefits of restful sleep upon waking.

[0481] (Example 2)

[0482] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0483] In modern society, many people have difficulty getting restful sleep due to stress and anxiety. To solve this problem, there is a need for a system that allows users to have the dreams they desire and get restful sleep. However, conventional methods have not been able to reflect the user's emotional state in the content of their dreams, making it difficult to generate dreams that match the user's emotions.

[0484] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0485] In this invention, the server includes a device for inputting dream information desired by the user, a device for detecting the user's emotional state, and a device for analyzing the user's input and emotional state to generate dream information. This makes it possible to generate dreams optimized for the user's emotions and provide the user with a comfortable sleep experience.

[0486] A "device for inputting dream information desired by the user" refers to a terminal or software that has the function of allowing the user to input the specific content of the dream they want to see.

[0487] A "device for detecting a user's emotional state" refers to a sensor or analysis engine that acquires a user's biometric data and uses that data to determine their emotional state.

[0488] A "device that analyzes user input and emotional state to generate dream information" is a system that possesses data analysis and generation technology to generate dream scenarios and content based on information and emotional data entered by the user.

[0489] A "device that converts to signals" is a device that converts the generated dream information into an electrical signal format.

[0490] A "device that transmits signals to the user's brain" is a device that transmits electrical signals to the user's brain to convey the experience of dreams.

[0491] This invention is a system aimed at helping users achieve comfortable sleep by generating dreams that the user desires. The system consists of a device for inputting dream content, a device for detecting the user's emotional state, and a server that generates dreams using a generation AI model.

[0492] The user enters a dream prompt via the terminal. This prompt text represents the content of the dream the user desires, written in natural language. For example, a prompt text might be, "A dream of peacefully meditating in front of a beautiful waterfall."

[0493] Next, the user wears a biosensor to detect their emotional state. This sensor can acquire biometric data such as skin electrical activity and pulse rate in real time. The device sends this data to an emotion engine, which then analyzes the user's emotional state in detail.

[0494] The server receives prompt text from the user and emotion data from the emotion engine. The generative AI model generates dream content based on this information. This process utilizes natural language processing and machine learning to create dreams optimized for the user's current emotional state.

[0495] Finally, the generated dream information is converted into signals and transmitted via the user's brainwave interface. This process allows the user to experience their desired dreams, enjoy mental and physical refreshment, and achieve restful sleep. This system enables users to experience dreams tailored to their emotions, providing a sense of mental well-being.

[0496] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0497] Step 1:

[0498] The user uses a terminal to input a dream prompt. The input is a desired dream scenario expressed in natural language. This prompt is stored as digital data on the terminal and prepared for transmission to the server.

[0499] Step 2:

[0500] The user wears a biosensor, and the device acquires biometric data from this sensor in real time. The input data includes pulse rate and skin electrical activity, and this data is sent to an emotion engine. The emotion engine analyzes the acquired biometric data to recognize the user's current emotional state and sends the analysis results to a server.

[0501] Step 3:

[0502] The server receives prompt text sent by the user and emotion data obtained from the emotion engine. Based on this data, it generates dream content using a generative AI model. Specifically, it uses natural language processing techniques to analyze the prompt text and combines it with emotion data to create a personalized dream scenario. This output is stored as structured data.

[0503] Step 4:

[0504] The server performs a process of converting the generated dream scenario into electrical signals. This operation uses an algorithm that converts digital information into electrical signals in a format that can be recognized by an EEG interface device. The converted data is then transmitted to the user's EEG interface device.

[0505] Step 5:

[0506] The user's brainwave interface device receives electrical signals transmitted from a server and uses them to directly send dream images to the user's brain. Specifically, by decoding the signals and stimulating brainwaves related to vision and other senses, the user can experience the dream they desire.

[0507] (Application Example 2)

[0508] Next, we will explain Application Example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0509] Conventional dream generation systems can only generate static dreams based solely on user input, making it difficult to provide a flexible dream experience that responds to the user's emotional state. Furthermore, there is a lack of means to optimize dream content based on the user's emotions, making it difficult to contribute to improving the user's mental health.

[0510] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0511] In this invention, the server includes means for inputting the content of a dream desired by the user, means for analyzing the user's input and generating the dream content, means for optimizing the generated dream content based on the user's emotional state, and means for acquiring emotional data via a biosensor that detects the emotional state. This makes it possible to provide a dynamically optimized dream according to the user's emotional state, thereby improving the user experience and supporting mental health.

[0512] A "user" is an individual who uses the system to input dream content and obtain a dream experience based on their emotions.

[0513] The "means for inputting dream content" refer to an interface that allows users to communicate the specific content and scenario of their desired dream to the system.

[0514] "Analysis" is the process of deriving meaning and patterns from input data and information, and using that to generate appropriate dream content.

[0515] "Generation" refers to the act of creating a specific storyline and content of a dream based on user input and emotional data.

[0516] "Optimization" is the process of adjusting dream content according to the user's emotional state to provide a more appropriate and comfortable dream experience.

[0517] "Emotional state" refers to the user's feelings, mood, and mental state at a given time, and is captured as emotional data by the system.

[0518] A "biosensor" is a device that senses a user's physical and physiological state and understands their emotional state.

[0519] "Converting to electrical signals" is the process of changing the content of the generated dream into a form that can be transmitted to the nervous system.

[0520] The "nervous system" refers to the central and peripheral nerve tissues in the human body that are responsible for transmitting information.

[0521] The system of this invention provides a series of processes for realizing the content of a user's desired dream. First, the user inputs the content of their desired dream using a dedicated application installed on their mobile device. The input prompts are initially analyzed by the device and sent to the server.

[0522] The server receives data from biosensors to recognize the user's emotional state in real time. This emotional data is analyzed using a deep learning model to understand the user's emotional state. Machine learning frameworks such as TensorFlow are utilized in this process.

[0523] Based on the analyzed emotional data and user-inputted prompts, the server uses a generative AI model to generate a dream storyline optimized for the user. Using the OpenAI API, it constructs a comfortable dream experience tailored to the user's emotional state. This generated storyline is then converted into electrical signals and prepared for transmission to a neural interface.

[0524] For example, if a user inputs "I want to relax" and a biosensor detects the user's stress level, the server will generate a dream with relaxing content to reduce stress. The following prompt is input to the generation AI model.

[0525] "If a user's emotional state indicates stress, recommend relaxing music or videos."

[0526] This system allows users to experience dreams optimized to their emotional state, enabling them to enjoy restful sleep.

[0527] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0528] Step 1:

[0529] The user launches the application on their device and enters the content of their desired dream as a prompt. The entered prompt is formatted into text data by the application for initial analysis and sent to the server.

[0530] Step 2:

[0531] The server receives and analyzes prompts sent by the user. Using natural language processing techniques, it analyzes the prompts and forms a dataset to build the foundation for the dream storyline. At this point, the output is a diverse set of candidate storylines.

[0532] Step 3:

[0533] Simultaneously, the user wears biosensors that record their current emotional state in real time. The biosensors collect physiological data such as heart rate and skin temperature and send it to the emotion engine as emotional data. The emotion engine performs emotional analysis based on this physiological data, quantifies the user's emotional state, and returns it to the server.

[0534] Step 4:

[0535] The server combines the analyzed prompts with emotional data obtained from the emotion engine and uses a generative AI model to generate an optimized dream storyline. Specifically, it uses the emotional data as feedback to adjust and enhance the prompt's storyline. In this process, the AI ​​model evaluates multiple story candidates and selects the one that best suits the emotional state.

[0536] Step 5:

[0537] The final selected dream storyline is prepared to be converted into electrical signals. This process is necessary to convert the digital story into a format that can be transmitted to the nervous system. The electrical signals are transmitted to the user's nervous system via the user's neural interface, initiating the dream as an experience.

[0538] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0539] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0540] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0541] [Fourth Embodiment]

[0542] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0543] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0544] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0545] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0546] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0547] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0548] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0549] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0550] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0551] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0552] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0553] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0554] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0555] As an embodiment of this invention, a system for obtaining comfortable sleep while having desired dreams is described. This system includes a terminal, a server, and a user electroencephalogram (EEG) interface device.

[0556] First, the user uses a dedicated terminal application to input the details of the dream they want to see. This input can include scenes, characters, and plot developments from the dream. The entered data is received by the terminal and sent to the server in a secure manner.

[0557] The server analyzes the received data using natural language processing technology to understand the user's intentions. Based on the analysis results, it then generates a dream that aligns with the user's wishes. The generated dream storyline is converted into electrical signals and formed into a signal pattern suitable for stimulating the user's brain.

[0558] This electrical signal is sent back to the terminal and then to an EEG interface device worn by the user. The device transmits this signal to specific areas of the brain, allowing the user to experience the dream they desire.

[0559] As a concrete example, consider a user who wishes to dream of "enjoying a hike with friends under a clear blue sky on a mountaintop." The user inputs this into a terminal and sends it to the system. The server generates the dream based on this input, converts the signal, and transmits it via the terminal to the brainwave interface. The user can then experience this pre-set dream and wake up feeling refreshed. Through this process, we offer a new means of addressing nightmares and insomnia in today's stressful society.

[0560] The following describes the processing flow.

[0561] Step 1:

[0562] Users enter the details of their dreams in text format into an input screen of a dedicated application. They can describe specific scenes and desired outcomes of their dreams in detail.

[0563] Step 2:

[0564] The terminal receives the entered user data and securely transmits that data to the server using an encryption protocol.

[0565] Step 3:

[0566] The server analyzes the received data using a natural language processing engine to extract elements of the user's desired dream. An AI algorithm within the server then processes this data to generate a dream storyline.

[0567] Step 4:

[0568] The server converts the dream storyline it generates into a specific electrical signal pattern. This conversion uses an algorithm built on neuroscience theory.

[0569] Step 5:

[0570] The server transmits the converted electrical signal to the terminal. The terminal prepares to transfer this signal to the user's EEG interface device.

[0571] Step 6:

[0572] The device transmits electrical signals to the user's brain via an electroencephalogram (EEG) interface. Based on these signals, the device stimulates the brain to perceive the dreams the user desires.

[0573] Step 7:

[0574] Users can experience pre-set dreams and enjoy a comfortable sleep. This process aims to reduce nightmares and improve sleep quality.

[0575] (Example 1)

[0576] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0577] In today's stressful society, more and more people are suffering from unpleasant dreams and insomnia. Therefore, there is a need for a system that allows users to experience the dreams they desire while enjoying comfortable sleep. However, there are challenges in accurately generating the dreams desired by users and actually allowing them to experience them, particularly in signal generation and conversion, as well as secure and reliable data communication.

[0578] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0579] In this invention, the server includes means for inputting the content of a dream desired by the user, means for analyzing the user's input and generating the dream content, means for converting the generated dream content into electrical signals, and means for transmitting the electrical signals to an electroencephalogram (EEG) interface device via a terminal. This allows the user to enjoy sleep while experiencing the dream of their choice with peace of mind.

[0580] A "user" refers to a person who uses the system to input the content of their desired dream and then experiences it.

[0581] "Input means" refers to a method or device for a user to record the content of their dreams to the system.

[0582] "Analysis method" refers to the method or technique used to understand the content and meaning of a dream that has been input.

[0583] "Generative means" refers to methods or techniques for constructing the content of dreams based on analyzed data.

[0584] "Electrical signals" refer to the electrical representations used to convert the content of dreams into a form that users can experience.

[0585] "Transmission means" refers to a method or device for delivering the generated electrical signals to the user's brain.

[0586] "Terminal" refers to a computer device or apparatus used by a user to input the content of their dreams.

[0587] A "brainwave interface device" refers to a device that transmits electrical signals to the user to allow them to experience dreams.

[0588] This invention is a system for achieving comfortable sleep while experiencing the dreams a user desires. The system consists of three main components: a terminal, a server, and a user's brainwave interface device.

[0589] Users use a device with a dedicated application installed to input the content of their desired dream. The input is in text format, allowing for detailed descriptions of the scenes, characters, and storyline that make up the dream. For example, if a user wants to dream of "enjoying a barbecue with family on the beach," they would input this wish into their device.

[0590] The terminal receives data entered by the user and sends it to the server using a secure protocol. The server analyzes the received data using natural language processing technology managed in the cloud. Specifically, it utilizes a generative AI model to convert the user's input into structured data. Through this analysis, the system understands the specific content of the dream.

[0591] Next, the server moves on to the process of converting the generated dream elements into electrical signals. Here, a signal processor processes the dream content into a form corresponding to the brain, ultimately generating a signal. This signal is then sent back to the terminal using encryption technology.

[0592] Meanwhile, the user wears an electroencephalogram (EEG) interface device. The device interprets the received signals and guides them to specific areas of the user's brain. This allows the user to experience their desired dream. The device also monitors the user's physiological state, providing a safe and comfortable dream experience.

[0593] An example of a prompt message is, "User's desired dream scene: Enjoying a barbecue with family on the beach." In this way, the system reflects individual preferences and supports a comfortable sleep experience.

[0594] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0595] Step 1:

[0596] The user uses their device to input the content of their desired dream into a dedicated application. Specifically, they describe the dream's scenes, characters, and plot in text format. The input data at this stage is natural language text and is temporarily stored on the device. When the user presses the "Submit" button, the input is complete and the data is prepared to proceed to the next step.

[0597] Step 2:

[0598] The terminal sends data entered by the user to the server via a secure protocol (encrypted communication). The input in this step is the user's text data, and the output is securely encrypted data. Once the terminal confirms transmission is complete, it notifies the user that the server has received the information.

[0599] Step 3:

[0600] The server begins analyzing the received text data. Using natural language processing techniques, a generative AI model understands the user's intent and analyzes the specific structure of the dream. This analysis transforms the data into structured information. In this step, encrypted text data is received as input, and structured dream story information is generated as output.

[0601] Step 4:

[0602] The server converts the dream storyline into electrical signals based on the analysis. A signal processor is used to generate the storyline as a specific signal pattern. Here, structured dream information is taken as input, and electrical signals tailored to the user's brain are output. These signals are prepared for use in the next step.

[0603] Step 5:

[0604] The server sends the generated electrical signal back to the terminal. This transmission also uses an encryption protocol to ensure the signal's security. The input is an electrical signal, and the output arrives at the terminal as a securely transmitted signal. The terminal then enters a standby state, ready to transmit the received signal to the electroencephalogram (EEG) interface device.

[0605] Step 6:

[0606] The user wears an electroencephalogram (EEG) interface device. The device appropriately interprets the electrical signals sent back by the terminal and transmits them to the user's brain. The input is electrical signals, and the final output is the user experiencing a dream. As a result, the user can achieve deep sleep while experiencing the desired dream.

[0607] (Application Example 1)

[0608] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0609] While virtual experiences are widespread today, conventional technologies have struggled to satisfy users' desires for more realistic and personalized experiences. In particular, there is a need for technology that enables users to experience their desired experiences not just visually, but sensorily. Therefore, technology capable of realizing more immersive virtual experiences is essential.

[0610] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0611] In this invention, the server includes a device for inputting the content of a virtual experience desired by the user, a device for analyzing the user's input and generating the content of the virtual experience, and a device for converting the generated content of the virtual experience into electrical signals. This makes it possible for the user to experience the desired virtual experience in a more realistic and sensory way.

[0612] A "device for inputting the content of a virtual experience desired by the user" is a device that allows users to input specific experiences or virtual environments they desire in text format and processes that information.

[0613] "The device that analyzes user input and generates the content of the virtual experience" is a system that uses artificial intelligence and natural language processing technology to create a virtual experience based on information entered by the user.

[0614] "The device that converts the content of the generated virtual experience into electrical signals" refers to a device that converts the generated virtual experience into electrical signals in order to transmit it to the brain and nervous system.

[0615] "The device that transmits the electrical signals to the user's nervous system" is a device that directly inputs the converted electrical signals into the user's physiological system, allowing the virtual experience to be physically perceived.

[0616] This invention provides a system that allows users to realistically experience their desired virtual experiences through sight and touch. In one embodiment, the user starts by inputting the content of their desired virtual experience using a dedicated terminal. This terminal is equipped with an interface that allows information to be entered in text format.

[0617] After receiving the input, the server uses a generative AI model to analyze the user's input, extract the necessary elements, and then generate a virtual experience. This generation process utilizes natural language processing technology, shaping the user's intended experience into a concrete digital scene. For example, if a user inputs "I want to experience a vacation on a beach on a southern island," the server will construct a digital experience based on this input, including beach scenery and the sound of waves.

[0618] The generated virtual experience is converted into electrical signals necessary to directly affect the user's nervous system. Specialized conversion software is used for this conversion process. These converted electrical signals are then delivered to the user via an electroencephalogram (EEG) interface, enabling a deeply immersive virtual experience.

[0619] The hardware used includes VR devices and EEG interfaces. This allows users to enjoy a visually and sensory immersive experience. Key software includes Unity and Unreal Engine, as well as Python libraries and Azure Cognitive Services to ensure reliable natural language processing.

[0620] As an example of a prompt, if a user wants to experience a vacation on a southern island beach, the input would be: "The user wants to experience a vacation on a southern island beach. Based on this, generate a virtual experience that will give the user a sense of relaxation." Based on this prompt, the server will perform the process of generating the virtual experience.

[0621] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0622] Step 1:

[0623] The user uses a dedicated terminal to input specific details about the virtual experience. The entered data is temporarily stored on the terminal. In this step, an example prompt statement such as "I want to experience a vacation on a beach on a southern island" is entered, and this data is securely transferred to the next processing step.

[0624] Step 2:

[0625] The terminal sends the entered prompt text to the server. The server analyzes the received data. Using the prompt text received from the terminal as input, it applies a generative AI model to perform natural language processing and generates structured data of the user's desired experience. The output is the resulting dream scenario data.

[0626] Step 3:

[0627] The server designs the virtual experience based on the generated scenario data. Specifically, it uses development environments such as Unity to generate digital content to reproduce visual, auditory, and haptic feedback. In this step, each element is programmed, and processing is carried out to provide the user with a rich experience.

[0628] Step 4:

[0629] The process involves converting the generated virtual experience into electrical signals. The server analyzes the digital content and converts it into electrical signals that can be transmitted to the brain and nervous system. The input is the digital content, and the output is the converted electrical signal.

[0630] Step 5:

[0631] The device transmits the converted electrical signals to the user's EEG interface. The EEG interface uses these electrical signals to transmit them to the user's nervous system, providing them as a real virtual experience. By receiving these signals, the user can sensorially experience the desired experience.

[0632] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0633] This invention combines a system that enables users to have desired dreams and achieve comfortable sleep with an emotion engine that recognizes the user's emotions and reflects them in the content of the dreams. The system comprises a terminal, a server, an emotion engine, and an electroencephalogram (EEG) interface device.

[0634] First, the user uses a dedicated application on their device to input the content of the dream they want to have. Next, the user wears a biosensor device that detects emotions, which allows the emotion engine to recognize the user's current emotional state. The emotion engine analyzes the user's emotions based on this data and sends it to the server.

[0635] The server generates dreams by incorporating not only the dream prompts entered by the user, but also emotional data obtained from the emotion engine. Specifically, it uses natural language processing to analyze the prompts and constructs a storyline that incorporates the emotional data as feedback. The generated dream story is converted into electrical signals and transmitted in a format suitable for the user's brainwave interface.

[0636] For example, if a user wants to dream of "relaxing and meditating in a favorite landscape," and the emotion engine detects the user's stress, the server will generate a dream that further emphasizes the relaxing environment. This provides a dream optimized for the user's current emotions, leading to mental and physical refreshment and restful sleep.

[0637] Through this system, users can not only have the dreams they desire, but also experience dreams that best match their emotional state at the time, thereby achieving a higher level of mental well-being and health.

[0638] The following describes the processing flow.

[0639] Step 1:

[0640] The user launches a dedicated terminal application and enters the content of the dream they want to have. They describe specific scenes, situations, characters, and other details.

[0641] Step 2:

[0642] The user wears biosensors, and the emotion engine collects biometric data such as the user's pulse and skin electrical responses. This data is then used by the emotion engine to analyze the user's current emotional state.

[0643] Step 3:

[0644] The device sends the user's dream content and emotional data obtained from the emotion engine to the server. The data is encrypted to protect privacy.

[0645] Step 4:

[0646] The server analyzes the received data using a natural language processing engine to generate a dream storyline. It also considers emotional data and adjusts the dream according to the user's emotional state.

[0647] Step 5:

[0648] The server generates a dream story, which is then converted into electrical signals to be sent to an EEG interface device. This conversion uses an algorithm that optimizes neural stimulation.

[0649] Step 6:

[0650] The terminal receives electrical signals from the server and prepares to transfer them to the EEG interface device worn by the user.

[0651] Step 7:

[0652] The device transmits signals to an electroencephalogram (EEG) interface device, which then transmits these signals to the brain, allowing the user to experience the dream they desire.

[0653] Step 8:

[0654] Users can experience dreams tuned through an emotional engine, resulting in an overall feeling of refreshment and the benefits of restful sleep upon waking.

[0655] (Example 2)

[0656] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0657] In modern society, many people have difficulty getting restful sleep due to stress and anxiety. To solve this problem, there is a need for a system that allows users to have the dreams they desire and get restful sleep. However, conventional methods have not been able to reflect the user's emotional state in the content of their dreams, making it difficult to generate dreams that match the user's emotions.

[0658] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0659] In this invention, the server includes a device for inputting dream information desired by the user, a device for detecting the user's emotional state, and a device for analyzing the user's input and emotional state to generate dream information. This makes it possible to generate dreams optimized for the user's emotions and provide the user with a comfortable sleep experience.

[0660] A "device for inputting dream information desired by the user" refers to a terminal or software that has the function of allowing the user to input the specific content of the dream they want to see.

[0661] A "device for detecting a user's emotional state" refers to a sensor or analysis engine that acquires a user's biometric data and uses that data to determine their emotional state.

[0662] A "device that analyzes user input and emotional state to generate dream information" is a system that possesses data analysis and generation technology to generate dream scenarios and content based on information and emotional data entered by the user.

[0663] A "device that converts to signals" is a device that converts the generated dream information into an electrical signal format.

[0664] A "device that transmits signals to the user's brain" is a device that transmits electrical signals to the user's brain to convey the experience of dreams.

[0665] This invention is a system aimed at helping users achieve comfortable sleep by generating dreams that the user desires. The system consists of a device for inputting dream content, a device for detecting the user's emotional state, and a server that generates dreams using a generation AI model.

[0666] The user enters a dream prompt via the terminal. This prompt text represents the content of the dream the user desires, written in natural language. For example, a prompt text might be, "A dream of peacefully meditating in front of a beautiful waterfall."

[0667] Next, the user wears a biosensor to detect their emotional state. This sensor can acquire biometric data such as skin electrical activity and pulse rate in real time. The device sends this data to an emotion engine, which then analyzes the user's emotional state in detail.

[0668] The server receives prompt text from the user and emotion data from the emotion engine. The generative AI model generates dream content based on this information. This process utilizes natural language processing and machine learning to create dreams optimized for the user's current emotional state.

[0669] Finally, the generated dream information is converted into signals and transmitted via the user's brainwave interface. This process allows the user to experience their desired dreams, enjoy mental and physical refreshment, and achieve restful sleep. This system enables users to experience dreams tailored to their emotions, providing a sense of mental well-being.

[0670] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0671] Step 1:

[0672] The user uses a terminal to input a dream prompt. The input is a desired dream scenario expressed in natural language. This prompt is stored as digital data on the terminal and prepared for transmission to the server.

[0673] Step 2:

[0674] The user wears a biosensor, and the device acquires biometric data from this sensor in real time. The input data includes pulse rate and skin electrical activity, and this data is sent to an emotion engine. The emotion engine analyzes the acquired biometric data to recognize the user's current emotional state and sends the analysis results to a server.

[0675] Step 3:

[0676] The server receives prompt text sent by the user and emotion data obtained from the emotion engine. Based on this data, it generates dream content using a generative AI model. Specifically, it uses natural language processing techniques to analyze the prompt text and combines it with emotion data to create a personalized dream scenario. This output is stored as structured data.

[0677] Step 4:

[0678] The server performs a process of converting the generated dream scenario into electrical signals. This operation uses an algorithm that converts digital information into electrical signals in a format that can be recognized by an EEG interface device. The converted data is then transmitted to the user's EEG interface device.

[0679] Step 5:

[0680] The user's brainwave interface device receives electrical signals transmitted from a server and uses them to directly send dream images to the user's brain. Specifically, by decoding the signals and stimulating brainwaves related to vision and other senses, the user can experience the dream they desire.

[0681] (Application Example 2)

[0682] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0683] Conventional dream generation systems can only generate static dreams based solely on user input, making it difficult to provide a flexible dream experience that responds to the user's emotional state. Furthermore, there is a lack of means to optimize dream content based on the user's emotions, making it difficult to contribute to improving the user's mental health.

[0684] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0685] In this invention, the server includes means for inputting the content of a dream desired by the user, means for analyzing the user's input and generating the dream content, means for optimizing the generated dream content based on the user's emotional state, and means for acquiring emotional data via a biosensor that detects the emotional state. This makes it possible to provide a dynamically optimized dream according to the user's emotional state, thereby improving the user experience and supporting mental health.

[0686] A "user" is an individual who uses the system to input dream content and obtain a dream experience based on their emotions.

[0687] The "means for inputting dream content" refer to an interface that allows users to communicate the specific content and scenario of their desired dream to the system.

[0688] "Analysis" is the process of deriving meaning and patterns from input data and information, and using that to generate appropriate dream content.

[0689] "Generation" refers to the act of creating a specific storyline and content of a dream based on user input and emotional data.

[0690] "Optimization" is the process of adjusting dream content according to the user's emotional state to provide a more appropriate and comfortable dream experience.

[0691] "Emotional state" refers to the user's feelings, mood, and mental state at a given time, and is captured as emotional data by the system.

[0692] A "biosensor" is a device that senses a user's physical and physiological state and understands their emotional state.

[0693] "Converting to electrical signals" is the process of changing the content of the generated dream into a form that can be transmitted to the nervous system.

[0694] The "nervous system" refers to the central and peripheral nerve tissues in the human body that are responsible for transmitting information.

[0695] The system of this invention provides a series of processes for realizing the content of a user's desired dream. First, the user inputs the content of their desired dream using a dedicated application installed on their mobile device. The input prompts are initially analyzed by the device and sent to the server.

[0696] The server receives data from biosensors to recognize the user's emotional state in real time. This emotional data is analyzed using a deep learning model to understand the user's emotional state. Machine learning frameworks such as TensorFlow are utilized in this process.

[0697] Based on the analyzed emotional data and user-inputted prompts, the server uses a generative AI model to generate a dream storyline optimized for the user. Using the OpenAI API, it constructs a comfortable dream experience tailored to the user's emotional state. This generated storyline is then converted into electrical signals and prepared for transmission to a neural interface.

[0698] For example, if a user inputs "I want to relax" and a biosensor detects the user's stress level, the server will generate a dream with relaxing content to reduce stress. The following prompt is input to the generation AI model.

[0699] "If a user's emotional state indicates stress, recommend relaxing music or videos."

[0700] This system allows users to experience dreams optimized to their emotional state, enabling them to enjoy restful sleep.

[0701] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0702] Step 1:

[0703] The user launches the application on their device and enters the content of their desired dream as a prompt. The entered prompt is formatted into text data by the application for initial analysis and sent to the server.

[0704] Step 2:

[0705] The server receives and analyzes prompts sent by the user. Using natural language processing techniques, it analyzes the prompts and forms a dataset to build the foundation for the dream storyline. At this point, the output is a diverse set of candidate storylines.

[0706] Step 3:

[0707] Simultaneously, the user wears biosensors that record their current emotional state in real time. The biosensors collect physiological data such as heart rate and skin temperature and send it to the emotion engine as emotional data. The emotion engine performs emotional analysis based on this physiological data, quantifies the user's emotional state, and returns it to the server.

[0708] Step 4:

[0709] The server combines the analyzed prompts with emotional data obtained from the emotion engine and uses a generative AI model to generate an optimized dream storyline. Specifically, it uses the emotional data as feedback to adjust and enhance the prompt's storyline. In this process, the AI ​​model evaluates multiple story candidates and selects the one that best suits the emotional state.

[0710] Step 5:

[0711] The final selected dream storyline is prepared to be converted into electrical signals. This process is necessary to convert the digital story into a format that can be transmitted to the nervous system. The electrical signals are transmitted to the user's nervous system via the user's neural interface, initiating the dream as an experience.

[0712] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0713] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0714] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0715] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0716] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0717] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0718] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0719] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0720] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0721] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0722] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0723] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0724] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0725] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0726] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0727] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0728] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0729] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0730] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0731] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0732] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0733] The following is further disclosed regarding the embodiments described above.

[0734] (Claim 1)

[0735] A means for the user to input the content of the dream they want,

[0736] A means for analyzing the user's input and generating the content of the dream,

[0737] A means for converting the generated dream content into an electrical signal,

[0738] Means for transmitting the aforementioned electrical signals to the user's brain,

[0739] A system that includes this.

[0740] (Claim 2)

[0741] The system according to claim 1, wherein the content of the dream is analyzed by natural language processing.

[0742] (Claim 3)

[0743] The system according to claim 1, wherein the electrical signal is transmitted via the user's electroencephalogram interface.

[0744] "Example 1"

[0745] (Claim 1)

[0746] A means for the user to input the content of the dream they want,

[0747] A means for analyzing the user's input and generating the content of the dream,

[0748] A means for converting the generated dream content into an electrical signal,

[0749] Means for transmitting the aforementioned electrical signals to the user's brain,

[0750] Means for transmitting the electrical signals to the electroencephalogram interface device via a terminal,

[0751] A system that includes this.

[0752] (Claim 2)

[0753] The system according to claim 1, wherein the content of the dream is analyzed using natural language processing technology.

[0754] (Claim 3)

[0755] The system according to claim 1, wherein the electrical signal is transmitted via encrypted communication through a terminal.

[0756] "Application Example 1"

[0757] (Claim 1)

[0758] A device in which the user inputs the content of the virtual experience they wish to have,

[0759] A device that analyzes the user's input and generates the content of the virtual experience,

[0760] A device that converts the content of the generated virtual experience into electrical signals,

[0761] A device that transmits the aforementioned electrical signals to the user's nervous system,

[0762] A system that includes this.

[0763] (Claim 2)

[0764] The system according to claim 1, wherein the content of the virtual experience is analyzed by natural language processing.

[0765] (Claim 3)

[0766] The system according to claim 1, wherein the electrical signal is transmitted via the user's electroencephalogram interface.

[0767] "Example 2 of combining an emotion engine"

[0768] (Claim 1)

[0769] A device into which the user inputs information about their desired dream,

[0770] A device for detecting the emotional state of the user,

[0771] A device that analyzes the user's input and emotional state and generates dream information,

[0772] A device that converts the generated dream information into a signal,

[0773] A device that transmits the aforementioned signal to the user's brain,

[0774] A system that includes this.

[0775] (Claim 2)

[0776] The system according to claim 1, wherein the aforementioned dream information is analyzed by language processing technology.

[0777] (Claim 3)

[0778] The system according to claim 1, wherein the signal is transmitted via the user's electroencephalogram interface.

[0779] "Application example 2 when combining with an emotional engine"

[0780] (Claim 1)

[0781] A means for the user to input the content of the dream they want,

[0782] A means for analyzing the user's input and generating the content of the dream,

[0783] A means for optimizing the content of the generated dream based on the user's emotional state,

[0784] Means for acquiring emotional data via a biosensor that detects the emotional state,

[0785] A means for converting the optimized dream content into an electrical signal,

[0786] Means for transmitting the aforementioned electrical signal to the user's nervous system,

[0787] A system that includes this.

[0788] (Claim 2)

[0789] The system according to claim 1, wherein the content of the dream is analyzed by natural language processing and optimized using a generative AI model.

[0790] (Claim 3)

[0791] The system according to claim 1, wherein the electrical signal is transmitted via the user's neural interface. [Explanation of Symbols]

[0792] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means for the user to input the content of the dream they want, A means for analyzing the user's input and generating the content of the dream, A means for converting the generated dream content into an electrical signal, Means for transmitting the aforementioned electrical signals to the user's brain, A system that includes this.

2. The system according to claim 1, wherein the content of the dream is analyzed by natural language processing.

3. The system according to claim 1, wherein the electrical signal is transmitted via the user's electroencephalogram interface.

Images