System
The system addresses the challenge of personalized scent generation by analyzing user data to create optimal aroma blends, enhancing comfort and efficiency through automatic adjustments.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-19
- Publication Date
- 2026-03-04
Smart Images

Figure 2026035304000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] Compared to other senses, the sense of smell has a more direct effect on emotions and memories, making it potentially effective in improving daily comfort and work efficiency. However, conventional scent generation technologies have struggled to personalize scents to suit individual psychological states and task content, and have only been able to provide a uniform, consistent scent. Furthermore, scent adjustments based on user feedback are performed manually, which is time-consuming and results in low accuracy. To address these issues, we aim to provide a system that can automatically select and adjust the optimal aroma oil based on each individual user's psychological state and vital data. [Means for solving the problem]
[0005] The present invention provides a system including a means for collecting a user's psychological state and work content through dialogue with the user and a means for collecting the user's vital data in real time. A means for analyzing the collected dialogue data and vital data is provided, and the user's psychological and physical state is determined through this analysis. The system further includes a means for generating an optimal aroma oil blend based on the analysis results. The generated aroma oil blend is mixed in the correct ratio in a dispenser, and the blended aroma oils are diffused throughout the room. The system also includes a means for collecting user feedback and adjusting the scent blend based on the feedback. This allows for a scent experience tailored to the user's needs, improving comfort and work efficiency.
[0006] "User" refers to an individual who uses this system, who receives information on psychological state and work content, and who receives a scent experience.
[0007] "Dialogue data" refers to information provided by the user through conversation with the system, and includes text data relating to the user's psychological state and the content of the work.
[0008] "Vital data" refers to a user's biological signals (heart rate, body temperature, respiratory rate, etc.), and refers to data about the physical condition collected in real time.
[0009] "Mental state" refers to the emotions and mental state that a user feels, and includes specific needs such as wanting to concentrate or wanting to relax.
[0010] "Physical condition" refers to the user's physical health condition and stress level obtained by analyzing vital data.
[0011] "Aromatherapy oil" refers to a liquid containing aromatic components extracted from plants, etc., and has effects such as relaxation and improved concentration through its scent.
[0012] An "aromatherapy oil blend" refers to a mixture of multiple aroma oils in specific proportions, and is a combination of scents that aims to achieve a specific effect.
[0013] A "dispenser" refers to a device for mixing aromatic oils in precise proportions, and has the function of releasing only the required amount of different aromatic oils.
[0014] An "aroma diffuser" is a device that diffuses blended aroma oils into a space, providing the fragrance to the user's environment by spreading the scent.
[0015] "Feedback" refers to the act of users providing information about their impressions of the aroma experience and its effects, which is used to adjust the scent for future use.
[0016] "Natural language processing (NLP)" refers to the technology that enables computers to understand, analyze, and generate human language, and is used to analyze dialogue data.
[0017] "Machine learning algorithms" refer to technology that analyzes data to discover patterns and make predictions and decisions based on those patterns, and are used to analyze vital data. [Brief explanation of the drawings]
[0018] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6]FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0019] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0020] First, the terms used in the following description will be explained.
[0021] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0022] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0023] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0024] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0025] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0026] [First embodiment]
[0027] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0028] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0029] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0030] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0031] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0032] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0033] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0034] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0035] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0036] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0037] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0038] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0039] The present invention is a system that interacts with users, collects and analyzes vital data, blends and mixes aroma oils, diffuses them into the room, and collects feedback, allowing the system to provide an optimal aroma experience tailored to each individual user's psychological and physical state.
[0040] System Configuration
[0041] The system consists of the following main components:
[0042] 1. AI Conversation Engine
[0043] 2. Vital Data Monitoring Device
[0044] 3. Data Analysis Module
[0045] 4. Aroma Profiling Module
[0046] 5. Dispenser Module
[0047] 6. Aroma diffuser
[0048] 7. Feedback Module
[0049] Program processing
[0050] Data collection
[0051] Device: The user launches the AI conversation app and inputs their current work and mood. They also wear a vital data monitoring device. The device responds by starting a dialogue with the user, collecting their psychological state and needs. At the same time, vital data such as heart rate, body temperature, and respiratory rate are also collected in real time.
[0052] Sending data
[0053] Terminal: Collected interaction data and vital data are sent to the server in real time.
[0054] Data storage and analysis
[0055] Server: The received data is stored in a database. Natural language processing (NLP) algorithms analyze the dialogue data to identify the user's task and psychological state. At the same time, machine learning algorithms analyze vital data to determine real-time physical condition.
[0056] Aroma Profiling
[0057] Server: Based on the analysis results, it generates a blend of aroma oils that best suits the user's needs. This profile is sent to the dispenser module.
[0058] Aroma blend composition
[0059] Terminal: The dispenser module mixes each aromatic oil in the correct proportions based on instructions received from the server.
[0060] Aroma diffusion
[0061] Terminal: The aroma diffuser diffuses the blended aroma oil into the room.
[0062] User Feedback
[0063] User: Enter their impressions and effects of the aroma experience into the device.
[0064] Feedback analysis and adjustment
[0065] Server: Analyzes collected feedback data and adjusts the scent blend for future visits to continuously improve the quality of the scent experience.
[0066] Specific examples
[0067] Data collection and analysis
[0068] User: Because he / she is unable to maintain concentration while teleworking, he / she inputs "I want to concentrate" into the AI conversation app. He / she also wears a vital data monitoring device to collect data such as heart rate and body temperature.
[0069] Terminal: Interaction data and vital data are collected and sent to the server.
[0070] Server: Analyzes the dialogue data using natural language processing to determine that the user is seeking increased concentration. Analysis of vital data reveals that the user's heart rate is high (e.g., 85 BPM), indicating stress.
[0071] Aroma Profiling and Blending
[0072] Server: Based on the analysis results, it creates a blend of 70% rosemary and 30% peppermint, which is effective for improving concentration, and sends this information to the dispenser module.
[0073] Terminal: The dispenser module follows instructions from the server and mixes rosemary and peppermint in the specified ratio.
[0074] Aroma diffusion and feedback
[0075] Terminal: The blended aroma oil is diffused throughout the room through the aroma diffuser.
[0076] User: Works while enjoying the scent, then enters feedback such as "My concentration has improved, but the scent is a little strong."
[0077] Server: We'll analyze your feedback and adjust the ratio to less peppermint and more rosemary next time.
[0078] In this way, the system can provide a scent experience tailored to the user's needs, improving comfort and work efficiency.
[0079] The processing flow will be explained below.
[0080] Step 1:
[0081] User: Launches the AI conversation app and inputs the details of the task and current mental state into the device. For example, the user might input "I want to concentrate."
[0082] Step 2:
[0083] On the device: The AI conversation engine asks the user follow-up questions to gather more information, such as "What exactly are you working on?" or "How are you feeling right now?"
[0084] Step 3:
[0085] Terminal: Collects vital data such as the user's heart rate, body temperature, and respiratory rate in real time via a vital data monitoring device.
[0086] Step 4:
[0087] Terminal: Sends collected interaction data and vital data to the server in real time.
[0088] Step 5:
[0089] Server: Stores the received data in a database.
[0090] Step 6:
[0091] Server: Using natural language processing (NLP) algorithms, the server analyzes dialogue data and identifies the user's psychological state, such as "wanting to concentrate," and the task at hand.
[0092] Step 7:
[0093] Server: Analyzes vital data using machine learning algorithms and determines the user's physical condition (e.g., a high heart rate indicates stress).
[0094] Step 8:
[0095] Server: Based on the analysis results, the server generates a blend of aroma oils that is optimal for the user's psychological and physical state. For example, it generates a blend of 70% rosemary and 30% peppermint to "improve concentration."
[0096] Step 9:
[0097] Server: Sends the generated aroma profile to the dispenser module.
[0098] Step 10:
[0099] Terminal: The dispenser module follows the instructions received from the server and mixes each aromatic oil in the correct proportions, for example, accurately measuring out 70% rosemary and 30% peppermint.
[0100] Step 11:
[0101] Terminal: The aroma diffuser diffuses the blended aroma oil into the room, for example, releasing the scent at regular intervals.
[0102] Step 12:
[0103] User: Enters feedback into the device, such as whether the aroma experience improved their concentration and whether the strength of the scent was appropriate.
[0104] Step 13:
[0105] Terminal: Sends collected feedback data to the server.
[0106] Step 14:
[0107] Server: Analyzes the received feedback data and adjusts the blend ratio and fragrance intensity from the next time onwards. For example, if the user feedback is that "the peppermint is too strong," the ratio of peppermint will be adjusted to 20% next time.
[0108] In this way, the system can continuously optimize the scent experience according to the user's needs, improving comfort and work efficiency.
[0109] Example 1
[0110] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0111] In modern society, many people face problems such as stress, fatigue, and decreased concentration. To solve these problems, it is important to provide optimal relaxation and concentration-improving methods tailored to each individual user's psychological and physical state. However, with conventional methods, it has been difficult to accurately grasp the user's condition and provide an appropriate aroma oil blend based on that. It has also been difficult to continuously adjust the blend based on feedback.
[0112] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0113] In this invention, the server includes means for collecting the user's psychological state and work content through dialogue with the user, means for collecting the user's biological information in real time, means for analyzing the collected dialogue data and biological information to determine the user's psychological state and physical state, means for generating an optimal fragrance blend based on the analysis results, means for mixing the generated fragrance blend in an accurate ratio using a dispenser, means for diffusing the mixed fragrance into the room space, and means for collecting user evaluation information and adjusting the fragrance blend based on the evaluation information, thereby enabling the provision of an individually optimized aroma experience tailored to the user's needs and continuous adjustments.
[0114] "Dialogue data" is information about the psychological state and work content collected through dialogue with the user.
[0115] "Biometric information" refers to data relating to the user's physical condition, such as heart rate, body temperature, and respiratory rate, that is acquired in real time.
[0116] "Natural language processing technology" is a technology that enables computers to understand and analyze human language.
[0117] "Fragrance blending" refers to mixing multiple fragrances in a certain ratio.
[0118] A "dispenser" is a device that mixes liquids or gases, such as fragrances, in precise proportions.
[0119] "User evaluation information" refers to feedback provided by users regarding their impressions and effects after experiencing the aroma.
[0120] "Indoor space" refers to the inside of a room, office, or other enclosed space.
[0121] A "server" is a computer system that performs processes such as collecting, storing, analyzing, and distributing data over a network.
[0122] The present invention is a system that interacts with users, collects and analyzes vital data, blends and mixes aroma oils, diffuses them into the room, and collects feedback, allowing the system to provide an optimal aroma experience tailored to each individual user's psychological and physical state.
[0123] System Configuration
[0124] The system consists of the following main components:
[0125] 1. AI Conversation Engine
[0126] 2. Vital Data Monitoring Device
[0127] 3. Data Analysis Module
[0128] 4. Aroma Profiling Module
[0129] 5. Dispenser Module
[0130] 6. Aroma diffuser
[0131] 7. Feedback Module
[0132] Program processing
[0133] Data collection
[0134] The user launches the AI conversation app and inputs their current work and mood. They also wear a vital data monitoring device. The device responds by starting a dialogue with the user, collecting their psychological state and needs. At the same time, vital data such as heart rate, body temperature, and respiratory rate are also collected in real time.
[0135] Sending data
[0136] The device transmits collected interaction data and vital data to a server in real time using an internet connection.
[0137] Data storage and analysis
[0138] The server stores the received data in a database. It uses natural language processing (NLP) algorithms to analyze the dialogue data and identify the user's task and psychological state. At the same time, it uses machine learning algorithms to analyze the vital signs and determine the user's real-time physical condition.
[0139] Aroma Profiling
[0140] The server then generates a blend of aroma oils that best suits the user's needs based on the analysis results, and this profile is sent to the dispenser module.
[0141] Aroma blend composition
[0142] The dispenser module mixes each aromatic oil in the correct proportions based on instructions received from the server.
[0143] Aroma diffusion
[0144] The aroma diffuser diffuses the aromatic oils it contains into the room.
[0145] User Feedback
[0146] Users input their impressions and effects of the aroma experience into the terminal.
[0147] Feedback analysis and adjustment
[0148] The server analyzes the collected feedback data and adjusts the scent blend for future visits, continually improving the quality of the scent experience.
[0149] Specific examples
[0150] Data collection and analysis
[0151] Because the user is unable to maintain concentration while teleworking, they input "I want to concentrate" into an AI conversation app. They also wear a vital data monitoring device to collect data such as heart rate and body temperature. The device collects the dialogue data and vital data and sends it to a server. The server analyzes the dialogue data using natural language processing and determines that the user wants to improve their concentration. Analysis of the vital data reveals that the heart rate is high (e.g., 85 BPM), indicating that the user is feeling stressed.
[0152] Aroma Profiling and Blending
[0153] Based on the analysis results, the server generates a blend of 70% rosemary and 30% peppermint, which is effective for improving concentration. This information is sent to the dispenser module, which then follows instructions from the server to mix the rosemary and peppermint in the specified ratio.
[0154] Aroma diffusion and feedback
[0155] The device diffuses the blended aroma oil throughout the room through an aroma diffuser. The user works while enjoying the scent, and then inputs feedback such as "My concentration has improved, but the scent is a little strong." The server analyzes the feedback and adjusts the ratio of peppermint to rosemary next time.
[0156] Prompt Sentence Examples
[0157] The user enters "I want to concentrate" into the AI conversation app and wears a vital data monitoring device. The device receives this and sends the conversation data and vital data to the server. The server analyzes the data, determines that the user is seeking improved concentration, and generates an optimal aroma blend (e.g., 70% rosemary, 30% peppermint). The dispenser module mixes this blend, and the aroma diffuser diffuses it throughout the room. The user experiences the scent and provides feedback, and the server adjusts the blend for the next time.
[0158] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0159] Step 1:
[0160] The user launches the AI conversation app, inputs their current mental state and work details, and wears a vital data monitoring device (e.g., a smartwatch).
[0161] Input: Text data on mental state and work content, vital data such as heart rate, body temperature, and respiratory rate.
[0162] Output: Text data of collected psychological state and work content, and real-time vital data.
[0163] Specifically, the user enters "I want to concentrate" into the app, and then puts on the smartwatch, which records their heart rate and body temperature.
[0164] Step 2:
[0165] The device transmits collected text data on psychological state and work activity, as well as vital data, to a server in real time using an internet connection.
[0166] Input: Text data of collected psychological state and work content, vital data.
[0167] Output: Collected data sent to the server.
[0168] Specifically, the terminal encrypts and transmits text data and vital data to a server via the Internet.
[0169] Step 3:
[0170] The server stores the received data in a database, then uses natural language processing (NLP) algorithms to analyze the dialogue data and identify the user's psychological state and work needs, while using machine learning algorithms to analyze the vital signs and determine the user's real-time physical condition.
[0171] Input: Text data of mental state and work content, and vital data sent to the server.
[0172] Output: Analyzed information about the user's psychological state, task needs, and real-time physical condition.
[0173] Specifically, the server analyzes the dialogue data entered as "I want to concentrate" and determines that the user wants to improve their concentration. It also recognizes from vital signs that the heart rate is 85 BPM and determines that the user is feeling stressed.
[0174] Step 4:
[0175] Based on the analysis results, the server generates a blend of aroma oils that best suits the user's needs, and this profile is sent to the dispenser module.
[0176] Input: Analyzed psychological state, work needs, and real-time physical state information.
[0177] Output: Information on optimal aroma oil blend.
[0178] Specifically, it creates a blend of 70% rosemary and 30% peppermint, which is effective in improving concentration, and sends that information to the dispenser module.
[0179] Step 5:
[0180] The dispenser module mixes each aromatic oil in the correct proportions based on instructions received from the server.
[0181] Input: Information on optimal aroma oil blend.
[0182] Output: Precisely formulated aromatic oils.
[0183] Specifically, the dispenser module mixes rosemary and peppermint in the specified ratio.
[0184] Step 6:
[0185] The device's aroma diffuser diffuses the blended aroma oil into the room.
[0186] Input: precisely formulated aromatic oils.
[0187] Output: Aroma diffused into the room.
[0188] Specifically, the fan built into the aroma diffuser is activated to diffuse the aroma oil throughout the room.
[0189] Step 7:
[0190] Users input their impressions and effects of the aroma experience into the terminal.
[0191] Input: Feedback data on impressions and effects of aroma experience.
[0192] Output: Collected user feedback data.
[0193] As a specific action, the user inputs feedback such as "My concentration has improved, but the scent is a little strong."
[0194] Step 8:
[0195] The server analyzes the collected feedback data and adjusts the fragrance blend for future applications, for example by sending instructions to the dispenser module to reduce the proportion of peppermint and increase the proportion of rosemary.
[0196] Input: Collected user feedback data.
[0197] Output: Adjusted aroma oil blend information for next use.
[0198] Specifically, the server analyzes the feedback data, generates new blending instructions, and sends them.
[0199] (Application example 1)
[0200] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0201] With conventional aroma oils, it was difficult to generate and provide optimal aroma blends tailored to the user's psychological and physical state. Furthermore, the collection and analysis of vital data in real time, and the provision of effective aroma experiences in virtual environments were not fully realized. This limited the provision of personalized aroma experiences tailored to individual users. Furthermore, it was difficult to appropriately adjust the aroma blend based on feedback and reflect it in the next offering.
[0202] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0203] In this invention, the server includes means for collecting the user's psychological state and work content through dialogue with the user, means for collecting the user's vital data in real time, means for analyzing the collected dialogue data and vital data to determine the user's psychological and physical state, means for determining an aroma blend that is optimal for the user's needs from the dialogue data and vital data using a generative AI model, means for mixing the generated aroma oil blend in an accurate ratio using a dispenser, means for diffusing the blended aroma oil into a room space, means for providing an aroma experience in a virtual environment, and means for collecting feedback and reflecting it in the next aroma experience. This makes it possible to provide an aroma experience that is optimized for each user, thereby improving user comfort and satisfaction.
[0204] Interacting with the User
[0205] This is the process by which the system communicates with the user and collects information about their mental state and the tasks they are performing.
[0206] "Psychological state"
[0207] It refers to the user's state of mind, emotions, and mood.
[0208] "Work content"
[0209] This indicates the work or activities that the user is currently doing.
[0210] "Vital Data"
[0211] is biometric information that indicates the user's physical condition, such as heart rate, body temperature, and respiratory rate.
[0212] Real-time collection
[0213] This means that data is acquired immediately and entered into the system without delay.
[0214] "Collected conversation data"
[0215] is data that the system obtains through interaction with the user.
[0216] "Collected vital data"
[0217] This is data that is input into the system as biometric information such as heart rate, body temperature, and respiratory rate.
[0218] "analysis"
[0219] is the process of examining, evaluating, and finding meaning in collected data.
[0220] "Generative AI model"
[0221] is an algorithm that uses artificial intelligence to generate data for a specific purpose.
[0222] "The best aroma blend"
[0223] This is the most effective and suitable combination of aroma oils for the user based on the analysis results.
[0224] "dispenser"
[0225] is a device that mixes liquids or powders in specific proportions.
[0226] "Diffusion throughout the indoor space"
[0227] This means spreading the produced aromatic oil within a specific space.
[0228] "In a virtual environment"
[0229] refers to digital environments, including virtual reality and augmented reality.
[0230] "feedback"
[0231] These are the impressions, opinions, and response data provided by users to the system after their experience.
[0232] "I will reflect this in my next aroma experience."
[0233] This means utilizing feedback from users and incorporating that information into future aroma blends.
[0234] System Overview
[0235] This system collects the user's psychological state and work details through dialogue, monitors vital data in real time, analyzes the data, and creates, mixes, and diffuses the optimal aroma oil blend into the room. It also collects and analyzes user feedback and can reflect it in the next aroma experience.
[0236] Hardware and software used
[0237] 1. Hardware:
[0238] Smartphone
[0239] Smartwatch
[0240] Vital Data Monitoring Device
[0241] Aroma diffuser
[0242] 2. Software:
[0243] AI conversation engine (e.g., Google® Dialogflow)
[0244] Data analysis platform (e.g., TENSORFLOW (registered trademark), Scikit-learn)
[0245] Natural language processing tools (e.g., spaCy, NLTK)
[0246] Cloud services (e.g., AWS (registered trademark), GCP)
[0247] Data collection and analysis
[0248] The server collects conversation data when the user accesses the AI conversation engine using a smartphone and inputs their current mood and work. At the same time, when the user wears a smartwatch or vital data monitoring device, vital data such as heart rate, body temperature, and respiratory rate are collected in real time.
[0249] The collected data is sent to a cloud server and stored in a database. The server uses natural language processing technology to analyze the dialogue data and identify the user's psychological state. At the same time, machine learning algorithms are used to analyze the vital signs and determine the user's real-time physical condition.
[0250] Aroma Profiling
[0251] Based on the analysis results, the server uses a generative AI model to determine the aroma blend that best suits the user's needs, and this blend information is sent to the dispenser module.
[0252] Aroma blend composition and diffusion
[0253] The dispenser module mixes the aromatic oils in the correct proportions based on instructions received from the server, and the mixed aromatic oils are then diffused into the room through the aroma diffuser.
[0254] User feedback and next adjustments
[0255] After experiencing the aroma, users can input their impressions and effects as feedback into their smartphone. The server analyzes this feedback data and adjusts the aroma blend for future visits.
[0256] Examples and prompts
[0257] For example, if a user types "I want to improve my concentration" and their heart rate is measured as 85 BPM on their smartwatch, the server will use a natural language processing algorithm to identify the desire to improve concentration from the conversation data, and then use a machine learning algorithm to analyze the vital data. As a result, rosemary and peppermint will be selected as the optimal blend.
[0258] Example prompt sentence:
[0259] Below are the conversational and vital data collected from users. Please suggest the best aroma oil blend and ratio to improve concentration.
[0260] Conversation data: difficulty concentrating, stress
[0261] Vital data: Heart rate 85 BPM, body temperature 36.8℃
[0262] In this way, the system can provide an optimal aroma experience tailored to the user's specific needs, improving comfort and performance.
[0263] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0264] Step 1:
[0265] The user launches the AI conversation application on their smartphone and inputs their psychological state and work details. The input data is stored on the device as dialogue data. Furthermore, when the user wears a smartwatch or vital data monitoring device, vital data such as heart rate, body temperature, and respiratory rate are collected in real time on the device.
[0266] Input: User's mental state, work content, vital data (heart rate, body temperature, respiratory rate)
[0267] Output: Collected interaction data and vital data
[0268] Step 2:
[0269] The collected conversation data and vital signs are sent in real time from the device to a cloud server, where the device formats and converts the data into a format that the server can easily analyze.
[0270] Input: Collected interaction data and vital data
[0271] Output: Formatted data
[0272] Step 3:
[0273] The server uses a natural language processing (NLP) engine to analyze the user's psychological state and the tasks they are performing based on the dialogue data sent to it, while also using machine learning algorithms to analyze vital data and determine the user's real-time physical condition.
[0274] Input: Interaction data and vital data
[0275] Output: Analysis results (user's mental state, work content, physical state)
[0276] Step 4:
[0277] The server uses a generative AI model based on the analysis results to determine the optimal aroma blend tailored to the user's needs. Specifically, it generates the types of aroma oils and their blend ratios according to the user's psychological and physical state.
[0278] Input: Analysis results (mental state, work content, physical state)
[0279] Output: Optimal aroma blend profile
[0280] Step 5:
[0281] The server sends the profile of the optimal aroma blend to the dispenser module, which then accurately blends each aroma oil in the specified ratio and returns the result to the terminal.
[0282] Input: Aroma Blend Profile
[0283] Output: Pre-blended aroma oil
[0284] Step 6:
[0285] The aroma diffuser receives the blended aroma oil from the device and diffuses it into the room. The device monitors the operation status of the diffuser to ensure proper diffusion.
[0286] Input: Pre-blended aroma oil
[0287] Output: Diffused aroma
[0288] Step 7:
[0289] Users input their impressions and effects of the aroma experience as feedback into their smartphone, and the device sends this feedback data to the server.
[0290] Input: User feedback
[0291] Output: Feedback data sent to the server
[0292] Step 8:
[0293] The server analyzes the collected feedback data and reflects it in the next aroma blend. Based on the user's preferences and experience, the algorithm continuously improves the quality of the aroma blend.
[0294] Input: Feedback data
[0295] Output: Improved aroma blend profile
[0296] Through these steps, the system can provide users with an optimized aroma experience, improving comfort and satisfaction.
[0297] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0298] This invention is a system that generates and adjusts optimal aroma oils through dialogue with the user, collection of vital data, and emotion recognition. This system can provide the optimal aroma experience according to the psychological, emotional, and physical state of each individual user.
[0299] System Configuration
[0300] The system consists of the following main components:
[0301] 1. AI Conversation Engine
[0302] 2. Vital Data Monitoring Device
[0303] 3. Emotion Engine
[0304] 4. Data Analysis Module
[0305] 5. Aroma Profiling Module
[0306] 6. Dispenser Module
[0307] 7. Aroma diffuser
[0308] 8. Feedback Module
[0309] Program processing
[0310] Data collection
[0311] Device: The user launches the AI conversation app and inputs their current work and mood. They also wear a vital data monitoring device. Furthermore, voice and facial expression data are collected using the emotion engine's input devices (microphone and camera).
[0312] Sending data
[0313] Terminal: Collected interaction data, vital data, and emotion data are sent to the server in real time.
[0314] Data storage and analysis
[0315] Server: Stores the received data in a database. Natural language processing (NLP) algorithms analyze the dialogue data to identify the user's task and psychological state. Machine learning algorithms analyze vital data to determine real-time physical condition. The emotion engine analyzes voice and facial expression data to determine the user's emotions in real time.
[0316] Aroma Profiling
[0317] Server: Generates the optimal blend of aroma oils to suit the user's needs based on the results of an integrated analysis of psychological state, physical state, and emotions.
[0318] Aroma blend composition
[0319] Server: Sends the generated aroma profile to the dispenser module.
[0320] Terminal: The dispenser module receives instructions from the server and mixes each aromatic oil in the correct proportions.
[0321] Aroma diffusion
[0322] Terminal: The aroma diffuser diffuses the blended aroma oil into the room.
[0323] User Feedback
[0324] User: Enters feedback into the device, such as whether the aroma experience improved their concentration and whether the strength of the scent was appropriate.
[0325] Feedback analysis and adjustment
[0326] Server: Analyzes the collected feedback data and adjusts the blend ratio and fragrance intensity for future batches.
[0327] Specific examples
[0328] Data collection and analysis
[0329] User: Because they are unable to maintain concentration while teleworking, they input "I want to concentrate" into the AI conversation app and wear a vital data monitoring device. In addition, the emotion engine collects the user's voice and facial expression data.
[0330] Terminal: Interaction data, vital data, and emotion data are collected and sent to the server.
[0331] Server: Analyzes the dialogue data using natural language processing (NLP) to determine that the user is seeking increased concentration. Analyzing vital data reveals that the user's heart rate is high (e.g., 85 BPM), indicating stress. The emotion engine analyzes voice and facial expression data to recognize emotions such as "impatience" in real time.
[0332] Aroma Profiling and Blending
[0333] Server: Based on the integrated results of psychological state, physical state, and emotions, it generates a blend of 70% rosemary and 30% peppermint, which is effective for improving concentration. It sends this information to the dispenser module.
[0334] Terminal: The dispenser module mixes the aroma oil as instructed, and the aroma diffuser spreads it throughout the room.
[0335] Aroma diffusion and feedback
[0336] User: Works while enjoying the scent, then enters feedback such as "My concentration has improved, but the scent is a little strong."
[0337] Server: We'll analyze your feedback and adjust the ratio to less peppermint and more rosemary next time.
[0338] In this way, the system can provide a personalized scent experience based on the user's needs and emotions, improving comfort and work efficiency.
[0339] The processing flow will be explained below.
[0340] Step 1:
[0341] User: Launches the AI conversation app and inputs the details of the task and current mental state. For example, the user might input "I want to concentrate." The user also wears a vital data monitoring device (heart rate monitor, thermometer, etc.).
[0342] Step 2:
[0343] On the device: The AI conversation engine initiates a dialogue with the user and asks more detailed questions, such as "What exactly are you working on?" or "How are you feeling right now?"
[0344] Step 3:
[0345] Terminal: Vital data monitoring device collects vital data such as heart rate, body temperature, and respiratory rate in real time.
[0346] Step 4:
[0347] Device: The emotion engine collects the user's voice and facial expressions through the camera and microphone, and analyzes this data in real time.
[0348] Step 5:
[0349] Terminal: Transmits collected interaction data, vital data, and emotion data to the server in real time.
[0350] Step 6:
[0351] Server: Stores the received data in a database.
[0352] Step 7:
[0353] Server: Analyzes the dialogue data using natural language processing (NLP) algorithms to identify the user's task and psychological state. For example, it identifies the user's desire to "concentrate."
[0354] Step 8:
[0355] Server: Machine learning algorithms analyze vital data and determine real-time physical conditions. For example, a high heart rate can indicate stress.
[0356] Step 9:
[0357] Server: The emotion engine analyzes voice data (tone, speed, etc.) and facial expression data (camera images) to recognize the user's emotional state (e.g., "anxious" or "relaxed").
[0358] Step 10:
[0359] Server: Generates the optimal blend of aroma oils based on the integrated results of psychological, physical, and emotional states. For example, a blend of 70% rosemary and 30% peppermint is generated to improve concentration.
[0360] Step 11:
[0361] Server: Sends the generated aroma profile to the dispenser module.
[0362] Step 12:
[0363] Terminal: The dispenser module receives instructions from the server and mixes each aromatic oil in the correct proportions, for example, accurately measuring out 70% rosemary and 30% peppermint.
[0364] Step 13:
[0365] Terminal: The aroma diffuser diffuses the blended aroma oil throughout the room, for example, automatically releasing the scent at regular intervals.
[0366] Step 14:
[0367] User: Enters feedback into the device about how they felt through the aroma experience, whether their concentration improved, whether the strength of the scent was appropriate, etc.
[0368] Step 15:
[0369] Terminal: Sends collected feedback data to the server.
[0370] Step 16:
[0371] Server: Analyzes the feedback data and adjusts the blend of aroma oils and the strength of the scent from the next time onwards. For example, if the user gives feedback that "the peppermint is too strong," the proportion of peppermint will be reduced and the proportion of rosemary will be increased next time.
[0372] In this way, the system can provide a personalized scent experience based on the user's needs and emotions, improving comfort and work efficiency.
[0373] Example 2
[0374] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0375] Conventional aroma oil blending systems have difficulty recognizing the user's psychological and emotional state in real time and providing the optimal aroma blend based on that. They also lacked a mechanism for effectively incorporating user feedback and utilizing it in the next aroma blend. Furthermore, they lacked the technology to integrate and analyze collected vital data and emotional data, making it impossible to provide a personalized aroma experience tailored to the user's individual needs.
[0376] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0377] In this invention, the server includes means for collecting the user's psychological state and work content through dialogue with the user, means for collecting biological information in real time, and means for analyzing the collected voice and facial expression data to determine the user's emotions in real time. This makes it possible to generate an optimal fragrance blend in real time that comprehensively considers the user's psychological, physical, and emotional states, thereby providing a personalized aroma experience.
[0378] "Interaction with the user" is the process of using AI to collect information from the user about their work and psychological state.
[0379] "Mood" refers to a user's current emotional or mental state.
[0380] "Work content" refers to the specific content of the work or activity that the user is currently performing.
[0381] "Biometric information" includes physiological data such as the user's heart rate, body temperature, and respiratory rate.
[0382] "Real-time" refers to data collection and analysis occurring immediately, without delay.
[0383] "Voice data" refers to data that records the words and tone of voice spoken by a user.
[0384] "Facial expression data" is video data acquired to analyze a user's facial expressions.
[0385] "Emotions" refer to subjective experiences and feelings that indicate a user's psychological state.
[0386] A "fragrance blend" refers to a mixture of different fragrances in specific proportions.
[0387] "Proportioning device" means a device for mixing flavorings in specified proportions.
[0388] "Diffused throughout the room" means that the fragrance spreads throughout the room.
[0389] "Feedback" refers to the opinions and impressions provided by users after experiencing an aroma.
[0390] "Natural language processing technology" refers to technology for analyzing dialogue data and understanding human language.
[0391] MODE FOR CARRYING OUT THE INVENTION
[0392] (Detailed Description of the Invention)
[0393] This invention is a system that generates and adjusts optimal fragrance blends through dialogue with the user, collection of biometric information, and emotion recognition. This system can provide the optimal aroma experience according to the individual user's psychological, emotional, and physical state.
[0394] System Configuration
[0395] The system consists of the following main components:
[0396] 1. AI Conversation Engine
[0397] 2. Vital Data Monitoring Device
[0398] 3. Emotion Engine
[0399] 4. Data Analysis Module
[0400] 5. Aroma Profiling Module
[0401] 6. Dispenser Module
[0402] 7. Aroma diffuser
[0403] 8. Feedback Module
[0404] Technical details
[0405] The program of this system operates as follows.
[0406] 1. Data Collection
[0407] The user launches the AI conversation app and inputs their current work and mood. They also wear a vital data monitoring device. Furthermore, voice and facial expression data are collected using the emotion engine's input devices (microphone and camera).
[0408] 2. Data transmission
[0409] The terminal transmits the collected interaction data, biometric information, and emotion data to the server in real time.
[0410] 3. Data storage and analysis
[0411] The server stores the received data in a database. Natural language processing (NLP) algorithms analyze the dialogue data to identify the user's task and psychological state. Machine learning algorithms analyze biometric information to determine real-time physical state. An emotion engine analyzes voice and facial expression data to determine the user's emotions in real time.
[0412] 4. Aroma Profiling
[0413] The server generates a fragrance blend that best suits the user's needs based on the results of an integrated analysis of their psychological state, physical state, and emotions.
[0414] 5. Aroma blend composition
[0415] The server sends the generated aroma profile to the dispenser module.
[0416] The dispenser module in the terminal receives instructions from the server and mixes each fragrance in the correct proportions.
[0417] 6. Aroma diffusion
[0418] The device is an aroma diffuser that spreads the blended fragrance throughout the room.
[0419] 7. User Feedback
[0420] Users input feedback into the device, such as whether their concentration improved through the aroma experience and whether the strength of the scent was appropriate.
[0421] 8. Feedback Analysis and Adjustment
[0422] The server analyzes the collected feedback data and adjusts the blend ratio and fragrance intensity for future uses.
[0423] Specific examples
[0424] Specific examples are shown below.
[0425] Data collection and analysis
[0426] When a user is unable to maintain concentration while teleworking, they input "I want to concentrate" into the AI conversation app and wear a vital data monitoring device. In addition, the emotion engine collects the user's voice and facial expression data.
[0427] The terminal collects dialogue data, biometric information, and emotion data and transmits them to the server.
[0428] The server analyzes the dialogue data using natural language processing (NLP) to determine that the user is seeking improved concentration. Biometric analysis determines that the user's heart rate is high (e.g., 85 BPM), indicating stress. The emotion engine analyzes voice and facial expression data to recognize emotions such as "impatience" in real time.
[0429] Aroma Profiling and Blending
[0430] The server generates a blend of 70% rosemary and 30% peppermint, which is effective for improving concentration, based on the integrated results of psychological state, physical state, and emotions, and sends this information to the dispenser module.
[0431] The dispenser module in the device mixes the fragrance as instructed, and the aroma diffuser spreads it throughout the room.
[0432] Aroma diffusion and feedback
[0433] The user works while enjoying the scent, and then inputs feedback such as, "My concentration has improved, but the scent is a little strong."
[0434] The server analyzes the feedback and adjusts the ratio of peppermint to more rosemary next time.
[0435] Example prompts
[0436] "I'd like to improve my focus, so please suggest the best fragrance blend based on my current psychological state and biometric information."
[0437] Hardware / Software used
[0438] AI conversation engine: Natural language processing library
[0439] Vital Data Monitoring Devices: Heart Rate Monitor / Thermometer
[0440] Emotion engine: voice analysis software, facial expression recognition camera
[0441] Data Analysis Module: Machine Learning Models
[0442] Aroma Profiling Module: Algorithm
[0443] Dispenser module: Automatic blender
[0444] Aroma diffuser: Diffuser device
[0445] Feedback Module: User Interface
[0446] As described above, the embodiments of the invention are designed so that each component works together to provide the optimal aroma experience.
[0447] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0448] Step 1:
[0449] Data collection
[0450] The user launches the AI conversation app and inputs their current work and mood, such as "I want to concentrate." They also wear a vital data monitoring device that measures their heart rate and body temperature. Furthermore, the emotion engine's camera and microphone are used to collect voice and facial expression data.
[0451] Input: User interaction data (e.g., "I want to concentrate"), biometric information (heart rate, body temperature, etc.), voice data, and facial expression data.
[0452] Output: Various data collected.
[0453] Specific actions
[0454] "The user types 'I want to concentrate' into the AI conversation app, wears a heart rate monitor on their wrist, and speaks into the camera to collect voice and facial expression data."
[0455] Step 2:
[0456] Sending data
[0457] The terminal transmits the collected interaction data, biometric information, and emotion data to the server in real time.
[0458] Input: Various data collected.
[0459] Output: Various data sent to the server.
[0460] Specific actions
[0461] "The device sends the user's input data, heart rate, voice, and facial expression data to a server over a secure channel via the Internet."
[0462] Step 3:
[0463] Data storage and analysis
[0464] The server stores the received data in a database. The dialogue data is analyzed using natural language processing (NLP) algorithms to identify the user's task and psychological state. Biometric information is analyzed using machine learning algorithms to determine the user's physical state in real time. The emotion engine analyzes voice and facial expression data to determine the user's emotions in real time.
[0465] Input: Various data sent.
[0466] Output: Analysis results (mental state, physical state, emotions).
[0467] Specific actions
[0468] "The server stores the data in a database, analyzes the dialogue data using an NLP algorithm, and identifies the user's desire to 'concentrate'. The machine learning algorithm analyzes the heart rate data and determines the user's stress level. The emotion engine analyzes the voice and facial expression data and detects the emotion 'impatience'."
[0469] Step 4:
[0470] Aroma Profiling
[0471] The server generates a fragrance blend that best suits the user's needs based on the integrated results of their psychological state, physical state, and emotions.
[0472] Input: Analysis results (mental state, physical state, emotions).
[0473] Output: Recipe for optimal flavor blend.
[0474] Specific actions
[0475] "The server integrates the psychological state, physical state, and emotions to produce a blend of 70% Rosmary and 30% Peppermint, and sends this information to the dispenser module."
[0476] Step 5:
[0477] Aroma blend composition
[0478] The server transmits the generated aroma blend information to the dispenser module.
[0479] The dispenser module in the terminal receives instructions from the server and mixes each fragrance in the correct proportions.
[0480] Input: A recipe for the optimal flavoring blend.
[0481] Output: Pre-blended fragrance oil.
[0482] Specific actions
[0483] "The dispenser module, based on instructions from the server, uses precision meters and pumps to mix the flavors in a ratio of 70% to 30%."
[0484] Step 6:
[0485] Aroma diffusion
[0486] The device acts as an aroma diffuser, spreading the blended fragrance throughout the room.
[0487] Enter: pre-blended fragrance oils.
[0488] Output: Fragrance diffused throughout the room.
[0489] Specific actions
[0490] The aroma diffuser operates a fan to evenly distribute the fragrance throughout the room.
[0491] Step 7:
[0492] User Feedback
[0493] Users input feedback into the device, such as whether their concentration improved through the aroma experience and whether the strength of the scent was appropriate.
[0494] Input: User's impressions and requests based on the aroma experience.
[0495] Output: Feedback data.
[0496] Specific actions
[0497] "The user experiences the aroma for a few hours and then provides feedback on the device, such as 'My concentration has improved, but the scent is a bit strong.'"
[0498] Step 8:
[0499] Feedback analysis and adjustment
[0500] The server analyzes the collected feedback data and adjusts the blend ratio and fragrance intensity for future uses.
[0501] Input: Feedback data.
[0502] Output: A recipe for the adjusted flavor blend.
[0503] Specific actions
[0504] "The server analyzes the feedback data and adjusts the flavoring blend recipe to reduce the percentage of peppermint and increase the percentage of rosemary."
[0505] (Application example 2)
[0506] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0507] In recent years, there has been a demand for services that aim to improve user experiences in real spaces. However, current systems face the challenge of accurately collecting and analyzing users' psychological state and emotions in real time and diffusing aroma oil blends based on that information into physical spaces. In particular, providing optimal scents that match the emotions and psychological state of customers in physical stores is an urgent task, as it directly contributes to creating a comfortable space and increasing purchasing motivation.
[0508] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting the user's psychological state and task details through dialogue with the user, means for collecting the user's emotional state using a smartphone, means for collecting the user's vital data in real time, means for analyzing the collected dialogue data, emotional data, and vital data to determine the user's psychological and physical states, means for generating an optimal aroma oil blend based on the analysis results, means for mixing the generated aroma oil blend in an accurate ratio using a dispenser, and means for diffusing the blended aroma oils into real space. This makes it possible to provide an optimal aroma experience in real time based on the user's psychological state and emotions, thereby improving the user experience in real space.
[0509] "User" refers to an individual who uses the System.
[0510] "Dialogue" is a type of communication between a user and a system, and is carried out for the purpose of gathering information about the user's mental state and the content of their work.
[0511] A "smartphone" refers to a portable electronic device that has communication capabilities and can be used by installing specific applications.
[0512] "Emotional state" is data that represents the user's emotional response, and is collected from voice, facial expressions, etc.
[0513] "Vital data" refers to data that indicates physiological information such as the user's heart rate, body temperature, and respiratory rate.
[0514] "Real-time" refers to data being processed with almost no delay and results being provided immediately.
[0515] "Dialogue data" is information collected through dialogue with a user, and includes the user's psychological state and work content.
[0516] "Emotion data" is emotional information analyzed from the user's voice and facial expressions.
[0517] "Mental state" is information that indicates the mental state of the user, and is inferred from dialogue data and emotion data.
[0518] "Physical condition" is information indicating the physiological state of the user, and is analyzed from vital data.
[0519] "Aroma oil" is an oil containing aromatic substances extracted from plants, etc., and is used in aromatherapy.
[0520] A "blend" refers to a mixture of multiple aromatic oils in a specific ratio.
[0521] A "dispenser" is a device that mixes aromatic oils in a specified ratio.
[0522] "Diffusion" refers to spreading the blended aroma oils into physical space.
[0523] A "real space" is a physical space where a user actually exists.
[0524] "Feedback" refers to the opinions and thoughts that users provide to the system about their experience and usage.
[0525] "Adjusting" means changing the system settings or aroma oil blends based on the feedback.
[0526] "Natural language processing technology" is a technology that analyzes dialogue data to understand the user's intentions and psychological state.
[0527] "Heart rate, body temperature, and respiratory rate data" are basic physiological indicators that make up the user's vital data.
[0528] System Configuration
[0529] The present invention provides an aroma service system that improves user experience in brick-and-mortar stores. This system is comprised of the following main hardware and software:
[0530] Hardware
[0531] 1. Smartphone
[0532] 2. Vital data monitoring devices (e.g., smart watches)
[0533] 3. Aroma diffusers in brick-and-mortar stores
[0534] 4. Server
[0535] software
[0536] 1. AI conversation engines (e.g., Dialogflow, a natural language processing technology)
[0537] 2. Vital data monitoring device integration API (e.g. Fitbit API)
[0538] 3. Emotion Recognition Software (e.g., Azure® Cognitive Services)
[0539] 4. Data analysis modules (e.g., TensorFlow)
[0540] 5. Aroma Profiling Module
[0541] 6. Dispenser module (e.g. Arduino controlled)
[0542] Program processing procedure (overview)
[0543] Data collection
[0544] Device: A user enters a store and launches the smartphone application. The application presents simple questions to collect the customer's psychological and emotional state. The user wears a vital data monitoring device (smartwatch) and collects data in real time. Emotion recognition software is used to capture facial and voice data from the smartphone's camera and microphone.
[0545] Data transmission and analysis
[0546] Server: Interaction data, emotional data, and vital data collected from smartphones and other devices are sent to the server in real time. The server stores this data in a database and analyzes it using natural language processing technology (Dialogflow) and emotion recognition software (Azure Cognitive Services). Specifically, the server identifies the user's psychological state and task content based on the interaction data, and determines the user's emotional state from the emotional data. Vital data includes the user's heart rate, body temperature, and respiratory rate.
[0547] Aroma Profiling and Blend Formulation
[0548] Server: Generates the optimal aroma oil blend for the user based on the analysis of their psychological, emotional, and physical state (vital data). This generated aroma profile is sent to the dispenser module, and the aroma diffuser in the physical store mixes the aroma oils in a specific ratio and diffuses them into the space.
[0549] User feedback and aroma blend adjustments
[0550] Users: Experience the scent in the store and then provide feedback via a smartphone app. They can enter specific opinions such as, "My concentration improved, but the scent is a little strong."
[0551] Server: The collected feedback data will be analyzed and the blend ratio and strength of the aroma oils will be adjusted from the next time onwards. For example, the ratio of peppermint will be reduced and the ratio of rosemary will be increased.
[0552] Specific examples
[0553] Assume that a user wants to improve their concentration while teleworking. In this case, the user enters "I want to concentrate" into a smartphone application and wears a vital data monitoring device. At the same time, an emotion recognition engine recognizes the emotion of "anxiety" from the user's voice and facial expression. Based on this data, the server generates an aroma blend (e.g., 70% rosemary, 30% peppermint) effective for improving concentration and sends instructions to the aroma diffuser.
[0554] Example prompt sentence:
[0555] "I feel like relaxing today. I've been feeling a bit stressed lately."
[0556] In this way, the brick-and-mortar aroma service system of the present invention can improve the user experience in real space by analyzing the user's psychological state and emotions in real time and providing the most appropriate aroma oil based on that.
[0557] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0558] Step 1:
[0559] Data collection
[0560] Input: A user visits a physical store and launches the smartphone application. They answer simple questions provided within the app and input their emotional and psychological state. They wear a vital data monitoring device (smartwatch) that collects data such as heart rate, body temperature, and respiratory rate in real time. The camera and microphone are used to capture facial and voice data using emotion recognition software.
[0561] Data processing: The collected interaction data, emotion data, and vital data are formatted and sent to the server.
[0562] Output: Dialogue data, emotion data, and vital data are sent to the server.
[0563] Step 2:
[0564] Data storage and initial analysis
[0565] Input: The interaction data, emotion data, and vital data sent as the output of Step 1.
[0566] Data processing: The server stores the received data in a database and analyzes the dialogue data using natural language processing technology (Dialogflow). At the same time, emotion recognition software (Azure Cognitive Services) analyzes the emotional data to identify the emotional state. Vital data is analyzed using a machine learning algorithm (TensorFlow) to determine the physical condition.
[0567] Output: Analysis of the user's mental, emotional and physical state.
[0568] Step 3:
[0569] Aroma Profiling
[0570] Input: Analysis results as output of step 2 (mental, emotional, and physical states).
[0571] Data calculation: Based on the analysis results, the server uses the aroma profiling module to generate the optimal aroma oil blend. Specifically, it comprehensively analyzes data such as psychological state (e.g., need for concentration), emotional state (e.g., impatience), and physical state (e.g., high heart rate) to determine the type and ratio of aroma oils.
[0572] Output: Optimal aroma oil blend profile.
[0573] Step 4:
[0574] Aroma blend composition
[0575] Input: Aroma oil blend profile as output of step 3.
[0576] Data processing: The aroma blend profile is sent to the dispenser module (controlled by Arduino), which then precisely blends each aroma oil in the specified ratio.
[0577] Output: Blended aroma oil.
[0578] Step 5:
[0579] Aroma diffusion
[0580] Input: Blended aroma oils as output of step 4.
[0581] How it works: The aroma diffuser receives the aroma oil blended in the dispenser module and diffuses it into the real space, allowing the user to experience the scent in the real space.
[0582] Output: Aroma diffused in real space.
[0583] Step 6:
[0584] Collecting and analyzing user feedback
[0585] Input: Feedback from users who experienced the scent in real space. Specific opinions such as "My concentration improved, but the scent was a little strong."
[0586] Data calculation: The server analyzes the collected feedback data and uses it to adjust the next aroma blend, for example, by reducing the proportion of peppermint and increasing the proportion of rosemary.
[0587] Output: New adjusted aroma blend profile.
[0588] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0589] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0590] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0591] [Second embodiment]
[0592] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0593] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0594] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0595] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0596] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0597] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0598] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0599] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0600] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0601] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0602] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0603] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0604] The present invention is a system that interacts with users, collects and analyzes vital data, blends and mixes aroma oils, diffuses them into the room, and collects feedback, allowing the system to provide an optimal aroma experience tailored to each individual user's psychological and physical state.
[0605] System Configuration
[0606] The system consists of the following main components:
[0607] 1. AI Conversation Engine
[0608] 2. Vital Data Monitoring Device
[0609] 3. Data Analysis Module
[0610] 4. Aroma Profiling Module
[0611] 5. Dispenser Module
[0612] 6. Aroma diffuser
[0613] 7. Feedback Module
[0614] Program processing
[0615] Data collection
[0616] Device: The user launches the AI conversation app and inputs their current work and mood. They also wear a vital data monitoring device. The device responds by starting a dialogue with the user, collecting their psychological state and needs. At the same time, vital data such as heart rate, body temperature, and respiratory rate are also collected in real time.
[0617] Sending data
[0618] Terminal: Collected interaction data and vital data are sent to the server in real time.
[0619] Data storage and analysis
[0620] Server: The received data is stored in a database. Natural language processing (NLP) algorithms analyze the dialogue data to identify the user's task and psychological state. At the same time, machine learning algorithms analyze vital data to determine real-time physical condition.
[0621] Aroma Profiling
[0622] Server: Based on the analysis results, it generates a blend of aroma oils that best suits the user's needs. This profile is sent to the dispenser module.
[0623] Aroma blend composition
[0624] Terminal: The dispenser module mixes each aromatic oil in the correct proportions based on instructions received from the server.
[0625] Aroma diffusion
[0626] Terminal: The aroma diffuser diffuses the blended aroma oil into the room.
[0627] User Feedback
[0628] User: Enter their impressions and effects of the aroma experience into the device.
[0629] Feedback analysis and adjustment
[0630] Server: Analyzes collected feedback data and adjusts the scent blend for future visits to continuously improve the quality of the scent experience.
[0631] Specific examples
[0632] Data collection and analysis
[0633] User: Because he / she is unable to maintain concentration while teleworking, he / she inputs "I want to concentrate" into the AI conversation app. He / she also wears a vital data monitoring device to collect data such as heart rate and body temperature.
[0634] Terminal: Interaction data and vital data are collected and sent to the server.
[0635] Server: Analyzes the dialogue data using natural language processing to determine that the user is seeking increased concentration. Analysis of vital data reveals that the user's heart rate is high (e.g., 85 BPM), indicating stress.
[0636] Aroma Profiling and Blending
[0637] Server: Based on the analysis results, it creates a blend of 70% rosemary and 30% peppermint, which is effective for improving concentration, and sends this information to the dispenser module.
[0638] Terminal: The dispenser module follows instructions from the server and mixes rosemary and peppermint in the specified ratio.
[0639] Aroma diffusion and feedback
[0640] Terminal: The blended aroma oil is diffused throughout the room through the aroma diffuser.
[0641] User: Works while enjoying the scent, then enters feedback such as "My concentration has improved, but the scent is a little strong."
[0642] Server: We'll analyze your feedback and adjust the ratio to less peppermint and more rosemary next time.
[0643] In this way, the system can provide a scent experience tailored to the user's needs, improving comfort and work efficiency.
[0644] The processing flow will be explained below.
[0645] Step 1:
[0646] User: Launches the AI conversation app and inputs the details of the task and current mental state into the device. For example, the user might input "I want to concentrate."
[0647] Step 2:
[0648] On the device: The AI conversation engine asks the user follow-up questions to gather more information, such as "What exactly are you working on?" or "How are you feeling right now?"
[0649] Step 3:
[0650] Terminal: Collects vital data such as the user's heart rate, body temperature, and respiratory rate in real time via a vital data monitoring device.
[0651] Step 4:
[0652] Terminal: Sends collected interaction data and vital data to the server in real time.
[0653] Step 5:
[0654] Server: Stores the received data in a database.
[0655] Step 6:
[0656] Server: Using natural language processing (NLP) algorithms, the server analyzes dialogue data and identifies the user's psychological state, such as "wanting to concentrate," and the task at hand.
[0657] Step 7:
[0658] Server: Analyzes vital data using machine learning algorithms and determines the user's physical condition (e.g., a high heart rate indicates stress).
[0659] Step 8:
[0660] Server: Based on the analysis results, the server generates a blend of aroma oils that is optimal for the user's psychological and physical state. For example, it generates a blend of 70% rosemary and 30% peppermint to "improve concentration."
[0661] Step 9:
[0662] Server: Sends the generated aroma profile to the dispenser module.
[0663] Step 10:
[0664] Terminal: The dispenser module follows the instructions received from the server and mixes each aromatic oil in the correct proportions, for example, accurately measuring out 70% rosemary and 30% peppermint.
[0665] Step 11:
[0666] Terminal: The aroma diffuser diffuses the blended aroma oil into the room, for example, releasing the scent at regular intervals.
[0667] Step 12:
[0668] User: Enters feedback into the device, such as whether the aroma experience improved their concentration and whether the strength of the scent was appropriate.
[0669] Step 13:
[0670] Terminal: Sends collected feedback data to the server.
[0671] Step 14:
[0672] Server: Analyzes the received feedback data and adjusts the blend ratio and fragrance intensity from the next time onwards. For example, if the user feedback is that "the peppermint is too strong," the ratio of peppermint will be adjusted to 20% next time.
[0673] In this way, the system can continuously optimize the scent experience according to the user's needs, improving comfort and work efficiency.
[0674] Example 1
[0675] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0676] In modern society, many people face problems such as stress, fatigue, and decreased concentration. To solve these problems, it is important to provide optimal relaxation and concentration-improving methods tailored to each individual user's psychological and physical state. However, with conventional methods, it has been difficult to accurately grasp the user's condition and provide an appropriate aroma oil blend based on that. It has also been difficult to continuously adjust the blend based on feedback.
[0677] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0678] In this invention, the server includes means for collecting the user's psychological state and work content through dialogue with the user, means for collecting the user's biological information in real time, means for analyzing the collected dialogue data and biological information to determine the user's psychological state and physical state, means for generating an optimal fragrance blend based on the analysis results, means for mixing the generated fragrance blend in an accurate ratio using a dispenser, means for diffusing the mixed fragrance into the room space, and means for collecting user evaluation information and adjusting the fragrance blend based on the evaluation information, thereby enabling the provision of an individually optimized aroma experience tailored to the user's needs and continuous adjustments.
[0679] "Dialogue data" is information about the psychological state and work content collected through dialogue with the user.
[0680] "Biometric information" refers to data relating to the user's physical condition, such as heart rate, body temperature, and respiratory rate, that is acquired in real time.
[0681] "Natural language processing technology" is a technology that enables computers to understand and analyze human language.
[0682] "Fragrance blending" refers to mixing multiple fragrances in a certain ratio.
[0683] A "dispenser" is a device that mixes liquids or gases, such as fragrances, in precise proportions.
[0684] "User evaluation information" refers to feedback provided by users regarding their impressions and effects after experiencing the aroma.
[0685] "Indoor space" refers to the inside of a room, office, or other enclosed space.
[0686] A "server" is a computer system that performs processes such as collecting, storing, analyzing, and distributing data over a network.
[0687] The present invention is a system that interacts with users, collects and analyzes vital data, blends and mixes aroma oils, diffuses them into the room, and collects feedback, allowing the system to provide an optimal aroma experience tailored to each individual user's psychological and physical state.
[0688] System Configuration
[0689] The system consists of the following main components:
[0690] 1. AI Conversation Engine
[0691] 2. Vital Data Monitoring Device
[0692] 3. Data Analysis Module
[0693] 4. Aroma Profiling Module
[0694] 5. Dispenser Module
[0695] 6. Aroma diffuser
[0696] 7. Feedback Module
[0697] Program processing
[0698] Data collection
[0699] The user launches the AI conversation app and inputs their current work and mood. They also wear a vital data monitoring device. The device responds by starting a dialogue with the user, collecting their psychological state and needs. At the same time, vital data such as heart rate, body temperature, and respiratory rate are also collected in real time.
[0700] Sending data
[0701] The device transmits collected interaction data and vital data to a server in real time using an internet connection.
[0702] Data storage and analysis
[0703] The server stores the received data in a database. It uses natural language processing (NLP) algorithms to analyze the dialogue data and identify the user's task and psychological state. At the same time, it uses machine learning algorithms to analyze the vital signs and determine the user's real-time physical condition.
[0704] Aroma Profiling
[0705] The server then generates a blend of aroma oils that best suits the user's needs based on the analysis results, and this profile is sent to the dispenser module.
[0706] Aroma blend composition
[0707] The dispenser module mixes each aromatic oil in the correct proportions based on instructions received from the server.
[0708] Aroma diffusion
[0709] The aroma diffuser diffuses the aromatic oils it contains into the room.
[0710] User Feedback
[0711] Users input their impressions and effects of the aroma experience into the terminal.
[0712] Feedback analysis and adjustment
[0713] The server analyzes the collected feedback data and adjusts the scent blend for future visits, continually improving the quality of the scent experience.
[0714] Specific examples
[0715] Data collection and analysis
[0716] Because the user is unable to maintain concentration while teleworking, they input "I want to concentrate" into an AI conversation app. They also wear a vital data monitoring device to collect data such as heart rate and body temperature. The device collects the dialogue data and vital data and sends it to a server. The server analyzes the dialogue data using natural language processing and determines that the user wants to improve their concentration. Analysis of the vital data reveals that the heart rate is high (e.g., 85 BPM), indicating that the user is feeling stressed.
[0717] Aroma Profiling and Blending
[0718] Based on the analysis results, the server generates a blend of 70% rosemary and 30% peppermint, which is effective for improving concentration. This information is sent to the dispenser module, which then follows instructions from the server to mix the rosemary and peppermint in the specified ratio.
[0719] Aroma diffusion and feedback
[0720] The device diffuses the blended aroma oil throughout the room through an aroma diffuser. The user works while enjoying the scent, and then inputs feedback such as "My concentration has improved, but the scent is a little strong." The server analyzes the feedback and adjusts the ratio of peppermint to rosemary next time.
[0721] Prompt Sentence Examples
[0722] The user enters "I want to concentrate" into the AI conversation app and wears a vital data monitoring device. The device receives this and sends the conversation data and vital data to the server. The server analyzes the data, determines that the user is seeking improved concentration, and generates an optimal aroma blend (e.g., 70% rosemary, 30% peppermint). The dispenser module mixes this blend, and the aroma diffuser diffuses it throughout the room. The user experiences the scent and provides feedback, and the server adjusts the blend for the next time.
[0723] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0724] Step 1:
[0725] The user launches the AI conversation app, inputs their current mental state and work details, and wears a vital data monitoring device (e.g., a smartwatch).
[0726] Input: Text data on mental state and work content, vital data such as heart rate, body temperature, and respiratory rate.
[0727] Output: Text data of collected psychological state and work content, and real-time vital data.
[0728] Specifically, the user enters "I want to concentrate" into the app, and then puts on the smartwatch, which records their heart rate and body temperature.
[0729] Step 2:
[0730] The device transmits collected text data on psychological state and work activity, as well as vital data, to a server in real time using an internet connection.
[0731] Input: Text data of collected psychological state and work content, vital data.
[0732] Output: Collected data sent to the server.
[0733] Specifically, the terminal encrypts and transmits text data and vital data to a server via the Internet.
[0734] Step 3:
[0735] The server stores the received data in a database, then uses natural language processing (NLP) algorithms to analyze the dialogue data and identify the user's psychological state and work needs, while using machine learning algorithms to analyze the vital signs and determine the user's real-time physical condition.
[0736] Input: Text data of mental state and work content, and vital data sent to the server.
[0737] Output: Analyzed information about the user's psychological state, task needs, and real-time physical condition.
[0738] Specifically, the server analyzes the dialogue data entered as "I want to concentrate" and determines that the user wants to improve their concentration. It also recognizes from vital signs that the heart rate is 85 BPM and determines that the user is feeling stressed.
[0739] Step 4:
[0740] Based on the analysis results, the server generates a blend of aroma oils that best suits the user's needs, and this profile is sent to the dispenser module.
[0741] Input: Analyzed psychological state, work needs, and real-time physical state information.
[0742] Output: Information on optimal aroma oil blend.
[0743] Specifically, it creates a blend of 70% rosemary and 30% peppermint, which is effective in improving concentration, and sends that information to the dispenser module.
[0744] Step 5:
[0745] The dispenser module mixes each aromatic oil in the correct proportions based on instructions received from the server.
[0746] Input: Information on optimal aroma oil blend.
[0747] Output: Precisely formulated aromatic oils.
[0748] Specifically, the dispenser module mixes rosemary and peppermint in the specified ratio.
[0749] Step 6:
[0750] The device's aroma diffuser diffuses the blended aroma oil into the room.
[0751] Input: precisely formulated aromatic oils.
[0752] Output: Aroma diffused into the room.
[0753] Specifically, the fan built into the aroma diffuser is activated to diffuse the aroma oil throughout the room.
[0754] Step 7:
[0755] Users input their impressions and effects of the aroma experience into the terminal.
[0756] Input: Feedback data on impressions and effects of aroma experience.
[0757] Output: Collected user feedback data.
[0758] As a specific action, the user inputs feedback such as "My concentration has improved, but the scent is a little strong."
[0759] Step 8:
[0760] The server analyzes the collected feedback data and adjusts the fragrance blend for future applications, for example by sending instructions to the dispenser module to reduce the proportion of peppermint and increase the proportion of rosemary.
[0761] Input: Collected user feedback data.
[0762] Output: Adjusted aroma oil blend information for next use.
[0763] Specifically, the server analyzes the feedback data, generates new blending instructions, and sends them.
[0764] (Application example 1)
[0765] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0766] With conventional aroma oils, it was difficult to generate and provide optimal aroma blends tailored to the user's psychological and physical state. Furthermore, the collection and analysis of vital data in real time, and the provision of effective aroma experiences in virtual environments were not fully realized. This limited the provision of personalized aroma experiences tailored to individual users. Furthermore, it was difficult to appropriately adjust the aroma blend based on feedback and reflect it in the next offering.
[0767] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0768] In this invention, the server includes means for collecting the user's psychological state and work content through dialogue with the user, means for collecting the user's vital data in real time, means for analyzing the collected dialogue data and vital data to determine the user's psychological and physical state, means for determining an aroma blend that is optimal for the user's needs from the dialogue data and vital data using a generative AI model, means for mixing the generated aroma oil blend in an accurate ratio using a dispenser, means for diffusing the blended aroma oil into a room space, means for providing an aroma experience in a virtual environment, and means for collecting feedback and reflecting it in the next aroma experience. This makes it possible to provide an aroma experience that is optimized for each user, thereby improving user comfort and satisfaction.
[0769] Interacting with the User
[0770] This is the process by which the system communicates with the user and collects information about their mental state and the tasks they are performing.
[0771] "Psychological state"
[0772] It refers to the user's state of mind, emotions, and mood.
[0773] "Work content"
[0774] This indicates the work or activities that the user is currently doing.
[0775] "Vital Data"
[0776] is biometric information that indicates the user's physical condition, such as heart rate, body temperature, and respiratory rate.
[0777] Real-time collection
[0778] This means that data is acquired immediately and entered into the system without delay.
[0779] "Collected conversation data"
[0780] is data that the system obtains through interaction with the user.
[0781] "Collected vital data"
[0782] This is data that is input into the system as biometric information such as heart rate, body temperature, and respiratory rate.
[0783] "analysis"
[0784] is the process of examining, evaluating, and finding meaning in collected data.
[0785] "Generative AI model"
[0786] is an algorithm that uses artificial intelligence to generate data for a specific purpose.
[0787] "The best aroma blend"
[0788] This is the most effective and suitable combination of aroma oils for the user based on the analysis results.
[0789] "dispenser"
[0790] is a device that mixes liquids or powders in specific proportions.
[0791] "Diffusion throughout the indoor space"
[0792] This means spreading the produced aromatic oil within a specific space.
[0793] "In a virtual environment"
[0794] refers to digital environments, including virtual reality and augmented reality.
[0795] "feedback"
[0796] These are the impressions, opinions, and response data provided by users to the system after their experience.
[0797] "I will reflect this in my next aroma experience."
[0798] This means utilizing feedback from users and incorporating that information into future aroma blends.
[0799] System Overview
[0800] This system collects the user's psychological state and work details through dialogue, monitors vital data in real time, analyzes the data, and creates, mixes, and diffuses the optimal aroma oil blend into the room. It also collects and analyzes user feedback and can reflect it in the next aroma experience.
[0801] Hardware and software used
[0802] 1. Hardware:
[0803] Smartphone
[0804] Smartwatch
[0805] Vital Data Monitoring Device
[0806] Aroma diffuser
[0807] 2. Software:
[0808] AI conversation engine (e.g. Google Dialogflow)
[0809] Data analysis platforms (e.g. TensorFlow, Scikit-learn)
[0810] Natural language processing tools (e.g., spaCy, NLTK)
[0811] Cloud services (e.g. AWS, GCP)
[0812] Data collection and analysis
[0813] The server collects conversation data when the user accesses the AI conversation engine using a smartphone and inputs their current mood and work. At the same time, when the user wears a smartwatch or vital data monitoring device, vital data such as heart rate, body temperature, and respiratory rate are collected in real time.
[0814] The collected data is sent to a cloud server and stored in a database. The server uses natural language processing technology to analyze the dialogue data and identify the user's psychological state. At the same time, machine learning algorithms are used to analyze the vital signs and determine the user's real-time physical condition.
[0815] Aroma Profiling
[0816] Based on the analysis results, the server uses a generative AI model to determine the aroma blend that best suits the user's needs, and this blend information is sent to the dispenser module.
[0817] Aroma blend composition and diffusion
[0818] The dispenser module mixes the aromatic oils in the correct proportions based on instructions received from the server, and the mixed aromatic oils are then diffused into the room through the aroma diffuser.
[0819] User feedback and next adjustments
[0820] After experiencing the aroma, users can input their impressions and effects as feedback into their smartphone. The server analyzes this feedback data and adjusts the aroma blend for future visits.
[0821] Examples and prompts
[0822] For example, if a user types "I want to improve my concentration" and their heart rate is measured as 85 BPM on their smartwatch, the server will use a natural language processing algorithm to identify the desire to improve concentration from the conversation data, and then use a machine learning algorithm to analyze the vital data. As a result, rosemary and peppermint will be selected as the optimal blend.
[0823] Example prompt sentence:
[0824] Below are the conversational and vital data collected from users. Please suggest the best aroma oil blend and ratio to improve concentration.
[0825] Conversation data: difficulty concentrating, stress
[0826] Vital data: Heart rate 85 BPM, body temperature 36.8℃
[0827] In this way, the system can provide an optimal aroma experience tailored to the user's specific needs, improving comfort and performance.
[0828] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0829] Step 1:
[0830] The user launches the AI conversation application on their smartphone and inputs their psychological state and work details. The input data is stored on the device as dialogue data. Furthermore, when the user wears a smartwatch or vital data monitoring device, vital data such as heart rate, body temperature, and respiratory rate are collected in real time on the device.
[0831] Input: User's mental state, work content, vital data (heart rate, body temperature, respiratory rate)
[0832] Output: Collected interaction data and vital data
[0833] Step 2:
[0834] The collected conversation data and vital signs are sent in real time from the device to a cloud server, where the device formats and converts the data into a format that the server can easily analyze.
[0835] Input: Collected interaction data and vital data
[0836] Output: Formatted data
[0837] Step 3:
[0838] The server uses a natural language processing (NLP) engine to analyze the user's psychological state and the tasks they are performing based on the dialogue data sent to it, while also using machine learning algorithms to analyze vital data and determine the user's real-time physical condition.
[0839] Input: Interaction data and vital data
[0840] Output: Analysis results (user's mental state, work content, physical state)
[0841] Step 4:
[0842] The server uses a generative AI model based on the analysis results to determine the optimal aroma blend tailored to the user's needs. Specifically, it generates the types of aroma oils and their blend ratios according to the user's psychological and physical state.
[0843] Input: Analysis results (mental state, work content, physical state)
[0844] Output: Optimal aroma blend profile
[0845] Step 5:
[0846] The server sends the profile of the optimal aroma blend to the dispenser module, which then accurately blends each aroma oil in the specified ratio and returns the result to the terminal.
[0847] Input: Aroma Blend Profile
[0848] Output: Pre-blended aroma oil
[0849] Step 6:
[0850] The aroma diffuser receives the blended aroma oil from the device and diffuses it into the room. The device monitors the operation status of the diffuser to ensure proper diffusion.
[0851] Input: Pre-blended aroma oil
[0852] Output: Diffused aroma
[0853] Step 7:
[0854] Users input their impressions and effects of the aroma experience as feedback into their smartphone, and the device sends this feedback data to the server.
[0855] Input: User feedback
[0856] Output: Feedback data sent to the server
[0857] Step 8:
[0858] The server analyzes the collected feedback data and reflects it in the next aroma blend. Based on the user's preferences and experience, the algorithm continuously improves the quality of the aroma blend.
[0859] Input: Feedback data
[0860] Output: Improved aroma blend profile
[0861] Through these steps, the system can provide users with an optimized aroma experience, improving comfort and satisfaction.
[0862] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0863] This invention is a system that generates and adjusts optimal aroma oils through dialogue with the user, collection of vital data, and emotion recognition. This system can provide the optimal aroma experience according to the psychological, emotional, and physical state of each individual user.
[0864] System Configuration
[0865] The system consists of the following main components:
[0866] 1. AI Conversation Engine
[0867] 2. Vital Data Monitoring Device
[0868] 3. Emotion Engine
[0869] 4. Data Analysis Module
[0870] 5. Aroma Profiling Module
[0871] 6. Dispenser Module
[0872] 7. Aroma diffuser
[0873] 8. Feedback Module
[0874] Program processing
[0875] Data collection
[0876] Device: The user launches the AI conversation app and inputs their current work and mood. They also wear a vital data monitoring device. Furthermore, voice and facial expression data are collected using the emotion engine's input devices (microphone and camera).
[0877] Sending data
[0878] Terminal: Collected interaction data, vital data, and emotion data are sent to the server in real time.
[0879] Data storage and analysis
[0880] Server: Stores the received data in a database. Natural language processing (NLP) algorithms analyze the dialogue data to identify the user's task and psychological state. Machine learning algorithms analyze vital data to determine real-time physical condition. The emotion engine analyzes voice and facial expression data to determine the user's emotions in real time.
[0881] Aroma Profiling
[0882] Server: Generates the optimal blend of aroma oils to suit the user's needs based on the results of an integrated analysis of psychological state, physical state, and emotions.
[0883] Aroma blend composition
[0884] Server: Sends the generated aroma profile to the dispenser module.
[0885] Terminal: The dispenser module receives instructions from the server and mixes each aromatic oil in the correct proportions.
[0886] Aroma diffusion
[0887] Terminal: The aroma diffuser diffuses the blended aroma oil into the room.
[0888] User Feedback
[0889] User: Enters feedback into the device, such as whether the aroma experience improved their concentration and whether the strength of the scent was appropriate.
[0890] Feedback analysis and adjustment
[0891] Server: Analyzes the collected feedback data and adjusts the blend ratio and fragrance intensity for future batches.
[0892] Specific examples
[0893] Data collection and analysis
[0894] User: Because they are unable to maintain concentration while teleworking, they input "I want to concentrate" into the AI conversation app and wear a vital data monitoring device. In addition, the emotion engine collects the user's voice and facial expression data.
[0895] Terminal: Interaction data, vital data, and emotion data are collected and sent to the server.
[0896] Server: Analyzes the dialogue data using natural language processing (NLP) to determine that the user is seeking increased concentration. Analyzing vital data reveals that the user's heart rate is high (e.g., 85 BPM), indicating stress. The emotion engine analyzes voice and facial expression data to recognize emotions such as "impatience" in real time.
[0897] Aroma Profiling and Blending
[0898] Server: Based on the integrated results of psychological state, physical state, and emotions, it generates a blend of 70% rosemary and 30% peppermint, which is effective for improving concentration. It sends this information to the dispenser module.
[0899] Terminal: The dispenser module mixes the aroma oil as instructed, and the aroma diffuser spreads it throughout the room.
[0900] Aroma diffusion and feedback
[0901] User: Works while enjoying the scent, then enters feedback such as "My concentration has improved, but the scent is a little strong."
[0902] Server: We'll analyze your feedback and adjust the ratio to less peppermint and more rosemary next time.
[0903] In this way, the system can provide a personalized scent experience based on the user's needs and emotions, improving comfort and work efficiency.
[0904] The processing flow will be explained below.
[0905] Step 1:
[0906] User: Launches the AI conversation app and inputs the details of the task and current mental state. For example, the user might input "I want to concentrate." The user also wears a vital data monitoring device (heart rate monitor, thermometer, etc.).
[0907] Step 2:
[0908] On the device: The AI conversation engine initiates a dialogue with the user and asks more detailed questions, such as "What exactly are you working on?" or "How are you feeling right now?"
[0909] Step 3:
[0910] Terminal: Vital data monitoring device collects vital data such as heart rate, body temperature, and respiratory rate in real time.
[0911] Step 4:
[0912] Device: The emotion engine collects the user's voice and facial expressions through the camera and microphone, and analyzes this data in real time.
[0913] Step 5:
[0914] Terminal: Transmits collected interaction data, vital data, and emotion data to the server in real time.
[0915] Step 6:
[0916] Server: Stores the received data in a database.
[0917] Step 7:
[0918] Server: Analyzes the dialogue data using natural language processing (NLP) algorithms to identify the user's task and psychological state. For example, it identifies the user's desire to "concentrate."
[0919] Step 8:
[0920] Server: Machine learning algorithms analyze vital data and determine real-time physical conditions. For example, a high heart rate can indicate stress.
[0921] Step 9:
[0922] Server: The emotion engine analyzes voice data (tone, speed, etc.) and facial expression data (camera images) to recognize the user's emotional state (e.g., "anxious" or "relaxed").
[0923] Step 10:
[0924] Server: Generates the optimal blend of aroma oils based on the integrated results of psychological, physical, and emotional states. For example, a blend of 70% rosemary and 30% peppermint is generated to improve concentration.
[0925] Step 11:
[0926] Server: Sends the generated aroma profile to the dispenser module.
[0927] Step 12:
[0928] Terminal: The dispenser module receives instructions from the server and mixes each aromatic oil in the correct proportions, for example, accurately measuring out 70% rosemary and 30% peppermint.
[0929] Step 13:
[0930] Terminal: The aroma diffuser diffuses the blended aroma oil throughout the room, for example, automatically releasing the scent at regular intervals.
[0931] Step 14:
[0932] User: Enters feedback into the device about how they felt through the aroma experience, whether their concentration improved, whether the strength of the scent was appropriate, etc.
[0933] Step 15:
[0934] Terminal: Sends collected feedback data to the server.
[0935] Step 16:
[0936] Server: Analyzes the feedback data and adjusts the blend of aroma oils and the strength of the scent from the next time onwards. For example, if the user gives feedback that "the peppermint is too strong," the proportion of peppermint will be reduced and the proportion of rosemary will be increased next time.
[0937] In this way, the system can provide a personalized scent experience based on the user's needs and emotions, improving comfort and work efficiency.
[0938] Example 2
[0939] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0940] Conventional aroma oil blending systems have difficulty recognizing the user's psychological and emotional state in real time and providing the optimal aroma blend based on that. They also lacked a mechanism for effectively incorporating user feedback and utilizing it in the next aroma blend. Furthermore, they lacked the technology to integrate and analyze collected vital data and emotional data, making it impossible to provide a personalized aroma experience tailored to the user's individual needs.
[0941] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0942] In this invention, the server includes means for collecting the user's psychological state and work content through dialogue with the user, means for collecting biological information in real time, and means for analyzing the collected voice and facial expression data to determine the user's emotions in real time. This makes it possible to generate an optimal fragrance blend in real time that comprehensively considers the user's psychological, physical, and emotional states, thereby providing a personalized aroma experience.
[0943] "Interaction with the user" is the process of using AI to collect information from the user about their work and psychological state.
[0944] "Mood" refers to a user's current emotional or mental state.
[0945] "Work content" refers to the specific content of the work or activity that the user is currently performing.
[0946] "Biometric information" includes physiological data such as the user's heart rate, body temperature, and respiratory rate.
[0947] "Real-time" refers to data collection and analysis occurring immediately, without delay.
[0948] "Voice data" refers to data that records the words and tone of voice spoken by a user.
[0949] "Facial expression data" is video data acquired to analyze a user's facial expressions.
[0950] "Emotions" refer to subjective experiences and feelings that indicate a user's psychological state.
[0951] A "fragrance blend" refers to a mixture of different fragrances in specific proportions.
[0952] "Proportioning device" means a device for mixing flavorings in specified proportions.
[0953] "Diffused throughout the room" means that the fragrance spreads throughout the room.
[0954] "Feedback" refers to the opinions and impressions provided by users after experiencing an aroma.
[0955] "Natural language processing technology" refers to technology for analyzing dialogue data and understanding human language.
[0956] MODE FOR CARRYING OUT THE INVENTION
[0957] (Detailed Description of the Invention)
[0958] This invention is a system that generates and adjusts optimal fragrance blends through dialogue with the user, collection of biometric information, and emotion recognition. This system can provide the optimal aroma experience according to the individual user's psychological, emotional, and physical state.
[0959] System Configuration
[0960] The system consists of the following main components:
[0961] 1. AI Conversation Engine
[0962] 2. Vital Data Monitoring Device
[0963] 3. Emotion Engine
[0964] 4. Data Analysis Module
[0965] 5. Aroma Profiling Module
[0966] 6. Dispenser Module
[0967] 7. Aroma diffuser
[0968] 8. Feedback Module
[0969] Technical details
[0970] The program of this system operates as follows.
[0971] 1. Data Collection
[0972] The user launches the AI conversation app and inputs their current work and mood. They also wear a vital data monitoring device. Furthermore, voice and facial expression data are collected using the emotion engine's input devices (microphone and camera).
[0973] 2. Data transmission
[0974] The terminal transmits the collected interaction data, biometric information, and emotion data to the server in real time.
[0975] 3. Data storage and analysis
[0976] The server stores the received data in a database. Natural language processing (NLP) algorithms analyze the dialogue data to identify the user's task and psychological state. Machine learning algorithms analyze biometric information to determine real-time physical state. An emotion engine analyzes voice and facial expression data to determine the user's emotions in real time.
[0977] 4. Aroma Profiling
[0978] The server generates a fragrance blend that best suits the user's needs based on the results of an integrated analysis of their psychological state, physical state, and emotions.
[0979] 5. Aroma blend composition
[0980] The server sends the generated aroma profile to the dispenser module.
[0981] The dispenser module in the terminal receives instructions from the server and mixes each fragrance in the correct proportions.
[0982] 6. Aroma diffusion
[0983] The device is an aroma diffuser that spreads the blended fragrance throughout the room.
[0984] 7. User Feedback
[0985] Users input feedback into the device, such as whether their concentration improved through the aroma experience and whether the strength of the scent was appropriate.
[0986] 8. Feedback Analysis and Adjustment
[0987] The server analyzes the collected feedback data and adjusts the blend ratio and fragrance intensity for future uses.
[0988] Specific examples
[0989] Specific examples are shown below.
[0990] Data collection and analysis
[0991] When a user is unable to maintain concentration while teleworking, they input "I want to concentrate" into the AI conversation app and wear a vital data monitoring device. In addition, the emotion engine collects the user's voice and facial expression data.
[0992] The terminal collects dialogue data, biometric information, and emotion data and transmits them to the server.
[0993] The server analyzes the dialogue data using natural language processing (NLP) to determine that the user is seeking improved concentration. Biometric analysis determines that the user's heart rate is high (e.g., 85 BPM), indicating stress. The emotion engine analyzes voice and facial expression data to recognize emotions such as "impatience" in real time.
[0994] Aroma Profiling and Blending
[0995] The server generates a blend of 70% rosemary and 30% peppermint, which is effective for improving concentration, based on the integrated results of psychological state, physical state, and emotions, and sends this information to the dispenser module.
[0996] The dispenser module in the device mixes the fragrance as instructed, and the aroma diffuser spreads it throughout the room.
[0997] Aroma diffusion and feedback
[0998] The user works while enjoying the scent, and then inputs feedback such as, "My concentration has improved, but the scent is a little strong."
[0999] The server analyzes the feedback and adjusts the ratio of peppermint to more rosemary next time.
[1000] Example prompts
[1001] "I'd like to improve my focus, so please suggest the best fragrance blend based on my current psychological state and biometric information."
[1002] Hardware / Software used
[1003] AI conversation engine: Natural language processing library
[1004] Vital Data Monitoring Devices: Heart Rate Monitor / Thermometer
[1005] Emotion engine: voice analysis software, facial expression recognition camera
[1006] Data Analysis Module: Machine Learning Models
[1007] Aroma Profiling Module: Algorithm
[1008] Dispenser module: Automatic blender
[1009] Aroma diffuser: Diffuser device
[1010] Feedback Module: User Interface
[1011] As described above, the embodiments of the invention are designed so that each component works together to provide the optimal aroma experience.
[1012] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1013] Step 1:
[1014] Data collection
[1015] The user launches the AI conversation app and inputs their current work and mood, such as "I want to concentrate." They also wear a vital data monitoring device that measures their heart rate and body temperature. Furthermore, the emotion engine's camera and microphone are used to collect voice and facial expression data.
[1016] Input: User interaction data (e.g., "I want to concentrate"), biometric information (heart rate, body temperature, etc.), voice data, and facial expression data.
[1017] Output: Various data collected.
[1018] Specific actions
[1019] "The user types 'I want to concentrate' into the AI conversation app, wears a heart rate monitor on their wrist, and speaks into the camera to collect voice and facial expression data."
[1020] Step 2:
[1021] Sending data
[1022] The terminal transmits the collected interaction data, biometric information, and emotion data to the server in real time.
[1023] Input: Various data collected.
[1024] Output: Various data sent to the server.
[1025] Specific actions
[1026] "The device sends the user's input data, heart rate, voice, and facial expression data to a server over a secure channel via the Internet."
[1027] Step 3:
[1028] Data storage and analysis
[1029] The server stores the received data in a database. The dialogue data is analyzed using natural language processing (NLP) algorithms to identify the user's task and psychological state. Biometric information is analyzed using machine learning algorithms to determine the user's physical state in real time. The emotion engine analyzes voice and facial expression data to determine the user's emotions in real time.
[1030] Input: Various data sent.
[1031] Output: Analysis results (mental state, physical state, emotions).
[1032] Specific actions
[1033] "The server stores the data in a database, analyzes the dialogue data using an NLP algorithm, and identifies the user's desire to 'concentrate'. The machine learning algorithm analyzes the heart rate data and determines the user's stress level. The emotion engine analyzes the voice and facial expression data and detects the emotion 'impatience'."
[1034] Step 4:
[1035] Aroma Profiling
[1036] The server generates a fragrance blend that best suits the user's needs based on the integrated results of their psychological state, physical state, and emotions.
[1037] Input: Analysis results (mental state, physical state, emotions).
[1038] Output: Recipe for optimal flavor blend.
[1039] Specific actions
[1040] "The server integrates the psychological state, physical state, and emotions to produce a blend of 70% Rosmary and 30% Peppermint, and sends this information to the dispenser module."
[1041] Step 5:
[1042] Aroma blend composition
[1043] The server transmits the generated aroma blend information to the dispenser module.
[1044] The dispenser module in the terminal receives instructions from the server and mixes each fragrance in the correct proportions.
[1045] Input: A recipe for the optimal flavoring blend.
[1046] Output: Pre-blended fragrance oil.
[1047] Specific actions
[1048] "The dispenser module, based on instructions from the server, uses precision meters and pumps to mix the flavors in a ratio of 70% to 30%."
[1049] Step 6:
[1050] Aroma diffusion
[1051] The device acts as an aroma diffuser, spreading the blended fragrance throughout the room.
[1052] Enter: pre-blended fragrance oils.
[1053] Output: Fragrance diffused throughout the room.
[1054] Specific actions
[1055] The aroma diffuser operates a fan to evenly distribute the fragrance throughout the room.
[1056] Step 7:
[1057] User Feedback
[1058] Users input feedback into the device, such as whether their concentration improved through the aroma experience and whether the strength of the scent was appropriate.
[1059] Input: User's impressions and requests based on the aroma experience.
[1060] Output: Feedback data.
[1061] Specific actions
[1062] "The user experiences the aroma for a few hours and then provides feedback on the device, such as 'My concentration has improved, but the scent is a bit strong.'"
[1063] Step 8:
[1064] Feedback analysis and adjustment
[1065] The server analyzes the collected feedback data and adjusts the blend ratio and fragrance intensity for future uses.
[1066] Input: Feedback data.
[1067] Output: A recipe for the adjusted flavor blend.
[1068] Specific actions
[1069] "The server analyzes the feedback data and adjusts the flavoring blend recipe to reduce the percentage of peppermint and increase the percentage of rosemary."
[1070] (Application example 2)
[1071] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1072] In recent years, there has been a demand for services that aim to improve user experiences in real spaces. However, current systems face the challenge of accurately collecting and analyzing users' psychological state and emotions in real time and diffusing aroma oil blends based on that information into physical spaces. In particular, providing optimal scents that match the emotions and psychological state of customers in physical stores is an urgent task, as it directly contributes to creating a comfortable space and increasing purchasing motivation.
[1073] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting the user's psychological state and task details through dialogue with the user, means for collecting the user's emotional state using a smartphone, means for collecting the user's vital data in real time, means for analyzing the collected dialogue data, emotional data, and vital data to determine the user's psychological and physical states, means for generating an optimal aroma oil blend based on the analysis results, means for mixing the generated aroma oil blend in an accurate ratio using a dispenser, and means for diffusing the blended aroma oils into real space. This makes it possible to provide an optimal aroma experience in real time based on the user's psychological state and emotions, thereby improving the user experience in real space.
[1074] "User" refers to an individual who uses the System.
[1075] "Dialogue" is a type of communication between a user and a system, and is carried out for the purpose of gathering information about the user's mental state and the content of their work.
[1076] A "smartphone" refers to a portable electronic device that has communication capabilities and can be used by installing specific applications.
[1077] "Emotional state" is data that represents the user's emotional response, and is collected from voice, facial expressions, etc.
[1078] "Vital data" refers to data that indicates physiological information such as the user's heart rate, body temperature, and respiratory rate.
[1079] "Real-time" refers to data being processed with almost no delay and results being provided immediately.
[1080] "Dialogue data" is information collected through dialogue with a user, and includes the user's psychological state and work content.
[1081] "Emotion data" is emotional information analyzed from the user's voice and facial expressions.
[1082] "Mental state" is information that indicates the mental state of the user, and is inferred from dialogue data and emotion data.
[1083] "Physical condition" is information indicating the physiological state of the user, and is analyzed from vital data.
[1084] "Aroma oil" is an oil containing aromatic substances extracted from plants, etc., and is used in aromatherapy.
[1085] A "blend" refers to a mixture of multiple aromatic oils in a specific ratio.
[1086] A "dispenser" is a device that mixes aromatic oils in a specified ratio.
[1087] "Diffusion" refers to spreading the blended aroma oils into physical space.
[1088] A "real space" is a physical space where a user actually exists.
[1089] "Feedback" refers to the opinions and thoughts that users provide to the system about their experience and usage.
[1090] "Adjusting" means changing the system settings or aroma oil blends based on the feedback.
[1091] "Natural language processing technology" is a technology that analyzes dialogue data to understand the user's intentions and psychological state.
[1092] "Heart rate, body temperature, and respiratory rate data" are basic physiological indicators that make up the user's vital data.
[1093] System Configuration
[1094] The present invention provides an aroma service system that improves user experience in brick-and-mortar stores. This system is comprised of the following main hardware and software:
[1095] Hardware
[1096] 1. Smartphone
[1097] 2. Vital data monitoring devices (e.g., smart watches)
[1098] 3. Aroma diffusers in brick-and-mortar stores
[1099] 4. Server
[1100] software
[1101] 1. AI conversation engines (e.g., Dialogflow, a natural language processing technology)
[1102] 2. Vital data monitoring device integration API (e.g. Fitbit API)
[1103] 3. Emotion recognition software (e.g., Azure Cognitive Services)
[1104] 4. Data analysis modules (e.g., TensorFlow)
[1105] 5. Aroma Profiling Module
[1106] 6. Dispenser module (e.g. Arduino controlled)
[1107] Program processing procedure (overview)
[1108] Data collection
[1109] Device: A user enters a store and launches the smartphone application. The application presents simple questions to collect the customer's psychological and emotional state. The user wears a vital data monitoring device (smartwatch) and collects data in real time. Emotion recognition software is used to capture facial and voice data from the smartphone's camera and microphone.
[1110] Data transmission and analysis
[1111] Server: Interaction data, emotional data, and vital data collected from smartphones and other devices are sent to the server in real time. The server stores this data in a database and analyzes it using natural language processing technology (Dialogflow) and emotion recognition software (Azure Cognitive Services). Specifically, the server identifies the user's psychological state and task content based on the interaction data, and determines the user's emotional state from the emotional data. Vital data includes the user's heart rate, body temperature, and respiratory rate.
[1112] Aroma Profiling and Blend Formulation
[1113] Server: Generates the optimal aroma oil blend for the user based on the analysis of their psychological, emotional, and physical state (vital data). This generated aroma profile is sent to the dispenser module, and the aroma diffuser in the physical store mixes the aroma oils in a specific ratio and diffuses them into the space.
[1114] User feedback and aroma blend adjustments
[1115] Users: Experience the scent in the store and then provide feedback via a smartphone app. They can enter specific opinions such as, "My concentration improved, but the scent is a little strong."
[1116] Server: The collected feedback data will be analyzed and the blend ratio and strength of the aroma oils will be adjusted from the next time onwards. For example, the ratio of peppermint will be reduced and the ratio of rosemary will be increased.
[1117] Specific examples
[1118] Assume that a user wants to improve their concentration while teleworking. In this case, the user enters "I want to concentrate" into a smartphone application and wears a vital data monitoring device. At the same time, an emotion recognition engine recognizes the emotion of "anxiety" from the user's voice and facial expression. Based on this data, the server generates an aroma blend (e.g., 70% rosemary, 30% peppermint) effective for improving concentration and sends instructions to the aroma diffuser.
[1119] Example prompt sentence:
[1120] "I feel like relaxing today. I've been feeling a bit stressed lately."
[1121] In this way, the brick-and-mortar aroma service system of the present invention can improve the user experience in real space by analyzing the user's psychological state and emotions in real time and providing the most appropriate aroma oil based on that.
[1122] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1123] Step 1:
[1124] Data collection
[1125] Input: A user visits a physical store and launches the smartphone application. They answer simple questions provided within the app and input their emotional and psychological state. They wear a vital data monitoring device (smartwatch) that collects data such as heart rate, body temperature, and respiratory rate in real time. The camera and microphone are used to capture facial and voice data using emotion recognition software.
[1126] Data processing: The collected interaction data, emotion data, and vital data are formatted and sent to the server.
[1127] Output: Dialogue data, emotion data, and vital data are sent to the server.
[1128] Step 2:
[1129] Data storage and initial analysis
[1130] Input: The interaction data, emotion data, and vital data sent as the output of Step 1.
[1131] Data processing: The server stores the received data in a database and analyzes the dialogue data using natural language processing technology (Dialogflow). At the same time, emotion recognition software (Azure Cognitive Services) analyzes the emotional data to identify the emotional state. Vital data is analyzed using a machine learning algorithm (TensorFlow) to determine the physical condition.
[1132] Output: Analysis of the user's mental, emotional and physical state.
[1133] Step 3:
[1134] Aroma Profiling
[1135] Input: Analysis results as output of step 2 (mental, emotional, and physical states).
[1136] Data calculation: Based on the analysis results, the server uses the aroma profiling module to generate the optimal aroma oil blend. Specifically, it comprehensively analyzes data such as psychological state (e.g., need for concentration), emotional state (e.g., impatience), and physical state (e.g., high heart rate) to determine the type and ratio of aroma oils.
[1137] Output: Optimal aroma oil blend profile.
[1138] Step 4:
[1139] Aroma blend composition
[1140] Input: Aroma oil blend profile as output of step 3.
[1141] Data processing: The aroma blend profile is sent to the dispenser module (controlled by Arduino), which then precisely blends each aroma oil in the specified ratio.
[1142] Output: Blended aroma oil.
[1143] Step 5:
[1144] Aroma diffusion
[1145] Input: Blended aroma oils as output of step 4.
[1146] How it works: The aroma diffuser receives the aroma oil blended in the dispenser module and diffuses it into the real space, allowing the user to experience the scent in the real space.
[1147] Output: Aroma diffused in real space.
[1148] Step 6:
[1149] Collecting and analyzing user feedback
[1150] Input: Feedback from users who experienced the scent in real space. Specific opinions such as "My concentration improved, but the scent was a little strong."
[1151] Data calculation: The server analyzes the collected feedback data and uses it to adjust the next aroma blend, for example, by reducing the proportion of peppermint and increasing the proportion of rosemary.
[1152] Output: New adjusted aroma blend profile.
[1153] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1154] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1155] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[1156] [Third embodiment]
[1157] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[1158] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[1159] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1160] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[1161] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1162] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1163] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1164] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1165] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1166] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1167] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1168] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[1169] The present invention is a system that interacts with users, collects and analyzes vital data, blends and mixes aroma oils, diffuses them into the room, and collects feedback, allowing the system to provide an optimal aroma experience tailored to each individual user's psychological and physical state.
[1170] System Configuration
[1171] The system consists of the following main components:
[1172] 1. AI Conversation Engine
[1173] 2. Vital Data Monitoring Device
[1174] 3. Data Analysis Module
[1175] 4. Aroma Profiling Module
[1176] 5. Dispenser Module
[1177] 6. Aroma diffuser
[1178] 7. Feedback Module
[1179] Program processing
[1180] Data collection
[1181] Device: The user launches the AI conversation app and inputs their current work and mood. They also wear a vital data monitoring device. The device responds by starting a dialogue with the user, collecting their psychological state and needs. At the same time, vital data such as heart rate, body temperature, and respiratory rate are also collected in real time.
[1182] Sending data
[1183] Terminal: Collected interaction data and vital data are sent to the server in real time.
[1184] Data storage and analysis
[1185] Server: The received data is stored in a database. Natural language processing (NLP) algorithms analyze the dialogue data to identify the user's task and psychological state. At the same time, machine learning algorithms analyze vital data to determine real-time physical condition.
[1186] Aroma Profiling
[1187] Server: Based on the analysis results, it generates a blend of aroma oils that best suits the user's needs. This profile is sent to the dispenser module.
[1188] Aroma blend composition
[1189] Terminal: The dispenser module mixes each aromatic oil in the correct proportions based on instructions received from the server.
[1190] Aroma diffusion
[1191] Terminal: The aroma diffuser diffuses the blended aroma oil into the room.
[1192] User Feedback
[1193] User: Enter their impressions and effects of the aroma experience into the device.
[1194] Feedback analysis and adjustment
[1195] Server: Analyzes collected feedback data and adjusts the scent blend for future visits to continuously improve the quality of the scent experience.
[1196] Specific examples
[1197] Data collection and analysis
[1198] User: Because he / she is unable to maintain concentration while teleworking, he / she inputs "I want to concentrate" into the AI conversation app. He / she also wears a vital data monitoring device to collect data such as heart rate and body temperature.
[1199] Terminal: Interaction data and vital data are collected and sent to the server.
[1200] Server: Analyzes the dialogue data using natural language processing to determine that the user is seeking increased concentration. Analysis of vital data reveals that the user's heart rate is high (e.g., 85 BPM), indicating stress.
[1201] Aroma Profiling and Blending
[1202] Server: Based on the analysis results, it creates a blend of 70% rosemary and 30% peppermint, which is effective for improving concentration, and sends this information to the dispenser module.
[1203] Terminal: The dispenser module follows instructions from the server and mixes rosemary and peppermint in the specified ratio.
[1204] Aroma diffusion and feedback
[1205] Terminal: The blended aroma oil is diffused throughout the room through the aroma diffuser.
[1206] User: Works while enjoying the scent, then enters feedback such as "My concentration has improved, but the scent is a little strong."
[1207] Server: We'll analyze your feedback and adjust the ratio to less peppermint and more rosemary next time.
[1208] In this way, the system can provide a scent experience tailored to the user's needs, improving comfort and work efficiency.
[1209] The processing flow will be explained below.
[1210] Step 1:
[1211] User: Launches the AI conversation app and inputs the details of the task and current mental state into the device. For example, the user might input "I want to concentrate."
[1212] Step 2:
[1213] On the device: The AI conversation engine asks the user follow-up questions to gather more information, such as "What exactly are you working on?" or "How are you feeling right now?"
[1214] Step 3:
[1215] Terminal: Collects vital data such as the user's heart rate, body temperature, and respiratory rate in real time via a vital data monitoring device.
[1216] Step 4:
[1217] Terminal: Sends collected interaction data and vital data to the server in real time.
[1218] Step 5:
[1219] Server: Stores the received data in a database.
[1220] Step 6:
[1221] Server: Using natural language processing (NLP) algorithms, the server analyzes dialogue data and identifies the user's psychological state, such as "wanting to concentrate," and the task at hand.
[1222] Step 7:
[1223] Server: Analyzes vital data using machine learning algorithms and determines the user's physical condition (e.g., a high heart rate indicates stress).
[1224] Step 8:
[1225] Server: Based on the analysis results, the server generates a blend of aroma oils that is optimal for the user's psychological and physical state. For example, it generates a blend of 70% rosemary and 30% peppermint to "improve concentration."
[1226] Step 9:
[1227] Server: Sends the generated aroma profile to the dispenser module.
[1228] Step 10:
[1229] Terminal: The dispenser module follows the instructions received from the server and mixes each aromatic oil in the correct proportions, for example, accurately measuring out 70% rosemary and 30% peppermint.
[1230] Step 11:
[1231] Terminal: The aroma diffuser diffuses the blended aroma oil into the room, for example, releasing the scent at regular intervals.
[1232] Step 12:
[1233] User: Enters feedback into the device, such as whether the aroma experience improved their concentration and whether the strength of the scent was appropriate.
[1234] Step 13:
[1235] Terminal: Sends collected feedback data to the server.
[1236] Step 14:
[1237] Server: Analyzes the received feedback data and adjusts the blend ratio and fragrance intensity from the next time onwards. For example, if the user feedback is that "the peppermint is too strong," the ratio of peppermint will be adjusted to 20% next time.
[1238] In this way, the system can continuously optimize the scent experience according to the user's needs, improving comfort and work efficiency.
[1239] Example 1
[1240] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1241] In modern society, many people face problems such as stress, fatigue, and decreased concentration. To solve these problems, it is important to provide optimal relaxation and concentration-improving methods tailored to each individual user's psychological and physical state. However, with conventional methods, it has been difficult to accurately grasp the user's condition and provide an appropriate aroma oil blend based on that. It has also been difficult to continuously adjust the blend based on feedback.
[1242] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1243] In this invention, the server includes means for collecting the user's psychological state and work content through dialogue with the user, means for collecting the user's biological information in real time, means for analyzing the collected dialogue data and biological information to determine the user's psychological state and physical state, means for generating an optimal fragrance blend based on the analysis results, means for mixing the generated fragrance blend in an accurate ratio using a dispenser, means for diffusing the mixed fragrance into the room space, and means for collecting user evaluation information and adjusting the fragrance blend based on the evaluation information, thereby enabling the provision of an individually optimized aroma experience tailored to the user's needs and continuous adjustments.
[1244] "Dialogue data" is information about the psychological state and work content collected through dialogue with the user.
[1245] "Biometric information" refers to data relating to the user's physical condition, such as heart rate, body temperature, and respiratory rate, that is acquired in real time.
[1246] "Natural language processing technology" is a technology that enables computers to understand and analyze human language.
[1247] "Fragrance blending" refers to mixing multiple fragrances in a certain ratio.
[1248] A "dispenser" is a device that mixes liquids or gases, such as fragrances, in precise proportions.
[1249] "User evaluation information" refers to feedback provided by users regarding their impressions and effects after experiencing the aroma.
[1250] "Indoor space" refers to the inside of a room, office, or other enclosed space.
[1251] A "server" is a computer system that performs processes such as collecting, storing, analyzing, and distributing data over a network.
[1252] The present invention is a system that interacts with users, collects and analyzes vital data, blends and mixes aroma oils, diffuses them into the room, and collects feedback, allowing the system to provide an optimal aroma experience tailored to each individual user's psychological and physical state.
[1253] System Configuration
[1254] The system consists of the following main components:
[1255] 1. AI Conversation Engine
[1256] 2. Vital Data Monitoring Device
[1257] 3. Data Analysis Module
[1258] 4. Aroma Profiling Module
[1259] 5. Dispenser Module
[1260] 6. Aroma diffuser
[1261] 7. Feedback Module
[1262] Program processing
[1263] Data collection
[1264] The user launches the AI conversation app and inputs their current work and mood. They also wear a vital data monitoring device. The device responds by starting a dialogue with the user, collecting their psychological state and needs. At the same time, vital data such as heart rate, body temperature, and respiratory rate are also collected in real time.
[1265] Sending data
[1266] The device transmits collected interaction data and vital data to a server in real time using an internet connection.
[1267] Data storage and analysis
[1268] The server stores the received data in a database. It uses natural language processing (NLP) algorithms to analyze the dialogue data and identify the user's task and psychological state. At the same time, it uses machine learning algorithms to analyze the vital signs and determine the user's real-time physical condition.
[1269] Aroma Profiling
[1270] The server then generates a blend of aroma oils that best suits the user's needs based on the analysis results, and this profile is sent to the dispenser module.
[1271] Aroma blend composition
[1272] The dispenser module mixes each aromatic oil in the correct proportions based on instructions received from the server.
[1273] Aroma diffusion
[1274] The aroma diffuser diffuses the aromatic oils it contains into the room.
[1275] User Feedback
[1276] Users input their impressions and effects of the aroma experience into the terminal.
[1277] Feedback analysis and adjustment
[1278] The server analyzes the collected feedback data and adjusts the scent blend for future visits, continually improving the quality of the scent experience.
[1279] Specific examples
[1280] Data collection and analysis
[1281] Because the user is unable to maintain concentration while teleworking, they input "I want to concentrate" into an AI conversation app. They also wear a vital data monitoring device to collect data such as heart rate and body temperature. The device collects the dialogue data and vital data and sends it to a server. The server analyzes the dialogue data using natural language processing and determines that the user wants to improve their concentration. Analysis of the vital data reveals that the heart rate is high (e.g., 85 BPM), indicating that the user is feeling stressed.
[1282] Aroma Profiling and Blending
[1283] Based on the analysis results, the server generates a blend of 70% rosemary and 30% peppermint, which is effective for improving concentration. This information is sent to the dispenser module, which then follows instructions from the server to mix the rosemary and peppermint in the specified ratio.
[1284] Aroma diffusion and feedback
[1285] The device diffuses the blended aroma oil throughout the room through an aroma diffuser. The user works while enjoying the scent, and then inputs feedback such as "My concentration has improved, but the scent is a little strong." The server analyzes the feedback and adjusts the ratio of peppermint to rosemary next time.
[1286] Prompt Sentence Examples
[1287] The user enters "I want to concentrate" into the AI conversation app and wears a vital data monitoring device. The device receives this and sends the conversation data and vital data to the server. The server analyzes the data, determines that the user is seeking improved concentration, and generates an optimal aroma blend (e.g., 70% rosemary, 30% peppermint). The dispenser module mixes this blend, and the aroma diffuser diffuses it throughout the room. The user experiences the scent and provides feedback, and the server adjusts the blend for the next time.
[1288] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1289] Step 1:
[1290] The user launches the AI conversation app, inputs their current mental state and work details, and wears a vital data monitoring device (e.g., a smartwatch).
[1291] Input: Text data on mental state and work content, vital data such as heart rate, body temperature, and respiratory rate.
[1292] Output: Text data of collected psychological state and work content, and real-time vital data.
[1293] Specifically, the user enters "I want to concentrate" into the app, and then puts on the smartwatch, which records their heart rate and body temperature.
[1294] Step 2:
[1295] The device transmits collected text data on psychological state and work activity, as well as vital data, to a server in real time using an internet connection.
[1296] Input: Text data of collected psychological state and work content, vital data.
[1297] Output: Collected data sent to the server.
[1298] Specifically, the terminal encrypts and transmits text data and vital data to a server via the Internet.
[1299] Step 3:
[1300] The server stores the received data in a database, then uses natural language processing (NLP) algorithms to analyze the dialogue data and identify the user's psychological state and work needs, while using machine learning algorithms to analyze the vital signs and determine the user's real-time physical condition.
[1301] Input: Text data of mental state and work content, and vital data sent to the server.
[1302] Output: Analyzed information about the user's psychological state, task needs, and real-time physical condition.
[1303] Specifically, the server analyzes the dialogue data entered as "I want to concentrate" and determines that the user wants to improve their concentration. It also recognizes from vital signs that the heart rate is 85 BPM and determines that the user is feeling stressed.
[1304] Step 4:
[1305] Based on the analysis results, the server generates a blend of aroma oils that best suits the user's needs, and this profile is sent to the dispenser module.
[1306] Input: Analyzed psychological state, work needs, and real-time physical state information.
[1307] Output: Information on optimal aroma oil blend.
[1308] Specifically, it creates a blend of 70% rosemary and 30% peppermint, which is effective in improving concentration, and sends that information to the dispenser module.
[1309] Step 5:
[1310] The dispenser module mixes each aromatic oil in the correct proportions based on instructions received from the server.
[1311] Input: Information on optimal aroma oil blend.
[1312] Output: Precisely formulated aromatic oils.
[1313] Specifically, the dispenser module mixes rosemary and peppermint in the specified ratio.
[1314] Step 6:
[1315] The device's aroma diffuser diffuses the blended aroma oil into the room.
[1316] Input: precisely formulated aromatic oils.
[1317] Output: Aroma diffused into the room.
[1318] Specifically, the fan built into the aroma diffuser is activated to diffuse the aroma oil throughout the room.
[1319] Step 7:
[1320] Users input their impressions and effects of the aroma experience into the terminal.
[1321] Input: Feedback data on impressions and effects of aroma experience.
[1322] Output: Collected user feedback data.
[1323] As a specific action, the user inputs feedback such as "My concentration has improved, but the scent is a little strong."
[1324] Step 8:
[1325] The server analyzes the collected feedback data and adjusts the fragrance blend for future applications, for example by sending instructions to the dispenser module to reduce the proportion of peppermint and increase the proportion of rosemary.
[1326] Input: Collected user feedback data.
[1327] Output: Adjusted aroma oil blend information for next use.
[1328] Specifically, the server analyzes the feedback data, generates new blending instructions, and sends them.
[1329] (Application example 1)
[1330] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1331] With conventional aroma oils, it was difficult to generate and provide optimal aroma blends tailored to the user's psychological and physical state. Furthermore, the collection and analysis of vital data in real time, and the provision of effective aroma experiences in virtual environments were not fully realized. This limited the provision of personalized aroma experiences tailored to individual users. Furthermore, it was difficult to appropriately adjust the aroma blend based on feedback and reflect it in the next offering.
[1332] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1333] In this invention, the server includes means for collecting the user's psychological state and work content through dialogue with the user, means for collecting the user's vital data in real time, means for analyzing the collected dialogue data and vital data to determine the user's psychological and physical state, means for determining an aroma blend that is optimal for the user's needs from the dialogue data and vital data using a generative AI model, means for mixing the generated aroma oil blend in an accurate ratio using a dispenser, means for diffusing the blended aroma oil into a room space, means for providing an aroma experience in a virtual environment, and means for collecting feedback and reflecting it in the next aroma experience. This makes it possible to provide an aroma experience that is optimized for each user, thereby improving user comfort and satisfaction.
[1334] Interacting with the User
[1335] This is the process by which the system communicates with the user and collects information about their mental state and the tasks they are performing.
[1336] "Psychological state"
[1337] It refers to the user's state of mind, emotions, and mood.
[1338] "Work content"
[1339] This indicates the work or activities that the user is currently doing.
[1340] "Vital Data"
[1341] is biometric information that indicates the user's physical condition, such as heart rate, body temperature, and respiratory rate.
[1342] Real-time collection
[1343] This means that data is acquired immediately and entered into the system without delay.
[1344] "Collected conversation data"
[1345] is data that the system obtains through interaction with the user.
[1346] "Collected vital data"
[1347] This is data that is input into the system as biometric information such as heart rate, body temperature, and respiratory rate.
[1348] "analysis"
[1349] is the process of examining, evaluating, and finding meaning in collected data.
[1350] "Generative AI model"
[1351] is an algorithm that uses artificial intelligence to generate data for a specific purpose.
[1352] "The best aroma blend"
[1353] This is the most effective and suitable combination of aroma oils for the user based on the analysis results.
[1354] "dispenser"
[1355] is a device that mixes liquids or powders in specific proportions.
[1356] "Diffusion throughout the indoor space"
[1357] This means spreading the produced aromatic oil within a specific space.
[1358] "In a virtual environment"
[1359] refers to digital environments, including virtual reality and augmented reality.
[1360] "feedback"
[1361] These are the impressions, opinions, and response data provided by users to the system after their experience.
[1362] "I will reflect this in my next aroma experience."
[1363] This means utilizing feedback from users and incorporating that information into future aroma blends.
[1364] System Overview
[1365] This system collects the user's psychological state and work details through dialogue, monitors vital data in real time, analyzes the data, and creates, mixes, and diffuses the optimal aroma oil blend into the room. It also collects and analyzes user feedback and can reflect it in the next aroma experience.
[1366] Hardware and software used
[1367] 1. Hardware:
[1368] Smartphone
[1369] Smartwatch
[1370] Vital Data Monitoring Device
[1371] Aroma diffuser
[1372] 2. Software:
[1373] AI conversation engine (e.g. Google Dialogflow)
[1374] Data analysis platforms (e.g. TensorFlow, Scikit-learn)
[1375] Natural language processing tools (e.g., spaCy, NLTK)
[1376] Cloud services (e.g. AWS, GCP)
[1377] Data collection and analysis
[1378] The server collects conversation data when the user accesses the AI conversation engine using a smartphone and inputs their current mood and work. At the same time, when the user wears a smartwatch or vital data monitoring device, vital data such as heart rate, body temperature, and respiratory rate are collected in real time.
[1379] The collected data is sent to a cloud server and stored in a database. The server uses natural language processing technology to analyze the dialogue data and identify the user's psychological state. At the same time, machine learning algorithms are used to analyze the vital signs and determine the user's real-time physical condition.
[1380] Aroma Profiling
[1381] Based on the analysis results, the server uses a generative AI model to determine the aroma blend that best suits the user's needs, and this blend information is sent to the dispenser module.
[1382] Aroma blend composition and diffusion
[1383] The dispenser module mixes the aromatic oils in the correct proportions based on instructions received from the server, and the mixed aromatic oils are then diffused into the room through the aroma diffuser.
[1384] User feedback and next adjustments
[1385] After experiencing the aroma, users can input their impressions and effects as feedback into their smartphone. The server analyzes this feedback data and adjusts the aroma blend for future visits.
[1386] Examples and prompts
[1387] For example, if a user types "I want to improve my concentration" and their heart rate is measured as 85 BPM on their smartwatch, the server will use a natural language processing algorithm to identify the desire to improve concentration from the conversation data, and then use a machine learning algorithm to analyze the vital data. As a result, rosemary and peppermint will be selected as the optimal blend.
[1388] Example prompt sentence:
[1389] Below are the conversational and vital data collected from users. Please suggest the best aroma oil blend and ratio to improve concentration.
[1390] Conversation data: difficulty concentrating, stress
[1391] Vital data: Heart rate 85 BPM, body temperature 36.8℃
[1392] In this way, the system can provide an optimal aroma experience tailored to the user's specific needs, improving comfort and performance.
[1393] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1394] Step 1:
[1395] The user launches the AI conversation application on their smartphone and inputs their psychological state and work details. The input data is stored on the device as dialogue data. Furthermore, when the user wears a smartwatch or vital data monitoring device, vital data such as heart rate, body temperature, and respiratory rate are collected in real time on the device.
[1396] Input: User's mental state, work content, vital data (heart rate, body temperature, respiratory rate)
[1397] Output: Collected interaction data and vital data
[1398] Step 2:
[1399] The collected conversation data and vital signs are sent in real time from the device to a cloud server, where the device formats and converts the data into a format that the server can easily analyze.
[1400] Input: Collected interaction data and vital data
[1401] Output: Formatted data
[1402] Step 3:
[1403] The server uses a natural language processing (NLP) engine to analyze the user's psychological state and the tasks they are performing based on the dialogue data sent to it, while also using machine learning algorithms to analyze vital data and determine the user's real-time physical condition.
[1404] Input: Interaction data and vital data
[1405] Output: Analysis results (user's mental state, work content, physical state)
[1406] Step 4:
[1407] The server uses a generative AI model based on the analysis results to determine the optimal aroma blend tailored to the user's needs. Specifically, it generates the types of aroma oils and their blend ratios according to the user's psychological and physical state.
[1408] Input: Analysis results (mental state, work content, physical state)
[1409] Output: Optimal aroma blend profile
[1410] Step 5:
[1411] The server sends the profile of the optimal aroma blend to the dispenser module, which then accurately blends each aroma oil in the specified ratio and returns the result to the terminal.
[1412] Input: Aroma Blend Profile
[1413] Output: Pre-blended aroma oil
[1414] Step 6:
[1415] The aroma diffuser receives the blended aroma oil from the device and diffuses it into the room. The device monitors the operation status of the diffuser to ensure proper diffusion.
[1416] Input: Pre-blended aroma oil
[1417] Output: Diffused aroma
[1418] Step 7:
[1419] Users input their impressions and effects of the aroma experience as feedback into their smartphone, and the device sends this feedback data to the server.
[1420] Input: User feedback
[1421] Output: Feedback data sent to the server
[1422] Step 8:
[1423] The server analyzes the collected feedback data and reflects it in the next aroma blend. Based on the user's preferences and experience, the algorithm continuously improves the quality of the aroma blend.
[1424] Input: Feedback data
[1425] Output: Improved aroma blend profile
[1426] Through these steps, the system can provide users with an optimized aroma experience, improving comfort and satisfaction.
[1427] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1428] This invention is a system that generates and adjusts optimal aroma oils through dialogue with the user, collection of vital data, and emotion recognition. This system can provide the optimal aroma experience according to the psychological, emotional, and physical state of each individual user.
[1429] System Configuration
[1430] The system consists of the following main components:
[1431] 1. AI Conversation Engine
[1432] 2. Vital Data Monitoring Device
[1433] 3. Emotion Engine
[1434] 4. Data Analysis Module
[1435] 5. Aroma Profiling Module
[1436] 6. Dispenser Module
[1437] 7. Aroma diffuser
[1438] 8. Feedback Module
[1439] Program processing
[1440] Data collection
[1441] Device: The user launches the AI conversation app and inputs their current work and mood. They also wear a vital data monitoring device. Furthermore, voice and facial expression data are collected using the emotion engine's input devices (microphone and camera).
[1442] Sending data
[1443] Terminal: Collected interaction data, vital data, and emotion data are sent to the server in real time.
[1444] Data storage and analysis
[1445] Server: Stores the received data in a database. Natural language processing (NLP) algorithms analyze the dialogue data to identify the user's task and psychological state. Machine learning algorithms analyze vital data to determine real-time physical condition. The emotion engine analyzes voice and facial expression data to determine the user's emotions in real time.
[1446] Aroma Profiling
[1447] Server: Generates the optimal blend of aroma oils to suit the user's needs based on the results of an integrated analysis of psychological state, physical state, and emotions.
[1448] Aroma blend composition
[1449] Server: Sends the generated aroma profile to the dispenser module.
[1450] Terminal: The dispenser module receives instructions from the server and mixes each aromatic oil in the correct proportions.
[1451] Aroma diffusion
[1452] Terminal: The aroma diffuser diffuses the blended aroma oil into the room.
[1453] User Feedback
[1454] User: Enters feedback into the device, such as whether the aroma experience improved their concentration and whether the strength of the scent was appropriate.
[1455] Feedback analysis and adjustment
[1456] Server: Analyzes the collected feedback data and adjusts the blend ratio and fragrance intensity for future batches.
[1457] Specific examples
[1458] Data collection and analysis
[1459] User: Because they are unable to maintain concentration while teleworking, they input "I want to concentrate" into the AI conversation app and wear a vital data monitoring device. In addition, the emotion engine collects the user's voice and facial expression data.
[1460] Terminal: Interaction data, vital data, and emotion data are collected and sent to the server.
[1461] Server: Analyzes the dialogue data using natural language processing (NLP) to determine that the user is seeking increased concentration. Analyzing vital data reveals that the user's heart rate is high (e.g., 85 BPM), indicating stress. The emotion engine analyzes voice and facial expression data to recognize emotions such as "impatience" in real time.
[1462] Aroma Profiling and Blending
[1463] Server: Based on the integrated results of psychological state, physical state, and emotions, it generates a blend of 70% rosemary and 30% peppermint, which is effective for improving concentration. It sends this information to the dispenser module.
[1464] Terminal: The dispenser module mixes the aroma oil as instructed, and the aroma diffuser spreads it throughout the room.
[1465] Aroma diffusion and feedback
[1466] User: Works while enjoying the scent, then enters feedback such as "My concentration has improved, but the scent is a little strong."
[1467] Server: We'll analyze your feedback and adjust the ratio to less peppermint and more rosemary next time.
[1468] In this way, the system can provide a personalized scent experience based on the user's needs and emotions, improving comfort and work efficiency.
[1469] The processing flow will be explained below.
[1470] Step 1:
[1471] User: Launches the AI conversation app and inputs the details of the task and current mental state. For example, the user might input "I want to concentrate." The user also wears a vital data monitoring device (heart rate monitor, thermometer, etc.).
[1472] Step 2:
[1473] On the device: The AI conversation engine initiates a dialogue with the user and asks more detailed questions, such as "What exactly are you working on?" or "How are you feeling right now?"
[1474] Step 3:
[1475] Terminal: Vital data monitoring device collects vital data such as heart rate, body temperature, and respiratory rate in real time.
[1476] Step 4:
[1477] Device: The emotion engine collects the user's voice and facial expressions through the camera and microphone, and analyzes this data in real time.
[1478] Step 5:
[1479] Terminal: Transmits collected interaction data, vital data, and emotion data to the server in real time.
[1480] Step 6:
[1481] Server: Stores the received data in a database.
[1482] Step 7:
[1483] Server: Analyzes the dialogue data using natural language processing (NLP) algorithms to identify the user's task and psychological state. For example, it identifies the user's desire to "concentrate."
[1484] Step 8:
[1485] Server: Machine learning algorithms analyze vital data and determine real-time physical conditions. For example, a high heart rate can indicate stress.
[1486] Step 9:
[1487] Server: The emotion engine analyzes voice data (tone, speed, etc.) and facial expression data (camera images) to recognize the user's emotional state (e.g., "anxious" or "relaxed").
[1488] Step 10:
[1489] Server: Generates the optimal blend of aroma oils based on the integrated results of psychological, physical, and emotional states. For example, a blend of 70% rosemary and 30% peppermint is generated to improve concentration.
[1490] Step 11:
[1491] Server: Sends the generated aroma profile to the dispenser module.
[1492] Step 12:
[1493] Terminal: The dispenser module receives instructions from the server and mixes each aromatic oil in the correct proportions, for example, accurately measuring out 70% rosemary and 30% peppermint.
[1494] Step 13:
[1495] Terminal: The aroma diffuser diffuses the blended aroma oil throughout the room, for example, automatically releasing the scent at regular intervals.
[1496] Step 14:
[1497] User: Enters feedback into the device about how they felt through the aroma experience, whether their concentration improved, whether the strength of the scent was appropriate, etc.
[1498] Step 15:
[1499] Terminal: Sends collected feedback data to the server.
[1500] Step 16:
[1501] Server: Analyzes the feedback data and adjusts the blend of aroma oils and the strength of the scent from the next time onwards. For example, if the user gives feedback that "the peppermint is too strong," the proportion of peppermint will be reduced and the proportion of rosemary will be increased next time.
[1502] In this way, the system can provide a personalized scent experience based on the user's needs and emotions, improving comfort and work efficiency.
[1503] Example 2
[1504] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1505] Conventional aroma oil blending systems have difficulty recognizing the user's psychological and emotional state in real time and providing the optimal aroma blend based on that. They also lacked a mechanism for effectively incorporating user feedback and utilizing it in the next aroma blend. Furthermore, they lacked the technology to integrate and analyze collected vital data and emotional data, making it impossible to provide a personalized aroma experience tailored to the user's individual needs.
[1506] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1507] In this invention, the server includes means for collecting the user's psychological state and work content through dialogue with the user, means for collecting biological information in real time, and means for analyzing the collected voice and facial expression data to determine the user's emotions in real time. This makes it possible to generate an optimal fragrance blend in real time that comprehensively considers the user's psychological, physical, and emotional states, thereby providing a personalized aroma experience.
[1508] "Interaction with the user" is the process of using AI to collect information from the user about their work and psychological state.
[1509] "Mood" refers to a user's current emotional or mental state.
[1510] "Work content" refers to the specific content of the work or activity that the user is currently performing.
[1511] "Biometric information" includes physiological data such as the user's heart rate, body temperature, and respiratory rate.
[1512] "Real-time" refers to data collection and analysis occurring immediately, without delay.
[1513] "Voice data" refers to data that records the words and tone of voice spoken by a user.
[1514] "Facial expression data" is video data acquired to analyze a user's facial expressions.
[1515] "Emotions" refer to subjective experiences and feelings that indicate a user's psychological state.
[1516] A "fragrance blend" refers to a mixture of different fragrances in specific proportions.
[1517] "Proportioning device" means a device for mixing flavorings in specified proportions.
[1518] "Diffused throughout the room" means that the fragrance spreads throughout the room.
[1519] "Feedback" refers to the opinions and impressions provided by users after experiencing an aroma.
[1520] "Natural language processing technology" refers to technology for analyzing dialogue data and understanding human language.
[1521] MODE FOR CARRYING OUT THE INVENTION
[1522] (Detailed Description of the Invention)
[1523] This invention is a system that generates and adjusts optimal fragrance blends through dialogue with the user, collection of biometric information, and emotion recognition. This system can provide the optimal aroma experience according to the individual user's psychological, emotional, and physical state.
[1524] System Configuration
[1525] The system consists of the following main components:
[1526] 1. AI Conversation Engine
[1527] 2. Vital Data Monitoring Device
[1528] 3. Emotion Engine
[1529] 4. Data Analysis Module
[1530] 5. Aroma Profiling Module
[1531] 6. Dispenser Module
[1532] 7. Aroma diffuser
[1533] 8. Feedback Module
[1534] Technical details
[1535] The program of this system operates as follows.
[1536] 1. Data Collection
[1537] The user launches the AI conversation app and inputs their current work and mood. They also wear a vital data monitoring device. Furthermore, voice and facial expression data are collected using the emotion engine's input devices (microphone and camera).
[1538] 2. Data transmission
[1539] The terminal transmits the collected interaction data, biometric information, and emotion data to the server in real time.
[1540] 3. Data storage and analysis
[1541] The server stores the received data in a database. Natural language processing (NLP) algorithms analyze the dialogue data to identify the user's task and psychological state. Machine learning algorithms analyze biometric information to determine real-time physical state. An emotion engine analyzes voice and facial expression data to determine the user's emotions in real time.
[1542] 4. Aroma Profiling
[1543] The server generates a fragrance blend that best suits the user's needs based on the results of an integrated analysis of their psychological state, physical state, and emotions.
[1544] 5. Aroma blend composition
[1545] The server sends the generated aroma profile to the dispenser module.
[1546] The dispenser module in the terminal receives instructions from the server and mixes each fragrance in the correct proportions.
[1547] 6. Aroma diffusion
[1548] The device is an aroma diffuser that spreads the blended fragrance throughout the room.
[1549] 7. User Feedback
[1550] Users input feedback into the device, such as whether their concentration improved through the aroma experience and whether the strength of the scent was appropriate.
[1551] 8. Feedback Analysis and Adjustment
[1552] The server analyzes the collected feedback data and adjusts the blend ratio and fragrance intensity for future uses.
[1553] Specific examples
[1554] Specific examples are shown below.
[1555] Data collection and analysis
[1556] When a user is unable to maintain concentration while teleworking, they input "I want to concentrate" into the AI conversation app and wear a vital data monitoring device. In addition, the emotion engine collects the user's voice and facial expression data.
[1557] The terminal collects dialogue data, biometric information, and emotion data and transmits them to the server.
[1558] The server analyzes the dialogue data using natural language processing (NLP) to determine that the user is seeking improved concentration. Biometric analysis determines that the user's heart rate is high (e.g., 85 BPM), indicating stress. The emotion engine analyzes voice and facial expression data to recognize emotions such as "impatience" in real time.
[1559] Aroma Profiling and Blending
[1560] The server generates a blend of 70% rosemary and 30% peppermint, which is effective for improving concentration, based on the integrated results of psychological state, physical state, and emotions, and sends this information to the dispenser module.
[1561] The dispenser module in the device mixes the fragrance as instructed, and the aroma diffuser spreads it throughout the room.
[1562] Aroma diffusion and feedback
[1563] The user works while enjoying the scent, and then inputs feedback such as, "My concentration has improved, but the scent is a little strong."
[1564] The server analyzes the feedback and adjusts the ratio of peppermint to more rosemary next time.
[1565] Example prompts
[1566] "I'd like to improve my focus, so please suggest the best fragrance blend based on my current psychological state and biometric information."
[1567] Hardware / Software used
[1568] AI conversation engine: Natural language processing library
[1569] Vital Data Monitoring Devices: Heart Rate Monitor / Thermometer
[1570] Emotion engine: voice analysis software, facial expression recognition camera
[1571] Data Analysis Module: Machine Learning Models
[1572] Aroma Profiling Module: Algorithm
[1573] Dispenser module: Automatic blender
[1574] Aroma diffuser: Diffuser device
[1575] Feedback Module: User Interface
[1576] As described above, the embodiments of the invention are designed so that each component works together to provide the optimal aroma experience.
[1577] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1578] Step 1:
[1579] Data collection
[1580] The user launches the AI conversation app and inputs their current work and mood, such as "I want to concentrate." They also wear a vital data monitoring device that measures their heart rate and body temperature. Furthermore, the emotion engine's camera and microphone are used to collect voice and facial expression data.
[1581] Input: User interaction data (e.g., "I want to concentrate"), biometric information (heart rate, body temperature, etc.), voice data, and facial expression data.
[1582] Output: Various data collected.
[1583] Specific actions
[1584] "The user types 'I want to concentrate' into the AI conversation app, wears a heart rate monitor on their wrist, and speaks into the camera to collect voice and facial expression data."
[1585] Step 2:
[1586] Sending data
[1587] The terminal transmits the collected interaction data, biometric information, and emotion data to the server in real time.
[1588] Input: Various data collected.
[1589] Output: Various data sent to the server.
[1590] Specific actions
[1591] "The device sends the user's input data, heart rate, voice, and facial expression data to a server over a secure channel via the Internet."
[1592] Step 3:
[1593] Data storage and analysis
[1594] The server stores the received data in a database. The dialogue data is analyzed using natural language processing (NLP) algorithms to identify the user's task and psychological state. Biometric information is analyzed using machine learning algorithms to determine the user's physical state in real time. The emotion engine analyzes voice and facial expression data to determine the user's emotions in real time.
[1595] Input: Various data sent.
[1596] Output: Analysis results (mental state, physical state, emotions).
[1597] Specific actions
[1598] "The server stores the data in a database, analyzes the dialogue data using an NLP algorithm, and identifies the user's desire to 'concentrate'. The machine learning algorithm analyzes the heart rate data and determines the user's stress level. The emotion engine analyzes the voice and facial expression data and detects the emotion 'impatience'."
[1599] Step 4:
[1600] Aroma Profiling
[1601] The server generates a fragrance blend that best suits the user's needs based on the integrated results of their psychological state, physical state, and emotions.
[1602] Input: Analysis results (mental state, physical state, emotions).
[1603] Output: Recipe for optimal flavor blend.
[1604] Specific actions
[1605] "The server integrates the psychological state, physical state, and emotions to produce a blend of 70% Rosmary and 30% Peppermint, and sends this information to the dispenser module."
[1606] Step 5:
[1607] Aroma blend composition
[1608] The server transmits the generated aroma blend information to the dispenser module.
[1609] The dispenser module in the terminal receives instructions from the server and mixes each fragrance in the correct proportions.
[1610] Input: A recipe for the optimal flavoring blend.
[1611] Output: Pre-blended fragrance oil.
[1612] Specific actions
[1613] "The dispenser module, based on instructions from the server, uses precision meters and pumps to mix the flavors in a ratio of 70% to 30%."
[1614] Step 6:
[1615] Aroma diffusion
[1616] The device acts as an aroma diffuser, spreading the blended fragrance throughout the room.
[1617] Enter: pre-blended fragrance oils.
[1618] Output: Fragrance diffused throughout the room.
[1619] Specific actions
[1620] The aroma diffuser operates a fan to evenly distribute the fragrance throughout the room.
[1621] Step 7:
[1622] User Feedback
[1623] Users input feedback into the device, such as whether their concentration improved through the aroma experience and whether the strength of the scent was appropriate.
[1624] Input: User's impressions and requests based on the aroma experience.
[1625] Output: Feedback data.
[1626] Specific actions
[1627] "The user experiences the aroma for a few hours and then provides feedback on the device, such as 'My concentration has improved, but the scent is a bit strong.'"
[1628] Step 8:
[1629] Feedback analysis and adjustment
[1630] The server analyzes the collected feedback data and adjusts the blend ratio and fragrance intensity for future uses.
[1631] Input: Feedback data.
[1632] Output: A recipe for the adjusted flavor blend.
[1633] Specific actions
[1634] "The server analyzes the feedback data and adjusts the flavoring blend recipe to reduce the percentage of peppermint and increase the percentage of rosemary."
[1635] (Application example 2)
[1636] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1637] In recent years, there has been a demand for services that aim to improve user experiences in real spaces. However, current systems face the challenge of accurately collecting and analyzing users' psychological state and emotions in real time and diffusing aroma oil blends based on that information into physical spaces. In particular, providing optimal scents that match the emotions and psychological state of customers in physical stores is an urgent task, as it directly contributes to creating a comfortable space and increasing purchasing motivation.
[1638] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting the user's psychological state and task details through dialogue with the user, means for collecting the user's emotional state using a smartphone, means for collecting the user's vital data in real time, means for analyzing the collected dialogue data, emotional data, and vital data to determine the user's psychological and physical states, means for generating an optimal aroma oil blend based on the analysis results, means for mixing the generated aroma oil blend in an accurate ratio using a dispenser, and means for diffusing the blended aroma oils into real space. This makes it possible to provide an optimal aroma experience in real time based on the user's psychological state and emotions, thereby improving the user experience in real space.
[1639] "User" refers to an individual who uses the System.
[1640] "Dialogue" is a type of communication between a user and a system, and is carried out for the purpose of gathering information about the user's mental state and the content of their work.
[1641] A "smartphone" refers to a portable electronic device that has communication capabilities and can be used by installing specific applications.
[1642] "Emotional state" is data that represents the user's emotional response, and is collected from voice, facial expressions, etc.
[1643] "Vital data" refers to data that indicates physiological information such as the user's heart rate, body temperature, and respiratory rate.
[1644] "Real-time" refers to data being processed with almost no delay and results being provided immediately.
[1645] "Dialogue data" is information collected through dialogue with a user, and includes the user's psychological state and work content.
[1646] "Emotion data" is emotional information analyzed from the user's voice and facial expressions.
[1647] "Mental state" is information that indicates the mental state of the user, and is inferred from dialogue data and emotion data.
[1648] "Physical condition" is information indicating the physiological state of the user, and is analyzed from vital data.
[1649] "Aroma oil" is an oil containing aromatic substances extracted from plants, etc., and is used in aromatherapy.
[1650] A "blend" refers to a mixture of multiple aromatic oils in a specific ratio.
[1651] A "dispenser" is a device that mixes aromatic oils in a specified ratio.
[1652] "Diffusion" refers to spreading the blended aroma oils into physical space.
[1653] A "real space" is a physical space where a user actually exists.
[1654] "Feedback" refers to the opinions and thoughts that users provide to the system about their experience and usage.
[1655] "Adjusting" means changing the system settings or aroma oil blends based on the feedback.
[1656] "Natural language processing technology" is a technology that analyzes dialogue data to understand the user's intentions and psychological state.
[1657] "Heart rate, body temperature, and respiratory rate data" are basic physiological indicators that make up the user's vital data.
[1658] System Configuration
[1659] The present invention provides an aroma service system that improves user experience in brick-and-mortar stores. This system is comprised of the following main hardware and software:
[1660] Hardware
[1661] 1. Smartphone
[1662] 2. Vital data monitoring devices (e.g., smart watches)
[1663] 3. Aroma diffusers in brick-and-mortar stores
[1664] 4. Server
[1665] software
[1666] 1. AI conversation engines (e.g., Dialogflow, a natural language processing technology)
[1667] 2. Vital data monitoring device integration API (e.g. Fitbit API)
[1668] 3. Emotion recognition software (e.g., Azure Cognitive Services)
[1669] 4. Data analysis modules (e.g., TensorFlow)
[1670] 5. Aroma Profiling Module
[1671] 6. Dispenser module (e.g. Arduino controlled)
[1672] Program processing procedure (overview)
[1673] Data collection
[1674] Device: A user enters a store and launches the smartphone application. The application presents simple questions to collect the customer's psychological and emotional state. The user wears a vital data monitoring device (smartwatch) and collects data in real time. Emotion recognition software is used to capture facial and voice data from the smartphone's camera and microphone.
[1675] Data transmission and analysis
[1676] Server: Interaction data, emotional data, and vital data collected from smartphones and other devices are sent to the server in real time. The server stores this data in a database and analyzes it using natural language processing technology (Dialogflow) and emotion recognition software (Azure Cognitive Services). Specifically, the server identifies the user's psychological state and task content based on the interaction data, and determines the user's emotional state from the emotional data. Vital data includes the user's heart rate, body temperature, and respiratory rate.
[1677] Aroma Profiling and Blend Formulation
[1678] Server: Generates the optimal aroma oil blend for the user based on the analysis of their psychological, emotional, and physical state (vital data). This generated aroma profile is sent to the dispenser module, and the aroma diffuser in the physical store mixes the aroma oils in a specific ratio and diffuses them into the space.
[1679] User feedback and aroma blend adjustments
[1680] Users: Experience the scent in the store and then provide feedback via a smartphone app. They can enter specific opinions such as, "My concentration improved, but the scent is a little strong."
[1681] Server: The collected feedback data will be analyzed and the blend ratio and strength of the aroma oils will be adjusted from the next time onwards. For example, the ratio of peppermint will be reduced and the ratio of rosemary will be increased.
[1682] Specific examples
[1683] Assume that a user wants to improve their concentration while teleworking. In this case, the user enters "I want to concentrate" into a smartphone application and wears a vital data monitoring device. At the same time, an emotion recognition engine recognizes the emotion of "anxiety" from the user's voice and facial expression. Based on this data, the server generates an aroma blend (e.g., 70% rosemary, 30% peppermint) effective for improving concentration and sends instructions to the aroma diffuser.
[1684] Example prompt sentence:
[1685] "I feel like relaxing today. I've been feeling a bit stressed lately."
[1686] In this way, the brick-and-mortar aroma service system of the present invention can improve the user experience in real space by analyzing the user's psychological state and emotions in real time and providing the most appropriate aroma oil based on that.
[1687] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1688] Step 1:
[1689] Data collection
[1690] Input: A user visits a physical store and launches the smartphone application. They answer simple questions provided within the app and input their emotional and psychological state. They wear a vital data monitoring device (smartwatch) that collects data such as heart rate, body temperature, and respiratory rate in real time. The camera and microphone are used to capture facial and voice data using emotion recognition software.
[1691] Data processing: The collected interaction data, emotion data, and vital data are formatted and sent to the server.
[1692] Output: Dialogue data, emotion data, and vital data are sent to the server.
[1693] Step 2:
[1694] Data storage and initial analysis
[1695] Input: The interaction data, emotion data, and vital data sent as the output of Step 1.
[1696] Data processing: The server stores the received data in a database and analyzes the dialogue data using natural language processing technology (Dialogflow). At the same time, emotion recognition software (Azure Cognitive Services) analyzes the emotional data to identify the emotional state. Vital data is analyzed using a machine learning algorithm (TensorFlow) to determine the physical condition.
[1697] Output: Analysis of the user's mental, emotional and physical state.
[1698] Step 3:
[1699] Aroma Profiling
[1700] Input: Analysis results as output of step 2 (mental, emotional, and physical states).
[1701] Data calculation: Based on the analysis results, the server uses the aroma profiling module to generate the optimal aroma oil blend. Specifically, it comprehensively analyzes data such as psychological state (e.g., need for concentration), emotional state (e.g., impatience), and physical state (e.g., high heart rate) to determine the type and ratio of aroma oils.
[1702] Output: Optimal aroma oil blend profile.
[1703] Step 4:
[1704] Aroma blend composition
[1705] Input: Aroma oil blend profile as output of step 3.
[1706] Data processing: The aroma blend profile is sent to the dispenser module (controlled by Arduino), which then precisely blends each aroma oil in the specified ratio.
[1707] Output: Blended aroma oil.
[1708] Step 5:
[1709] Aroma diffusion
[1710] Input: Blended aroma oils as output of step 4.
[1711] How it works: The aroma diffuser receives the aroma oil blended in the dispenser module and diffuses it into the real space, allowing the user to experience the scent in the real space.
[1712] Output: Aroma diffused in real space.
[1713] Step 6:
[1714] Collecting and analyzing user feedback
[1715] Input: Feedback from users who experienced the scent in real space. Specific opinions such as "My concentration improved, but the scent was a little strong."
[1716] Data calculation: The server analyzes the collected feedback data and uses it to adjust the next aroma blend, for example, by reducing the proportion of peppermint and increasing the proportion of rosemary.
[1717] Output: New adjusted aroma blend profile.
[1718] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1719] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1720] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1721] [Fourth embodiment]
[1722] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1723] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1724] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1725] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1726] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1727] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1728] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1729] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1730] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1731] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1732] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1733] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1734] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1735] The present invention is a system that interacts with users, collects and analyzes vital data, blends and mixes aroma oils, diffuses them into the room, and collects feedback, allowing the system to provide an optimal aroma experience tailored to each individual user's psychological and physical state.
[1736] System Configuration
[1737] The system consists of the following main components:
[1738] 1. AI Conversation Engine
[1739] 2. Vital Data Monitoring Device
[1740] 3. Data Analysis Module
[1741] 4. Aroma Profiling Module
[1742] 5. Dispenser Module
[1743] 6. Aroma diffuser
[1744] 7. Feedback Module
[1745] Program processing
[1746] Data collection
[1747] Device: The user launches the AI conversation app and inputs their current work and mood. They also wear a vital data monitoring device. The device responds by starting a dialogue with the user, collecting their psychological state and needs. At the same time, vital data such as heart rate, body temperature, and respiratory rate are also collected in real time.
[1748] Sending data
[1749] Terminal: Collected interaction data and vital data are sent to the server in real time.
[1750] Data storage and analysis
[1751] Server: The received data is stored in a database. Natural language processing (NLP) algorithms analyze the dialogue data to identify the user's task and psychological state. At the same time, machine learning algorithms analyze vital data to determine real-time physical condition.
[1752] Aroma Profiling
[1753] Server: Based on the analysis results, it generates a blend of aroma oils that best suits the user's needs. This profile is sent to the dispenser module.
[1754] Aroma blend composition
[1755] Terminal: The dispenser module mixes each aromatic oil in the correct proportions based on instructions received from the server.
[1756] Aroma diffusion
[1757] Terminal: The aroma diffuser diffuses the blended aroma oil into the room.
[1758] User Feedback
[1759] User: Enter their impressions and effects of the aroma experience into the device.
[1760] Feedback analysis and adjustment
[1761] Server: Analyzes collected feedback data and adjusts the scent blend for future visits to continuously improve the quality of the scent experience.
[1762] Specific examples
[1763] Data collection and analysis
[1764] User: Because he / she is unable to maintain concentration while teleworking, he / she inputs "I want to concentrate" into the AI conversation app. He / she also wears a vital data monitoring device to collect data such as heart rate and body temperature.
[1765] Terminal: Interaction data and vital data are collected and sent to the server.
[1766] Server: Analyzes the dialogue data using natural language processing to determine that the user is seeking increased concentration. Analysis of vital data reveals that the user's heart rate is high (e.g., 85 BPM), indicating stress.
[1767] Aroma Profiling and Blending
[1768] Server: Based on the analysis results, it creates a blend of 70% rosemary and 30% peppermint, which is effective for improving concentration, and sends this information to the dispenser module.
[1769] Terminal: The dispenser module follows instructions from the server and mixes rosemary and peppermint in the specified ratio.
[1770] Aroma diffusion and feedback
[1771] Terminal: The blended aroma oil is diffused throughout the room through the aroma diffuser.
[1772] User: Works while enjoying the scent, then enters feedback such as "My concentration has improved, but the scent is a little strong."
[1773] Server: We'll analyze your feedback and adjust the ratio to less peppermint and more rosemary next time.
[1774] In this way, the system can provide a scent experience tailored to the user's needs, improving comfort and work efficiency.
[1775] The processing flow will be explained below.
[1776] Step 1:
[1777] User: Launches the AI conversation app and inputs the details of the task and current mental state into the device. For example, the user might input "I want to concentrate."
[1778] Step 2:
[1779] On the device: The AI conversation engine asks the user follow-up questions to gather more information, such as "What exactly are you working on?" or "How are you feeling right now?"
[1780] Step 3:
[1781] Terminal: Collects vital data such as the user's heart rate, body temperature, and respiratory rate in real time via a vital data monitoring device.
[1782] Step 4:
[1783] Terminal: Sends collected interaction data and vital data to the server in real time.
[1784] Step 5:
[1785] Server: Stores the received data in a database.
[1786] Step 6:
[1787] Server: Using natural language processing (NLP) algorithms, the server analyzes dialogue data and identifies the user's psychological state, such as "wanting to concentrate," and the task at hand.
[1788] Step 7:
[1789] Server: Analyzes vital data using machine learning algorithms and determines the user's physical condition (e.g., a high heart rate indicates stress).
[1790] Step 8:
[1791] Server: Based on the analysis results, the server generates a blend of aroma oils that is optimal for the user's psychological and physical state. For example, it generates a blend of 70% rosemary and 30% peppermint to "improve concentration."
[1792] Step 9:
[1793] Server: Sends the generated aroma profile to the dispenser module.
[1794] Step 10:
[1795] Terminal: The dispenser module follows the instructions received from the server and mixes each aromatic oil in the correct proportions, for example, accurately measuring out 70% rosemary and 30% peppermint.
[1796] Step 11:
[1797] Terminal: The aroma diffuser diffuses the blended aroma oil into the room, for example, releasing the scent at regular intervals.
[1798] Step 12:
[1799] User: Enters feedback into the device, such as whether the aroma experience improved their concentration and whether the strength of the scent was appropriate.
[1800] Step 13:
[1801] Terminal: Sends collected feedback data to the server.
[1802] Step 14:
[1803] Server: Analyzes the received feedback data and adjusts the blend ratio and fragrance intensity from the next time onwards. For example, if the user feedback is that "the peppermint is too strong," the ratio of peppermint will be adjusted to 20% next time.
[1804] In this way, the system can continuously optimize the scent experience according to the user's needs, improving comfort and work efficiency.
[1805] Example 1
[1806] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1807] In modern society, many people face problems such as stress, fatigue, and decreased concentration. To solve these problems, it is important to provide optimal relaxation and concentration-improving methods tailored to each individual user's psychological and physical state. However, with conventional methods, it has been difficult to accurately grasp the user's condition and provide an appropriate aroma oil blend based on that. It has also been difficult to continuously adjust the blend based on feedback.
[1808] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1809] In this invention, the server includes means for collecting the user's psychological state and work content through dialogue with the user, means for collecting the user's biological information in real time, means for analyzing the collected dialogue data and biological information to determine the user's psychological state and physical state, means for generating an optimal fragrance blend based on the analysis results, means for mixing the generated fragrance blend in an accurate ratio using a dispenser, means for diffusing the mixed fragrance into the room space, and means for collecting user evaluation information and adjusting the fragrance blend based on the evaluation information, thereby enabling the provision of an individually optimized aroma experience tailored to the user's needs and continuous adjustments.
[1810] "Dialogue data" is information about the psychological state and work content collected through dialogue with the user.
[1811] "Biometric information" refers to data relating to the user's physical condition, such as heart rate, body temperature, and respiratory rate, that is acquired in real time.
[1812] "Natural language processing technology" is a technology that enables computers to understand and analyze human language.
[1813] "Fragrance blending" refers to mixing multiple fragrances in a certain ratio.
[1814] A "dispenser" is a device that mixes liquids or gases, such as fragrances, in precise proportions.
[1815] "User evaluation information" refers to feedback provided by users regarding their impressions and effects after experiencing the aroma.
[1816] "Indoor space" refers to the inside of a room, office, or other enclosed space.
[1817] A "server" is a computer system that performs processes such as collecting, storing, analyzing, and distributing data over a network.
[1818] The present invention is a system that interacts with users, collects and analyzes vital data, blends and mixes aroma oils, diffuses them into the room, and collects feedback, allowing the system to provide an optimal aroma experience tailored to each individual user's psychological and physical state.
[1819] System Configuration
[1820] The system consists of the following main components:
[1821] 1. AI Conversation Engine
[1822] 2. Vital Data Monitoring Device
[1823] 3. Data Analysis Module
[1824] 4. Aroma Profiling Module
[1825] 5. Dispenser Module
[1826] 6. Aroma diffuser
[1827] 7. Feedback Module
[1828] Program processing
[1829] Data collection
[1830] The user launches the AI conversation app and inputs their current work and mood. They also wear a vital data monitoring device. The device responds by starting a dialogue with the user, collecting their psychological state and needs. At the same time, vital data such as heart rate, body temperature, and respiratory rate are also collected in real time.
[1831] Sending data
[1832] The device transmits collected interaction data and vital data to a server in real time using an internet connection.
[1833] Data storage and analysis
[1834] The server stores the received data in a database. It uses natural language processing (NLP) algorithms to analyze the dialogue data and identify the user's task and psychological state. At the same time, it uses machine learning algorithms to analyze the vital signs and determine the user's real-time physical condition.
[1835] Aroma Profiling
[1836] The server then generates a blend of aroma oils that best suits the user's needs based on the analysis results, and this profile is sent to the dispenser module.
[1837] Aroma blend composition
[1838] The dispenser module mixes each aromatic oil in the correct proportions based on instructions received from the server.
[1839] Aroma diffusion
[1840] The aroma diffuser diffuses the aromatic oils it contains into the room.
[1841] User Feedback
[1842] Users input their impressions and effects of the aroma experience into the terminal.
[1843] Feedback analysis and adjustment
[1844] The server analyzes the collected feedback data and adjusts the scent blend for future visits, continually improving the quality of the scent experience.
[1845] Specific examples
[1846] Data collection and analysis
[1847] Because the user is unable to maintain concentration while teleworking, they input "I want to concentrate" into an AI conversation app. They also wear a vital data monitoring device to collect data such as heart rate and body temperature. The device collects the dialogue data and vital data and sends it to a server. The server analyzes the dialogue data using natural language processing and determines that the user wants to improve their concentration. Analysis of the vital data reveals that the heart rate is high (e.g., 85 BPM), indicating that the user is feeling stressed.
[1848] Aroma Profiling and Blending
[1849] Based on the analysis results, the server generates a blend of 70% rosemary and 30% peppermint, which is effective for improving concentration. This information is sent to the dispenser module, which then follows instructions from the server to mix the rosemary and peppermint in the specified ratio.
[1850] Aroma diffusion and feedback
[1851] The device diffuses the blended aroma oil throughout the room through an aroma diffuser. The user works while enjoying the scent, and then inputs feedback such as "My concentration has improved, but the scent is a little strong." The server analyzes the feedback and adjusts the ratio of peppermint to rosemary next time.
[1852] Prompt Sentence Examples
[1853] The user enters "I want to concentrate" into the AI conversation app and wears a vital data monitoring device. The device receives this and sends the conversation data and vital data to the server. The server analyzes the data, determines that the user is seeking improved concentration, and generates an optimal aroma blend (e.g., 70% rosemary, 30% peppermint). The dispenser module mixes this blend, and the aroma diffuser diffuses it throughout the room. The user experiences the scent and provides feedback, and the server adjusts the blend for the next time.
[1854] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1855] Step 1:
[1856] The user launches the AI conversation app, inputs their current mental state and work details, and wears a vital data monitoring device (e.g., a smartwatch).
[1857] Input: Text data on mental state and work content, vital data such as heart rate, body temperature, and respiratory rate.
[1858] Output: Text data of collected psychological state and work content, and real-time vital data.
[1859] Specifically, the user enters "I want to concentrate" into the app, and then puts on the smartwatch, which records their heart rate and body temperature.
[1860] Step 2:
[1861] The device transmits collected text data on psychological state and work activity, as well as vital data, to a server in real time using an internet connection.
[1862] Input: Text data of collected psychological state and work content, vital data.
[1863] Output: Collected data sent to the server.
[1864] Specifically, the terminal encrypts and transmits text data and vital data to a server via the Internet.
[1865] Step 3:
[1866] The server stores the received data in a database, then uses natural language processing (NLP) algorithms to analyze the dialogue data and identify the user's psychological state and work needs, while using machine learning algorithms to analyze the vital signs and determine the user's real-time physical condition.
[1867] Input: Text data of mental state and work content, and vital data sent to the server.
[1868] Output: Analyzed information about the user's psychological state, task needs, and real-time physical condition.
[1869] Specifically, the server analyzes the dialogue data entered as "I want to concentrate" and determines that the user wants to improve their concentration. It also recognizes from vital signs that the heart rate is 85 BPM and determines that the user is feeling stressed.
[1870] Step 4:
[1871] Based on the analysis results, the server generates a blend of aroma oils that best suits the user's needs, and this profile is sent to the dispenser module.
[1872] Input: Analyzed psychological state, work needs, and real-time physical state information.
[1873] Output: Information on optimal aroma oil blend.
[1874] Specifically, it creates a blend of 70% rosemary and 30% peppermint, which is effective in improving concentration, and sends that information to the dispenser module.
[1875] Step 5:
[1876] The dispenser module mixes each aromatic oil in the correct proportions based on instructions received from the server.
[1877] Input: Information on optimal aroma oil blend.
[1878] Output: Precisely formulated aromatic oils.
[1879] Specifically, the dispenser module mixes rosemary and peppermint in the specified ratio.
[1880] Step 6:
[1881] The device's aroma diffuser diffuses the blended aroma oil into the room.
[1882] Input: precisely formulated aromatic oils.
[1883] Output: Aroma diffused into the room.
[1884] Specifically, the fan built into the aroma diffuser is activated to diffuse the aroma oil throughout the room.
[1885] Step 7:
[1886] Users input their impressions and effects of the aroma experience into the terminal.
[1887] Input: Feedback data on impressions and effects of aroma experience.
[1888] Output: Collected user feedback data.
[1889] As a specific action, the user inputs feedback such as "My concentration has improved, but the scent is a little strong."
[1890] Step 8:
[1891] The server analyzes the collected feedback data and adjusts the fragrance blend for future applications, for example by sending instructions to the dispenser module to reduce the proportion of peppermint and increase the proportion of rosemary.
[1892] Input: Collected user feedback data.
[1893] Output: Adjusted aroma oil blend information for next use.
[1894] Specifically, the server analyzes the feedback data, generates new blending instructions, and sends them.
[1895] (Application example 1)
[1896] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1897] With conventional aroma oils, it was difficult to generate and provide optimal aroma blends tailored to the user's psychological and physical state. Furthermore, the collection and analysis of vital data in real time, and the provision of effective aroma experiences in virtual environments were not fully realized. This limited the provision of personalized aroma experiences tailored to individual users. Furthermore, it was difficult to appropriately adjust the aroma blend based on feedback and reflect it in the next offering.
[1898] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1899] In this invention, the server includes means for collecting the user's psychological state and work content through dialogue with the user, means for collecting the user's vital data in real time, means for analyzing the collected dialogue data and vital data to determine the user's psychological and physical state, means for determining an aroma blend that is optimal for the user's needs from the dialogue data and vital data using a generative AI model, means for mixing the generated aroma oil blend in an accurate ratio using a dispenser, means for diffusing the blended aroma oil into a room space, means for providing an aroma experience in a virtual environment, and means for collecting feedback and reflecting it in the next aroma experience. This makes it possible to provide an aroma experience that is optimized for each user, thereby improving user comfort and satisfaction.
[1900] Interacting with the User
[1901] This is the process by which the system communicates with the user and collects information about their mental state and the tasks they are performing.
[1902] "Psychological state"
[1903] It refers to the user's state of mind, emotions, and mood.
[1904] "Work content"
[1905] This indicates the work or activities that the user is currently doing.
[1906] "Vital Data"
[1907] is biometric information that indicates the user's physical condition, such as heart rate, body temperature, and respiratory rate.
[1908] Real-time collection
[1909] This means that data is acquired immediately and entered into the system without delay.
[1910] "Collected conversation data"
[1911] is data that the system obtains through interaction with the user.
[1912] "Collected vital data"
[1913] This is data that is input into the system as biometric information such as heart rate, body temperature, and respiratory rate.
[1914] "analysis"
[1915] is the process of examining, evaluating, and finding meaning in collected data.
[1916] "Generative AI model"
[1917] is an algorithm that uses artificial intelligence to generate data for a specific purpose.
[1918] "The best aroma blend"
[1919] This is the most effective and suitable combination of aroma oils for the user based on the analysis results.
[1920] "dispenser"
[1921] is a device that mixes liquids or powders in specific proportions.
[1922] "Diffusion throughout the indoor space"
[1923] This means spreading the produced aromatic oil within a specific space.
[1924] "In a virtual environment"
[1925] refers to digital environments, including virtual reality and augmented reality.
[1926] "feedback"
[1927] These are the impressions, opinions, and response data provided by users to the system after their experience.
[1928] "I will reflect this in my next aroma experience."
[1929] This means utilizing feedback from users and incorporating that information into future aroma blends.
[1930] System Overview
[1931] This system collects the user's psychological state and work details through dialogue, monitors vital data in real time, analyzes the data, and creates, mixes, and diffuses the optimal aroma oil blend into the room. It also collects and analyzes user feedback and can reflect it in the next aroma experience.
[1932] Hardware and software used
[1933] 1. Hardware:
[1934] Smartphone
[1935] Smartwatch
[1936] Vital Data Monitoring Device
[1937] Aroma diffuser
[1938] 2. Software:
[1939] AI conversation engine (e.g. Google Dialogflow)
[1940] Data analysis platforms (e.g. TensorFlow, Scikit-learn)
[1941] Natural language processing tools (e.g., spaCy, NLTK)
[1942] Cloud services (e.g. AWS, GCP)
[1943] Data collection and analysis
[1944] The server collects conversation data when the user accesses the AI conversation engine using a smartphone and inputs their current mood and work. At the same time, when the user wears a smartwatch or vital data monitoring device, vital data such as heart rate, body temperature, and respiratory rate are collected in real time.
[1945] The collected data is sent to a cloud server and stored in a database. The server uses natural language processing technology to analyze the dialogue data and identify the user's psychological state. At the same time, machine learning algorithms are used to analyze the vital signs and determine the user's real-time physical condition.
[1946] Aroma Profiling
[1947] Based on the analysis results, the server uses a generative AI model to determine the aroma blend that best suits the user's needs, and this blend information is sent to the dispenser module.
[1948] Aroma blend composition and diffusion
[1949] The dispenser module mixes the aromatic oils in the correct proportions based on instructions received from the server, and the mixed aromatic oils are then diffused into the room through the aroma diffuser.
[1950] User feedback and next adjustments
[1951] After experiencing the aroma, users can input their impressions and effects as feedback into their smartphone. The server analyzes this feedback data and adjusts the aroma blend for future visits.
[1952] Examples and prompts
[1953] For example, if a user types "I want to improve my concentration" and their heart rate is measured as 85 BPM on their smartwatch, the server will use a natural language processing algorithm to identify the desire to improve concentration from the conversation data, and then use a machine learning algorithm to analyze the vital data. As a result, rosemary and peppermint will be selected as the optimal blend.
[1954] Example prompt sentence:
[1955] Below are the conversational and vital data collected from users. Please suggest the best aroma oil blend and ratio to improve concentration.
[1956] Conversation data: difficulty concentrating, stress
[1957] Vital data: Heart rate 85 BPM, body temperature 36.8℃
[1958] In this way, the system can provide an optimal aroma experience tailored to the user's specific needs, improving comfort and performance.
[1959] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1960] Step 1:
[1961] The user launches the AI conversation application on their smartphone and inputs their psychological state and work details. The input data is stored on the device as dialogue data. Furthermore, when the user wears a smartwatch or vital data monitoring device, vital data such as heart rate, body temperature, and respiratory rate are collected in real time on the device.
[1962] Input: User's mental state, work content, vital data (heart rate, body temperature, respiratory rate)
[1963] Output: Collected interaction data and vital data
[1964] Step 2:
[1965] The collected conversation data and vital signs are sent in real time from the device to a cloud server, where the device formats and converts the data into a format that the server can easily analyze.
[1966] Input: Collected interaction data and vital data
[1967] Output: Formatted data
[1968] Step 3:
[1969] The server uses a natural language processing (NLP) engine to analyze the user's psychological state and the tasks they are performing based on the dialogue data sent to it, while also using machine learning algorithms to analyze vital data and determine the user's real-time physical condition.
[1970] Input: Interaction data and vital data
[1971] Output: Analysis results (user's mental state, work content, physical state)
[1972] Step 4:
[1973] The server uses a generative AI model based on the analysis results to determine the optimal aroma blend tailored to the user's needs. Specifically, it generates the types of aroma oils and their blend ratios according to the user's psychological and physical state.
[1974] Input: Analysis results (mental state, work content, physical state)
[1975] Output: Optimal aroma blend profile
[1976] Step 5:
[1977] The server sends the profile of the optimal aroma blend to the dispenser module, which then accurately blends each aroma oil in the specified ratio and returns the result to the terminal.
[1978] Input: Aroma Blend Profile
[1979] Output: Pre-blended aroma oil
[1980] Step 6:
[1981] The aroma diffuser receives the blended aroma oil from the device and diffuses it into the room. The device monitors the operation status of the diffuser to ensure proper diffusion.
[1982] Input: Pre-blended aroma oil
[1983] Output: Diffused aroma
[1984] Step 7:
[1985] Users input their impressions and effects of the aroma experience as feedback into their smartphone, and the device sends this feedback data to the server.
[1986] Input: User feedback
[1987] Output: Feedback data sent to the server
[1988] Step 8:
[1989] The server analyzes the collected feedback data and reflects it in the next aroma blend. Based on the user's preferences and experience, the algorithm continuously improves the quality of the aroma blend.
[1990] Input: Feedback data
[1991] Output: Improved aroma blend profile
[1992] Through these steps, the system can provide users with an optimized aroma experience, improving comfort and satisfaction.
[1993] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1994] This invention is a system that generates and adjusts optimal aroma oils through dialogue with the user, collection of vital data, and emotion recognition. This system can provide the optimal aroma experience according to the psychological, emotional, and physical state of each individual user.
[1995] System Configuration
[1996] The system consists of the following main components:
[1997] 1. AI Conversation Engine
[1998] 2. Vital Data Monitoring Device
[1999] 3. Emotion Engine
[2000] 4. Data Analysis Module
[2001] 5. Aroma Profiling Module
[2002] 6. Dispenser Module
[2003] 7. Aroma diffuser
[2004] 8. Feedback Module
[2005] Program processing
[2006] Data collection
[2007] Device: The user launches the AI conversation app and inputs their current work and mood. They also wear a vital data monitoring device. Furthermore, voice and facial expression data are collected using the emotion engine's input devices (microphone and camera).
[2008] Sending data
[2009] Terminal: Collected interaction data, vital data, and emotion data are sent to the server in real time.
[2010] Data storage and analysis
[2011] Server: Stores the received data in a database. Natural language processing (NLP) algorithms analyze the dialogue data to identify the user's task and psychological state. Machine learning algorithms analyze vital data to determine real-time physical condition. The emotion engine analyzes voice and facial expression data to determine the user's emotions in real time.
[2012] Aroma Profiling
[2013] Server: Generates the optimal blend of aroma oils to suit the user's needs based on the results of an integrated analysis of psychological state, physical state, and emotions.
[2014] Aroma blend composition
[2015] Server: Sends the generated aroma profile to the dispenser module.
[2016] Terminal: The dispenser module receives instructions from the server and mixes each aromatic oil in the correct proportions.
[2017] Aroma diffusion
[2018] Terminal: The aroma diffuser diffuses the blended aroma oil into the room.
[2019] User Feedback
[2020] User: Enters feedback into the device, such as whether the aroma experience improved their concentration and whether the strength of the scent was appropriate.
[2021] Feedback analysis and adjustment
[2022] Server: Analyzes the collected feedback data and adjusts the blend ratio and fragrance intensity for future batches.
[2023] Specific examples
[2024] Data collection and analysis
[2025] User: Because they are unable to maintain concentration while teleworking, they input "I want to concentrate" into the AI conversation app and wear a vital data monitoring device. In addition, the emotion engine collects the user's voice and facial expression data.
[2026] Terminal: Interaction data, vital data, and emotion data are collected and sent to the server.
[2027] Server: Analyzes the dialogue data using natural language processing (NLP) to determine that the user is seeking increased concentration. Analyzing vital data reveals that the user's heart rate is high (e.g., 85 BPM), indicating stress. The emotion engine analyzes voice and facial expression data to recognize emotions such as "impatience" in real time.
[2028] Aroma Profiling and Blending
[2029] Server: Based on the integrated results of psychological state, physical state, and emotions, it generates a blend of 70% rosemary and 30% peppermint, which is effective for improving concentration. It sends this information to the dispenser module.
[2030] Terminal: The dispenser module mixes the aroma oil as instructed, and the aroma diffuser spreads it throughout the room.
[2031] Aroma diffusion and feedback
[2032] User: Works while enjoying the scent, then enters feedback such as "My concentration has improved, but the scent is a little strong."
[2033] Server: We'll analyze your feedback and adjust the ratio to less peppermint and more rosemary next time.
[2034] In this way, the system can provide a personalized scent experience based on the user's needs and emotions, improving comfort and work efficiency.
[2035] The processing flow will be explained below.
[2036] Step 1:
[2037] User: Launches the AI conversation app and inputs the details of the task and current mental state. For example, the user might input "I want to concentrate." The user also wears a vital data monitoring device (heart rate monitor, thermometer, etc.).
[2038] Step 2:
[2039] On the device: The AI conversation engine initiates a dialogue with the user and asks more detailed questions, such as "What exactly are you working on?" or "How are you feeling right now?"
[2040] Step 3:
[2041] Terminal: Vital data monitoring device collects vital data such as heart rate, body temperature, and respiratory rate in real time.
[2042] Step 4:
[2043] Device: The emotion engine collects the user's voice and facial expressions through the camera and microphone, and analyzes this data in real time.
[2044] Step 5:
[2045] Terminal: Transmits collected interaction data, vital data, and emotion data to the server in real time.
[2046] Step 6:
[2047] Server: Stores the received data in a database.
[2048] Step 7:
[2049] Server: Analyzes the dialogue data using natural language processing (NLP) algorithms to identify the user's task and psychological state. For example, it identifies the user's desire to "concentrate."
[2050] Step 8:
[2051] Server: Machine learning algorithms analyze vital data and determine real-time physical conditions. For example, a high heart rate can indicate stress.
[2052] Step 9:
[2053] Server: The emotion engine analyzes voice data (tone, speed, etc.) and facial expression data (camera images) to recognize the user's emotional state (e.g., "anxious" or "relaxed").
[2054] Step 10:
[2055] Server: Generates the optimal blend of aroma oils based on the integrated results of psychological, physical, and emotional states. For example, a blend of 70% rosemary and 30% peppermint is generated to improve concentration.
[2056] Step 11:
[2057] Server: Sends the generated aroma profile to the dispenser module.
[2058] Step 12:
[2059] Terminal: The dispenser module receives instructions from the server and mixes each aromatic oil in the correct proportions, for example, accurately measuring out 70% rosemary and 30% peppermint.
[2060] Step 13:
[2061] Terminal: The aroma diffuser diffuses the blended aroma oil throughout the room, for example, automatically releasing the scent at regular intervals.
[2062] Step 14:
[2063] User: Enters feedback into the device about how they felt through the aroma experience, whether their concentration improved, whether the strength of the scent was appropriate, etc.
[2064] Step 15:
[2065] Terminal: Sends collected feedback data to the server.
[2066] Step 16:
[2067] Server: Analyzes the feedback data and adjusts the blend of aroma oils and the strength of the scent from the next time onwards. For example, if the user gives feedback that "the peppermint is too strong," the proportion of peppermint will be reduced and the proportion of rosemary will be increased next time.
[2068] In this way, the system can provide a personalized scent experience based on the user's needs and emotions, improving comfort and work efficiency.
[2069] Example 2
[2070] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2071] Conventional aroma oil blending systems have difficulty recognizing the user's psychological and emotional state in real time and providing the optimal aroma blend based on that. They also lacked a mechanism for effectively incorporating user feedback and utilizing it in the next aroma blend. Furthermore, they lacked the technology to integrate and analyze collected vital data and emotional data, making it impossible to provide a personalized aroma experience tailored to the user's individual needs.
[2072] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[2073] In this invention, the server includes means for collecting the user's psychological state and work content through dialogue with the user, means for collecting biological information in real time, and means for analyzing the collected voice and facial expression data to determine the user's emotions in real time. This makes it possible to generate an optimal fragrance blend in real time that comprehensively considers the user's psychological, physical, and emotional states, thereby providing a personalized aroma experience.
[2074] "Interaction with the user" is the process of using AI to collect information from the user about their work and psychological state.
[2075] "Mood" refers to a user's current emotional or mental state.
[2076] "Work content" refers to the specific content of the work or activity that the user is currently performing.
[2077] "Biometric information" includes physiological data such as the user's heart rate, body temperature, and respiratory rate.
[2078] "Real-time" refers to data collection and analysis occurring immediately, without delay.
[2079] "Voice data" refers to data that records the words and tone of voice spoken by a user.
[2080] "Facial expression data" is video data acquired to analyze a user's facial expressions.
[2081] "Emotions" refer to subjective experiences and feelings that indicate a user's psychological state.
[2082] A "fragrance blend" refers to a mixture of different fragrances in specific proportions.
[2083] "Proportioning device" means a device for mixing flavorings in specified proportions.
[2084] "Diffused throughout the room" means that the fragrance spreads throughout the room.
[2085] "Feedback" refers to the opinions and impressions provided by users after experiencing an aroma.
[2086] "Natural language processing technology" refers to technology for analyzing dialogue data and understanding human language.
[2087] MODE FOR CARRYING OUT THE INVENTION
[2088] (Detailed Description of the Invention)
[2089] This invention is a system that generates and adjusts optimal fragrance blends through dialogue with the user, collection of biometric information, and emotion recognition. This system can provide the optimal aroma experience according to the individual user's psychological, emotional, and physical state.
[2090] System Configuration
[2091] The system consists of the following main components:
[2092] 1. AI Conversation Engine
[2093] 2. Vital Data Monitoring Device
[2094] 3. Emotion Engine
[2095] 4. Data Analysis Module
[2096] 5. Aroma Profiling Module
[2097] 6. Dispenser Module
[2098] 7. Aroma diffuser
[2099] 8. Feedback Module
[2100] Technical details
[2101] The program of this system operates as follows.
[2102] 1. Data Collection
[2103] The user launches the AI conversation app and inputs their current work and mood. They also wear a vital data monitoring device. Furthermore, voice and facial expression data are collected using the emotion engine's input devices (microphone and camera).
[2104] 2. Data transmission
[2105] The terminal transmits the collected interaction data, biometric information, and emotion data to the server in real time.
[2106] 3. Data storage and analysis
[2107] The server stores the received data in a database. Natural language processing (NLP) algorithms analyze the dialogue data to identify the user's task and psychological state. Machine learning algorithms analyze biometric information to determine real-time physical state. An emotion engine analyzes voice and facial expression data to determine the user's emotions in real time.
[2108] 4. Aroma Profiling
[2109] The server generates a fragrance blend that best suits the user's needs based on the results of an integrated analysis of their psychological state, physical state, and emotions.
[2110] 5. Aroma blend composition
[2111] The server sends the generated aroma profile to the dispenser module.
[2112] The dispenser module in the terminal receives instructions from the server and mixes each fragrance in the correct proportions.
[2113] 6. Aroma diffusion
[2114] The device is an aroma diffuser that spreads the blended fragrance throughout the room.
[2115] 7. User Feedback
[2116] Users input feedback into the device, such as whether their concentration improved through the aroma experience and whether the strength of the scent was appropriate.
[2117] 8. Feedback Analysis and Adjustment
[2118] The server analyzes the collected feedback data and adjusts the blend ratio and fragrance intensity for future uses.
[2119] Specific examples
[2120] Specific examples are shown below.
[2121] Data collection and analysis
[2122] When a user is unable to maintain concentration while teleworking, they input "I want to concentrate" into the AI conversation app and wear a vital data monitoring device. In addition, the emotion engine collects the user's voice and facial expression data.
[2123] The terminal collects dialogue data, biometric information, and emotion data and transmits them to the server.
[2124] The server analyzes the dialogue data using natural language processing (NLP) to determine that the user is seeking improved concentration. Biometric analysis determines that the user's heart rate is high (e.g., 85 BPM), indicating stress. The emotion engine analyzes voice and facial expression data to recognize emotions such as "impatience" in real time.
[2125] Aroma Profiling and Blending
[2126] The server generates a blend of 70% rosemary and 30% peppermint, which is effective for improving concentration, based on the integrated results of psychological state, physical state, and emotions, and sends this information to the dispenser module.
[2127] The dispenser module in the device mixes the fragrance as instructed, and the aroma diffuser spreads it throughout the room.
[2128] Aroma diffusion and feedback
[2129] The user works while enjoying the scent, and then inputs feedback such as, "My concentration has improved, but the scent is a little strong."
[2130] The server analyzes the feedback and adjusts the ratio of peppermint to more rosemary next time.
[2131] Example prompts
[2132] "I'd like to improve my focus, so please suggest the best fragrance blend based on my current psychological state and biometric information."
[2133] Hardware / Software used
[2134] AI conversation engine: Natural language processing library
[2135] Vital Data Monitoring Devices: Heart Rate Monitor / Thermometer
[2136] Emotion engine: voice analysis software, facial expression recognition camera
[2137] Data Analysis Module: Machine Learning Models
[2138] Aroma Profiling Module: Algorithm
[2139] Dispenser module: Automatic blender
[2140] Aroma diffuser: Diffuser device
[2141] Feedback Module: User Interface
[2142] As described above, the embodiments of the invention are designed so that each component works together to provide the optimal aroma experience.
[2143] The flow of the identification process in the second embodiment will be described with reference to FIG.
[2144] Step 1:
[2145] Data collection
[2146] The user launches the AI conversation app and inputs their current work and mood, such as "I want to concentrate." They also wear a vital data monitoring device that measures their heart rate and body temperature. Furthermore, the emotion engine's camera and microphone are used to collect voice and facial expression data.
[2147] Input: User interaction data (e.g., "I want to concentrate"), biometric information (heart rate, body temperature, etc.), voice data, and facial expression data.
[2148] Output: Various data collected.
[2149] Specific actions
[2150] "The user types 'I want to concentrate' into the AI conversation app, wears a heart rate monitor on their wrist, and speaks into the camera to collect voice and facial expression data."
[2151] Step 2:
[2152] Sending data
[2153] The terminal transmits the collected interaction data, biometric information, and emotion data to the server in real time.
[2154] Input: Various data collected.
[2155] Output: Various data sent to the server.
[2156] Specific actions
[2157] "The device sends the user's input data, heart rate, voice, and facial expression data to a server over a secure channel via the Internet."
[2158] Step 3:
[2159] Data storage and analysis
[2160] The server stores the received data in a database. The dialogue data is analyzed using natural language processing (NLP) algorithms to identify the user's task and psychological state. Biometric information is analyzed using machine learning algorithms to determine the user's physical state in real time. The emotion engine analyzes voice and facial expression data to determine the user's emotions in real time.
[2161] Input: Various data sent.
[2162] Output: Analysis results (mental state, physical state, emotions).
[2163] Specific actions
[2164] "The server stores the data in a database, analyzes the dialogue data using an NLP algorithm, and identifies the user's desire to 'concentrate'. The machine learning algorithm analyzes the heart rate data and determines the user's stress level. The emotion engine analyzes the voice and facial expression data and detects the emotion 'impatience'."
[2165] Step 4:
[2166] Aroma Profiling
[2167] The server generates a fragrance blend that best suits the user's needs based on the integrated results of their psychological state, physical state, and emotions.
[2168] Input: Analysis results (mental state, physical state, emotions).
[2169] Output: Recipe for optimal flavor blend.
[2170] Specific actions
[2171] "The server integrates the psychological state, physical state, and emotions to produce a blend of 70% Rosmary and 30% Peppermint, and sends this information to the dispenser module."
[2172] Step 5:
[2173] Aroma blend composition
[2174] The server transmits the generated aroma blend information to the dispenser module.
[2175] The dispenser module in the terminal receives instructions from the server and mixes each fragrance in the correct proportions.
[2176] Input: A recipe for the optimal flavoring blend.
[2177] Output: Pre-blended fragrance oil.
[2178] Specific actions
[2179] "The dispenser module, based on instructions from the server, uses precision meters and pumps to mix the flavors in a ratio of 70% to 30%."
[2180] Step 6:
[2181] Aroma diffusion
[2182] The device acts as an aroma diffuser, spreading the blended fragrance throughout the room.
[2183] Enter: pre-blended fragrance oils.
[2184] Output: Fragrance diffused throughout the room.
[2185] Specific actions
[2186] The aroma diffuser operates a fan to evenly distribute the fragrance throughout the room.
[2187] Step 7:
[2188] User Feedback
[2189] Users input feedback into the device, such as whether their concentration improved through the aroma experience and whether the strength of the scent was appropriate.
[2190] Input: User's impressions and requests based on the aroma experience.
[2191] Output: Feedback data.
[2192] Specific actions
[2193] "The user experiences the aroma for a few hours and then provides feedback on the device, such as 'My concentration has improved, but the scent is a bit strong.'"
[2194] Step 8:
[2195] Feedback analysis and adjustment
[2196] The server analyzes the collected feedback data and adjusts the blend ratio and fragrance intensity for future uses.
[2197] Input: Feedback data.
[2198] Output: A recipe for the adjusted flavor blend.
[2199] Specific actions
[2200] "The server analyzes the feedback data and adjusts the flavoring blend recipe to reduce the percentage of peppermint and increase the percentage of rosemary."
[2201] (Application example 2)
[2202] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2203] In recent years, there has been a demand for services that aim to improve user experiences in real spaces. However, current systems face the challenge of accurately collecting and analyzing users' psychological state and emotions in real time and diffusing aroma oil blends based on that information into physical spaces. In particular, providing optimal scents that match the emotions and psychological state of customers in physical stores is an urgent task, as it directly contributes to creating a comfortable space and increasing purchasing motivation.
[2204] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting the user's psychological state and task details through dialogue with the user, means for collecting the user's emotional state using a smartphone, means for collecting the user's vital data in real time, means for analyzing the collected dialogue data, emotional data, and vital data to determine the user's psychological and physical states, means for generating an optimal aroma oil blend based on the analysis results, means for mixing the generated aroma oil blend in an accurate ratio using a dispenser, and means for diffusing the blended aroma oils into real space. This makes it possible to provide an optimal aroma experience in real time based on the user's psychological state and emotions, thereby improving the user experience in real space.
[2205] "User" refers to an individual who uses the System.
[2206] "Dialogue" is a type of communication between a user and a system, and is carried out for the purpose of gathering information about the user's mental state and the content of their work.
[2207] A "smartphone" refers to a portable electronic device that has communication capabilities and can be used by installing specific applications.
[2208] "Emotional state" is data that represents the user's emotional response, and is collected from voice, facial expressions, etc.
[2209] "Vital data" refers to data that indicates physiological information such as the user's heart rate, body temperature, and respiratory rate.
[2210] "Real-time" refers to data being processed with almost no delay and results being provided immediately.
[2211] "Dialogue data" is information collected through dialogue with a user, and includes the user's psychological state and work content.
[2212] "Emotion data" is emotional information analyzed from the user's voice and facial expressions.
[2213] "Mental state" is information that indicates the mental state of the user, and is inferred from dialogue data and emotion data.
[2214] "Physical condition" is information indicating the physiological state of the user, and is analyzed from vital data.
[2215] "Aroma oil" is an oil containing aromatic substances extracted from plants, etc., and is used in aromatherapy.
[2216] A "blend" refers to a mixture of multiple aromatic oils in a specific ratio.
[2217] A "dispenser" is a device that mixes aromatic oils in a specified ratio.
[2218] "Diffusion" refers to spreading the blended aroma oils into physical space.
[2219] A "real space" is a physical space where a user actually exists.
[2220] "Feedback" refers to the opinions and thoughts that users provide to the system about their experience and usage.
[2221] "Adjusting" means changing the system settings or aroma oil blends based on the feedback.
[2222] "Natural language processing technology" is a technology that analyzes dialogue data to understand the user's intentions and psychological state.
[2223] "Heart rate, body temperature, and respiratory rate data" are basic physiological indicators that make up the user's vital data.
[2224] System Configuration
[2225] The present invention provides an aroma service system that improves user experience in brick-and-mortar stores. This system is comprised of the following main hardware and software:
[2226] Hardware
[2227] 1. Smartphone
[2228] 2. Vital data monitoring devices (e.g., smart watches)
[2229] 3. Aroma diffusers in brick-and-mortar stores
[2230] 4. Server
[2231] software
[2232] 1. AI conversation engines (e.g., Dialogflow, a natural language processing technology)
[2233] 2. Vital data monitoring device integration API (e.g. Fitbit API)
[2234] 3. Emotion recognition software (e.g., Azure Cognitive Services)
[2235] 4. Data analysis modules (e.g., TensorFlow)
[2236] 5. Aroma Profiling Module
[2237] 6. Dispenser module (e.g. Arduino controlled)
[2238] Program processing procedure (overview)
[2239] Data collection
[2240] Device: A user enters a store and launches the smartphone application. The application presents simple questions to collect the customer's psychological and emotional state. The user wears a vital data monitoring device (smartwatch) and collects data in real time. Emotion recognition software is used to capture facial and voice data from the smartphone's camera and microphone.
[2241] Data transmission and analysis
[2242] Server: Interaction data, emotional data, and vital data collected from smartphones and other devices are sent to the server in real time. The server stores this data in a database and analyzes it using natural language processing technology (Dialogflow) and emotion recognition software (Azure Cognitive Services). Specifically, the server identifies the user's psychological state and task content based on the interaction data, and determines the user's emotional state from the emotional data. Vital data includes the user's heart rate, body temperature, and respiratory rate.
[2243] Aroma Profiling and Blend Formulation
[2244] Server: Generates the optimal aroma oil blend for the user based on the analysis of their psychological, emotional, and physical state (vital data). This generated aroma profile is sent to the dispenser module, and the aroma diffuser in the physical store mixes the aroma oils in a specific ratio and diffuses them into the space.
[2245] User feedback and aroma blend adjustments
[2246] Users: Experience the scent in the store and then provide feedback via a smartphone app. They can enter specific opinions such as, "My concentration improved, but the scent is a little strong."
[2247] Server: The collected feedback data will be analyzed and the blend ratio and strength of the aroma oils will be adjusted from the next time onwards. For example, the ratio of peppermint will be reduced and the ratio of rosemary will be increased.
[2248] Specific examples
[2249] Assume that a user wants to improve their concentration while teleworking. In this case, the user enters "I want to concentrate" into a smartphone application and wears a vital data monitoring device. At the same time, an emotion recognition engine recognizes the emotion of "anxiety" from the user's voice and facial expression. Based on this data, the server generates an aroma blend (e.g., 70% rosemary, 30% peppermint) effective for improving concentration and sends instructions to the aroma diffuser.
[2250] Example prompt sentence:
[2251] "I feel like relaxing today. I've been feeling a bit stressed lately."
[2252] In this way, the brick-and-mortar aroma service system of the present invention can improve the user experience in real space by analyzing the user's psychological state and emotions in real time and providing the most appropriate aroma oil based on that.
[2253] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[2254] Step 1:
[2255] Data collection
[2256] Input: A user visits a physical store and launches the smartphone application. They answer simple questions provided within the app and input their emotional and psychological state. They wear a vital data monitoring device (smartwatch) that collects data such as heart rate, body temperature, and respiratory rate in real time. The camera and microphone are used to capture facial and voice data using emotion recognition software.
[2257] Data processing: The collected interaction data, emotion data, and vital data are formatted and sent to the server.
[2258] Output: Dialogue data, emotion data, and vital data are sent to the server.
[2259] Step 2:
[2260] Data storage and initial analysis
[2261] Input: The interaction data, emotion data, and vital data sent as the output of Step 1.
[2262] Data processing: The server stores the received data in a database and analyzes the dialogue data using natural language processing technology (Dialogflow). At the same time, emotion recognition software (Azure Cognitive Services) analyzes the emotional data to identify the emotional state. Vital data is analyzed using a machine learning algorithm (TensorFlow) to determine the physical condition.
[2263] Output: Analysis of the user's mental, emotional and physical state.
[2264] Step 3:
[2265] Aroma Profiling
[2266] Input: Analysis results as output of step 2 (mental, emotional, and physical states).
[2267] Data calculation: Based on the analysis results, the server uses the aroma profiling module to generate the optimal aroma oil blend. Specifically, it comprehensively analyzes data such as psychological state (e.g., need for concentration), emotional state (e.g., impatience), and physical state (e.g., high heart rate) to determine the type and ratio of aroma oils.
[2268] Output: Optimal aroma oil blend profile.
[2269] Step 4:
[2270] Aroma blend composition
[2271] Input: Aroma oil blend profile as output of step 3.
[2272] Data processing: The aroma blend profile is sent to the dispenser module (controlled by Arduino), which then precisely blends each aroma oil in the specified ratio.
[2273] Output: Blended aroma oil.
[2274] Step 5:
[2275] Aroma diffusion
[2276] Input: Blended aroma oils as output of step 4.
[2277] How it works: The aroma diffuser receives the aroma oil blended in the dispenser module and diffuses it into the real space, allowing the user to experience the scent in the real space.
[2278] Output: Aroma diffused in real space.
[2279] Step 6:
[2280] Collecting and analyzing user feedback
[2281] Input: Feedback from users who experienced the scent in real space. Specific opinions such as "My concentration improved, but the scent was a little strong."
[2282] Data calculation: The server analyzes the collected feedback data and uses it to adjust the next aroma blend, for example, by reducing the proportion of peppermint and increasing the proportion of rosemary.
[2283] Output: New adjusted aroma blend profile.
[2284] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.
[2285] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[2286] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.
[2287] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[2288] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.
[2289] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.
[2290] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).
[2291] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.
[2292] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."
[2293] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.
[2294] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).
[2295] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.
[2296] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.
[2297] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[2298] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.
[2299] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.
[2300] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.
[2301] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.
[2302] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.
[2303] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.
[2304] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.
[2305] The following is further disclosed regarding the above embodiment.
[2306] (Claim 1)
[2307] A means for collecting psychological states and work contents through dialogue with a user;
[2308] a means for collecting user vital data in real time;
[2309] a means for analyzing the collected dialogue data and vital data to determine the user's psychological and physical states;
[2310] A means for generating an optimal blend of aromatic oils based on the analysis results;
[2311] a means for accurately dispensing the resulting aromatic oil blend in a dispenser;
[2312] The system includes a means for diffusing the blended aromatic oil into an indoor space.
[2313] (Claim 2)
[2314] 10. The system of claim 1, further comprising means for collecting user feedback and adjusting the blend of aromatic oils based on the feedback.
[2315] (Claim 3)
[2316] The system of claim 1, wherein the dialogue data is collected using natural language processing techniques, and the vital data is collected including heart rate, body temperature, and respiratory rate data.
[2317] "Example 1"
[2318] (Claim 1)
[2319] A means for collecting psychological states and work contents through dialogue with a user;
[2320] means for collecting biometric information of a user in real time;
[2321] a means for analyzing the collected dialogue data and biometric information to determine the user's psychological and physical states;
[2322] A means for generating an optimal fragrance blend based on the analysis results;
[2323] means for mixing the resulting fragrance formula in the correct proportions in a dispenser;
[2324] The system includes a means for dispersing the fragrance blend into an indoor space.
[2325] (Claim 2)
[2326] 2. The system according to claim 1, further comprising means for collecting user evaluation information and adjusting the blend of fragrances based on the evaluation information.
[2327] (Claim 3)
[2328] 2. The system according to claim 1, wherein the dialogue data is collected using natural language processing techniques, and the biometric information includes heart rate, body temperature, and respiratory rate data.
[2329] "Application Example 1"
[2330] (Claim 1)
[2331] A means for collecting psychological states and work contents through dialogue with a user;
[2332] a means for collecting user vital data in real time;
[2333] a means for analyzing the collected dialogue data and vital data to determine the user's psychological and physical states;
[2334] A means for generating an optimal blend of aromatic oils based on the analysis results;
[2335] a means for accurately dispensing the resulting aromatic oil blend in a dispenser;
[2336] A means for diffusing the blended aroma oil into the room;
[2337] A means for providing an aroma experience in a virtual environment;
[2338] A way to collect feedback and incorporate it into your next aroma experience.
[2339] A system including a means for determining an aroma blend that best suits a user's needs from interaction data and vital data using a generative AI model.
[2340] (Claim 2)
[2341] and means for collecting user feedback and adjusting the blend of aromatic oils based on the feedback.
[2342] 10. The system of claim 1.
[2343] (Claim 3)
[2344] The conversation data is collected using natural language processing technology, and the vital data includes heart rate, body temperature, and respiratory rate.
[2345] 10. The system of claim 1.
[2346] "Example 2: Combining Emotion Engines"
[2347] (Claim 1)
[2348] A means for collecting psychological states and work contents through dialogue with a user;
[2349] means for collecting biometric information of a user in real time;
[2350] a means for analyzing the collected dialogue data and biometric information to determine the user's psychological and physical states;
[2351] A means of analyzing collected voice and facial expression data to determine the user's emotions in real time;
[2352] a means for generating an optimal blend of flavorings based on the analysis results;
[2353] means for accurately proportioning the resulting flavor blend in a dispensing device;
[2354] The system includes a means for dispersing the blended fragrance into an indoor space.
[2355] (Claim 2)
[2356] 10. The system of claim 1, further comprising means for collecting user feedback and adjusting the blend of fragrances based on the feedback.
[2357] (Claim 3)
[2358] 2. The system according to claim 1, wherein the dialogue data is collected using natural language processing techniques, and the biometric information includes heart rate, body temperature, and respiratory rate data.
[2359] "Application example 2 when combining emotion engines"
[2360] Extracting and reconstructing novel parts
[2361] Features of the new part
[2362] Specific application cases aimed at improving user experience in real space
[2363] Collecting psychological states and emotions using smartphones in brick-and-mortar stores
[2364] Real-time feedback collection and analysis in real space
[2365] Dispensers diffuse the optimal aroma oil into physical spaces
[2366] Analysis and adjustments for improved real-world experience
[2367] Combination of original claim and new part
[2368] Create new claims that include specific real-space examples in addition to the original claims.
[2369] (Claim 1)
[2370] A means for collecting psychological states and work contents through dialogue with a user;
[2371] A means for collecting a user's emotional state using a smartphone;
[2372] a means for collecting user vital data in real time;
[2373] means for analyzing the collected dialogue data, emotion data, and vital data to determine the user's mental and physical states;
[2374] A means for generating an optimal blend of aromatic oils based on the analysis results;
[2375] a means for accurately dispensing the resulting aromatic oil blend in a dispenser;
[2376] A system including a means for diffusing blended aromatic oils into a real space.
[2377] (Claim 2)
[2378] 10. The system of claim 1, further comprising means for collecting user feedback and adjusting the blend of aromatic oils based on the feedback.
[2379] (Claim 3)
[2380] The system of claim 1, wherein the dialogue data is collected using natural language processing techniques, and the vital data is collected including heart rate, body temperature, and respiratory rate data. [Explanation of symbols]
[2381] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>
Claims
1. A means for collecting psychological states and work contents through dialogue with a user; a means for collecting user vital data in real time; a means for analyzing the collected dialogue data and vital data to determine the user's psychological and physical states; A means for generating an optimal blend of aromatic oils based on the analysis results; a means for accurately dispensing the resulting aromatic oil blend in a dispenser; The system includes a means for diffusing the blended aromatic oil into an indoor space.
2. 10. The system of claim 1, further comprising means for collecting user feedback and adjusting the blend of aromatic oils based on the feedback.
3. The system according to claim 1 , wherein the collection of the dialogue data uses natural language processing techniques, and the collection of the vital data includes data on heart rate, body temperature, and respiratory rate.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A