System
The system addresses the challenge of recognizing and addressing unpleasant odors by using sensors and AI to automatically generate and spray customized fragrances, enhancing interpersonal relationships through real-time odor management.
Patent Information
- Application Number
- JP2024116377
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-07-19
- Publication Date
- 2026-01-29
AI Technical Summary
Unpleasant human body odors and breath are difficult to recognize and address promptly, leading to interpersonal discomfort, with existing methods requiring manual intervention and lacking real-time odor detection and appropriate fragrance generation.
A system that includes odor detection sensors, AI-driven odor analysis, automatic fragrance generation and spraying, and user notification, allowing real-time detection and counteraction of odors by generating and dispersing customized fragrances.
Enables timely recognition and automatic countermeasures for unpleasant odors, improving interpersonal relationships by reducing discomfort through efficient and user-friendly odor management.
Smart Images

Figure 2026014903000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] Traditionally, unpleasant odors contained in human body odor and breath have been difficult for people to recognize, leading to problems in interpersonal relationships. Unpleasant odors are diverse, ranging from alcohol, food (e.g., garlic), sweat, and body odor, making it difficult to take appropriate measures each time. These odors, in particular, are difficult to notice, increasing the risk of causing discomfort to others. To solve this problem, there is a demand for a system that automatically detects odors and generates and sprays the corresponding fragrance. [Means for solving the problem]
[0005] The present invention provides a system including a means for detecting odors, a means for analyzing the component data of the detected odors to identify specific odors, a means for generating a fragrance recipe corresponding to the identified odor, a means for automatically blending and spraying the generated fragrance, and a means for notifying the user of an alert. Specifically, the system includes a means for transmitting odor component data to a server when the odor intensity exceeds a set threshold, a means for analyzing the odor component data using an AI model, and a means for generating and spraying an optimal fragrance recipe. This allows users to recognize their own odor in a timely manner and automatically take appropriate measures to address it, thereby reducing discomfort in interpersonal relationships.
[0006] "Means for detecting odors" refers to sensors or devices that monitor odor components in the surrounding air and collect data on those components.
[0007] "Means for analyzing detected odor component data and identifying specific odors" refers to software or algorithms for determining and identifying specific odor types based on odor component data.
[0008] A "means for generating a fragrance recipe corresponding to an identified odor" is a system or process for determining an optimal fragrance specific blend based on an identified odor.
[0009] "Means for automatically blending and spraying the generated fragrance" refers to a device or technology that automatically mixes and sprays fragrances based on a determined fragrance recipe.
[0010] "Means for notifying the user of an alert" refers to a notification function or device that notifies the user that an odor has been detected and that countermeasures have been implemented.
[0011] "Means for transmitting odor component data to a server when the odor intensity exceeds a set threshold" refers to a communication module or protocol for sending the data to a server when the intensity of the detected odor exceeds a certain level.
[0012] "Means for analyzing odor component data using an AI model" refers to an algorithm that uses artificial intelligence technology to analyze odor component data and identify specific odor types.
[0013] "Means for generating and spraying optimal fragrance recipes" refers to devices and technologies that calculate the appropriate fragrance blend ratio based on the analysis results, and generate and spray that fragrance. [Brief explanation of the drawings]
[0014] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10]1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0015] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0016] First, the terms used in the following description will be explained.
[0017] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0018] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0019] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0020] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0022] [First embodiment]
[0023] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0024] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0025] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0026] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0027] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0030] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0031] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0032] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0033] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0034] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0035] The system of this invention aims to effectively counteract unpleasant body odors and breath odors by automatically detecting odors and instantly generating and spraying corresponding fragrances. This system is primarily composed of a terminal and a server, and the main roles and processing flow of each are explained below.
[0036] Device features and operations
[0037] Odor detection
[0038] The device is equipped with a built-in odor sensor that constantly monitors the air around the user. The sensor chemically detects odor components and records their intensity as digital data. This data is sent to a server when a specific odor exceeds a set threshold.
[0039] Data transmission
[0040] The device establishes a connection with the server via a wireless communication module and transmits odor component data, including the chemical formulas and concentrations of the detected odor components.
[0041] Server Functions and Operations
[0042] Odor analysis and identification
[0043] The server receives the odor component data sent from the device. This data is analyzed by an AI model to identify specific odors. The AI model has been trained in advance with a variety of odor data, allowing it to identify odor types with high accuracy. Identified odors include alcohol, garlic, sweat, and body odor.
[0044] Creating a fragrance recipe
[0045] The fragrance recipe corresponding to the identified scent is retrieved from a database stored on the server, which runs an algorithm to generate a composite fragrance recipe, possibly corresponding to multiple scent components, and transmits this recipe to the device.
[0046] Fragrance production and spraying
[0047] Procedural generation and spraying
[0048] The device activates its built-in fragrance generator based on the fragrance recipe received from the server. Fragrance cartridges are loaded into the device, which automatically extracts and mixes the necessary fragrances according to the recipe. The generated fragrance is sprayed appropriately around the user using a built-in pump system.
[0049] Alert Notifications
[0050] User Notification
[0051] The device will generate an alert via vibration or sound to let the user know that an odor has been detected and corrective action has been taken, and a notification will also appear in the smartphone application or on the device display, allowing the user to confirm that the problem has been resolved.
[0052] Specific examples
[0053] Case 1: User who drank alcohol last night
[0054] 1. Odor detection: The device detects a strong odor of alcohol from the user's breath.
[0055] 2. Data transmission: This odor component data is sent to the server.
[0056] 3. Smell analysis and identification: The server identifies the smell as "alcohol" and generates a fragrance recipe based on that information.
[0057] 4. Fragrance generation and spraying: The device generates and sprays peppermint and rosemary fragrance.
[0058] 5. Alert notification: The device will vibrate to notify the user that the alcohol smell has been neutralized.
[0059] Case 2: A user who ate gyoza for lunch
[0060] 1. Odor detection: The device detects a strong garlic odor from the user's breath.
[0061] 2. Data transmission: This odor component data is sent to the server.
[0062] 3. Smell analysis and identification: The server identifies the scent as "garlic" and generates a fragrance recipe based on that information.
[0063] 4. Fragrance generation and spraying: The device generates and sprays a citrus and basil fragrance.
[0064] 5. Alert notification: The device will vibrate to notify the user that the garlic smell has been neutralized.
[0065] As is clear from these examples, the present invention provides an easy-to-use and effective odor countermeasure for users. The integrated operation of the entire system can improve the quality of life of users.
[0066] The processing flow will be explained below.
[0067] Step 1: Smell detection
[0068] The device activates an odor sensor to monitor the air around the user. The sensor chemically detects odor components and records their intensity as digital data. The odor component data is temporarily stored in the device's internal memory.
[0069] Step 2: Check if the threshold is exceeded
[0070] The device determines whether the recorded odor component data exceeds the set threshold. If so, it sends the data to the server. If not, it continues odor detection.
[0071] Step 3: Send data
[0072] The device establishes a connection with the server via a wireless communication module and transmits odor component data, including the chemical formulas and concentrations of the detected odor components, to the server.
[0073] Step 4: Data reception and analysis
[0074] The server receives the odor component data sent from the device. This data is analyzed by an AI model to identify specific odors. The AI model has been trained in advance on a variety of odor data, allowing it to identify odor types with high accuracy.
[0075] Step 5: Save the identification results and search for fragrance recipes
[0076] The server records the identification results in a database, then searches the database for fragrance recipes corresponding to the identified scents, and optionally runs an algorithm to generate a composite fragrance recipe.
[0077] Step 6: Submit your fragrance recipe
[0078] The server determines the appropriate fragrance combination and its mixing ratio and sends this recipe to the device, including the specific types of fragrances and their amounts.
[0079] Step 7: Start the fragrance generator
[0080] The device processes the fragrance recipe received from the server, stores it in its internal memory, and then activates the fragrance generator, which automatically extracts and mixes the required fragrances.
[0081] Step 8: Spray with fragrance
[0082] The device then uses a built-in pump system to spray the generated fragrance around the user, controlling the timing and amount of spray to ensure the fragrance is dispersed effectively.
[0083] Step 9: Re-detect the smell
[0084] After spraying the fragrance, the device activates the odor sensor again to check whether the odor was properly neutralized. If the odor was not neutralized sufficiently, the cycle starts again from step 1.
[0085] Step 10: Alert Notification
[0086] The device generates an alert to notify the user, using vibrations, a sound, or a notification on the smartphone application or device display. The user confirms the notification and knows that the odor problem has been resolved.
[0087] Through the above processing steps, the user can recognize his or her own odor in a timely manner and automatically take necessary measures.
[0088] Example 1
[0089] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0090] In modern life, unpleasant odors from personal body odor and breath are a significant problem because they can be unpleasant for others. Conventional methods involve the use of masks or portable fragrance dispensers, but these methods require manual intervention and are difficult to implement in real time. Furthermore, there are limited technologies available for instantly generating the appropriate fragrance combination for a specific odor. The present invention aims to address these issues and provide a user-friendly and effective odor control solution.
[0091] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0092] In this invention, the server includes means for detecting odors, means for transmitting component data of the detected odors to the server, means for receiving and analyzing the transmitted component data of the odors to identify specific odors, means for generating a fragrance recipe corresponding to the identified odor, means for automatically blending and spraying the generated fragrance, and means for notifying the user of an alert. This makes it possible to detect odors around the user in real time and instantly generate and spray an appropriate fragrance.
[0093] An "odor detection means" is a device or sensor that detects specific chemical components in the surrounding air and converts their concentrations into digital data.
[0094] "Means for transmitting data on detected odor components to a server" refers to technology that has the function of transmitting data on odor components detected by a sensor to a server using a wireless communication module or the like.
[0095] "Means for receiving and analyzing the transmitted odor component data to identify specific odors" refers to a method for processing the data received on the server using an AI model or analytical algorithm to identify the specific type of odor.
[0096] The "means for generating a fragrance recipe corresponding to an identified scent" refers to a technology that uses a database or algorithm to determine the appropriate fragrance composition corresponding to a specific scent and generate that recipe.
[0097] The "means for automatically blending and spraying the generated fragrance" is a device that uses a fragrance generator installed inside to automatically extract and mix the necessary fragrances and spray the fragrance through a pump system.
[0098] "Means for notifying the user of an alert" refers to a function that notifies the user that fragrance spraying has been completed or other important information by vibration, notification sound, display, or the like.
[0099] An "AI model" is an algorithm that has been trained using large amounts of data to perform a specific task (in this case, identifying odors) with high accuracy.
[0100] A "prompt statement" is an instruction statement that provides specific input data to an AI model and is used to instruct processing such as analysis and identification.
[0101] MODE FOR CARRYING OUT THE INVENTION
[0102] The system of the present invention detects odors in the air around the user in real time, and generates and sprays a corresponding fragrance to quickly and effectively counteract unpleasant odors. The details of each component and their operation are explained below.
[0103] Odor detection
[0104] The device is equipped with a built-in odor sensor that constantly monitors the air around the user. The odor sensor detects chemical components and records their concentration as digital data. If this data exceeds a set threshold, it proceeds to the next processing step. A highly sensitive odor sensor using MEMS technology is suitable for this hardware.
[0105] Data transmission
[0106] The device transmits odor component data to a server using a wireless communication module (e.g., Wi-Fi module or Bluetooth module), which can send the chemical formula and concentration data of odor components to the server in real time.
[0107] Odor analysis and identification
[0108] The server receives the odor component data sent from the device and uses a generative AI model to analyze it. The AI model is pre-trained with a variety of odor data and can identify odors with high accuracy. An example of a prompt is "Please identify the components based on this odor data." Specific functions include the ability to identify odors such as alcohol, garlic, sweat, and body odor.
[0109] Creating a fragrance recipe
[0110] A fragrance recipe corresponding to the identified scent is retrieved from a database stored on the server, which runs an algorithm to generate a composite fragrance recipe corresponding to multiple scent components as needed, and transmits the generated recipe to the device.
[0111] Fragrance production and spraying
[0112] The device activates the built-in fragrance generator based on the fragrance recipe received from the server. The device is loaded with fragrance cartridges and automatically extracts and mixes the necessary fragrances according to the recipe. The generated fragrance is then sprayed appropriately around the user using a built-in pump system.
[0113] User Notification
[0114] The device will alert the user by vibrating or making a sound to let them know that fragrance spraying is complete, and an alert message will appear in the smartphone application or on the device display, allowing the user to confirm that the problem has been resolved.
[0115] Specific examples
[0116] Case 1: User who drank alcohol last night
[0117] 1. Odor detection: The device detects a strong odor of alcohol from the user's breath.
[0118] 2. Data transmission: This odor component data is sent to the server.
[0119] 3. Smell analysis and identification: The server instructs the generative AI model to "identify the ingredients based on this smell data," and identifies "alcohol."
[0120] 4. Fragrance generation and spraying: The server generates a peppermint and rosemary fragrance recipe and sends it to the terminal, which then sprays it.
[0121] 5. Alert notification: The device will vibrate to notify the user that the alcohol smell has been neutralized.
[0122] Case 2: A user who ate gyoza for lunch
[0123] 1. Odor detection: The device detects a strong garlic odor from the user's breath.
[0124] 2. Data transmission: This odor component data is sent to the server.
[0125] 3. Smell analysis and identification: The server instructs the generative AI model to "identify the ingredients based on this smell data," and identifies "garlic."
[0126] 4. Fragrance generation and spraying: The server generates a citrus and basil fragrance recipe and sends it to the terminal, which then sprays it.
[0127] 5. Alert notification: The device will vibrate to notify the user that the garlic smell has been neutralized.
[0128] In this way, the system of the present invention can quickly and effectively address various odor problems faced by users, thereby enabling users to maintain a comfortable environment at all times.
[0129] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0130] Step 1:
[0131] Odor detection
[0132] The device uses an odor sensor to constantly monitor the air around the user. The sensor detects specific chemical components in real time and converts their concentrations into digital data. The input for this process is the chemical components in the surrounding air, and the output is digital data containing those chemical components. Specifically, the sensor detects the odor component of alcohol, and if its concentration exceeds a certain threshold, the data is recorded.
[0133] Step 2:
[0134] Data transmission
[0135] The device connects to the server using a wireless communication module (e.g., Wi-Fi or Bluetooth). Data on the detected odor components (chemical formula and concentration) is sent to the server. The input in this process is the digital data detected by the sensor, and the output is the odor component data sent to the server. Specifically, the device sends alcohol concentration data to the server via the Wi-Fi module.
[0136] Step 3:
[0137] Odor analysis and identification
[0138] The server uses a generative AI model to analyze the data received from the device. The AI model has been trained in advance on a variety of odor data and identifies specific odors based on the data. The input for this process is the transmitted odor component data, and the output is the identified odor type. Specifically, the server prompts the generative AI model, saying, "Please identify the component based on this odor data," and the response is "alcohol."
[0139] Step 4:
[0140] Creating a fragrance recipe
[0141] The server searches the database for fragrance recipes corresponding to the identified scent. If necessary, it runs an algorithm to generate a composite fragrance recipe corresponding to multiple scent components. The input to this process is the identified scent type, and the output is the generated fragrance recipe. Specifically, the server searches the database, finds "peppermint and rosemary" as a "fragrance recipe for alcohol," and sends it to the terminal.
[0142] Step 5:
[0143] Fragrance production and atomization
[0144] The device activates its built-in fragrance generator based on the fragrance recipe received from the server. It uses fragrance cartridges to extract and mix the required fragrances. The input for this process is the fragrance recipe, and the output is the generated fragrance. Specifically, the device activates the fragrance generator, extracts peppermint and rosemary fragrances in the specified ratio, and sprays them through the pump system.
[0145] Step 6:
[0146] Alert Notifications
[0147] The device vibrates or sounds an alert to notify the user that fragrance spraying is complete. An alert message is also displayed on the smartphone app or device display. The input during this process is the completion status of spraying, and the output is a notification to the user. Specifically, the device activates a vibration and displays a message on the smartphone app saying, "The smell of alcohol has been neutralized."
[0148] (Application example 1)
[0149] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0150] Conventional odor control systems have difficulty responding immediately to individual users' body odors and breath odors, and lack the functionality to efficiently notify administrators of odor detection and countermeasure implementation in specific spaces. This makes it difficult to immediately resolve odor-related discomfort, and there is a particular need for systems that can generate appropriate fragrances according to the strength and type of odor and quickly report on countermeasures.
[0151] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0152] In this invention, the server includes means for detecting odors, means for analyzing component data of the detected odors to identify specific odors, means for generating a fragrance recipe corresponding to the identified odor, means for automatically blending and spraying the generated fragrance, means for notifying the user of an alert, and means for detecting odors in a specific space and notifying an administrator that odor countermeasures have been completed. This makes it possible to immediately take appropriate odor countermeasures for the user or the specific space and quickly report the results to the administrator.
[0153] "Means for detecting odors" refers to technology that uses chemical sensors or electronic noses to detect odor components in a space in real time.
[0154] "Means for analyzing detected odor component data to identify specific odors" refers to the process of using AI models or machine learning algorithms to analyze detected odor components and identify their type.
[0155] "Means for generating a fragrance recipe corresponding to the identified smell" refers to a system that calculates and generates the appropriate fragrance composition and blend based on the analyzed smell information.
[0156] "Means for automatically blending and dispersing the resulting fragrance" refers to a device or mechanism that mixes fragrance according to a specified recipe and automatically disperses it into a space.
[0157] "Means for notifying the user of the alert" refers to a notification system for notifying the user of the detection of odors and the completion status of countermeasures, and includes forms such as vibration, sound, and smartphone notifications.
[0158] "Means of detecting odors in a specific space and notifying the administrator that odor control measures have been completed" refers to a function that detects odors and takes measures in a specific location, and reports the results to the administrator by email, app notification, etc.
[0159] The present invention is a system for odor detection, analysis, fragrance generation, spraying, and alert notification. The embodiments for implementing this system are described in detail below.
[0160] A means of detecting odors
[0161] The device's built-in odor sensor chemically detects odor components in the air and records the detected odor intensity and component data as digital data, which is sent to a server when the odor exceeds a certain threshold.
[0162] A means of identifying specific odors by analyzing detected odor component data
[0163] The server receives the odor component data sent from the device and analyzes the odor using an AI model. This AI model is based on machine learning frameworks such as TensorFlow and PyTorch and is pre-trained to recognize various odor patterns, allowing it to identify specific odors such as alcohol, garlic, and sweat.
[0164] A means of generating fragrance recipes that correspond to identified odors
[0165] The fragrance recipe corresponding to the identified scent is retrieved from a database stored on the server, which uses an algorithm to generate a composite fragrance recipe corresponding to multiple scent components and transmits this recipe to the device.
[0166] Means for automatically blending and spraying the produced fragrance
[0167] The device activates the built-in fragrance generator based on the fragrance recipe received from the server. The device is loaded with fragrance cartridges, which automatically extract and mix the necessary fragrances according to the recipe, and then sprays the generated fragrance using a built-in pump system.
[0168] A means of notifying users of alerts
[0169] The device will alert the user by vibrating and / or making an audible notification that an odor has been detected and corrective action has been taken, and a notification will appear on the smartphone application or device display, allowing the user to confirm that the problem has been resolved.
[0170] A method for detecting odors in a specific space and notifying the administrator that odor control measures have been completed
[0171] When the system detects an odor in a specific space and the server generates and sprays the fragrance, it also includes a notification function that reports the results to the administrator. Notifications are sent via email or a smartphone app, allowing the administrator to immediately understand the status of the response.
[0172] Specific examples
[0173] 1. How to combat sweat odor in the fitting room:
[0174] The odor sensor detects the smell of sweat.
[0175] The server analyzes the sweat odor and generates a Silver Mountain Water fragrance.
[0176] The dispenser sprays the fragrance.
[0177] The app displays a notification saying, "Silver Mountain Water fragrance was used to combat the odor of sweat generated in the fitting room."
[0178] Prompt Sentence Examples
[0179] Regarding the odor that occurred in the fitting room today, please tell us the details of the fragrance you used and its effect.
[0180] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0181] Step 1:
[0182] Odor detection
[0183] The device uses a built-in odor sensor to continuously monitor the odor components in the air in the target area. The sensor detects the odor components based on chemical reactions and records their intensity and component data as digital data. If this data exceeds a threshold, the device proceeds to the next step.
[0184] Input: Odor components in the air
[0185] Data processing: Chemical detection and intensity measurement of odor components
[0186] Output: Digital data (odor components and their intensity)
[0187] Step 2:
[0188] Data transmission
[0189] The device transmits the detected odor component data, including the chemical formula and concentration of the detected odor component, to the server via a wireless communication module.
[0190] Input: Digital data (odor components and their intensity)
[0191] Data processing: Format conversion based on wireless communication protocol
[0192] Output: Odor component data sent to the server
[0193] Step 3:
[0194] Odor analysis and identification
[0195] The server analyzes the received odor component data and identifies specific odors using an AI model. This AI model has previously learned from a variety of odor data and is able to identify the type of odor with high accuracy.
[0196] Input: Received odor component data
[0197] Data Computing: Analysis and Classification of Odor Data with AI Models
[0198] Output: Identified odor type (e.g. alcohol, garlic, sweat, etc.)
[0199] Step 4:
[0200] Creating a fragrance recipe
[0201] Based on the identified scent, the server searches the database for a corresponding fragrance recipe and executes an algorithm to generate a composite fragrance recipe if necessary, which is then sent to the terminal.
[0202] Input: Identified odor type
[0203] Data processing: Database search and algorithmic fragrance recipe generation
[0204] Output: Fragrance recipe sent to the device
[0205] Step 5:
[0206] Fragrance production and spraying
[0207] Based on the received fragrance recipe, the device activates the built-in fragrance generator, automatically extracts and mixes the necessary fragrances from the fragrance cartridges, and then sprays the generated fragrance using the built-in pump system.
[0208] Input: Fragrance Recipe
[0209] Data processing: Extraction and blending of fragrances
[0210] Output: Atomized fragrance
[0211] Step 6:
[0212] Alert Notifications
[0213] The device will generate an alert via vibration or sound to notify the user that an odor has been detected and that countermeasures have been implemented. A notification will also appear on the smartphone application or device display, allowing the user to confirm that the problem has been resolved. Once odor detection and countermeasures have been completed in a specific space, the administrator will be notified via email or smartphone notification.
[0214] Input: Fragrance spray completion data
[0215] Data processing: Alert generation and notification sending
[0216] Output: Notification to users and administrators
[0217] As a result, the present invention makes it possible to implement highly efficient and accurate odor countermeasures and quickly notify users and administrators of the results.
[0218] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0219] This invention provides a system that not only automatically detects the user's scent and generates and sprays a fragrance that corresponds to that scent, but also recognizes the user's emotions and provides customized fragrances and alert messages based on those emotions. The system is mainly composed of a terminal, a server, and an emotion engine, and the main roles and processing flow of each are explained below.
[0220] Device features and operations
[0221] Odor detection
[0222] The device is equipped with a built-in odor sensor that constantly monitors the air around the user. The sensor chemically detects odor components and records their intensity as digital data. This data is sent to a server when a specific odor exceeds a set threshold.
[0223] Emotion recognition by emotion engine
[0224] The device uses an emotion engine to analyze the user's emotions in real time based on the user's facial expressions, voice, and biometric information, and this emotion data is also sent to the server.
[0225] Data transmission
[0226] The device establishes a connection with the server via a wireless communication module and transmits odor component data and emotion data to the server, including the chemical formulas and concentrations of the detected odor components and the user's emotional state.
[0227] Server Functions and Operations
[0228] Odor analysis and identification
[0229] The server receives the odor component data sent from the device, analyzes it using an AI model, and identifies specific odors. Identified odor types include alcohol, garlic, sweat, and body odor.
[0230] Emotional Data Analysis
[0231] The server analyzes the emotion data sent from the device and identifies the user's current emotional state, thereby understanding the user's psychological and physiological state.
[0232] Fragrance recipe generation and customization
[0233] The server searches a database for a basic fragrance recipe that corresponds to the identified scent, and then customizes this basic recipe according to the analyzed user's emotional state. For example, if the user is under stress, it adds ingredients that have a relaxing effect, or other elements that help with emotional care.
[0234] Data transmission
[0235] The server then sends the customized fragrance recipe and an appropriate alert message to the device, which is also tailored according to the user's emotional state.
[0236] Fragrance production and spraying
[0237] Procedural generation and spraying
[0238] The device activates its built-in fragrance generator based on the fragrance recipe received from the server. Fragrance cartridges are loaded into the device, which automatically extracts and mixes the necessary fragrances according to the recipe. The generated fragrance is sprayed appropriately around the user using a built-in pump system.
[0239] Alert Notifications
[0240] User Notification
[0241] The device generates an alert via vibration or sound to let the user know that an odor has been detected and that countermeasures have been implemented. Notifications are also displayed on the smartphone application and device display, with the alert message tailored to the user's emotional state. The user can confirm the notification and know that the problem has been resolved.
[0242] Specific examples
[0243] Case 1: User who drank alcohol last night
[0244] 1. Odor detection: The device detects a strong odor of alcohol from the user's breath.
[0245] 2. Emotion Recognition: The emotion engine detects when the user is in a relaxed state.
[0246] 3. Data transmission: Scent component data and emotion data are transmitted to the server.
[0247] 4. Analysis: The server identifies the alcohol and confirms that the user is relaxed.
[0248] 5. Fragrance Creation: Create a fragrance recipe by adding refreshing ingredients to the original recipe.
[0249] 6. Fragrance spray: The device produces and sprays peppermint and rosemary fragrance.
[0250] 7. Alert notification: The device will vibrate to notify the user and display the message "The smell of alcohol will disappear and you will feel refreshed."
[0251] Case 2: A user who ate gyoza for lunch
[0252] 1. Odor detection: The device detects a strong garlic odor from the user's breath.
[0253] 2. Emotion recognition: The emotion engine detects when the user is in a stressful state.
[0254] 3. Data transmission: Scent component data and emotion data are transmitted to the server.
[0255] 4. Analysis: The server identifies the user as "garlic" and determines that the user is in a stressed state.
[0256] 5. Fragrance Generation: Generate a fragrance recipe by adding relaxing ingredients to the original recipe.
[0257] 6. Fragrance spray: The device produces and sprays a citrus and lavender fragrance.
[0258] 7. Alert notification: The device will vibrate to notify the user and display the message "The garlic smell will disappear and have a relaxing effect."
[0259] As is clear from these examples, the present invention provides users with an easy-to-use and effective odor control and emotional care system. The integrated operation of the entire system can improve the user's quality of life.
[0260] The processing flow will be explained below.
[0261] Step 1: Smell detection
[0262] The device activates an odor sensor to monitor the air around the user. The sensor chemically detects odor components and records their intensity as digital data. The odor component data is temporarily stored in the device's internal memory.
[0263] Step 2: Check if the threshold is exceeded
[0264] The device determines whether the recorded odor component data exceeds a set threshold. If so, it sends the data to the server. If not, it continues odor detection.
[0265] Step 3: Emotion Recognition
[0266] The device also uses an emotion engine to analyze the user's facial expressions, voice, heart rate, and other biometric information to recognize the user's current emotional state. This emotional data is also sent to the server.
[0267] Step 4: Send data
[0268] The device establishes a connection with the server via a wireless communication module and transmits odor component data and emotion data to the server, including the chemical formulas and concentrations of the detected odor components and the user's emotional state.
[0269] Step 5: Data reception and analysis (Smell)
[0270] The server receives the odor component data sent from the device, analyzes this data using an AI model, and identifies specific odors. The identified odor types (e.g., alcohol, garlic, sweat, body odor) are recorded in a database.
[0271] Step 6: Data reception and analysis (emotions)
[0272] The server receives the emotion data sent from the device, analyzes it, and identifies the user's emotional state, such as relaxed or stressed, and stores the information in a database.
[0273] Step 7: Find and customize your fragrance recipe
[0274] The server searches a database for a basic fragrance recipe that corresponds to the identified scent, and then customizes this fragrance recipe based on the analyzed user's emotional state, for example by adding relaxing ingredients.
[0275] Step 8: Submit your fragrance recipe
[0276] The server then sends the customized fragrance recipe and appropriate alert messages to the device, including specific fragrance types, their amounts, and the alert messages.
[0277] Step 9: Start the fragrance generator
[0278] The device processes the fragrance recipe received from the server, stores it in its internal memory, and then activates the fragrance generator, which automatically extracts and mixes the required fragrances.
[0279] Step 10: Spray with fragrance
[0280] The device then uses a built-in pump system to spray the appropriate amount of fragrance around the user, controlling the timing and amount of spray to ensure the fragrance is distributed effectively.
[0281] Step 11: Re-detect odors
[0282] After spraying the fragrance, the device activates the odor sensor again to check whether the odor was properly neutralized. If the odor was not neutralized sufficiently, the cycle starts again from step 1.
[0283] Step 12: Alert Notification
[0284] The device generates an alert via vibration or sound to notify the user that an odor has been detected and that countermeasures have been implemented. An alert message is also displayed on the smartphone application or device display. The alert message is tailored to the user's emotional state. The user confirms the notification and realizes that the odor problem has been resolved.
[0285] Specific examples
[0286] Case 1: User who drank alcohol last night
[0287] 1. Odor detection: The device detects the strong odor of alcohol from the user's breath.
[0288] 2. Check if the threshold is exceeded: Check if the smell exceeds the threshold, and if it does, send the data to the server.
[0289] 3. Emotion Recognition: The emotion engine detects when the user is in a relaxed state and sends the emotion data to the server.
[0290] 4. Data transmission: Scent component data and emotion data are transmitted to the server.
[0291] 5. Data reception and analysis: The server identifies the condition as "alcohol" and confirms that the user is in a relaxed state.
[0292] 6. Customize fragrance recipes: Generate fragrance recipes by adding refreshing ingredients to the original recipe.
[0293] 7. Activate the fragrance generator: The device will generate a peppermint and rosemary fragrance.
[0294] 8. Spraying fragrance: Spray an appropriate amount of the fragrance you have created.
[0295] 9. Alert notification: Notifies the user by vibration and displays the message "The smell of alcohol disappears and has a refreshing effect."
[0296] Case 2: A user who ate gyoza for lunch
[0297] 1. Odor detection: The device detects a strong garlic odor from the user's breath.
[0298] 2. Check if the threshold is exceeded: Check if the smell exceeds the threshold, and if it does, send the data to the server.
[0299] 3. Emotion Recognition: The emotion engine detects when the user is in a stressful state and sends the emotion data to the server.
[0300] 4. Data transmission: Scent component data and emotion data are transmitted to the server.
[0301] 5. Data reception and analysis: The server identifies the user as "garlic" and confirms that the user is in a stressed state.
[0302] 6. Customize fragrance recipes: Generate fragrance recipes by adding relaxing ingredients to the original recipe.
[0303] 7. Activate fragrance generator: The device will produce a citrus and lavender fragrance.
[0304] 8. Spraying fragrance: Spray an appropriate amount of the fragrance you have created.
[0305] 9. Alert notification: Notify the user by vibration and display the message "The garlic smell will disappear and have a relaxing effect."
[0306] As is clear from these examples, the present invention provides users with an easy-to-use and effective odor control and emotional care system. The entire system works in an integrated manner to improve the user's quality of life.
[0307] Example 2
[0308] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0309] Conventional odor control systems were capable of detecting specific odors and generating and spraying fragrances, but they did not customize the system to take into account the user's emotional state. As a result, there were issues with the odor control being insufficiently effective or not being able to provide an appropriate fragrance according to the user's emotions. There was also a need for a system that could respond in a more detailed manner based on the intensity of the odor and the user's emotional state.
[0310] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0311] In this invention, the server includes means for detecting odors, means for analyzing component data of the detected odors to identify specific odors, means for collecting biometric information from the user and recognizing emotions, means for generating a fragrance recipe corresponding to the identified odor and the recognized emotion, means for automatically blending and spraying the generated fragrance, and means for issuing an alert to notify the user that countermeasures have been implemented. This makes it possible to address the user's emotions while also taking measures against odors, and automatically provide the most appropriate fragrance depending on the situation.
[0312] The "means for detecting odors" is a device that chemically detects odor components in the air around the user and records their intensity as digital data.
[0313] The "means for analyzing detected odor component data to identify specific odors" refers to a system that analyzes collected odor component data and executes algorithms or models to identify specific odors.
[0314] The "means for collecting biometric information of the user and recognizing emotions" refers to a device or algorithm that collects biometric information such as the user's facial expression, voice, heart rate, or skin potential, and analyzes it to identify the user's emotional state.
[0315] The "means for generating a fragrance recipe corresponding to the identified smell and the recognized emotion" is a system that determines the appropriate fragrance ingredients and their blending method based on the identified smell and the user's emotional state.
[0316] The "means for automatically blending and spraying the generated fragrance" is a system that extracts and mixes the necessary fragrances based on the generated fragrance recipe and sprays them around the user at the appropriate time using a built-in pump system.
[0317] "Means for sending an alert to inform the user that measures have been implemented" refers to a device or system that generates an alert via vibration, notification sound, or a display or smartphone application to inform the user that odor control measures have been completed.
[0318] "Means for transmitting odor component data to a server when the odor intensity exceeds a set threshold" refers to a system that transmits odor component data to a server via wireless communication when the odor detection result exceeds a preset threshold.
[0319] "Means for analyzing odor component data using an AI model and identifying emotions from the user's biometric information" is a system that inputs collected odor component data and biometric information into an AI model and identifies specific odors and the user's emotional state through complex analysis.
[0320] This system not only automatically detects the user's scent and generates and sprays a fragrance that corresponds to that scent, but also recognizes the user's emotions and provides customized fragrances and alert messages based on those emotions. This system is mainly composed of a terminal, a server, and an emotion engine.
[0321] Device features and operations
[0322] Odor detection
[0323] The device is equipped with a built-in odor sensor that constantly monitors the air around the user. This odor sensor chemically detects volatile organic compounds and records their intensity as digital data. The recorded data is automatically sent to a server when it exceeds a set threshold. For example, if a strong odor of alcohol or garlic is detected, that data is sent to the server.
[0324] emotion recognition
[0325] The device is equipped with a camera, microphone, and biosensors to collect biometric information such as the user's facial expression, voice, heart rate, and skin potential. This data is input into an emotion engine, which analyzes the user's emotional state in real time. The analysis results, along with odor component data, are sent to a server.
[0326] Data transmission
[0327] The device uses a wireless communication module such as Wi-Fi or Bluetooth to transmit odor component data and emotional data to a server, including the chemical formulas and concentrations of the detected odor components and the user's emotional state.
[0328] Server Functions and Operations
[0329] Odor analysis and identification
[0330] The server receives the odor component data sent from the device and analyzes it using an AI model. This AI model identifies specific odors and identifies specific odors such as alcohol, garlic, sweat, and body odor. For each identified odor, the server retrieves the associated fragrance recipe from the database.
[0331] Emotional Data Analysis
[0332] The server analyzes the emotional data sent from the device and identifies the user's current emotional state. This allows the server to understand the user's psychological and physiological state. For example, if the user is under stress, the server customizes the experience accordingly.
[0333] Fragrance recipe generation and customization
[0334] The server generates an appropriate fragrance recipe based on the identified smell and the analyzed emotional state. This recipe starts with a basic one and is customized according to the user's emotional state. For example, if the user is stressed, a fragrance recipe with added ingredients that have a relaxing effect is generated.
[0335] Data transmission
[0336] The server then sends the customized fragrance recipe and an appropriate alert message to the device, which is also tailored according to the user's emotional state.
[0337] Fragrance production and spraying
[0338] Procedural generation and spraying
[0339] The device activates its internal fragrance generator based on the fragrance recipe received from the server. A fragrance cartridge is loaded into the device, which automatically extracts and mixes the necessary fragrances according to the recipe. The generated fragrance is sprayed appropriately around the user using a built-in pump system.
[0340] Alert Notifications
[0341] User Notification
[0342] The device generates an alert via vibration or sound to notify the user that an odor has been detected and that countermeasures have been implemented. The device also displays a notification in the smartphone application or on the device display, with the alert message tailored to the user's emotional state. The user can confirm the notification and know that the problem has been resolved.
[0343] Specific examples
[0344] Case 1: User who drank alcohol last night
[0345] 1. The device detects a strong odor of alcohol from the user's breath.
[0346] 2. The emotion engine detects when the user is in a relaxed state.
[0347] 3. Smell component data and emotion data are sent to the server.
[0348] 4. The server identifies the alcohol and confirms that the user is relaxed.
[0349] 5. The server generates a fragrance recipe that adds a refreshing ingredient to the original recipe.
[0350] 6. The device will produce and spray a peppermint and rosemary fragrance.
[0351] 7. The device will vibrate to notify the user and display the message "The smell of alcohol will disappear and you will have a refreshing effect."
[0352] Case 2: A user who ate gyoza for lunch
[0353] 1. The device detects a strong garlic odor from the user's breath.
[0354] 2. The emotion engine detects when the user is in a stressful state.
[0355] 3. Smell component data and emotion data are sent to the server.
[0356] 4. The server identifies the user as "garlic" and confirms that the user is in a stressed state.
[0357] 5. The server generates a fragrance recipe that adds relaxing ingredients to the original recipe.
[0358] 6. The device produces and sprays a citrus and lavender fragrance.
[0359] 7. The device will vibrate to notify the user and display the message "The garlic smell will disappear and you will feel relaxed."
[0360] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0361] Step 1:
[0362] Odor monitoring
[0363] Input: The air around the user
[0364] Processing: The device constantly monitors the odor components in the air around the user using a built-in odor sensor. The sensor chemically detects volatile organic compounds and records their intensity as digital data.
[0365] Output: Digital data of odor components (data format example: [chemical formula: C2H5OH, concentration: 50 ppm])
[0366] Step 2:
[0367] Data recording and threshold determination
[0368] Input: Digital data of odor components
[0369] Processing: Pre-processing the recorded data to set a specific threshold and determine whether the odor component data exceeds the set threshold. This threshold determination determines whether or not necessary countermeasures are taken.
[0370] Output: Threshold judgment result (true or false)
[0371] Step 3:
[0372] Preparing to send data
[0373] Input: Digital data of threshold judgment results and odor components
[0374] Processing: If the threshold is exceeded, the device prepares to send the odor component data and the user's emotion data to the server.
[0375] Output: Transmission data packet (smell component data, emotion data)
[0376] Step 4:
[0377] emotion recognition
[0378] Input: User's biometric information (facial expression, voice, heart rate, etc.)
[0379] Processing: The device uses the camera, microphone, and biosensors to collect the user's biometric information and feeds it into the emotion engine, which analyzes this information to determine the user's emotional state in real time.
[0380] Output: Emotion data (data format example: [Emotion: Relaxed, Intensity: 70%])
[0381] Step 5:
[0382] Sending data to the server
[0383] Input: Transmission data packet (scent component data, emotion data)
[0384] Processing: The odor component data and emotion data are sent to the server via a wireless communication module, using Wi-Fi, Bluetooth, etc.
[0385] Output: Data sent to the server
[0386] Step 6:
[0387] Odor analysis and identification
[0388] Input: Sent odor component data
[0389] Processing: The server inputs the received odor component data into an AI model, analyzes it, and identifies specific odors, such as alcohol, garlic, sweat, and body odor.
[0390] Output: Identified odor (data format example: [Odor: Alcohol])
[0391] Step 7:
[0392] Emotional Data Analysis
[0393] Input: Emotion data sent
[0394] Processing: The server analyzes the received emotion data and identifies the user's current emotional state, thereby understanding the user's psychological and physiological state.
[0395] Output: Identified emotional state (Example data format: [Emotion: Relaxed])
[0396] Step 8:
[0397] Fragrance recipe generation and customization
[0398] Input: identified odor, identified emotional state
[0399] Processing: Based on the identified scent and the identified emotional state, the server retrieves a basic fragrance recipe from the database and customizes it based on the emotional state, for example by adding ingredients that have a relaxing effect.
[0400] Output: Customized fragrance recipe (data format example: [Ingredients: Peppermint, Rosemary])
[0401] Step 9:
[0402] Sending customized fragrance data
[0403] Input: Customized fragrance recipe, alert message
[0404] Processing: The server sends a customized fragrance recipe and an alert message to the device, which is tailored according to the user's emotional state.
[0405] Output: Data sent to the terminal
[0406] Step 10:
[0407] Automatic fragrance generation and spraying
[0408] Input: Customized fragrance recipe
[0409] Processing: The device activates its internal fragrance generator based on the received fragrance recipe. It extracts the necessary fragrances from the fragrance cartridges, mixes them together to create the fragrance, and then sprays the created fragrance appropriately using the built-in pump system.
[0410] Output: Sprayed fragrance
[0411] Step 11:
[0412] Alert Notifications
[0413] Input: Alert message from the server
[0414] Action: The device will generate an alert by vibrating or sounding to let the user know that the action has been taken, and will also display a notification in the smartphone application or on the device display to let the user know that the action has been taken.
[0415] Output: Message notified to the user
[0416] (Application example 2)
[0417] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0418] To improve passenger comfort and safety in autonomous vehicles, a system that monitors passenger odors and emotional states in real time and automatically generates and sprays appropriate fragrances accordingly is required. However, conventional technologies perform odor detection and emotion recognition separately, making it difficult to provide a comfortable in-car environment through integrated processing.
[0419] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0420] In this invention, the server includes means for detecting odors, means for analyzing component data of the detected odors to identify specific odors, means for recognizing a user's emotions, means for generating a fragrance recipe corresponding to the identified odor and the recognized emotion, means for automatically blending and spraying the generated fragrance, and means for notifying the user of an alert, thereby enabling real-time odor countermeasures and emotional care in autonomous vehicles.
[0421] The "means for detecting odors" is a device installed in a vehicle that chemically detects odor components in the surrounding air and acquires the data.
[0422] "Means for analyzing detected odor component data to identify specific odors" refers to a function that analyzes acquired odor component data using an AI model, etc., to identify specific odors.
[0423] The "means for recognizing the user's emotions" is a function that uses cameras and microphones inside the vehicle to analyze the user's facial expressions and voice and grasp their emotional state in real time.
[0424] The "means for generating a fragrance recipe corresponding to the identified smell and the recognized emotion" is a function that automatically creates a formula for generating an optimal fragrance based on the identified smell data and emotion data.
[0425] The "means for automatically blending and spraying the created fragrance" is a function for automatically blending fragrances based on the created fragrance recipe and spraying them inside the vehicle at the appropriate time.
[0426] "Means for notifying users of alerts" refers to features such as displays and audio systems that notify passengers when an odor or emotion-related issue is detected or when corrective measures are implemented.
[0427] The "wireless communication module" is a communication device that transmits and receives data between the inside of the vehicle and an external server.
[0428] A "fragrance generating device" is a device that mixes multiple fragrances and generates and sprays an appropriate fragrance based on a specified fragrance recipe.
[0429] An "emotion engine" is software or hardware that analyzes a user's emotional state based on facial expression analysis, voice analysis, and biometric analysis.
[0430] The present invention is a system for improving the in-car environment by generating customized fragrances based on the passenger's odor and emotional state, which is applied to autonomous vehicles. This system is realized using hardware and software such as odor sensors and cameras installed in the vehicle, a server, an emotion engine, and a fragrance generator.
[0431] System Configuration and Operation
[0432] Odor detection
[0433] The terminal (on-board device) is equipped with a built-in odor sensor that constantly monitors the air inside the vehicle. The sensor chemically detects odor components and digitizes and records the data. This data is sent to a server via a wireless communication module when a specific odor exceeds a certain threshold.
[0434] Emotion recognition by emotion engine
[0435] The device uses an in-car camera to monitor passengers' facial expressions and voices in real time and analyzes them using an emotion engine. This emotion data is also sent to the server via a wireless communication module. The emotion engine uses AI models such as OpenCV and TensorFlow.
[0436] Analysis of odor and emotion data
[0437] The server uses an AI model to analyze the odor component data sent from the device and identify specific odors (e.g., "alcohol," "garlic," etc.) and analyzes the emotion data to identify the passenger's current emotional state (e.g., "relaxed," "stressed," etc.).
[0438] Fragrance recipe generation and customization
[0439] The server searches a database for a fragrance recipe that corresponds to the identified smell and then customizes it based on that recipe, adding ingredients that have a relaxing or refreshing effect depending on the passenger's emotional state.
[0440] Procedural generation and spraying
[0441] The device activates its internal fragrance generator based on the fragrance recipe received from the server. Fragrance cartridges are loaded into the device, which automatically extracts and mixes the necessary fragrances according to the recipe. The generated fragrance is then sprayed appropriately into the vehicle interior using the device's pump system.
[0442] Alert Notifications
[0443] Once activated, the device will alert passengers with vibrations and sounds, and will also display a notification on the vehicle's display. The alert message will also be tailored to the passenger's emotional state. Examples of notifications include "The smell of alcohol will disappear, providing a refreshing effect" and "The smell of garlic will disappear, providing a relaxing effect."
[0444] Specific examples
[0445] Case 1: A passenger who drank alcohol last night
[0446] 1. Smell detection: Smell sensors inside the car detect the smell of alcohol.
[0447] 2. Emotion Recognition: The emotion engine detects when a passenger is relaxed.
[0448] 3. Server analysis: Alcohol is detected and passengers are confirmed to be relaxed.
[0449] 4. Fragrance generation: Generate fragrance recipes with refreshing ingredients.
[0450] 5. Fragrance spray: Produces and sprays peppermint and rosemary fragrance.
[0451] 6. Alert notification: Displays the message "The smell of alcohol disappears and you will feel refreshed."
[0452] Case 2: A passenger who ate gyoza for lunch
[0453] 1. Odor detection: Odor sensors inside the car detect the smell of garlic.
[0454] 2. Emotion Recognition: The emotion engine detects when a passenger is in a stressful state.
[0455] 3. Server analysis: Garlic is detected and passenger is confirmed to be in a stressed state.
[0456] 4. Fragrance generation: Generate fragrance recipes with relaxing ingredients.
[0457] 5. Fragrance spray: Produces and sprays citrus and lavender fragrance.
[0458] 6. Alert notification: Displays the message "The garlic smell will disappear and have a relaxing effect."
[0459] Prompt Sentence Examples
[0460] "Was a strong odor detected inside the vehicle? If so, what was the composition and intensity of that odor?"
[0461] "What is the passenger's current emotional state? For example, stressed or relaxed?"
[0462] "Generate fragrance recipes based on scent ingredients and emotional state. For example, if you're stressed, add ingredients that have a relaxing effect."
[0463] This system will enable real-time odor control and emotional care within autonomous vehicles.
[0464] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0465] Step 1:
[0466] An odor sensor in the terminal constantly monitors the air inside the vehicle. The odor sensor detects odor components in the surrounding air and digitizes the data. The input is data on the air inside the vehicle, and the output is digitized odor component data.
[0467] Step 2:
[0468] The device analyzes the odor component data and sends it to the server if it exceeds a certain threshold. The data is processed by checking the concentration of the digitized odor component data and performing a calculation to determine whether it exceeds the threshold. The input is the odor component data, and the output is the odor component data that exceeds the threshold.
[0469] Step 3:
[0470] The device uses an in-car camera to monitor passengers' facial expressions and voices in real time. It uses an emotion engine (such as OpenCV or TensorFlow) to acquire emotion data. The input is camera footage and voice data, and the output is analyzed emotion data.
[0471] Step 4:
[0472] The terminal transmits the odor component data and emotion data to the server via the wireless communication module. The input is the odor component data that exceeds the threshold and the emotion data, and the output is the data transmitted to the server.
[0473] Step 5:
[0474] The server uses an AI model to analyze the odor component data sent from the device and identify specific odors. The AI model analyzes the odor component data and performs calculations to determine the type of odor. The input is the odor component data received from the device, and the output is the identified odor data.
[0475] Step 6:
[0476] The server analyzes the emotional data to identify the user's current emotional state. It uses an AI model for the analysis and determines the emotional state. The input is the emotional data received from the device, and the output is the determined emotional state.
[0477] Step 7:
[0478] The server generates a fragrance recipe according to the identified smell and the recognized emotion. Here, it takes a basic recipe from the database and customizes it according to the emotional state. The input is the identified smell data and the emotional state data, and the output is a customized fragrance recipe.
[0479] Step 8:
[0480] The server sends the generated fragrance recipe to the terminal, where the input is the customized fragrance recipe and the output is the fragrance recipe sent to the terminal.
[0481] Step 9:
[0482] The terminal activates the fragrance generator based on the received fragrance recipe. The fragrance generator extracts and mixes the necessary ingredients from the fragrance cartridges. The input is the fragrance recipe, and the output is the generated fragrance.
[0483] Step 10:
[0484] The terminal sprays the generated fragrance into the car interior using a pump system. The input is the generated fragrance and the output is the sprayed fragrance.
[0485] Step 11:
[0486] The terminal notifies the user that the problem has been resolved by displaying an alert message on the display or audio system. The input is the data indicating the fragrance spray success, and the output is the alert message.
[0487] This process enhances passenger comfort and safety, while also providing integrated odor management and emotional care.
[0488] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0489] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0490] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0491] [Second embodiment]
[0492] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0493] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0494] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0495] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0496] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0497] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0498] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0499] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0500] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0501] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0502] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0503] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0504] The system of this invention aims to effectively counteract unpleasant body odors and breath odors by automatically detecting odors and instantly generating and spraying corresponding fragrances. This system is primarily composed of a terminal and a server, and the main roles and processing flow of each are explained below.
[0505] Device features and operations
[0506] Odor detection
[0507] The device is equipped with a built-in odor sensor that constantly monitors the air around the user. The sensor chemically detects odor components and records their intensity as digital data. This data is sent to a server when a specific odor exceeds a set threshold.
[0508] Data transmission
[0509] The device establishes a connection with the server via a wireless communication module and transmits odor component data, including the chemical formulas and concentrations of the detected odor components.
[0510] Server Functions and Operations
[0511] Odor analysis and identification
[0512] The server receives the odor component data sent from the device. This data is analyzed by an AI model to identify specific odors. The AI model has been trained in advance with a variety of odor data, allowing it to identify odor types with high accuracy. Identified odors include alcohol, garlic, sweat, and body odor.
[0513] Creating a fragrance recipe
[0514] A fragrance recipe corresponding to the identified scent is retrieved from a database stored on the server, which runs an algorithm to generate a composite fragrance recipe, possibly corresponding to multiple scent components, and transmits this recipe to the device.
[0515] Fragrance production and spraying
[0516] Auto-generation and spraying
[0517] The device activates its built-in fragrance generator based on the fragrance recipe received from the server. Fragrance cartridges are loaded into the device, which automatically extracts and mixes the necessary fragrances according to the recipe. The generated fragrance is sprayed appropriately around the user using a built-in pump system.
[0518] Alert Notifications
[0519] User Notification
[0520] The device will alert the user by vibrating and / or making an audible notification that an odor has been detected and corrective action has been taken, and a notification will appear in the smartphone application or on the device display, allowing the user to confirm that the problem has been resolved.
[0521] Specific examples
[0522] Case 1: User who drank alcohol last night
[0523] 1. Odor detection: The device detects a strong odor of alcohol from the user's breath.
[0524] 2. Data transmission: This odor component data is sent to the server.
[0525] 3. Smell analysis and identification: The server identifies the smell as "alcohol" and generates a fragrance recipe based on that information.
[0526] 4. Fragrance generation and spraying: The device generates and sprays peppermint and rosemary fragrance.
[0527] 5. Alert notification: The device will vibrate to notify the user that the alcohol smell has been neutralized.
[0528] Case 2: A user who ate gyoza for lunch
[0529] 1. Odor detection: The device detects a strong garlic odor from the user's breath.
[0530] 2. Data transmission: This odor component data is sent to the server.
[0531] 3. Smell analysis and identification: The server identifies the scent as "garlic" and generates a fragrance recipe based on that information.
[0532] 4. Fragrance generation and spraying: The device generates and sprays a citrus and basil fragrance.
[0533] 5. Alert notification: The device will vibrate to notify the user that the garlic smell has been neutralized.
[0534] As is clear from these examples, the present invention provides an easy-to-use and effective odor countermeasure for users. The integrated operation of the entire system can improve the quality of life of users.
[0535] The processing flow will be explained below.
[0536] Step 1: Smell detection
[0537] The device activates an odor sensor to monitor the air around the user. The sensor chemically detects odor components and records their intensity as digital data. The odor component data is temporarily stored in the device's internal memory.
[0538] Step 2: Check if the threshold is exceeded
[0539] The device determines whether the recorded odor component data exceeds the set threshold. If so, it sends the data to the server. If not, it continues odor detection.
[0540] Step 3: Send data
[0541] The device establishes a connection with the server via a wireless communication module and transmits odor component data, including the chemical formulas and concentrations of the detected odor components, to the server.
[0542] Step 4: Data reception and analysis
[0543] The server receives the odor component data sent from the device. This data is analyzed by an AI model to identify specific odors. The AI model has been trained in advance on a variety of odor data, allowing it to identify odor types with high accuracy.
[0544] Step 5: Save the identification results and search for fragrance recipes
[0545] The server records the identification results in a database, then searches the database for fragrance recipes corresponding to the identified scents, and optionally runs an algorithm to generate a composite fragrance recipe.
[0546] Step 6: Submit your fragrance recipe
[0547] The server determines the appropriate fragrance combination and its mixing ratio and sends this recipe to the device, including the specific types of fragrances and their amounts.
[0548] Step 7: Start the fragrance generator
[0549] The device processes the fragrance recipe received from the server, stores it in its internal memory, and then activates the fragrance generator, which automatically extracts and mixes the required fragrance ingredients.
[0550] Step 8: Spray with fragrance
[0551] The device then uses a built-in pump system to spray the generated fragrance around the user, controlling the timing and amount of spray to ensure the fragrance is dispersed effectively.
[0552] Step 9: Re-detect the smell
[0553] After spraying the fragrance, the device activates the odor sensor again to check whether the odor was properly neutralized. If the odor was not neutralized sufficiently, the cycle starts again from step 1.
[0554] Step 10: Alert Notification
[0555] The device generates an alert to notify the user, using vibrations, a sound, or a notification on the smartphone application or device display. The user confirms the notification and knows that the odor problem has been resolved.
[0556] Through the above processing steps, the user can recognize his or her own odor in a timely manner and automatically take necessary measures.
[0557] Example 1
[0558] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0559] In modern life, unpleasant odors from personal body odor and breath are a significant problem because they can be unpleasant for others. Conventional methods involve the use of masks or portable fragrance dispensers, but these methods require manual intervention and are difficult to implement in real time. Furthermore, there are limited technologies available for instantly generating the appropriate fragrance combination for a specific odor. The present invention aims to address these issues and provide a user-friendly and effective odor control solution.
[0560] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0561] In this invention, the server includes means for detecting odors, means for transmitting component data of the detected odors to the server, means for receiving and analyzing the transmitted component data of the odors to identify specific odors, means for generating a fragrance recipe corresponding to the identified odor, means for automatically blending and spraying the generated fragrance, and means for notifying the user of an alert. This makes it possible to detect odors around the user in real time and instantly generate and spray an appropriate fragrance.
[0562] An "odor detection means" is a device or sensor that detects specific chemical components in the surrounding air and converts their concentrations into digital data.
[0563] "Means for transmitting data on detected odor components to a server" refers to technology that has the function of transmitting data on odor components detected by a sensor to a server using a wireless communication module or the like.
[0564] "Means for receiving and analyzing the transmitted odor component data to identify specific odors" refers to a method for processing the data received on the server using an AI model or analytical algorithm to identify the specific type of odor.
[0565] The "means for generating a fragrance recipe corresponding to an identified scent" refers to a technology that uses a database or algorithm to determine the appropriate fragrance composition corresponding to a specific scent and generate that recipe.
[0566] The "means for automatically blending and spraying the generated fragrance" is a device that uses a fragrance generator installed inside to automatically extract and mix the necessary fragrances and spray the fragrance through a pump system.
[0567] "Means for notifying the user of an alert" refers to a function that notifies the user that fragrance spraying has been completed or other important information by vibration, notification sound, display, or the like.
[0568] An "AI model" is an algorithm that has been trained using large amounts of data to perform a specific task (in this case, identifying odors) with high accuracy.
[0569] A "prompt statement" is an instruction statement that provides specific input data to an AI model and is used to instruct processing such as analysis and identification.
[0570] MODE FOR CARRYING OUT THE INVENTION
[0571] The system of the present invention detects odors in the air around the user in real time, and generates and sprays a corresponding fragrance to quickly and effectively counteract unpleasant odors. The details of each component and their operation are explained below.
[0572] Odor detection
[0573] The device is equipped with a built-in odor sensor that constantly monitors the air around the user. The odor sensor detects chemical components and records their concentration as digital data. If this data exceeds a set threshold, it proceeds to the next processing step. A highly sensitive odor sensor using MEMS technology is suitable for this hardware.
[0574] Data transmission
[0575] The device transmits odor component data to a server using a wireless communication module (e.g., Wi-Fi module or Bluetooth module), which can send the chemical formula and concentration data of odor components to the server in real time.
[0576] Odor analysis and identification
[0577] The server receives the odor component data sent from the device and uses a generative AI model to analyze it. The AI model is pre-trained with a variety of odor data and can identify odors with high accuracy. An example of a prompt is "Please identify the components based on this odor data." Specific functions include the ability to identify odors such as alcohol, garlic, sweat, and body odor.
[0578] Creating a fragrance recipe
[0579] A fragrance recipe corresponding to the identified scent is retrieved from a database stored on the server, which runs an algorithm to generate a composite fragrance recipe corresponding to multiple scent components as needed, and transmits the generated recipe to the device.
[0580] Fragrance production and spraying
[0581] The device activates the built-in fragrance generator based on the fragrance recipe received from the server. The device is loaded with fragrance cartridges and automatically extracts and mixes the necessary fragrances according to the recipe. The generated fragrance is then sprayed appropriately around the user using a built-in pump system.
[0582] User Notification
[0583] The device will generate a vibration or sound alert to let the user know that fragrance spraying is complete, and an alert message will appear in the smartphone application or on the device display, allowing the user to confirm that the problem has been resolved.
[0584] Specific examples
[0585] Case 1: User who drank alcohol last night
[0586] 1. Odor detection: The device detects a strong odor of alcohol from the user's breath.
[0587] 2. Data transmission: This odor component data is sent to the server.
[0588] 3. Smell analysis and identification: The server instructs the generative AI model to "identify the ingredients based on this smell data," and identifies "alcohol."
[0589] 4. Fragrance generation and spraying: The server generates a peppermint and rosemary fragrance recipe and sends it to the terminal, which then sprays it.
[0590] 5. Alert notification: The device will vibrate to notify the user that the alcohol smell has been neutralized.
[0591] Case 2: A user who ate gyoza for lunch
[0592] 1. Odor detection: The device detects a strong garlic odor from the user's breath.
[0593] 2. Data transmission: This odor component data is sent to the server.
[0594] 3. Smell analysis and identification: The server instructs the generative AI model to "identify the ingredients based on this smell data," and identifies "garlic."
[0595] 4. Fragrance generation and spraying: The server generates a citrus and basil fragrance recipe and sends it to the terminal, which then sprays it.
[0596] 5. Alert notification: The device will vibrate to notify the user that the garlic smell has been neutralized.
[0597] In this way, the system of the present invention can quickly and effectively address various odor problems faced by users, thereby enabling users to maintain a comfortable environment at all times.
[0598] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0599] Step 1:
[0600] Odor detection
[0601] The device uses an odor sensor to constantly monitor the air around the user. The sensor detects specific chemical components in real time and converts their concentrations into digital data. The input for this process is the chemical components in the surrounding air, and the output is digital data containing those chemical components. Specifically, the sensor detects the odor component of alcohol, and if its concentration exceeds a certain threshold, the data is recorded.
[0602] Step 2:
[0603] Data transmission
[0604] The device connects to the server using a wireless communication module (e.g., Wi-Fi or Bluetooth). Data on the detected odor components (chemical formula and concentration) is sent to the server. The input in this process is the digital data detected by the sensor, and the output is the odor component data sent to the server. Specifically, the device sends alcohol concentration data to the server via the Wi-Fi module.
[0605] Step 3:
[0606] Odor analysis and identification
[0607] The server uses a generative AI model to analyze the data received from the device. The AI model has been trained in advance on a variety of odor data and identifies specific odors based on the data. The input for this process is the transmitted odor component data, and the output is the identified odor type. Specifically, the server prompts the generative AI model, saying, "Please identify the component based on this odor data," and the response is "alcohol."
[0608] Step 4:
[0609] Creating a fragrance recipe
[0610] The server searches the database for fragrance recipes corresponding to the identified scent. If necessary, it runs an algorithm to generate a composite fragrance recipe corresponding to multiple scent components. The input to this process is the identified scent type, and the output is the generated fragrance recipe. Specifically, the server searches the database, finds "peppermint and rosemary" as a "fragrance recipe for alcohol," and sends it to the terminal.
[0611] Step 5:
[0612] Fragrance production and atomization
[0613] The device activates its built-in fragrance generator based on the fragrance recipe received from the server. It uses fragrance cartridges to extract and mix the required fragrances. The input for this process is the fragrance recipe, and the output is the generated fragrance. Specifically, the device activates the fragrance generator, extracts peppermint and rosemary fragrances in the specified ratio, and sprays them through the pump system.
[0614] Step 6:
[0615] Alert Notifications
[0616] The device vibrates or sounds an alert to notify the user that fragrance spraying is complete. An alert message is also displayed on the smartphone app or device display. The input during this process is the completion status of spraying, and the output is a notification to the user. Specifically, the device activates a vibration and displays a message on the smartphone app saying, "The smell of alcohol has been neutralized."
[0617] (Application example 1)
[0618] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0619] Conventional odor control systems have difficulty responding immediately to individual users' body odors and breath odors, and lack the functionality to efficiently notify administrators of odor detection and countermeasure implementation in specific spaces. This makes it difficult to immediately resolve odor-related discomfort, and there is a particular need for systems that can generate appropriate fragrances according to the strength and type of odor and quickly report on countermeasures.
[0620] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0621] In this invention, the server includes means for detecting odors, means for analyzing component data of the detected odors to identify specific odors, means for generating a fragrance recipe corresponding to the identified odor, means for automatically blending and spraying the generated fragrance, means for notifying the user of an alert, and means for detecting odors in a specific space and notifying an administrator that odor countermeasures have been completed. This makes it possible to immediately take appropriate odor countermeasures for the user or the specific space and quickly report the results to the administrator.
[0622] "Means for detecting odors" refers to technology that uses chemical sensors or electronic noses to detect odor components in a space in real time.
[0623] "Means for analyzing detected odor component data to identify specific odors" refers to the process of using AI models or machine learning algorithms to analyze detected odor components and identify their type.
[0624] "Means for generating a fragrance recipe corresponding to the identified smell" refers to a system that calculates and generates the appropriate fragrance composition and blend based on the analyzed smell information.
[0625] "Means for automatically blending and dispersing the resulting fragrance" refers to a device or mechanism that mixes fragrance according to a specified recipe and automatically disperses it into a space.
[0626] "Means of notifying the user of the alert" refers to a notification system for notifying the user of the detection of odors and the completion status of countermeasures, and includes forms such as vibration, sound, and smartphone notifications.
[0627] "Means of detecting odors in a specific space and notifying the administrator that odor control measures have been completed" refers to a function that detects odors and takes measures in a specific location, and reports the results to the administrator by email, app notification, etc.
[0628] The present invention is a system for odor detection, analysis, fragrance generation, spraying, and alert notification. The embodiments for implementing this system are described in detail below.
[0629] A means of detecting odors
[0630] The device's built-in odor sensor chemically detects odor components in the air and records the detected odor intensity and component data as digital data, which is then sent to a server when the odor exceeds a certain threshold.
[0631] A means of identifying specific odors by analyzing detected odor component data
[0632] The server receives the odor component data sent from the device and analyzes the odor using an AI model. This AI model is based on machine learning frameworks such as TensorFlow and PyTorch and is pre-trained to recognize various odor patterns, allowing it to identify specific odors such as alcohol, garlic, and sweat.
[0633] A means of generating fragrance recipes that correspond to identified odors
[0634] The fragrance recipe corresponding to the identified scent is retrieved from a database stored on the server, which uses an algorithm to generate a composite fragrance recipe corresponding to multiple scent components and transmits this recipe to the device.
[0635] Means for automatically blending and spraying the produced fragrance
[0636] The device activates the built-in fragrance generator based on the fragrance recipe received from the server. The device is loaded with fragrance cartridges, which automatically extract and mix the necessary fragrances according to the recipe, and then sprays the generated fragrance using a built-in pump system.
[0637] A means of notifying users of alerts
[0638] The device will alert the user by vibrating and / or making an audible notification that an odor has been detected and corrective action has been taken, and a notification will appear on the smartphone application or device display, allowing the user to confirm that the problem has been resolved.
[0639] A method for detecting odors in a specific space and notifying the administrator that odor control measures have been completed
[0640] When the system detects an odor in a specific space and the server generates and sprays the fragrance, it also includes a notification function that reports the results to the administrator. Notifications are sent via email or a smartphone app, allowing the administrator to immediately understand the status of the response.
[0641] Specific examples
[0642] 1. How to combat sweat odor in the fitting room:
[0643] The odor sensor detects the smell of sweat.
[0644] The server analyzes the sweat odor and generates a Silver Mountain Water fragrance.
[0645] The dispenser sprays the fragrance.
[0646] The app displays a notification saying, "Silver Mountain Water fragrance was used to combat the odor of sweat generated in the fitting room."
[0647] Prompt Sentence Examples
[0648] Regarding the odor that occurred in the fitting room today, please tell us the details of the fragrance you used and its effect.
[0649] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0650] Step 1:
[0651] Odor detection
[0652] The device uses a built-in odor sensor to continuously monitor the odor components in the air in the target area. The sensor detects the odor components based on chemical reactions and records their intensity and component data as digital data. If this data exceeds a threshold, the device proceeds to the next step.
[0653] Input: Odor components in the air
[0654] Data processing: Chemical detection and intensity measurement of odor components
[0655] Output: Digital data (odor components and their intensity)
[0656] Step 2:
[0657] Data transmission
[0658] The device transmits the detected odor component data, including the chemical formula and concentration of the detected odor component, to the server via a wireless communication module.
[0659] Input: Digital data (odor components and their intensity)
[0660] Data processing: Format conversion based on wireless communication protocol
[0661] Output: Odor component data sent to the server
[0662] Step 3:
[0663] Odor analysis and identification
[0664] The server analyzes the received odor component data and identifies specific odors using an AI model. This AI model has previously learned from a variety of odor data and is able to identify the type of odor with high accuracy.
[0665] Input: Received odor component data
[0666] Data Computing: Analysis and Classification of Odor Data with AI Models
[0667] Output: Identified odor type (e.g. alcohol, garlic, sweat, etc.)
[0668] Step 4:
[0669] Creating a fragrance recipe
[0670] Based on the identified scent, the server searches the database for a corresponding fragrance recipe and executes an algorithm to generate a composite fragrance recipe if necessary, which is then sent to the terminal.
[0671] Input: Identified odor type
[0672] Data processing: Database search and algorithmic fragrance recipe generation
[0673] Output: Fragrance recipe sent to the device
[0674] Step 5:
[0675] Fragrance production and spraying
[0676] Based on the received fragrance recipe, the device activates the built-in fragrance generator, automatically extracts and mixes the necessary fragrances from the fragrance cartridges, and then sprays the generated fragrance using the built-in pump system.
[0677] Input: Fragrance Recipe
[0678] Data processing: Extraction and blending of fragrances
[0679] Output: Atomized fragrance
[0680] Step 6:
[0681] Alert Notifications
[0682] The device will generate an alert via vibration or sound to notify the user that an odor has been detected and that countermeasures have been implemented. A notification will also appear on the smartphone application or device display, allowing the user to confirm that the problem has been resolved. Once odor detection and countermeasures have been completed in a specific space, the administrator will be notified via email or smartphone notification.
[0683] Input: Fragrance spray completion data
[0684] Data processing: Alert generation and notification sending
[0685] Output: Notification to users and administrators
[0686] As a result, the present invention makes it possible to implement highly efficient and accurate odor countermeasures and quickly notify users and administrators of the results.
[0687] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0688] This invention provides a system that not only automatically detects the user's scent and generates and sprays a fragrance that corresponds to that scent, but also recognizes the user's emotions and provides customized fragrances and alert messages based on those emotions. The system is mainly composed of a terminal, a server, and an emotion engine, and the main roles and processing flow of each are explained below.
[0689] Device features and operations
[0690] Odor detection
[0691] The device is equipped with a built-in odor sensor that constantly monitors the air around the user. The sensor chemically detects odor components and records their intensity as digital data. This data is sent to a server when a specific odor exceeds a set threshold.
[0692] Emotion recognition by emotion engine
[0693] The device uses an emotion engine to analyze the user's emotions in real time based on the user's facial expressions, voice, and biometric information, and this emotion data is also sent to the server.
[0694] Data transmission
[0695] The device establishes a connection with the server via a wireless communication module and transmits odor component data and emotion data to the server, including the chemical formulas and concentrations of the detected odor components and the user's emotional state.
[0696] Server Functions and Operations
[0697] Odor analysis and identification
[0698] The server receives the odor component data sent from the device, analyzes it using an AI model, and identifies specific odors. Identified odor types include alcohol, garlic, sweat, and body odor.
[0699] Emotional Data Analysis
[0700] The server analyzes the emotion data sent from the device and identifies the user's current emotional state, thereby understanding the user's psychological and physiological state.
[0701] Fragrance recipe generation and customization
[0702] The server searches a database for a basic fragrance recipe that corresponds to the identified scent, and then customizes this basic recipe according to the analyzed user's emotional state. For example, if the user is under stress, it adds ingredients that have a relaxing effect, or other elements that help with emotional care.
[0703] Data transmission
[0704] The server then sends the customized fragrance recipe and an appropriate alert message to the device, which is also tailored according to the user's emotional state.
[0705] Fragrance production and spraying
[0706] Procedural generation and spraying
[0707] The device activates its built-in fragrance generator based on the fragrance recipe received from the server. Fragrance cartridges are loaded into the device, which automatically extracts and mixes the necessary fragrances according to the recipe. The generated fragrance is sprayed appropriately around the user using a built-in pump system.
[0708] Alert Notifications
[0709] User Notification
[0710] The device generates an alert via vibration or sound to let the user know that an odor has been detected and that countermeasures have been implemented. Notifications are also displayed on the smartphone application and device display, with the alert message tailored to the user's emotional state. The user can confirm the notification and know that the problem has been resolved.
[0711] Specific examples
[0712] Case 1: User who drank alcohol last night
[0713] 1. Odor detection: The device detects a strong odor of alcohol from the user's breath.
[0714] 2. Emotion Recognition: The emotion engine detects when the user is in a relaxed state.
[0715] 3. Data transmission: Scent component data and emotion data are transmitted to the server.
[0716] 4. Analysis: The server identifies the alcohol and confirms that the user is relaxed.
[0717] 5. Fragrance Creation: Create a fragrance recipe by adding refreshing ingredients to the original recipe.
[0718] 6. Fragrance spray: The device produces and sprays peppermint and rosemary fragrance.
[0719] 7. Alert notification: The device will vibrate to notify the user and display the message "The smell of alcohol will disappear and you will feel refreshed."
[0720] Case 2: A user who ate gyoza for lunch
[0721] 1. Odor detection: The device detects a strong garlic odor from the user's breath.
[0722] 2. Emotion recognition: The emotion engine detects when the user is in a stressful state.
[0723] 3. Data transmission: Scent component data and emotion data are transmitted to the server.
[0724] 4. Analysis: The server identifies the user as "garlic" and determines that the user is in a stressed state.
[0725] 5. Fragrance Generation: Generate a fragrance recipe by adding relaxing ingredients to the original recipe.
[0726] 6. Fragrance spray: The device produces and sprays a citrus and lavender fragrance.
[0727] 7. Alert notification: The device will vibrate to notify the user and display the message "The garlic smell will disappear and have a relaxing effect."
[0728] As is clear from these examples, the present invention provides users with an easy-to-use and effective odor control and emotional care system. The integrated operation of the entire system can improve the user's quality of life.
[0729] The processing flow will be explained below.
[0730] Step 1: Smell detection
[0731] The device activates an odor sensor to monitor the air around the user. The sensor chemically detects odor components and records their intensity as digital data. The odor component data is temporarily stored in the device's internal memory.
[0732] Step 2: Check if the threshold is exceeded
[0733] The device determines whether the recorded odor component data exceeds a set threshold. If so, it sends the data to the server. If not, it continues odor detection.
[0734] Step 3: Emotion Recognition
[0735] The device also uses an emotion engine to analyze the user's facial expressions, voice, heart rate, and other biometric information to recognize the user's current emotional state. This emotional data is also sent to the server.
[0736] Step 4: Send data
[0737] The device establishes a connection with the server via a wireless communication module and transmits odor component data and emotion data to the server, including the chemical formulas and concentrations of the detected odor components and the user's emotional state.
[0738] Step 5: Data reception and analysis (Smell)
[0739] The server receives the odor component data sent from the device, analyzes this data using an AI model, and identifies specific odors. The identified odor types (e.g., alcohol, garlic, sweat, body odor) are recorded in a database.
[0740] Step 6: Data reception and analysis (emotions)
[0741] The server receives the emotion data sent from the device, analyzes it, and identifies the user's emotional state, such as relaxed or stressed, and stores the information in a database.
[0742] Step 7: Find and customize your fragrance recipe
[0743] The server searches a database for a basic fragrance recipe that corresponds to the identified scent, and then customizes this fragrance recipe based on the analyzed user's emotional state, for example by adding relaxing ingredients.
[0744] Step 8: Submit your fragrance recipe
[0745] The server then sends the customized fragrance recipe and appropriate alert messages to the device, including specific fragrance types, their amounts, and the alert messages.
[0746] Step 9: Start the fragrance generator
[0747] The device processes the fragrance recipe received from the server, stores it in its internal memory, and then activates the fragrance generator, which automatically extracts and mixes the required fragrances.
[0748] Step 10: Spray with fragrance
[0749] The device then uses a built-in pump system to spray the appropriate amount of fragrance around the user, controlling the timing and amount of spray to ensure the fragrance is distributed effectively.
[0750] Step 11: Re-detect odors
[0751] After spraying the fragrance, the device activates the odor sensor again to check whether the odor was properly neutralized. If the odor was not neutralized sufficiently, the cycle starts again from step 1.
[0752] Step 12: Alert Notification
[0753] The device generates an alert via vibration or sound to notify the user that an odor has been detected and that countermeasures have been implemented. An alert message is also displayed on the smartphone application or device display. The alert message is tailored to the user's emotional state. The user confirms the notification and realizes that the odor problem has been resolved.
[0754] Specific examples
[0755] Case 1: User who drank alcohol last night
[0756] 1. Odor detection: The device detects the strong odor of alcohol from the user's breath.
[0757] 2. Check if the threshold is exceeded: Check if the smell exceeds the threshold, and if it does, send the data to the server.
[0758] 3. Emotion Recognition: The emotion engine detects when the user is in a relaxed state and sends the emotion data to the server.
[0759] 4. Data transmission: Scent component data and emotion data are transmitted to the server.
[0760] 5. Data reception and analysis: The server identifies the condition as "alcohol" and confirms that the user is in a relaxed state.
[0761] 6. Customize fragrance recipes: Generate fragrance recipes by adding refreshing ingredients to the original recipe.
[0762] 7. Activate the fragrance generator: The device will generate a peppermint and rosemary fragrance.
[0763] 8. Spraying fragrance: Spray an appropriate amount of the fragrance you have created.
[0764] 9. Alert notification: Notifies the user by vibration and displays the message "The smell of alcohol disappears and has a refreshing effect."
[0765] Case 2: A user who ate gyoza for lunch
[0766] 1. Odor detection: The device detects a strong garlic odor from the user's breath.
[0767] 2. Check if the threshold is exceeded: Check if the smell exceeds the threshold, and if it does, send the data to the server.
[0768] 3. Emotion Recognition: The emotion engine detects when the user is in a stressful state and sends the emotion data to the server.
[0769] 4. Data transmission: Scent component data and emotion data are transmitted to the server.
[0770] 5. Data reception and analysis: The server identifies the user as "garlic" and confirms that the user is in a stressed state.
[0771] 6. Customize fragrance recipes: Generate fragrance recipes by adding relaxing ingredients to the original recipe.
[0772] 7. Activate fragrance generator: The device will produce a citrus and lavender fragrance.
[0773] 8. Spraying fragrance: Spray an appropriate amount of the fragrance you have created.
[0774] 9. Alert notification: Notify the user by vibration and display the message "The garlic smell will disappear and have a relaxing effect."
[0775] As is clear from these examples, the present invention provides users with an easy-to-use and effective odor control and emotional care system. The entire system works in an integrated manner to improve the user's quality of life.
[0776] Example 2
[0777] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0778] Conventional odor control systems were capable of detecting specific odors and generating and spraying fragrances, but they did not customize the system to take into account the user's emotional state. As a result, there were issues with the odor control being insufficiently effective or not being able to provide an appropriate fragrance according to the user's emotions. There was also a need for a system that could respond in a more detailed manner based on the intensity of the odor and the user's emotional state.
[0779] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0780] In this invention, the server includes means for detecting odors, means for analyzing component data of the detected odors to identify specific odors, means for collecting biometric information from the user and recognizing emotions, means for generating a fragrance recipe corresponding to the identified odor and the recognized emotion, means for automatically blending and spraying the generated fragrance, and means for issuing an alert to notify the user that countermeasures have been implemented. This makes it possible to address the user's emotions while also taking measures against odors, and automatically provide the most appropriate fragrance depending on the situation.
[0781] The "means for detecting odors" is a device that chemically detects odor components in the air around the user and records their intensity as digital data.
[0782] The "means for analyzing detected odor component data to identify specific odors" refers to a system that analyzes collected odor component data and executes algorithms or models to identify specific odors.
[0783] The "means for collecting biometric information of the user and recognizing emotions" refers to a device or algorithm that collects biometric information such as the user's facial expression, voice, heart rate, or skin potential, and analyzes it to identify the user's emotional state.
[0784] The "means for generating a fragrance recipe corresponding to the identified smell and the recognized emotion" is a system that determines the appropriate fragrance ingredients and their blending method based on the identified smell and the user's emotional state.
[0785] The "means for automatically blending and spraying the generated fragrance" is a system that extracts and mixes the necessary fragrances based on the generated fragrance recipe and sprays them around the user at the appropriate time using a built-in pump system.
[0786] "Means for sending an alert to inform the user that measures have been implemented" refers to a device or system that generates an alert via vibration, notification sound, or a display or smartphone application to inform the user that odor control measures have been completed.
[0787] "Means for transmitting odor component data to a server when the odor intensity exceeds a set threshold" refers to a system that transmits odor component data to a server via wireless communication when the odor detection result exceeds a preset threshold.
[0788] "Means for analyzing odor component data using an AI model and identifying emotions from the user's biometric information" is a system that inputs collected odor component data and biometric information into an AI model and identifies specific odors and the user's emotional state through complex analysis.
[0789] This system not only automatically detects the user's scent and generates and sprays a fragrance that corresponds to that scent, but also recognizes the user's emotions and provides customized fragrances and alert messages based on those emotions. This system is mainly composed of a terminal, a server, and an emotion engine.
[0790] Device features and operations
[0791] Odor detection
[0792] The device is equipped with a built-in odor sensor that constantly monitors the air around the user. This odor sensor chemically detects volatile organic compounds and records their intensity as digital data. The recorded data is automatically sent to a server when it exceeds a set threshold. For example, if a strong odor of alcohol or garlic is detected, that data is sent to the server.
[0793] emotion recognition
[0794] The device is equipped with a camera, microphone, and biosensors to collect biometric information such as the user's facial expression, voice, heart rate, and skin potential. This data is input into an emotion engine, which analyzes the user's emotional state in real time. The analysis results, along with odor component data, are sent to a server.
[0795] Data transmission
[0796] The device uses a wireless communication module such as Wi-Fi or Bluetooth to transmit odor component data and emotional data to a server, including the chemical formulas and concentrations of the detected odor components and the user's emotional state.
[0797] Server Functions and Operations
[0798] Odor analysis and identification
[0799] The server receives the odor component data sent from the device and analyzes it using an AI model. This AI model identifies specific odors and identifies specific odors such as alcohol, garlic, sweat, and body odor. For each identified odor, the server retrieves the associated fragrance recipe from the database.
[0800] Emotional Data Analysis
[0801] The server analyzes the emotional data sent from the device and identifies the user's current emotional state. This allows the server to understand the user's psychological and physiological state. For example, if the user is under stress, the server customizes the experience accordingly.
[0802] Fragrance recipe generation and customization
[0803] The server generates an appropriate fragrance recipe based on the identified smell and the analyzed emotional state. This recipe starts with a basic one and is customized according to the user's emotional state. For example, if the user is stressed, a fragrance recipe with added ingredients that have a relaxing effect is generated.
[0804] Data transmission
[0805] The server then sends the customized fragrance recipe and an appropriate alert message to the device, which is also tailored according to the user's emotional state.
[0806] Fragrance production and spraying
[0807] Procedural generation and spraying
[0808] The device activates its internal fragrance generator based on the fragrance recipe received from the server. A fragrance cartridge is loaded into the device, which automatically extracts and mixes the necessary fragrances according to the recipe. The generated fragrance is sprayed appropriately around the user using a built-in pump system.
[0809] Alert Notifications
[0810] User Notification
[0811] The device generates an alert via vibration or sound to notify the user that an odor has been detected and that countermeasures have been implemented. The device also displays a notification in the smartphone application or on the device display, with the alert message tailored to the user's emotional state. The user can confirm the notification and know that the problem has been resolved.
[0812] Specific examples
[0813] Case 1: User who drank alcohol last night
[0814] 1. The device detects a strong odor of alcohol from the user's breath.
[0815] 2. The emotion engine detects when the user is in a relaxed state.
[0816] 3. Smell component data and emotion data are sent to the server.
[0817] 4. The server identifies the alcohol and confirms that the user is relaxed.
[0818] 5. The server generates a fragrance recipe that adds a refreshing ingredient to the original recipe.
[0819] 6. The device will produce and spray a peppermint and rosemary fragrance.
[0820] 7. The device will vibrate to notify the user and display the message "The smell of alcohol will disappear and you will have a refreshing effect."
[0821] Case 2: A user who ate gyoza for lunch
[0822] 1. The device detects a strong garlic odor from the user's breath.
[0823] 2. The emotion engine detects when the user is in a stressful state.
[0824] 3. Smell component data and emotion data are sent to the server.
[0825] 4. The server identifies the user as "garlic" and confirms that the user is in a stressed state.
[0826] 5. The server generates a fragrance recipe that adds relaxing ingredients to the original recipe.
[0827] 6. The device produces and sprays a citrus and lavender fragrance.
[0828] 7. The device will vibrate to notify the user and display the message "The garlic smell will disappear and you will feel relaxed."
[0829] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0830] Step 1:
[0831] Odor monitoring
[0832] Input: The air around the user
[0833] Processing: The device constantly monitors the odor components in the air around the user using a built-in odor sensor. The sensor chemically detects volatile organic compounds and records their intensity as digital data.
[0834] Output: Digital data of odor components (data format example: [chemical formula: C2H5OH, concentration: 50 ppm])
[0835] Step 2:
[0836] Data recording and threshold determination
[0837] Input: Digital data of odor components
[0838] Processing: Pre-processing the recorded data to set a specific threshold and determine whether the odor component data exceeds the set threshold. This threshold determination determines whether or not necessary countermeasures are taken.
[0839] Output: Threshold judgment result (true or false)
[0840] Step 3:
[0841] Preparing to send data
[0842] Input: Digital data of threshold judgment results and odor components
[0843] Processing: If the threshold is exceeded, the device prepares to send the odor component data and the user's emotion data to the server.
[0844] Output: Transmission data packet (smell component data, emotion data)
[0845] Step 4:
[0846] emotion recognition
[0847] Input: User's biometric information (facial expression, voice, heart rate, etc.)
[0848] Processing: The device uses the camera, microphone, and biosensors to collect the user's biometric information and feeds it into the emotion engine, which analyzes this information to determine the user's emotional state in real time.
[0849] Output: Emotion data (data format example: [Emotion: Relaxed, Intensity: 70%])
[0850] Step 5:
[0851] Sending data to the server
[0852] Input: Transmission data packet (scent component data, emotion data)
[0853] Processing: The odor component data and emotion data are sent to the server via a wireless communication module, using Wi-Fi, Bluetooth, etc.
[0854] Output: Data sent to the server
[0855] Step 6:
[0856] Odor analysis and identification
[0857] Input: Sent odor component data
[0858] Processing: The server inputs the received odor component data into an AI model, analyzes it, and identifies specific odors, such as alcohol, garlic, sweat, and body odor.
[0859] Output: Identified odor (data format example: [Odor: Alcohol])
[0860] Step 7:
[0861] Emotional Data Analysis
[0862] Input: Emotion data sent
[0863] Processing: The server analyzes the received emotion data and identifies the user's current emotional state, thereby understanding the user's psychological and physiological state.
[0864] Output: Identified emotional state (Example data format: [Emotion: Relaxed])
[0865] Step 8:
[0866] Fragrance recipe generation and customization
[0867] Input: identified odor, identified emotional state
[0868] Processing: Based on the identified scent and the identified emotional state, the server retrieves a basic fragrance recipe from the database and customizes it based on the emotional state, for example by adding ingredients that have a relaxing effect.
[0869] Output: Customized fragrance recipe (data format example: [Ingredients: Peppermint, Rosemary])
[0870] Step 9:
[0871] Sending customized fragrance data
[0872] Input: Customized fragrance recipe, alert message
[0873] Processing: The server sends a customized fragrance recipe and an alert message to the device, which is tailored according to the user's emotional state.
[0874] Output: Data sent to the terminal
[0875] Step 10:
[0876] Automatic fragrance generation and spraying
[0877] Input: Customized fragrance recipe
[0878] Processing: The device activates its internal fragrance generator based on the received fragrance recipe. It extracts the necessary fragrances from the fragrance cartridges, mixes them together to create the fragrance, and then sprays the created fragrance appropriately using the built-in pump system.
[0879] Output: Sprayed fragrance
[0880] Step 11:
[0881] Alert Notifications
[0882] Input: Alert message from the server
[0883] Action: The device will generate an alert by vibrating or sounding to let the user know that the action has been taken, and will also display a notification in the smartphone application or on the device display to let the user know that the action has been taken.
[0884] Output: Message notified to the user
[0885] (Application example 2)
[0886] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0887] To improve passenger comfort and safety in autonomous vehicles, a system that monitors passenger odors and emotional states in real time and automatically generates and sprays appropriate fragrances accordingly is required. However, conventional technologies perform odor detection and emotion recognition separately, making it difficult to provide a comfortable in-car environment through integrated processing.
[0888] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0889] In this invention, the server includes means for detecting odors, means for analyzing component data of the detected odors to identify specific odors, means for recognizing a user's emotions, means for generating a fragrance recipe corresponding to the identified odor and the recognized emotion, means for automatically blending and spraying the generated fragrance, and means for notifying the user of an alert, thereby enabling real-time odor countermeasures and emotional care in autonomous vehicles.
[0890] The "means for detecting odors" is a device installed in a vehicle that chemically detects odor components in the surrounding air and acquires the data.
[0891] "Means for analyzing detected odor component data to identify specific odors" refers to a function that analyzes acquired odor component data using an AI model, etc., to identify specific odors.
[0892] The "means for recognizing the user's emotions" is a function that uses cameras and microphones inside the vehicle to analyze the user's facial expressions and voice and grasp their emotional state in real time.
[0893] The "means for generating a fragrance recipe corresponding to the identified smell and the recognized emotion" is a function that automatically creates a formula for generating an optimal fragrance based on the identified smell data and emotion data.
[0894] The "means for automatically blending and spraying the created fragrance" is a function for automatically blending fragrances based on the created fragrance recipe and spraying them inside the vehicle at the appropriate time.
[0895] "Means for notifying users of alerts" refers to features such as displays and audio systems that notify passengers when an odor or emotion-related issue is detected or when corrective measures are implemented.
[0896] The "wireless communication module" is a communication device that transmits and receives data between the inside of the vehicle and an external server.
[0897] A "fragrance generating device" is a device that mixes multiple fragrances and generates and sprays an appropriate fragrance based on a specified fragrance recipe.
[0898] An "emotion engine" is software or hardware that analyzes a user's emotional state based on facial expression analysis, voice analysis, and biometric analysis.
[0899] The present invention is a system for improving the in-car environment by generating customized fragrances based on the passenger's odor and emotional state, which is applied to autonomous vehicles. This system is realized using hardware and software such as odor sensors and cameras installed in the vehicle, a server, an emotion engine, and a fragrance generator.
[0900] System Configuration and Operation
[0901] Odor detection
[0902] The terminal (on-board device) is equipped with a built-in odor sensor that constantly monitors the air inside the vehicle. The sensor chemically detects odor components and digitizes and records the data. This data is sent to a server via a wireless communication module when a specific odor exceeds a certain threshold.
[0903] Emotion recognition by emotion engine
[0904] The device uses an in-car camera to monitor passengers' facial expressions and voices in real time and analyzes them using an emotion engine. This emotion data is also sent to the server via a wireless communication module. The emotion engine uses AI models such as OpenCV and TensorFlow.
[0905] Analysis of odor and emotion data
[0906] The server uses an AI model to analyze the odor component data sent from the device and identify specific odors (e.g., "alcohol," "garlic," etc.) and analyzes the emotion data to identify the passenger's current emotional state (e.g., "relaxed," "stressed," etc.).
[0907] Fragrance recipe generation and customization
[0908] The server searches a database for a fragrance recipe that corresponds to the identified smell and then customizes it based on that recipe, adding ingredients that have a relaxing or refreshing effect depending on the passenger's emotional state.
[0909] Procedural generation and spraying
[0910] The device activates its internal fragrance generator based on the fragrance recipe received from the server. Fragrance cartridges are loaded into the device, which automatically extracts and mixes the necessary fragrances according to the recipe. The generated fragrance is then sprayed appropriately into the vehicle interior using the device's pump system.
[0911] Alert Notifications
[0912] Once activated, the device will alert passengers with vibrations and sounds, and will also display a notification on the vehicle's display. The alert message will also be tailored to the passenger's emotional state. Examples of notifications include "The smell of alcohol will disappear, providing a refreshing effect" and "The smell of garlic will disappear, providing a relaxing effect."
[0913] Specific examples
[0914] Case 1: A passenger who drank alcohol last night
[0915] 1. Smell detection: Smell sensors inside the car detect the smell of alcohol.
[0916] 2. Emotion Recognition: The emotion engine detects when a passenger is relaxed.
[0917] 3. Server analysis: Alcohol is detected and passengers are confirmed to be relaxed.
[0918] 4. Fragrance generation: Generate fragrance recipes with refreshing ingredients.
[0919] 5. Fragrance spray: Produces and sprays peppermint and rosemary fragrance.
[0920] 6. Alert notification: Displays the message "The smell of alcohol disappears and you will feel refreshed."
[0921] Case 2: A passenger who ate gyoza for lunch
[0922] 1. Odor detection: Odor sensors inside the car detect the smell of garlic.
[0923] 2. Emotion Recognition: The emotion engine detects when a passenger is in a stressful state.
[0924] 3. Server analysis: Garlic is detected and passenger is confirmed to be in a stressed state.
[0925] 4. Fragrance generation: Generate fragrance recipes with relaxing ingredients.
[0926] 5. Fragrance spray: Produces and sprays citrus and lavender fragrance.
[0927] 6. Alert notification: Displays the message "The garlic smell will disappear and have a relaxing effect."
[0928] Prompt Sentence Examples
[0929] "Was a strong odor detected inside the vehicle? If so, what was the composition and intensity of that odor?"
[0930] "What is the passenger's current emotional state? For example, stressed or relaxed?"
[0931] "Generate fragrance recipes based on scent ingredients and emotional state. For example, if you're stressed, add ingredients that have a relaxing effect."
[0932] This system will enable real-time odor control and emotional care within autonomous vehicles.
[0933] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0934] Step 1:
[0935] An odor sensor in the terminal constantly monitors the air inside the vehicle. The odor sensor detects odor components in the surrounding air and digitizes the data. The input is data on the air inside the vehicle, and the output is digitized odor component data.
[0936] Step 2:
[0937] The device analyzes the odor component data and sends it to the server if it exceeds a certain threshold. The data is processed by checking the concentration of the digitized odor component data and performing a calculation to determine whether it exceeds the threshold. The input is the odor component data, and the output is the odor component data that exceeds the threshold.
[0938] Step 3:
[0939] The device uses an in-car camera to monitor passengers' facial expressions and voices in real time. It uses an emotion engine (such as OpenCV or TensorFlow) to acquire emotion data. The input is camera footage and voice data, and the output is analyzed emotion data.
[0940] Step 4:
[0941] The terminal transmits the odor component data and emotion data to the server via the wireless communication module. The input is the odor component data that exceeds the threshold and the emotion data, and the output is the data transmitted to the server.
[0942] Step 5:
[0943] The server uses an AI model to analyze the odor component data sent from the device and identify specific odors. The AI model analyzes the odor component data and performs calculations to determine the type of odor. The input is the odor component data received from the device, and the output is the identified odor data.
[0944] Step 6:
[0945] The server analyzes the emotional data to identify the user's current emotional state. It uses an AI model for the analysis and determines the emotional state. The input is the emotional data received from the device, and the output is the determined emotional state.
[0946] Step 7:
[0947] The server generates a fragrance recipe according to the identified smell and the recognized emotion. Here, it takes a basic recipe from the database and customizes it according to the emotional state. The input is the identified smell data and the emotional state data, and the output is a customized fragrance recipe.
[0948] Step 8:
[0949] The server sends the generated fragrance recipe to the terminal, where the input is the customized fragrance recipe and the output is the fragrance recipe sent to the terminal.
[0950] Step 9:
[0951] The terminal activates the fragrance generator based on the received fragrance recipe. The fragrance generator extracts and mixes the necessary ingredients from the fragrance cartridges. The input is the fragrance recipe, and the output is the generated fragrance.
[0952] Step 10:
[0953] The terminal sprays the generated fragrance into the car interior using a pump system. The input is the generated fragrance and the output is the sprayed fragrance.
[0954] Step 11:
[0955] The terminal notifies the user that the problem has been resolved by displaying an alert message on the display or audio system. The input is the data indicating the fragrance spray success, and the output is the alert message.
[0956] This process enhances passenger comfort and safety, while also providing integrated odor management and emotional care.
[0957] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0958] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0959] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[0960] [Third embodiment]
[0961] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[0962] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.
[0963] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0964] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[0965] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0966] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0967] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0968] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0969] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0970] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0971] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0972] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[0973] The system of this invention aims to effectively counteract unpleasant body odors and breath odors by automatically detecting odors and instantly generating and spraying corresponding fragrances. This system is primarily composed of a terminal and a server, and the main roles and processing flow of each are explained below.
[0974] Device features and operations
[0975] Odor detection
[0976] The device is equipped with a built-in odor sensor that constantly monitors the air around the user. The sensor chemically detects odor components and records their intensity as digital data. This data is sent to a server when a specific odor exceeds a set threshold.
[0977] Data transmission
[0978] The device establishes a connection with the server via a wireless communication module and transmits odor component data, including the chemical formulas and concentrations of the detected odor components.
[0979] Server Functions and Operations
[0980] Odor analysis and identification
[0981] The server receives the odor component data sent from the device. This data is analyzed by an AI model to identify specific odors. The AI model has been trained in advance with a variety of odor data, allowing it to identify odor types with high accuracy. Identified odors include alcohol, garlic, sweat, and body odor.
[0982] Creating a fragrance recipe
[0983] A fragrance recipe corresponding to the identified scent is retrieved from a database stored on the server, which runs an algorithm to generate a composite fragrance recipe, possibly corresponding to multiple scent components, and transmits this recipe to the device.
[0984] Fragrance production and spraying
[0985] Auto-generation and spraying
[0986] The device activates its built-in fragrance generator based on the fragrance recipe received from the server. Fragrance cartridges are loaded into the device, which automatically extracts and mixes the necessary fragrances according to the recipe. The generated fragrance is sprayed appropriately around the user using a built-in pump system.
[0987] Alert Notifications
[0988] User Notification
[0989] The device will alert the user by vibrating and / or making an audible notification that an odor has been detected and corrective action has been taken, and a notification will appear in the smartphone application or on the device display, allowing the user to confirm that the problem has been resolved.
[0990] Specific examples
[0991] Case 1: User who drank alcohol last night
[0992] 1. Odor detection: The device detects a strong odor of alcohol from the user's breath.
[0993] 2. Data transmission: This odor component data is sent to the server.
[0994] 3. Smell analysis and identification: The server identifies the smell as "alcohol" and generates a fragrance recipe based on that information.
[0995] 4. Fragrance generation and spraying: The device generates and sprays peppermint and rosemary fragrance.
[0996] 5. Alert notification: The device will vibrate to notify the user that the alcohol smell has been neutralized.
[0997] Case 2: A user who ate gyoza for lunch
[0998] 1. Odor detection: The device detects a strong garlic odor from the user's breath.
[0999] 2. Data transmission: This odor component data is sent to the server.
[1000] 3. Smell analysis and identification: The server identifies the scent as "garlic" and generates a fragrance recipe based on that information.
[1001] 4. Fragrance generation and spraying: The device generates and sprays a citrus and basil fragrance.
[1002] 5. Alert notification: The device will vibrate to notify the user that the garlic smell has been neutralized.
[1003] As is clear from these examples, the present invention provides an easy-to-use and effective odor countermeasure for users. The integrated operation of the entire system can improve the quality of life of users.
[1004] The processing flow will be explained below.
[1005] Step 1: Smell detection
[1006] The device activates an odor sensor to monitor the air around the user. The sensor chemically detects odor components and records their intensity as digital data. The odor component data is temporarily stored in the device's internal memory.
[1007] Step 2: Check if the threshold is exceeded
[1008] The device determines whether the recorded odor component data exceeds the set threshold. If so, it sends the data to the server. If not, it continues odor detection.
[1009] Step 3: Send data
[1010] The device establishes a connection with the server via a wireless communication module and transmits odor component data, including the chemical formulas and concentrations of the detected odor components, to the server.
[1011] Step 4: Data reception and analysis
[1012] The server receives the odor component data sent from the device. This data is analyzed by an AI model to identify specific odors. The AI model has been trained in advance on a variety of odor data, allowing it to identify odor types with high accuracy.
[1013] Step 5: Save the identification results and search for fragrance recipes
[1014] The server records the identification results in a database, then searches the database for fragrance recipes corresponding to the identified scents, and optionally runs an algorithm to generate a composite fragrance recipe.
[1015] Step 6: Submit your fragrance recipe
[1016] The server determines the appropriate fragrance combination and its mixing ratio and sends this recipe to the device, including the specific types of fragrances and their amounts.
[1017] Step 7: Start the fragrance generator
[1018] The device processes the fragrance recipe received from the server, stores it in its internal memory, and then activates the fragrance generator, which automatically extracts and mixes the required fragrance ingredients.
[1019] Step 8: Spray with fragrance
[1020] The device then uses a built-in pump system to spray the generated fragrance around the user, controlling the timing and amount of spray to ensure the fragrance is dispersed effectively.
[1021] Step 9: Re-detect the smell
[1022] After spraying the fragrance, the device activates the odor sensor again to check whether the odor was properly neutralized. If the odor was not neutralized sufficiently, the cycle starts again from step 1.
[1023] Step 10: Alert Notification
[1024] The device generates an alert to notify the user, using vibrations, a sound, or a notification on the smartphone application or device display. The user confirms the notification and knows that the odor problem has been resolved.
[1025] Through the above processing steps, the user can recognize his or her own odor in a timely manner and automatically take necessary measures.
[1026] Example 1
[1027] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1028] In modern life, unpleasant odors from personal body odor and breath are a significant problem because they can be unpleasant for others. Conventional methods involve the use of masks or portable fragrance dispensers, but these methods require manual intervention and are difficult to implement in real time. Furthermore, there are limited technologies available for instantly generating the appropriate fragrance combination for a specific odor. The present invention aims to address these issues and provide a user-friendly and effective odor control solution.
[1029] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1030] In this invention, the server includes means for detecting odors, means for transmitting component data of the detected odors to the server, means for receiving and analyzing the transmitted component data of the odors to identify specific odors, means for generating a fragrance recipe corresponding to the identified odor, means for automatically blending and spraying the generated fragrance, and means for notifying the user of an alert. This makes it possible to detect odors around the user in real time and instantly generate and spray an appropriate fragrance.
[1031] An "odor detection means" is a device or sensor that detects specific chemical components in the surrounding air and converts their concentrations into digital data.
[1032] "Means for transmitting data on detected odor components to a server" refers to technology that has the function of transmitting data on odor components detected by a sensor to a server using a wireless communication module or the like.
[1033] "Means for receiving and analyzing the transmitted odor component data to identify specific odors" refers to a method for processing the data received on the server using an AI model or analytical algorithm to identify the specific type of odor.
[1034] The "means for generating a fragrance recipe corresponding to an identified scent" refers to a technology that uses a database or algorithm to determine the appropriate fragrance composition corresponding to a specific scent and generate that recipe.
[1035] The "means for automatically blending and spraying the generated fragrance" is a device that uses a fragrance generator installed inside to automatically extract and mix the necessary fragrances and spray the fragrance through a pump system.
[1036] "Means for notifying the user of an alert" refers to a function that notifies the user that fragrance spraying has been completed or other important information by vibration, notification sound, display, or the like.
[1037] An "AI model" is an algorithm that has been trained using large amounts of data to perform a specific task (in this case, identifying odors) with high accuracy.
[1038] A "prompt statement" is an instruction statement that provides specific input data to an AI model and is used to instruct processing such as analysis and identification.
[1039] MODE FOR CARRYING OUT THE INVENTION
[1040] The system of the present invention detects odors in the air around the user in real time, and generates and sprays a corresponding fragrance to quickly and effectively counteract unpleasant odors. The details of each component and their operation are explained below.
[1041] Odor detection
[1042] The device is equipped with a built-in odor sensor that constantly monitors the air around the user. The odor sensor detects chemical components and records their concentration as digital data. If this data exceeds a set threshold, it proceeds to the next processing step. A highly sensitive odor sensor using MEMS technology is suitable for this hardware.
[1043] Data transmission
[1044] The device transmits odor component data to a server using a wireless communication module (e.g., Wi-Fi module or Bluetooth module), which can send the chemical formula and concentration data of odor components to the server in real time.
[1045] Odor analysis and identification
[1046] The server receives the odor component data sent from the device and uses a generative AI model to analyze it. The AI model is pre-trained with a variety of odor data and can identify odors with high accuracy. An example of a prompt is "Please identify the components based on this odor data." Specific functions include the ability to identify odors such as alcohol, garlic, sweat, and body odor.
[1047] Creating a fragrance recipe
[1048] A fragrance recipe corresponding to the identified scent is retrieved from a database stored on the server, which runs an algorithm to generate a composite fragrance recipe corresponding to multiple scent components as needed, and transmits the generated recipe to the device.
[1049] Fragrance production and spraying
[1050] The device activates the built-in fragrance generator based on the fragrance recipe received from the server. The device is loaded with fragrance cartridges and automatically extracts and mixes the necessary fragrances according to the recipe. The generated fragrance is then sprayed appropriately around the user using a built-in pump system.
[1051] User Notification
[1052] The device will generate a vibration or sound alert to let the user know that fragrance spraying is complete, and an alert message will appear in the smartphone application or on the device display, allowing the user to confirm that the problem has been resolved.
[1053] Specific examples
[1054] Case 1: User who drank alcohol last night
[1055] 1. Odor detection: The device detects a strong odor of alcohol from the user's breath.
[1056] 2. Data transmission: This odor component data is sent to the server.
[1057] 3. Smell analysis and identification: The server instructs the generative AI model to "identify the ingredients based on this smell data," and identifies "alcohol."
[1058] 4. Fragrance generation and spraying: The server generates a peppermint and rosemary fragrance recipe and sends it to the terminal, which then sprays it.
[1059] 5. Alert notification: The device will vibrate to notify the user that the alcohol smell has been neutralized.
[1060] Case 2: A user who ate gyoza for lunch
[1061] 1. Odor detection: The device detects a strong garlic odor from the user's breath.
[1062] 2. Data transmission: This odor component data is sent to the server.
[1063] 3. Smell analysis and identification: The server instructs the generative AI model to "identify the ingredients based on this smell data," and identifies "garlic."
[1064] 4. Fragrance generation and spraying: The server generates a citrus and basil fragrance recipe and sends it to the terminal, which then sprays it.
[1065] 5. Alert notification: The device will vibrate to notify the user that the garlic smell has been neutralized.
[1066] In this way, the system of the present invention can quickly and effectively address various odor problems faced by users, thereby enabling users to maintain a comfortable environment at all times.
[1067] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1068] Step 1:
[1069] Odor detection
[1070] The device uses an odor sensor to constantly monitor the air around the user. The sensor detects specific chemical components in real time and converts their concentrations into digital data. The input for this process is the chemical components in the surrounding air, and the output is digital data containing those chemical components. Specifically, the sensor detects the odor component of alcohol, and if its concentration exceeds a certain threshold, the data is recorded.
[1071] Step 2:
[1072] Data transmission
[1073] The device connects to the server using a wireless communication module (e.g., Wi-Fi or Bluetooth). Data on the detected odor components (chemical formula and concentration) is sent to the server. The input in this process is the digital data detected by the sensor, and the output is the odor component data sent to the server. Specifically, the device sends alcohol concentration data to the server via the Wi-Fi module.
[1074] Step 3:
[1075] Odor analysis and identification
[1076] The server uses a generative AI model to analyze the data received from the device. The AI model has been trained in advance on a variety of odor data and identifies specific odors based on the data. The input for this process is the transmitted odor component data, and the output is the identified odor type. Specifically, the server prompts the generative AI model, saying, "Please identify the component based on this odor data," and the response is "alcohol."
[1077] Step 4:
[1078] Creating a fragrance recipe
[1079] The server searches the database for fragrance recipes corresponding to the identified scent. If necessary, it runs an algorithm to generate a composite fragrance recipe corresponding to multiple scent components. The input to this process is the identified scent type, and the output is the generated fragrance recipe. Specifically, the server searches the database, finds "peppermint and rosemary" as a "fragrance recipe for alcohol," and sends it to the terminal.
[1080] Step 5:
[1081] Fragrance production and atomization
[1082] The device activates its built-in fragrance generator based on the fragrance recipe received from the server. It uses fragrance cartridges to extract and mix the required fragrances. The input for this process is the fragrance recipe, and the output is the generated fragrance. Specifically, the device activates the fragrance generator, extracts peppermint and rosemary fragrances in the specified ratio, and sprays them through the pump system.
[1083] Step 6:
[1084] Alert Notifications
[1085] The device vibrates or sounds an alert to notify the user that fragrance spraying is complete. An alert message is also displayed on the smartphone app or device display. The input during this process is the completion status of spraying, and the output is a notification to the user. Specifically, the device activates a vibration and displays a message on the smartphone app saying, "The smell of alcohol has been neutralized."
[1086] (Application example 1)
[1087] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1088] Conventional odor control systems have difficulty responding immediately to individual users' body odors and breath odors, and lack the functionality to efficiently notify administrators of odor detection and countermeasure implementation in specific spaces. This makes it difficult to immediately resolve odor-related discomfort, and there is a particular need for systems that can generate appropriate fragrances according to the strength and type of odor and quickly report on countermeasures.
[1089] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1090] In this invention, the server includes means for detecting odors, means for analyzing component data of the detected odors to identify specific odors, means for generating a fragrance recipe corresponding to the identified odor, means for automatically blending and spraying the generated fragrance, means for notifying the user of an alert, and means for detecting odors in a specific space and notifying an administrator that odor countermeasures have been completed. This makes it possible to immediately take appropriate odor countermeasures for the user or the specific space and quickly report the results to the administrator.
[1091] "Means for detecting odors" refers to technology that uses chemical sensors or electronic noses to detect odor components in a space in real time.
[1092] "Means for analyzing detected odor component data to identify specific odors" refers to the process of using AI models or machine learning algorithms to analyze detected odor components and identify their type.
[1093] "Means for generating a fragrance recipe corresponding to the identified smell" refers to a system that calculates and generates the appropriate fragrance composition and blend based on the analyzed smell information.
[1094] "Means for automatically blending and dispersing the resulting fragrance" refers to a device or mechanism that mixes fragrance according to a specified recipe and automatically disperses it into a space.
[1095] "Means of notifying the user of the alert" refers to a notification system for notifying the user of the detection of odors and the completion status of countermeasures, and includes forms such as vibration, sound, and smartphone notifications.
[1096] "Means of detecting odors in a specific space and notifying the administrator that odor control measures have been completed" refers to a function that detects odors and takes measures in a specific location, and reports the results to the administrator by email, app notification, etc.
[1097] The present invention is a system for odor detection, analysis, fragrance generation, spraying, and alert notification. The embodiments for implementing this system are described in detail below.
[1098] A means of detecting odors
[1099] The device's built-in odor sensor chemically detects odor components in the air and records the detected odor intensity and component data as digital data, which is then sent to a server when the odor exceeds a certain threshold.
[1100] A means of identifying specific odors by analyzing detected odor component data
[1101] The server receives the odor component data sent from the device and analyzes the odor using an AI model. This AI model is based on machine learning frameworks such as TensorFlow and PyTorch and is pre-trained to recognize various odor patterns, allowing it to identify specific odors such as alcohol, garlic, and sweat.
[1102] A means of generating fragrance recipes that correspond to identified odors
[1103] The fragrance recipe corresponding to the identified scent is retrieved from a database stored on the server, which uses an algorithm to generate a composite fragrance recipe corresponding to multiple scent components and transmits this recipe to the device.
[1104] Means for automatically blending and spraying the produced fragrance
[1105] The device activates the built-in fragrance generator based on the fragrance recipe received from the server. The device is loaded with fragrance cartridges, which automatically extract and mix the necessary fragrances according to the recipe, and then sprays the generated fragrance using a built-in pump system.
[1106] A means of notifying users of alerts
[1107] The device will alert the user by vibrating and / or making an audible notification that an odor has been detected and corrective action has been taken, and a notification will appear on the smartphone application or device display, allowing the user to confirm that the problem has been resolved.
[1108] A method for detecting odors in a specific space and notifying the administrator that odor control measures have been completed
[1109] When the system detects an odor in a specific space and the server generates and sprays the fragrance, it also includes a notification function that reports the results to the administrator. Notifications are sent via email or a smartphone app, allowing the administrator to immediately understand the status of the response.
[1110] Specific examples
[1111] 1. How to combat sweat odor in the fitting room:
[1112] The odor sensor detects the smell of sweat.
[1113] The server analyzes the sweat odor and generates a Silver Mountain Water fragrance.
[1114] The dispenser sprays the fragrance.
[1115] The app displays a notification saying, "Silver Mountain Water fragrance was used to combat the odor of sweat generated in the fitting room."
[1116] Prompt Sentence Examples
[1117] Regarding the odor that occurred in the fitting room today, please tell us the details of the fragrance you used and its effect.
[1118] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1119] Step 1:
[1120] Odor detection
[1121] The device uses a built-in odor sensor to continuously monitor the odor components in the air in the target area. The sensor detects the odor components based on chemical reactions and records their intensity and component data as digital data. If this data exceeds a threshold, the device proceeds to the next step.
[1122] Input: Odor components in the air
[1123] Data processing: Chemical detection and intensity measurement of odor components
[1124] Output: Digital data (odor components and their intensity)
[1125] Step 2:
[1126] Data transmission
[1127] The device transmits the detected odor component data, including the chemical formula and concentration of the detected odor component, to the server via a wireless communication module.
[1128] Input: Digital data (odor components and their intensity)
[1129] Data processing: Format conversion based on wireless communication protocol
[1130] Output: Odor component data sent to the server
[1131] Step 3:
[1132] Odor analysis and identification
[1133] The server analyzes the received odor component data and identifies specific odors using an AI model. This AI model has previously learned from a variety of odor data and is able to identify the type of odor with high accuracy.
[1134] Input: Received odor component data
[1135] Data Computing: Analysis and Classification of Odor Data with AI Models
[1136] Output: Identified odor type (e.g. alcohol, garlic, sweat, etc.)
[1137] Step 4:
[1138] Creating a fragrance recipe
[1139] Based on the identified scent, the server searches the database for a corresponding fragrance recipe and executes an algorithm to generate a composite fragrance recipe if necessary, which is then sent to the terminal.
[1140] Input: Identified odor type
[1141] Data processing: Database search and algorithmic fragrance recipe generation
[1142] Output: Fragrance recipe sent to the device
[1143] Step 5:
[1144] Fragrance production and spraying
[1145] Based on the received fragrance recipe, the device activates the built-in fragrance generator, automatically extracts and mixes the necessary fragrances from the fragrance cartridges, and then sprays the generated fragrance using the built-in pump system.
[1146] Input: Fragrance Recipe
[1147] Data processing: Extraction and blending of fragrances
[1148] Output: Atomized fragrance
[1149] Step 6:
[1150] Alert Notifications
[1151] The device will generate an alert via vibration or sound to notify the user that an odor has been detected and that countermeasures have been implemented. A notification will also appear on the smartphone application or device display, allowing the user to confirm that the problem has been resolved. Once odor detection and countermeasures have been completed in a specific space, the administrator will be notified via email or smartphone notification.
[1152] Input: Fragrance spray completion data
[1153] Data processing: Alert generation and notification sending
[1154] Output: Notification to users and administrators
[1155] As a result, the present invention makes it possible to implement highly efficient and accurate odor countermeasures and quickly notify users and administrators of the results.
[1156] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1157] This invention provides a system that not only automatically detects the user's scent and generates and sprays a fragrance that corresponds to that scent, but also recognizes the user's emotions and provides customized fragrances and alert messages based on those emotions. The system is mainly composed of a terminal, a server, and an emotion engine, and the main roles and processing flow of each are explained below.
[1158] Device features and operations
[1159] Odor detection
[1160] The device is equipped with a built-in odor sensor that constantly monitors the air around the user. The sensor chemically detects odor components and records their intensity as digital data. This data is sent to a server when a specific odor exceeds a set threshold.
[1161] Emotion recognition by emotion engine
[1162] The device uses an emotion engine to analyze the user's emotions in real time based on the user's facial expressions, voice, and biometric information, and this emotion data is also sent to the server.
[1163] Data transmission
[1164] The device establishes a connection with the server via a wireless communication module and transmits odor component data and emotion data to the server, including the chemical formulas and concentrations of the detected odor components and the user's emotional state.
[1165] Server Functions and Operations
[1166] Odor analysis and identification
[1167] The server receives the odor component data sent from the device, analyzes it using an AI model, and identifies specific odors. Identified odor types include alcohol, garlic, sweat, and body odor.
[1168] Emotional Data Analysis
[1169] The server analyzes the emotion data sent from the device and identifies the user's current emotional state, thereby understanding the user's psychological and physiological state.
[1170] Fragrance recipe creation and customization
[1171] The server searches a database for a basic fragrance recipe that corresponds to the identified scent, and then customizes this basic recipe according to the analyzed user's emotional state. For example, if the user is under stress, it adds ingredients that have a relaxing effect, or other elements that help with emotional care.
[1172] Data transmission
[1173] The server then sends the customized fragrance recipe and an appropriate alert message to the device, which is also tailored according to the user's emotional state.
[1174] Fragrance production and spraying
[1175] Auto-generation and spraying
[1176] The device activates its built-in fragrance generator based on the fragrance recipe received from the server. Fragrance cartridges are loaded into the device, which automatically extracts and mixes the necessary fragrances according to the recipe. The generated fragrance is sprayed appropriately around the user using a built-in pump system.
[1177] Alert Notifications
[1178] User Notification
[1179] The device generates an alert via vibration or sound to let the user know that an odor has been detected and that countermeasures have been implemented. Notifications are also displayed on the smartphone application and device display, with the alert message tailored to the user's emotional state. The user can confirm the notification and know that the problem has been resolved.
[1180] Specific examples
[1181] Case 1: User who drank alcohol last night
[1182] 1. Odor detection: The device detects a strong odor of alcohol from the user's breath.
[1183] 2. Emotion Recognition: The emotion engine detects when the user is in a relaxed state.
[1184] 3. Data transmission: Scent component data and emotion data are transmitted to the server.
[1185] 4. Analysis: The server identifies the alcohol and confirms that the user is relaxed.
[1186] 5. Fragrance Creation: Create a fragrance recipe by adding refreshing ingredients to the original recipe.
[1187] 6. Fragrance spray: The device produces and sprays peppermint and rosemary fragrance.
[1188] 7. Alert notification: The device will vibrate to notify the user and display the message "The smell of alcohol will disappear and you will feel refreshed."
[1189] Case 2: A user who ate gyoza for lunch
[1190] 1. Odor detection: The device detects a strong garlic odor from the user's breath.
[1191] 2. Emotion recognition: The emotion engine detects when the user is in a stressful state.
[1192] 3. Data transmission: Scent component data and emotion data are transmitted to the server.
[1193] 4. Analysis: The server identifies the user as "garlic" and determines that the user is in a stressed state.
[1194] 5. Fragrance Generation: Generate a fragrance recipe by adding relaxing ingredients to the original recipe.
[1195] 6. Fragrance spray: The device produces and sprays a citrus and lavender fragrance.
[1196] 7. Alert notification: The device will vibrate to notify the user and display the message "The garlic smell will disappear and have a relaxing effect."
[1197] As is clear from these examples, the present invention provides users with an easy-to-use and effective odor control and emotional care system. The integrated operation of the entire system can improve the user's quality of life.
[1198] The processing flow will be explained below.
[1199] Step 1: Smell detection
[1200] The device activates an odor sensor to monitor the air around the user. The sensor chemically detects odor components and records their intensity as digital data. The odor component data is temporarily stored in the device's internal memory.
[1201] Step 2: Check if the threshold is exceeded
[1202] The device determines whether the recorded odor component data exceeds a set threshold. If so, it sends the data to the server. If not, it continues odor detection.
[1203] Step 3: Emotion Recognition
[1204] The device also uses an emotion engine to analyze the user's facial expressions, voice, heart rate, and other biometric information to recognize the user's current emotional state. This emotional data is also sent to the server.
[1205] Step 4: Send data
[1206] The device establishes a connection with the server via a wireless communication module and transmits odor component data and emotion data to the server, including the chemical formulas and concentrations of the detected odor components and the user's emotional state.
[1207] Step 5: Data reception and analysis (Smell)
[1208] The server receives the odor component data sent from the device, analyzes this data using an AI model, and identifies specific odors. The identified odor types (e.g., alcohol, garlic, sweat, body odor) are recorded in a database.
[1209] Step 6: Data reception and analysis (emotions)
[1210] The server receives the emotion data sent from the device, analyzes it, and identifies the user's emotional state, such as relaxed or stressed, and stores the information in a database.
[1211] Step 7: Find and customize your fragrance recipe
[1212] The server searches a database for a basic fragrance recipe that corresponds to the identified scent, and then customizes this fragrance recipe based on the analyzed user's emotional state, for example by adding relaxing ingredients.
[1213] Step 8: Submit your fragrance recipe
[1214] The server then sends the customized fragrance recipe and appropriate alert messages to the device, including specific fragrance types, their amounts, and the alert messages.
[1215] Step 9: Start the fragrance generator
[1216] The device processes the fragrance recipe received from the server, stores it in its internal memory, and then activates the fragrance generator, which automatically extracts and mixes the required fragrance ingredients.
[1217] Step 10: Spray with fragrance
[1218] The device then uses a built-in pump system to spray the appropriate amount of fragrance around the user, controlling the timing and amount of spray to ensure the fragrance is distributed effectively.
[1219] Step 11: Re-detect odors
[1220] After spraying the fragrance, the device activates the odor sensor again to check whether the odor was properly neutralized. If the odor was not neutralized sufficiently, the cycle starts again from step 1.
[1221] Step 12: Alert Notification
[1222] The device generates an alert via vibration or sound to notify the user that an odor has been detected and that countermeasures have been implemented. An alert message is also displayed on the smartphone application or device display. The alert message is tailored to the user's emotional state. The user confirms the notification and realizes that the odor problem has been resolved.
[1223] Specific examples
[1224] Case 1: User who drank alcohol last night
[1225] 1. Odor detection: The device detects the strong odor of alcohol from the user's breath.
[1226] 2. Check if the threshold is exceeded: Check if the smell exceeds the threshold, and if it does, send the data to the server.
[1227] 3. Emotion Recognition: The emotion engine detects when the user is in a relaxed state and sends the emotion data to the server.
[1228] 4. Data transmission: Scent component data and emotion data are transmitted to the server.
[1229] 5. Data reception and analysis: The server identifies the condition as "alcohol" and confirms that the user is in a relaxed state.
[1230] 6. Customize fragrance recipes: Generate fragrance recipes by adding refreshing ingredients to the original recipe.
[1231] 7. Activate the fragrance generator: The device will generate a peppermint and rosemary fragrance.
[1232] 8. Spraying fragrance: Spray an appropriate amount of the fragrance you have created.
[1233] 9. Alert notification: Notifies the user by vibration and displays the message "The smell of alcohol disappears and has a refreshing effect."
[1234] Case 2: A user who ate gyoza for lunch
[1235] 1. Odor detection: The device detects a strong garlic odor from the user's breath.
[1236] 2. Check if the threshold is exceeded: Check if the smell exceeds the threshold, and if it does, send the data to the server.
[1237] 3. Emotion Recognition: The emotion engine detects when the user is in a stressful state and sends the emotion data to the server.
[1238] 4. Data transmission: Scent component data and emotion data are transmitted to the server.
[1239] 5. Data reception and analysis: The server identifies the user as "garlic" and confirms that the user is in a stressed state.
[1240] 6. Customize fragrance recipes: Generate fragrance recipes by adding relaxing ingredients to the original recipe.
[1241] 7. Activate fragrance generator: The device will produce a citrus and lavender fragrance.
[1242] 8. Spraying fragrance: Spray an appropriate amount of the fragrance you have created.
[1243] 9. Alert notification: Notify the user by vibration and display the message "The garlic smell will disappear and have a relaxing effect."
[1244] As is clear from these examples, the present invention provides users with an easy-to-use and effective odor control and emotional care system. The entire system works in an integrated manner to improve the user's quality of life.
[1245] Example 2
[1246] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1247] Conventional odor control systems were capable of detecting specific odors and generating and spraying fragrances, but they did not customize the system to take into account the user's emotional state. As a result, there were issues with the odor control being insufficiently effective or not being able to provide an appropriate fragrance according to the user's emotions. There was also a need for a system that could respond in a more detailed manner based on the intensity of the odor and the user's emotional state.
[1248] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1249] In this invention, the server includes means for detecting odors, means for analyzing component data of the detected odors to identify specific odors, means for collecting biometric information from the user and recognizing emotions, means for generating a fragrance recipe corresponding to the identified odor and the recognized emotion, means for automatically blending and spraying the generated fragrance, and means for issuing an alert to notify the user that countermeasures have been implemented. This makes it possible to address the user's emotions while also taking measures against odors, and automatically provide the most appropriate fragrance depending on the situation.
[1250] The "means for detecting odors" is a device that chemically detects odor components in the air around the user and records their intensity as digital data.
[1251] The "means for analyzing detected odor component data to identify specific odors" refers to a system that analyzes collected odor component data and executes algorithms or models to identify specific odors.
[1252] The "means for collecting biometric information of the user and recognizing emotions" refers to a device or algorithm that collects biometric information such as the user's facial expression, voice, heart rate, or skin potential, and analyzes it to identify the user's emotional state.
[1253] The "means for generating a fragrance recipe corresponding to the identified smell and the recognized emotion" is a system that determines the appropriate fragrance ingredients and their blending method based on the identified smell and the user's emotional state.
[1254] The "means for automatically blending and spraying the generated fragrance" is a system that extracts and mixes the necessary fragrance ingredients based on the generated fragrance recipe and sprays them around the user at the appropriate time using a built-in pump system.
[1255] "Means for sending an alert to inform the user that countermeasures have been implemented" refers to a device or system that generates an alert via vibration, notification sound, or a display or smartphone application to inform the user that odor countermeasures have been completed.
[1256] "Means for transmitting odor component data to a server when the odor intensity exceeds a set threshold" refers to a system that transmits odor component data to a server via wireless communication when the odor detection result exceeds a preset threshold.
[1257] "Means for analyzing odor component data using an AI model and identifying emotions from the user's biometric information" is a system that inputs collected odor component data and biometric information into an AI model and identifies specific odors and the user's emotional state through complex analysis.
[1258] This system not only automatically detects the user's scent and generates and sprays a fragrance that corresponds to that scent, but also recognizes the user's emotions and provides customized fragrances and alert messages based on those emotions. This system is mainly composed of a terminal, a server, and an emotion engine.
[1259] Device features and operations
[1260] Odor detection
[1261] The device is equipped with a built-in odor sensor that constantly monitors the air around the user. This odor sensor chemically detects volatile organic compounds and records their intensity as digital data. The recorded data is automatically sent to a server when it exceeds a set threshold. For example, if a strong odor of alcohol or garlic is detected, that data is sent to the server.
[1262] emotion recognition
[1263] The device is equipped with a camera, microphone, and biosensors to collect biometric information such as the user's facial expression, voice, heart rate, and skin potential. This data is input into an emotion engine, which analyzes the user's emotional state in real time. The analysis results, along with odor component data, are sent to a server.
[1264] Data transmission
[1265] The device uses a wireless communication module such as Wi-Fi or Bluetooth to transmit odor component data and emotional data to a server, including the chemical formulas and concentrations of the detected odor components and the user's emotional state.
[1266] Server Functions and Operations
[1267] Odor analysis and identification
[1268] The server receives the odor component data sent from the device and analyzes it using an AI model. This AI model identifies specific odors and identifies specific odors such as alcohol, garlic, sweat, and body odor. For each identified odor, the server retrieves the associated fragrance recipe from the database.
[1269] Emotional Data Analysis
[1270] The server analyzes the emotional data sent from the device and identifies the user's current emotional state. This allows the server to understand the user's psychological and physiological state. For example, if the user is under stress, the server customizes the experience accordingly.
[1271] Fragrance recipe creation and customization
[1272] The server generates an appropriate fragrance recipe based on the identified smell and the analyzed emotional state. This recipe starts with a basic one and is customized according to the user's emotional state. For example, if the user is stressed, a fragrance recipe with added ingredients that have a relaxing effect is generated.
[1273] Data transmission
[1274] The server then sends the customized fragrance recipe and an appropriate alert message to the device, which is also tailored according to the user's emotional state.
[1275] Fragrance production and spraying
[1276] Auto-generation and spraying
[1277] The device activates its internal fragrance generator based on the fragrance recipe received from the server. A fragrance cartridge is loaded into the device, which automatically extracts and mixes the necessary fragrances according to the recipe. The generated fragrance is sprayed appropriately around the user using a built-in pump system.
[1278] Alert Notifications
[1279] User Notification
[1280] The device generates an alert via vibration or sound to notify the user that an odor has been detected and that countermeasures have been implemented. The device also displays a notification in the smartphone application or on the device display, with the alert message tailored to the user's emotional state. The user can confirm the notification and know that the problem has been resolved.
[1281] Specific examples
[1282] Case 1: User who drank alcohol last night
[1283] 1. The device detects a strong odor of alcohol from the user's breath.
[1284] 2. The emotion engine detects when the user is in a relaxed state.
[1285] 3. Smell component data and emotion data are sent to the server.
[1286] 4. The server identifies the alcohol and confirms that the user is relaxed.
[1287] 5. The server generates a fragrance recipe that adds a refreshing ingredient to the original recipe.
[1288] 6. The device will produce and spray a peppermint and rosemary fragrance.
[1289] 7. The device will vibrate to notify the user and display the message "The smell of alcohol will disappear and you will have a refreshing effect."
[1290] Case 2: A user who ate gyoza for lunch
[1291] 1. The device detects a strong garlic odor from the user's breath.
[1292] 2. The emotion engine detects when the user is in a stressful state.
[1293] 3. Smell component data and emotion data are sent to the server.
[1294] 4. The server identifies the user as "garlic" and confirms that the user is in a stressed state.
[1295] 5. The server generates a fragrance recipe that adds relaxing ingredients to the original recipe.
[1296] 6. The device produces and sprays a citrus and lavender fragrance.
[1297] 7. The device will vibrate to notify the user and display the message "The garlic smell will disappear and you will feel relaxed."
[1298] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1299] Step 1:
[1300] Odor monitoring
[1301] Input: The air around the user
[1302] Processing: The device constantly monitors the odor components in the air around the user using a built-in odor sensor. The sensor chemically detects volatile organic compounds and records their intensity as digital data.
[1303] Output: Digital data of odor components (data format example: [chemical formula: C2H5OH, concentration: 50 ppm])
[1304] Step 2:
[1305] Data recording and threshold determination
[1306] Input: Digital data of odor components
[1307] Processing: Pre-processing the recorded data to set a specific threshold and determine whether the odor component data exceeds the set threshold. This threshold determination determines whether or not necessary countermeasures are taken.
[1308] Output: Threshold judgment result (true or false)
[1309] Step 3:
[1310] Preparing to send data
[1311] Input: Digital data of threshold judgment results and odor components
[1312] Processing: If the threshold is exceeded, the device prepares to send the odor component data and the user's emotion data to the server.
[1313] Output: Transmission data packet (smell component data, emotion data)
[1314] Step 4:
[1315] emotion recognition
[1316] Input: User's biometric information (facial expression, voice, heart rate, etc.)
[1317] Processing: The device uses a camera, microphone, and biosensors to collect the user's biometric information and input it into the emotion engine, which analyzes this information to determine the user's emotional state in real time.
[1318] Output: Emotion data (data format example: [Emotion: Relaxed, Intensity: 70%])
[1319] Step 5:
[1320] Sending data to the server
[1321] Input: Transmission data packet (scent component data, emotion data)
[1322] Processing: The odor component data and emotion data are sent to the server via a wireless communication module, using Wi-Fi, Bluetooth, etc.
[1323] Output: Data sent to the server
[1324] Step 6:
[1325] Odor analysis and identification
[1326] Input: Sent odor component data
[1327] Processing: The server inputs the received odor component data into an AI model, analyzes it, and identifies specific odors, such as alcohol, garlic, sweat, and body odor.
[1328] Output: Identified odor (data format example: [Odor: Alcohol])
[1329] Step 7:
[1330] Emotional Data Analysis
[1331] Input: Emotion data sent
[1332] Processing: The server analyzes the received emotion data and identifies the user's current emotional state, thereby understanding the user's psychological and physiological state.
[1333] Output: Identified emotional state (Example data format: [Emotion: Relaxed])
[1334] Step 8:
[1335] Fragrance recipe creation and customization
[1336] Input: identified odor, identified emotional state
[1337] Processing: Based on the identified scent and the identified emotional state, the server retrieves a basic fragrance recipe from the database and customizes it based on the emotional state, for example by adding ingredients that have a relaxing effect.
[1338] Output: Customized fragrance recipe (data format example: [Ingredients: Peppermint, Rosemary])
[1339] Step 9:
[1340] Sending customized fragrance data
[1341] Input: Customized fragrance recipe, alert message
[1342] Processing: The server sends a customized fragrance recipe and an alert message to the device, which is tailored according to the user's emotional state.
[1343] Output: Data sent to the terminal
[1344] Step 10:
[1345] Automatic fragrance generation and spraying
[1346] Input: Customized fragrance recipe
[1347] Processing: The device activates its internal fragrance generator based on the received fragrance recipe. It extracts the necessary fragrances from the fragrance cartridges, mixes them together to create the fragrance, and then sprays the created fragrance appropriately using the built-in pump system.
[1348] Output: Sprayed fragrance
[1349] Step 11:
[1350] Alert Notifications
[1351] Input: Alert message from the server
[1352] Action: The device will generate an alert by vibrating or sounding to let the user know that the action has been taken, and will also display a notification in the smartphone application or on the device display to let the user know that the action has been taken.
[1353] Output: Message notified to the user
[1354] (Application example 2)
[1355] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1356] To improve passenger comfort and safety in autonomous vehicles, a system that monitors passenger odors and emotional states in real time and automatically generates and sprays appropriate fragrances accordingly is required. However, conventional technologies perform odor detection and emotion recognition separately, making it difficult to provide a comfortable in-car environment through integrated processing.
[1357] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1358] In this invention, the server includes means for detecting odors, means for analyzing component data of the detected odors to identify specific odors, means for recognizing a user's emotions, means for generating a fragrance recipe corresponding to the identified odor and the recognized emotion, means for automatically blending and spraying the generated fragrance, and means for notifying the user of an alert, thereby enabling real-time odor countermeasures and emotional care in autonomous vehicles.
[1359] The "means for detecting odors" is a device installed in a vehicle that chemically detects odor components in the surrounding air and acquires the data.
[1360] "Means for analyzing detected odor component data to identify specific odors" refers to a function that analyzes acquired odor component data using an AI model, etc., to identify specific odors.
[1361] The "means for recognizing the user's emotions" is a function that uses cameras and microphones inside the vehicle to analyze the user's facial expressions and voice and grasp their emotional state in real time.
[1362] The "means for generating a fragrance recipe corresponding to the identified smell and the recognized emotion" is a function that automatically creates a formula for generating an optimal fragrance based on the identified smell data and emotion data.
[1363] The "means for automatically blending and spraying the created fragrance" is a function for automatically blending fragrances based on the created fragrance recipe and spraying them inside the vehicle at the appropriate time.
[1364] "Means for notifying users of alerts" refers to features such as displays and audio systems that notify passengers when an odor or emotion-related issue is detected or when corrective measures are implemented.
[1365] The "wireless communication module" is a communication device that transmits and receives data between the inside of the vehicle and an external server.
[1366] A "fragrance generating device" is a device that mixes multiple fragrances and generates and sprays an appropriate fragrance based on a specified fragrance recipe.
[1367] An "emotion engine" is software or hardware that analyzes a user's emotional state based on facial expression analysis, voice analysis, and biometric analysis.
[1368] The present invention is a system for improving the in-car environment by generating customized fragrances based on the smell and emotional state of passengers in autonomous vehicles. This system is realized using hardware and software such as odor sensors and cameras installed in the vehicle, a server, an emotion engine, and a fragrance generator.
[1369] System Configuration and Operation
[1370] Odor detection
[1371] The terminal (on-board device) is equipped with a built-in odor sensor that constantly monitors the air inside the vehicle. The sensor chemically detects odor components and digitizes and records the data. This data is sent to a server via a wireless communication module when a specific odor exceeds a certain threshold.
[1372] Emotion recognition by emotion engine
[1373] The device uses an in-car camera to monitor passengers' facial expressions and voices in real time and analyzes them using an emotion engine. This emotion data is also sent to the server via a wireless communication module. The emotion engine uses AI models such as OpenCV and TensorFlow.
[1374] Analysis of odor and emotion data
[1375] The server uses an AI model to analyze the odor component data sent from the device and identify specific odors (e.g., "alcohol," "garlic," etc.) and analyzes the emotion data to identify the passenger's current emotional state (e.g., "relaxed," "stressed," etc.).
[1376] Fragrance recipe creation and customization
[1377] The server searches a database for a fragrance recipe that corresponds to the identified smell and then customizes it based on that recipe, adding ingredients that have a relaxing or refreshing effect depending on the passenger's emotional state.
[1378] Auto-generation and spraying
[1379] The device activates its internal fragrance generator based on the fragrance recipe received from the server. Fragrance cartridges are loaded into the device, which automatically extracts and mixes the necessary fragrances according to the recipe. The generated fragrance is then sprayed appropriately into the vehicle interior using the device's pump system.
[1380] Alert Notifications
[1381] Once activated, the device will alert passengers with vibrations and sounds, and will also display a notification on the vehicle's display. The alert message will also be tailored to the passenger's emotional state. Examples of notifications include "The smell of alcohol will disappear, giving you a refreshing effect" and "The smell of garlic will disappear, giving you a relaxing effect."
[1382] Specific examples
[1383] Case 1: A passenger who drank alcohol last night
[1384] 1. Smell detection: Smell sensors inside the car detect the smell of alcohol.
[1385] 2. Emotion Recognition: The emotion engine detects when a passenger is relaxed.
[1386] 3. Server analysis: Alcohol is detected and passengers are confirmed to be relaxed.
[1387] 4. Fragrance Generation: Create a fragrance recipe with refreshing ingredients.
[1388] 5. Fragrance spray: Produces and sprays peppermint and rosemary fragrance.
[1389] 6. Alert notification: Displays the message "The smell of alcohol disappears and you will feel refreshed."
[1390] Case 2: A passenger who ate gyoza for lunch
[1391] 1. Odor detection: Odor sensors inside the car detect the smell of garlic.
[1392] 2. Emotion Recognition: The emotion engine detects when a passenger is in a stressful state.
[1393] 3. Server analysis: Garlic is detected and passenger is confirmed to be in a stressed state.
[1394] 4. Fragrance generation: Generate fragrance recipes with relaxing ingredients.
[1395] 5. Fragrance spray: Produces and sprays citrus and lavender fragrance.
[1396] 6. Alert notification: Displays the message "The garlic smell will disappear and have a relaxing effect."
[1397] Prompt Sentence Examples
[1398] "Was a strong odor detected inside the vehicle? If so, what was the composition and intensity of that odor?"
[1399] "What is the passenger's current emotional state? For example, stressed or relaxed?"
[1400] "Generate fragrance recipes based on scent ingredients and emotional state. For example, if you're stressed, add ingredients that have a relaxing effect."
[1401] This system will enable real-time odor control and emotional care within autonomous vehicles.
[1402] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1403] Step 1:
[1404] An odor sensor in the terminal constantly monitors the air inside the vehicle. The odor sensor detects odor components in the surrounding air and digitizes the data. The input is data on the air inside the vehicle, and the output is digitized odor component data.
[1405] Step 2:
[1406] The device analyzes the odor component data and sends it to the server if it exceeds a certain threshold. The data is processed by checking the concentration of the digitized odor component data and performing a calculation to determine whether it exceeds the threshold. The input is the odor component data, and the output is the odor component data that exceeds the threshold.
[1407] Step 3:
[1408] The device uses an in-car camera to monitor passengers' facial expressions and voices in real time. It uses an emotion engine (such as OpenCV or TensorFlow) to acquire emotion data. The input is camera footage and voice data, and the output is analyzed emotion data.
[1409] Step 4:
[1410] The terminal transmits the odor component data and emotion data to the server via the wireless communication module. The input is the odor component data that exceeds the threshold and the emotion data, and the output is the data transmitted to the server.
[1411] Step 5:
[1412] The server uses an AI model to analyze the odor component data sent from the device and identify specific odors. The AI model analyzes the odor component data and performs calculations to determine the type of odor. The input is the odor component data received from the device, and the output is the identified odor data.
[1413] Step 6:
[1414] The server analyzes the emotional data to identify the user's current emotional state. It uses an AI model for the analysis and determines the emotional state. The input is the emotional data received from the device, and the output is the determined emotional state.
[1415] Step 7:
[1416] The server generates a fragrance recipe according to the identified smell and the recognized emotion. Here, it takes a basic recipe from the database and customizes it according to the emotional state. The input is the identified smell data and the emotional state data, and the output is a customized fragrance recipe.
[1417] Step 8:
[1418] The server sends the generated fragrance recipe to the terminal, where the input is the customized fragrance recipe and the output is the fragrance recipe sent to the terminal.
[1419] Step 9:
[1420] The terminal activates the fragrance generator based on the received fragrance recipe. The fragrance generator extracts and mixes the necessary ingredients from the fragrance cartridges. The input is the fragrance recipe, and the output is the generated fragrance.
[1421] Step 10:
[1422] The terminal sprays the generated fragrance into the car interior using a pump system. The input is the generated fragrance and the output is the sprayed fragrance.
[1423] Step 11:
[1424] The terminal notifies the user that the problem has been resolved by displaying an alert message on the display or audio system. The input is the data indicating the fragrance spray success, and the output is the alert message.
[1425] This process enhances passenger comfort and safety, while also providing integrated odor management and emotional care.
[1426] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1427] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1428] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1429] [Fourth embodiment]
[1430] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1431] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1432] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1433] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1434] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1435] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1436] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1437] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1438] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1439] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1440] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1441] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1442] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1443] The system of this invention aims to effectively counteract unpleasant body odors and breath odors by automatically detecting odors and instantly generating and spraying corresponding fragrances. This system is primarily composed of a terminal and a server, and the main roles and processing flow of each are explained below.
[1444] Device features and operations
[1445] Odor detection
[1446] The device is equipped with a built-in odor sensor that constantly monitors the air around the user. The sensor chemically detects odor components and records their intensity as digital data. This data is sent to a server when a specific odor exceeds a set threshold.
[1447] Data transmission
[1448] The device establishes a connection with the server via a wireless communication module and transmits odor component data, including the chemical formulas and concentrations of the detected odor components.
[1449] Server Functions and Operations
[1450] Odor analysis and identification
[1451] The server receives the odor component data sent from the device. This data is analyzed by an AI model to identify specific odors. The AI model has been trained in advance with a variety of odor data, allowing it to identify odor types with high accuracy. Identified odors include alcohol, garlic, sweat, and body odor.
[1452] Creating a fragrance recipe
[1453] A fragrance recipe corresponding to the identified scent is retrieved from a database stored on the server, which runs an algorithm to generate a composite fragrance recipe, possibly corresponding to multiple scent components, and transmits this recipe to the device.
[1454] Fragrance production and spraying
[1455] Auto-generation and spraying
[1456] The device activates its built-in fragrance generator based on the fragrance recipe received from the server. Fragrance cartridges are loaded into the device, which automatically extracts and mixes the necessary fragrances according to the recipe. The generated fragrance is sprayed appropriately around the user using a built-in pump system.
[1457] Alert Notifications
[1458] User Notification
[1459] The device will alert the user by vibrating and / or making an audible notification that an odor has been detected and corrective action has been taken, and a notification will appear in the smartphone application or on the device display, allowing the user to confirm that the problem has been resolved.
[1460] Specific examples
[1461] Case 1: User who drank alcohol last night
[1462] 1. Odor detection: The device detects a strong odor of alcohol from the user's breath.
[1463] 2. Data transmission: This odor component data is sent to the server.
[1464] 3. Smell analysis and identification: The server identifies the smell as "alcohol" and generates a fragrance recipe based on that information.
[1465] 4. Fragrance generation and spraying: The device generates and sprays peppermint and rosemary fragrance.
[1466] 5. Alert notification: The device will vibrate to notify the user that the alcohol smell has been neutralized.
[1467] Case 2: A user who ate gyoza for lunch
[1468] 1. Odor detection: The device detects a strong garlic odor from the user's breath.
[1469] 2. Data transmission: This odor component data is sent to the server.
[1470] 3. Smell analysis and identification: The server identifies the scent as "garlic" and generates a fragrance recipe based on that information.
[1471] 4. Fragrance generation and spraying: The device generates and sprays a citrus and basil fragrance.
[1472] 5. Alert notification: The device will vibrate to notify the user that the garlic smell has been neutralized.
[1473] As is clear from these examples, the present invention provides an easy-to-use and effective odor countermeasure for users. The integrated operation of the entire system can improve the quality of life of users.
[1474] The processing flow will be explained below.
[1475] Step 1: Smell detection
[1476] The device activates an odor sensor to monitor the air around the user. The sensor chemically detects odor components and records their intensity as digital data. The odor component data is temporarily stored in the device's internal memory.
[1477] Step 2: Check if the threshold is exceeded
[1478] The device determines whether the recorded odor component data exceeds the set threshold. If so, it sends the data to the server. If not, it continues odor detection.
[1479] Step 3: Send data
[1480] The device establishes a connection with the server via a wireless communication module and transmits odor component data, including the chemical formulas and concentrations of the detected odor components, to the server.
[1481] Step 4: Data reception and analysis
[1482] The server receives the odor component data sent from the device. This data is analyzed by an AI model to identify specific odors. The AI model has been trained in advance on a variety of odor data, allowing it to identify odor types with high accuracy.
[1483] Step 5: Save the identification results and search for fragrance recipes
[1484] The server records the identification results in a database, then searches the database for fragrance recipes corresponding to the identified scents, and optionally runs an algorithm to generate a composite fragrance recipe.
[1485] Step 6: Submit your fragrance recipe
[1486] The server determines the appropriate fragrance combination and its mixing ratio and sends this recipe to the device, including the specific types of fragrances and their amounts.
[1487] Step 7: Start the fragrance generator
[1488] The device processes the fragrance recipe received from the server, stores it in its internal memory, and then activates the fragrance generator, which automatically extracts and mixes the required fragrance ingredients.
[1489] Step 8: Spray with fragrance
[1490] The device then uses a built-in pump system to spray the generated fragrance around the user, controlling the timing and amount of spray to ensure the fragrance is dispersed effectively.
[1491] Step 9: Re-detect the smell
[1492] After spraying the fragrance, the device activates the odor sensor again to check whether the odor was properly neutralized. If the odor was not neutralized sufficiently, the cycle starts again from step 1.
[1493] Step 10: Alert Notification
[1494] The device generates an alert to notify the user, using vibrations, a sound, or a notification on the smartphone application or device display. The user confirms the notification and knows that the odor problem has been resolved.
[1495] Through the above processing steps, the user can recognize his or her own odor in a timely manner and automatically take necessary measures.
[1496] Example 1
[1497] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1498] In modern life, unpleasant odors from personal body odor and breath are a significant problem because they can be unpleasant for others. Conventional methods involve the use of masks or portable fragrance dispensers, but these methods require manual intervention and are difficult to implement in real time. Furthermore, there are limited technologies available for instantly generating the appropriate fragrance combination for a specific odor. The present invention aims to address these issues and provide a user-friendly and effective odor control solution.
[1499] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1500] In this invention, the server includes means for detecting odors, means for transmitting component data of the detected odors to the server, means for receiving and analyzing the transmitted component data of the odors to identify specific odors, means for generating a fragrance recipe corresponding to the identified odor, means for automatically blending and spraying the generated fragrance, and means for notifying the user of an alert. This makes it possible to detect odors around the user in real time and instantly generate and spray an appropriate fragrance.
[1501] An "odor detection means" is a device or sensor that detects specific chemical components in the surrounding air and converts their concentrations into digital data.
[1502] "Means for transmitting data on detected odor components to a server" refers to technology that has the function of transmitting data on odor components detected by a sensor to a server using a wireless communication module or the like.
[1503] "Means for receiving and analyzing the transmitted odor component data to identify specific odors" refers to a method for processing the data received on the server using an AI model or analytical algorithm to identify the specific type of odor.
[1504] The "means for generating a fragrance recipe corresponding to an identified scent" refers to a technology that uses a database or algorithm to determine the appropriate fragrance composition corresponding to a specific scent and generate that recipe.
[1505] The "means for automatically blending and spraying the generated fragrance" is a device that uses a fragrance generator installed inside to automatically extract and mix the necessary fragrances and spray the fragrance through a pump system.
[1506] "Means for notifying the user of an alert" refers to a function that notifies the user that fragrance spraying has been completed or other important information by vibration, notification sound, display, or the like.
[1507] An "AI model" is an algorithm that has been trained using large amounts of data to perform a specific task (in this case, identifying odors) with high accuracy.
[1508] A "prompt statement" is an instruction statement that provides specific input data to an AI model and is used to instruct processing such as analysis and identification.
[1509] MODE FOR CARRYING OUT THE INVENTION
[1510] The system of the present invention detects odors in the air around the user in real time, and generates and sprays a corresponding fragrance to quickly and effectively counteract unpleasant odors. The details of each component and their operation are explained below.
[1511] Odor detection
[1512] The device is equipped with a built-in odor sensor that constantly monitors the air around the user. The odor sensor detects chemical components and records their concentration as digital data. If this data exceeds a set threshold, it proceeds to the next processing step. A highly sensitive odor sensor using MEMS technology is suitable for this hardware.
[1513] Data transmission
[1514] The device transmits odor component data to a server using a wireless communication module (e.g., Wi-Fi module or Bluetooth module), which can send the chemical formula and concentration data of odor components to the server in real time.
[1515] Odor analysis and identification
[1516] The server receives the odor component data sent from the device and uses a generative AI model to analyze it. The AI model is pre-trained with a variety of odor data and can identify odors with high accuracy. An example of a prompt is "Please identify the components based on this odor data." Specific functions include the ability to identify odors such as alcohol, garlic, sweat, and body odor.
[1517] Creating a fragrance recipe
[1518] A fragrance recipe corresponding to the identified scent is retrieved from a database stored on the server, which runs an algorithm to generate a composite fragrance recipe corresponding to multiple scent components as needed, and transmits the generated recipe to the device.
[1519] Fragrance production and spraying
[1520] The device activates the built-in fragrance generator based on the fragrance recipe received from the server. The device is loaded with fragrance cartridges and automatically extracts and mixes the necessary fragrances according to the recipe. The generated fragrance is then sprayed appropriately around the user using a built-in pump system.
[1521] User Notification
[1522] The device will generate a vibration or sound alert to let the user know that fragrance spraying is complete, and an alert message will appear in the smartphone application or on the device display, allowing the user to confirm that the problem has been resolved.
[1523] Specific examples
[1524] Case 1: User who drank alcohol last night
[1525] 1. Odor detection: The device detects a strong odor of alcohol from the user's breath.
[1526] 2. Data transmission: This odor component data is sent to the server.
[1527] 3. Smell analysis and identification: The server instructs the generative AI model to "identify the ingredients based on this smell data," and identifies "alcohol."
[1528] 4. Fragrance generation and spraying: The server generates a peppermint and rosemary fragrance recipe and sends it to the terminal, which then sprays it.
[1529] 5. Alert notification: The device will vibrate to notify the user that the alcohol smell has been neutralized.
[1530] Case 2: A user who ate gyoza for lunch
[1531] 1. Odor detection: The device detects a strong garlic odor from the user's breath.
[1532] 2. Data transmission: This odor component data is sent to the server.
[1533] 3. Smell analysis and identification: The server instructs the generative AI model to "identify the ingredients based on this smell data," and identifies "garlic."
[1534] 4. Fragrance generation and spraying: The server generates a citrus and basil fragrance recipe and sends it to the terminal, which then sprays it.
[1535] 5. Alert notification: The device will vibrate to notify the user that the garlic smell has been neutralized.
[1536] In this way, the system of the present invention can quickly and effectively address various odor problems faced by users, thereby enabling users to maintain a comfortable environment at all times.
[1537] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1538] Step 1:
[1539] Odor detection
[1540] The device uses an odor sensor to constantly monitor the air around the user. The sensor detects specific chemical components in real time and converts their concentrations into digital data. The input for this process is the chemical components in the surrounding air, and the output is digital data containing those chemical components. Specifically, the sensor detects the odor component of alcohol, and if its concentration exceeds a certain threshold, the data is recorded.
[1541] Step 2:
[1542] Data transmission
[1543] The device connects to the server using a wireless communication module (e.g., Wi-Fi or Bluetooth). Data on the detected odor components (chemical formula and concentration) is sent to the server. The input in this process is the digital data detected by the sensor, and the output is the odor component data sent to the server. Specifically, the device sends alcohol concentration data to the server via the Wi-Fi module.
[1544] Step 3:
[1545] Odor analysis and identification
[1546] The server uses a generative AI model to analyze the data received from the device. The AI model has been trained in advance on a variety of odor data and identifies specific odors based on the data. The input for this process is the transmitted odor component data, and the output is the identified odor type. Specifically, the server prompts the generative AI model, saying, "Please identify the component based on this odor data," and the response is "alcohol."
[1547] Step 4:
[1548] Creating a fragrance recipe
[1549] The server searches the database for fragrance recipes corresponding to the identified scent. If necessary, it runs an algorithm to generate a composite fragrance recipe corresponding to multiple scent components. The input to this process is the identified scent type, and the output is the generated fragrance recipe. Specifically, the server searches the database, finds "peppermint and rosemary" as a "fragrance recipe for alcohol," and sends it to the terminal.
[1550] Step 5:
[1551] Fragrance production and atomization
[1552] The device activates its built-in fragrance generator based on the fragrance recipe received from the server. It uses fragrance cartridges to extract and mix the required fragrances. The input for this process is the fragrance recipe, and the output is the generated fragrance. Specifically, the device activates the fragrance generator, extracts peppermint and rosemary fragrances in the specified ratio, and sprays them through the pump system.
[1553] Step 6:
[1554] Alert Notifications
[1555] The device vibrates or sounds an alert to notify the user that fragrance spraying is complete. An alert message is also displayed on the smartphone app or device display. The input during this process is the completion status of spraying, and the output is a notification to the user. Specifically, the device activates a vibration and displays a message on the smartphone app saying, "The smell of alcohol has been neutralized."
[1556] (Application example 1)
[1557] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1558] Conventional odor control systems have difficulty responding immediately to individual users' body odors and breath odors, and lack the functionality to efficiently notify administrators of odor detection and countermeasure implementation in specific spaces. This makes it difficult to immediately resolve odor-related discomfort, and there is a particular need for systems that can generate appropriate fragrances according to the strength and type of odor and quickly report on countermeasures.
[1559] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1560] In this invention, the server includes means for detecting odors, means for analyzing component data of the detected odors to identify specific odors, means for generating a fragrance recipe corresponding to the identified odor, means for automatically blending and spraying the generated fragrance, means for notifying the user of an alert, and means for detecting odors in a specific space and notifying an administrator that odor countermeasures have been completed. This makes it possible to immediately take appropriate odor countermeasures for the user or the specific space and quickly report the results to the administrator.
[1561] "Means for detecting odors" refers to technology that uses chemical sensors or electronic noses to detect odor components in a space in real time.
[1562] "Means for analyzing detected odor component data to identify specific odors" refers to the process of using AI models or machine learning algorithms to analyze detected odor components and identify their type.
[1563] "Means for generating a fragrance recipe corresponding to the identified smell" refers to a system that calculates and generates the appropriate fragrance composition and blend based on the analyzed smell information.
[1564] "Means for automatically blending and dispersing the resulting fragrance" refers to a device or mechanism that mixes fragrance according to a specified recipe and automatically disperses it into a space.
[1565] "Means of notifying the user of the alert" refers to a notification system for notifying the user of the detection of odors and the completion status of countermeasures, and includes forms such as vibration, sound, and smartphone notifications.
[1566] "Means of detecting odors in a specific space and notifying the administrator that odor control measures have been completed" refers to a function that detects odors and takes measures in a specific location, and reports the results to the administrator by email, app notification, etc.
[1567] The present invention is a system for odor detection, analysis, fragrance generation, spraying, and alert notification. The embodiments for implementing this system are described in detail below.
[1568] A means of detecting odors
[1569] The device's built-in odor sensor chemically detects odor components in the air and records the detected odor intensity and component data as digital data, which is then sent to a server when the odor exceeds a certain threshold.
[1570] A means of identifying specific odors by analyzing detected odor component data
[1571] The server receives the odor component data sent from the device and analyzes the odor using an AI model. This AI model is based on machine learning frameworks such as TensorFlow and PyTorch and is pre-trained to recognize various odor patterns, allowing it to identify specific odors such as alcohol, garlic, and sweat.
[1572] A means of generating fragrance recipes that correspond to identified odors
[1573] The fragrance recipe corresponding to the identified scent is retrieved from a database stored on the server, which uses an algorithm to generate a composite fragrance recipe corresponding to multiple scent components and transmits this recipe to the device.
[1574] Means for automatically blending and spraying the produced fragrance
[1575] The device activates the built-in fragrance generator based on the fragrance recipe received from the server. The device is loaded with fragrance cartridges, which automatically extract and mix the necessary fragrances according to the recipe, and then sprays the generated fragrance using a built-in pump system.
[1576] A means of notifying users of alerts
[1577] The device will alert the user by vibrating and / or making an audible notification that an odor has been detected and corrective action has been taken, and a notification will appear on the smartphone application or device display, allowing the user to confirm that the problem has been resolved.
[1578] A method for detecting odors in a specific space and notifying the administrator that odor control measures have been completed
[1579] When the system detects an odor in a specific space and the server generates and sprays the fragrance, it also includes a notification function that reports the results to the administrator. Notifications are sent via email or a smartphone app, allowing the administrator to immediately understand the status of the response.
[1580] Specific examples
[1581] 1. How to combat sweat odor in the fitting room:
[1582] The odor sensor detects the smell of sweat.
[1583] The server analyzes the sweat odor and generates a Silver Mountain Water fragrance.
[1584] The dispenser sprays the fragrance.
[1585] The app displays a notification saying, "Silver Mountain Water fragrance was used to combat the odor of sweat generated in the fitting room."
[1586] Prompt Sentence Examples
[1587] Regarding the odor that occurred in the fitting room today, please tell us the details of the fragrance you used and its effect.
[1588] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1589] Step 1:
[1590] Odor detection
[1591] The device uses a built-in odor sensor to continuously monitor the odor components in the air in the target area. The sensor detects the odor components based on chemical reactions and records their intensity and component data as digital data. If this data exceeds a threshold, the device proceeds to the next step.
[1592] Input: Odor components in the air
[1593] Data processing: Chemical detection and intensity measurement of odor components
[1594] Output: Digital data (odor components and their intensity)
[1595] Step 2:
[1596] Data transmission
[1597] The device transmits the detected odor component data, including the chemical formula and concentration of the detected odor component, to the server via a wireless communication module.
[1598] Input: Digital data (odor components and their intensity)
[1599] Data processing: Format conversion based on wireless communication protocol
[1600] Output: Odor component data sent to the server
[1601] Step 3:
[1602] Odor analysis and identification
[1603] The server analyzes the received odor component data and identifies specific odors using an AI model. This AI model has previously learned from a variety of odor data and is able to identify the type of odor with high accuracy.
[1604] Input: Received odor component data
[1605] Data Computing: Analysis and Classification of Odor Data with AI Models
[1606] Output: Identified odor type (e.g. alcohol, garlic, sweat, etc.)
[1607] Step 4:
[1608] Creating a fragrance recipe
[1609] Based on the identified scent, the server searches the database for a corresponding fragrance recipe and executes an algorithm to generate a composite fragrance recipe if necessary, which is then sent to the terminal.
[1610] Input: Identified odor type
[1611] Data processing: Database search and algorithmic fragrance recipe generation
[1612] Output: Fragrance recipe sent to the device
[1613] Step 5:
[1614] Fragrance production and spraying
[1615] Based on the received fragrance recipe, the device activates the built-in fragrance generator, automatically extracts and mixes the necessary fragrances from the fragrance cartridges, and then sprays the generated fragrance using the built-in pump system.
[1616] Input: Fragrance Recipe
[1617] Data processing: Extraction and blending of fragrances
[1618] Output: Atomized fragrance
[1619] Step 6:
[1620] Alert Notifications
[1621] The device will generate an alert via vibration or sound to notify the user that an odor has been detected and that countermeasures have been implemented. A notification will also appear on the smartphone application or device display, allowing the user to confirm that the problem has been resolved. Once odor detection and countermeasures have been completed in a specific space, the administrator will be notified via email or smartphone notification.
[1622] Input: Fragrance spray completion data
[1623] Data processing: Alert generation and notification sending
[1624] Output: Notification to users and administrators
[1625] As a result, the present invention makes it possible to implement highly efficient and accurate odor countermeasures and quickly notify users and administrators of the results.
[1626] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1627] This invention provides a system that not only automatically detects the user's scent and generates and sprays a fragrance that corresponds to that scent, but also recognizes the user's emotions and provides customized fragrances and alert messages based on those emotions. The system is mainly composed of a terminal, a server, and an emotion engine, and the main roles and processing flow of each are explained below.
[1628] Device features and operations
[1629] Odor detection
[1630] The device is equipped with a built-in odor sensor that constantly monitors the air around the user. The sensor chemically detects odor components and records their intensity as digital data. This data is sent to a server when a specific odor exceeds a set threshold.
[1631] Emotion recognition by emotion engine
[1632] The device uses an emotion engine to analyze the user's emotions in real time based on the user's facial expressions, voice, and biometric information, and this emotion data is also sent to the server.
[1633] Data transmission
[1634] The device establishes a connection with the server via a wireless communication module and transmits odor component data and emotion data to the server, including the chemical formulas and concentrations of the detected odor components and the user's emotional state.
[1635] Server Functions and Operations
[1636] Odor analysis and identification
[1637] The server receives the odor component data sent from the device, analyzes it using an AI model, and identifies specific odors. Identified odor types include alcohol, garlic, sweat, and body odor.
[1638] Emotional Data Analysis
[1639] The server analyzes the emotion data sent from the device and identifies the user's current emotional state, thereby understanding the user's psychological and physiological state.
[1640] Fragrance recipe creation and customization
[1641] The server searches a database for a basic fragrance recipe that corresponds to the identified scent, and then customizes this basic recipe according to the analyzed user's emotional state. For example, if the user is under stress, it adds ingredients that have a relaxing effect, or other elements that help with emotional care.
[1642] Data transmission
[1643] The server then sends the customized fragrance recipe and an appropriate alert message to the device, which is also tailored according to the user's emotional state.
[1644] Fragrance production and spraying
[1645] Auto-generation and spraying
[1646] The device activates its built-in fragrance generator based on the fragrance recipe received from the server. Fragrance cartridges are loaded into the device, which automatically extracts and mixes the necessary fragrances according to the recipe. The generated fragrance is sprayed appropriately around the user using a built-in pump system.
[1647] Alert Notifications
[1648] User Notification
[1649] The device generates an alert via vibration or sound to let the user know that an odor has been detected and that countermeasures have been implemented. Notifications are also displayed on the smartphone application and device display, with the alert message tailored to the user's emotional state. The user can confirm the notification and know that the problem has been resolved.
[1650] Specific examples
[1651] Case 1: User who drank alcohol last night
[1652] 1. Odor detection: The device detects a strong odor of alcohol from the user's breath.
[1653] 2. Emotion Recognition: The emotion engine detects when the user is in a relaxed state.
[1654] 3. Data transmission: Scent component data and emotion data are transmitted to the server.
[1655] 4. Analysis: The server identifies the alcohol and confirms that the user is relaxed.
[1656] 5. Fragrance Creation: Create a fragrance recipe by adding refreshing ingredients to the original recipe.
[1657] 6. Fragrance spray: The device produces and sprays peppermint and rosemary fragrance.
[1658] 7. Alert notification: The device will vibrate to notify the user and display the message "The smell of alcohol will disappear and you will feel refreshed."
[1659] Case 2: A user who ate gyoza for lunch
[1660] 1. Odor detection: The device detects a strong garlic odor from the user's breath.
[1661] 2. Emotion recognition: The emotion engine detects when the user is in a stressful state.
[1662] 3. Data transmission: Scent component data and emotion data are transmitted to the server.
[1663] 4. Analysis: The server identifies the user as "garlic" and determines that the user is in a stressed state.
[1664] 5. Fragrance Generation: Generate a fragrance recipe by adding relaxing ingredients to the original recipe.
[1665] 6. Fragrance spray: The device produces and sprays a citrus and lavender fragrance.
[1666] 7. Alert notification: The device will vibrate to notify the user and display the message "The garlic smell will disappear and have a relaxing effect."
[1667] As is clear from these examples, the present invention provides users with an easy-to-use and effective odor control and emotional care system. The integrated operation of the entire system can improve the user's quality of life.
[1668] The processing flow will be explained below.
[1669] Step 1: Smell detection
[1670] The device activates an odor sensor to monitor the air around the user. The sensor chemically detects odor components and records their intensity as digital data. The odor component data is temporarily stored in the device's internal memory.
[1671] Step 2: Check if the threshold is exceeded
[1672] The device determines whether the recorded odor component data exceeds a set threshold. If so, it sends the data to the server. If not, it continues odor detection.
[1673] Step 3: Emotion Recognition
[1674] The device also uses an emotion engine to analyze the user's facial expressions, voice, heart rate, and other biometric information to recognize the user's current emotional state. This emotional data is also sent to the server.
[1675] Step 4: Send data
[1676] The device establishes a connection with the server via a wireless communication module and transmits odor component data and emotion data to the server, including the chemical formulas and concentrations of the detected odor components and the user's emotional state.
[1677] Step 5: Data reception and analysis (Smell)
[1678] The server receives the odor component data sent from the device, analyzes this data using an AI model, and identifies specific odors. The identified odor types (e.g., alcohol, garlic, sweat, body odor) are recorded in a database.
[1679] Step 6: Data reception and analysis (emotions)
[1680] The server receives the emotion data sent from the device, analyzes it, and identifies the user's emotional state, such as relaxed or stressed, and stores the information in a database.
[1681] Step 7: Find and customize your fragrance recipe
[1682] The server searches a database for a basic fragrance recipe that corresponds to the identified scent, and then customizes this fragrance recipe based on the analyzed user's emotional state, for example by adding relaxing ingredients.
[1683] Step 8: Submit your fragrance recipe
[1684] The server then sends the customized fragrance recipe and appropriate alert messages to the device, including specific fragrance types, their amounts, and the alert messages.
[1685] Step 9: Start the fragrance generator
[1686] The device processes the fragrance recipe received from the server, stores it in its internal memory, and then activates the fragrance generator, which automatically extracts and mixes the required fragrance ingredients.
[1687] Step 10: Spray with fragrance
[1688] The device then uses a built-in pump system to spray the appropriate amount of fragrance around the user, controlling the timing and amount of spray to ensure the fragrance is distributed effectively.
[1689] Step 11: Re-detect odors
[1690] After spraying the fragrance, the device activates the odor sensor again to check whether the odor was properly neutralized. If the odor was not neutralized sufficiently, the cycle starts again from step 1.
[1691] Step 12: Alert Notification
[1692] The device generates an alert via vibration or sound to notify the user that an odor has been detected and that countermeasures have been implemented. An alert message is also displayed on the smartphone application or device display. The alert message is tailored to the user's emotional state. The user confirms the notification and realizes that the odor problem has been resolved.
[1693] Specific examples
[1694] Case 1: User who drank alcohol last night
[1695] 1. Odor detection: The device detects the strong odor of alcohol from the user's breath.
[1696] 2. Check if the threshold is exceeded: Check if the smell exceeds the threshold, and if it does, send the data to the server.
[1697] 3. Emotion Recognition: The emotion engine detects when the user is in a relaxed state and sends the emotion data to the server.
[1698] 4. Data transmission: Scent component data and emotion data are transmitted to the server.
[1699] 5. Data reception and analysis: The server identifies the condition as "alcohol" and confirms that the user is in a relaxed state.
[1700] 6. Customize fragrance recipes: Generate fragrance recipes by adding refreshing ingredients to the original recipe.
[1701] 7. Activate the fragrance generator: The device will generate a peppermint and rosemary fragrance.
[1702] 8. Spraying fragrance: Spray an appropriate amount of the fragrance you have created.
[1703] 9. Alert notification: Notifies the user by vibration and displays the message "The smell of alcohol disappears and has a refreshing effect."
[1704] Case 2: A user who ate gyoza for lunch
[1705] 1. Odor detection: The device detects a strong garlic odor from the user's breath.
[1706] 2. Check if the threshold is exceeded: Check if the smell exceeds the threshold, and if it does, send the data to the server.
[1707] 3. Emotion Recognition: The emotion engine detects when the user is in a stressful state and sends the emotion data to the server.
[1708] 4. Data transmission: Scent component data and emotion data are transmitted to the server.
[1709] 5. Data reception and analysis: The server identifies the user as "garlic" and confirms that the user is in a stressed state.
[1710] 6. Customize fragrance recipes: Generate fragrance recipes by adding relaxing ingredients to the original recipe.
[1711] 7. Activate fragrance generator: The device will produce a citrus and lavender fragrance.
[1712] 8. Spraying fragrance: Spray an appropriate amount of the fragrance you have created.
[1713] 9. Alert notification: Notify the user by vibration and display the message "The garlic smell will disappear and have a relaxing effect."
[1714] As is clear from these examples, the present invention provides users with an easy-to-use and effective odor control and emotional care system. The entire system works in an integrated manner to improve the user's quality of life.
[1715] Example 2
[1716] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1717] Conventional odor control systems were capable of detecting specific odors and generating and spraying fragrances, but they did not customize the system to take into account the user's emotional state. As a result, there were issues with the odor control being insufficiently effective or not being able to provide an appropriate fragrance according to the user's emotions. There was also a need for a system that could respond in a more detailed manner based on the intensity of the odor and the user's emotional state.
[1718] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1719] In this invention, the server includes means for detecting odors, means for analyzing component data of the detected odors to identify specific odors, means for collecting biometric information from the user and recognizing emotions, means for generating a fragrance recipe corresponding to the identified odor and the recognized emotion, means for automatically blending and spraying the generated fragrance, and means for issuing an alert to notify the user that countermeasures have been implemented. This makes it possible to address the user's emotions while also taking measures against odors, and automatically provide the most appropriate fragrance depending on the situation.
[1720] The "means for detecting odors" is a device that chemically detects odor components in the air around the user and records their intensity as digital data.
[1721] The "means for analyzing detected odor component data to identify specific odors" refers to a system that analyzes collected odor component data and executes algorithms or models to identify specific odors.
[1722] The "means for collecting biometric information of the user and recognizing emotions" refers to a device or algorithm that collects biometric information such as the user's facial expression, voice, heart rate, or skin potential, and analyzes it to identify the user's emotional state.
[1723] The "means for generating a fragrance recipe corresponding to the identified smell and the recognized emotion" is a system that determines the appropriate fragrance ingredients and their blending method based on the identified smell and the user's emotional state.
[1724] The "means for automatically blending and spraying the generated fragrance" is a system that extracts and mixes the necessary fragrance ingredients based on the generated fragrance recipe and sprays them around the user at the appropriate time using a built-in pump system.
[1725] "Means for sending an alert to inform the user that countermeasures have been implemented" refers to a device or system that generates an alert via vibration, notification sound, or a display or smartphone application to inform the user that odor countermeasures have been completed.
[1726] "Means for transmitting odor component data to a server when the odor intensity exceeds a set threshold" refers to a system that transmits odor component data to a server via wireless communication when the odor detection result exceeds a preset threshold.
[1727] "Means for analyzing odor component data using an AI model and identifying emotions from the user's biometric information" is a system that inputs collected odor component data and biometric information into an AI model and identifies specific odors and the user's emotional state through complex analysis.
[1728] This system not only automatically detects the user's scent and generates and sprays a fragrance that corresponds to that scent, but also recognizes the user's emotions and provides customized fragrances and alert messages based on those emotions. This system is mainly composed of a terminal, a server, and an emotion engine.
[1729] Device features and operations
[1730] Odor detection
[1731] The device is equipped with a built-in odor sensor that constantly monitors the air around the user. This odor sensor chemically detects volatile organic compounds and records their intensity as digital data. The recorded data is automatically sent to a server when it exceeds a set threshold. For example, if a strong odor of alcohol or garlic is detected, that data is sent to the server.
[1732] emotion recognition
[1733] The device is equipped with a camera, microphone, and biosensors to collect biometric information such as the user's facial expression, voice, heart rate, and skin potential. This data is input into an emotion engine, which analyzes the user's emotional state in real time. The analysis results, along with odor component data, are sent to a server.
[1734] Data transmission
[1735] The device uses a wireless communication module such as Wi-Fi or Bluetooth to transmit odor component data and emotional data to a server, including the chemical formulas and concentrations of the detected odor components and the user's emotional state.
[1736] Server Functions and Operations
[1737] Odor analysis and identification
[1738] The server receives the odor component data sent from the device and analyzes it using an AI model. This AI model identifies specific odors and identifies specific odors such as alcohol, garlic, sweat, and body odor. For each identified odor, the server retrieves the associated fragrance recipe from the database.
[1739] Emotional Data Analysis
[1740] The server analyzes the emotional data sent from the device and identifies the user's current emotional state. This allows the server to understand the user's psychological and physiological state. For example, if the user is under stress, the server customizes the experience accordingly.
[1741] Fragrance recipe creation and customization
[1742] The server generates an appropriate fragrance recipe based on the identified smell and the analyzed emotional state. This recipe starts with a basic one and is customized according to the user's emotional state. For example, if the user is stressed, a fragrance recipe with added ingredients that have a relaxing effect is generated.
[1743] Data transmission
[1744] The server then sends the customized fragrance recipe and an appropriate alert message to the device, which is also tailored according to the user's emotional state.
[1745] Fragrance production and spraying
[1746] Auto-generation and spraying
[1747] The device activates its internal fragrance generator based on the fragrance recipe received from the server. A fragrance cartridge is loaded into the device, which automatically extracts and mixes the necessary fragrances according to the recipe. The generated fragrance is sprayed appropriately around the user using a built-in pump system.
[1748] Alert Notifications
[1749] User Notification
[1750] The device generates an alert via vibration or sound to notify the user that an odor has been detected and that countermeasures have been implemented. The device also displays a notification in the smartphone application or on the device display, with the alert message tailored to the user's emotional state. The user can confirm the notification and know that the problem has been resolved.
[1751] Specific examples
[1752] Case 1: User who drank alcohol last night
[1753] 1. The device detects a strong odor of alcohol from the user's breath.
[1754] 2. The emotion engine detects when the user is in a relaxed state.
[1755] 3. Smell component data and emotion data are sent to the server.
[1756] 4. The server identifies the alcohol and confirms that the user is relaxed.
[1757] 5. The server generates a fragrance recipe that adds a refreshing ingredient to the original recipe.
[1758] 6. The device will produce and spray a peppermint and rosemary fragrance.
[1759] 7. The device will vibrate to notify the user and display the message "The smell of alcohol will disappear and you will have a refreshing effect."
[1760] Case 2: A user who ate gyoza for lunch
[1761] 1. The device detects a strong garlic odor from the user's breath.
[1762] 2. The emotion engine detects when the user is in a stressful state.
[1763] 3. Smell component data and emotion data are sent to the server.
[1764] 4. The server identifies the user as "garlic" and confirms that the user is in a stressed state.
[1765] 5. The server generates a fragrance recipe that adds relaxing ingredients to the original recipe.
[1766] 6. The device produces and sprays a citrus and lavender fragrance.
[1767] 7. The device will vibrate to notify the user and display the message "The garlic smell will disappear and you will feel relaxed."
[1768] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1769] Step 1:
[1770] Odor monitoring
[1771] Input: The air around the user
[1772] Processing: The device constantly monitors the odor components in the air around the user using a built-in odor sensor. The sensor chemically detects volatile organic compounds and records their intensity as digital data.
[1773] Output: Digital data of odor components (data format example: [chemical formula: C2H5OH, concentration: 50 ppm])
[1774] Step 2:
[1775] Data recording and threshold determination
[1776] Input: Digital data of odor components
[1777] Processing: Pre-processing the recorded data to set a specific threshold and determine whether the odor component data exceeds the set threshold. This threshold determination determines whether or not necessary countermeasures are taken.
[1778] Output: Threshold judgment result (true or false)
[1779] Step 3:
[1780] Preparing to send data
[1781] Input: Digital data of threshold judgment results and odor components
[1782] Processing: If the threshold is exceeded, the device prepares to send the odor component data and the user's emotion data to the server.
[1783] Output: Transmission data packet (smell component data, emotion data)
[1784] Step 4:
[1785] emotion recognition
[1786] Input: User's biometric information (facial expression, voice, heart rate, etc.)
[1787] Processing: The device uses a camera, microphone, and biosensors to collect the user's biometric information and input it into the emotion engine, which analyzes this information to determine the user's emotional state in real time.
[1788] Output: Emotion data (data format example: [Emotion: Relaxed, Intensity: 70%])
[1789] Step 5:
[1790] Sending data to the server
[1791] Input: Transmission data packet (scent component data, emotion data)
[1792] Processing: The odor component data and emotion data are sent to the server via a wireless communication module, using Wi-Fi, Bluetooth, etc.
[1793] Output: Data sent to the server
[1794] Step 6:
[1795] Odor analysis and identification
[1796] Input: Sent odor component data
[1797] Processing: The server inputs the received odor component data into an AI model, analyzes it, and identifies specific odors, such as alcohol, garlic, sweat, and body odor.
[1798] Output: Identified odor (data format example: [Odor: Alcohol])
[1799] Step 7:
[1800] Emotional Data Analysis
[1801] Input: Emotion data sent
[1802] Processing: The server analyzes the received emotion data and identifies the user's current emotional state, thereby understanding the user's psychological and physiological state.
[1803] Output: Identified emotional state (Example data format: [Emotion: Relaxed])
[1804] Step 8:
[1805] Fragrance recipe creation and customization
[1806] Input: identified odor, identified emotional state
[1807] Processing: Based on the identified scent and the identified emotional state, the server retrieves a basic fragrance recipe from the database and customizes it based on the emotional state, for example by adding ingredients that have a relaxing effect.
[1808] Output: Customized fragrance recipe (data format example: [Ingredients: Peppermint, Rosemary])
[1809] Step 9:
[1810] Sending customized fragrance data
[1811] Input: Customized fragrance recipe, alert message
[1812] Processing: The server sends a customized fragrance recipe and an alert message to the device, which is tailored according to the user's emotional state.
[1813] Output: Data sent to the terminal
[1814] Step 10:
[1815] Automatic fragrance generation and spraying
[1816] Input: Customized fragrance recipe
[1817] Processing: The device activates its internal fragrance generator based on the received fragrance recipe. It extracts the necessary fragrances from the fragrance cartridges, mixes them together to create the fragrance, and then sprays the created fragrance appropriately using the built-in pump system.
[1818] Output: Sprayed fragrance
[1819] Step 11:
[1820] Alert Notifications
[1821] Input: Alert message from the server
[1822] Action: The device will generate an alert by vibrating or sounding to let the user know that the action has been taken, and will also display a notification in the smartphone application or on the device display to let the user know that the action has been taken.
[1823] Output: Message notified to the user
[1824] (Application example 2)
[1825] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1826] To improve passenger comfort and safety in autonomous vehicles, a system that monitors passenger odors and emotional states in real time and automatically generates and sprays appropriate fragrances accordingly is required. However, conventional technologies perform odor detection and emotion recognition separately, making it difficult to provide a comfortable in-car environment through integrated processing.
[1827] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1828] In this invention, the server includes means for detecting odors, means for analyzing component data of the detected odors to identify specific odors, means for recognizing a user's emotions, means for generating a fragrance recipe corresponding to the identified odor and the recognized emotion, means for automatically blending and spraying the generated fragrance, and means for notifying the user of an alert, thereby enabling real-time odor countermeasures and emotional care in autonomous vehicles.
[1829] The "means for detecting odors" is a device installed in a vehicle that chemically detects odor components in the surrounding air and acquires the data.
[1830] "Means for analyzing detected odor component data to identify specific odors" refers to a function that analyzes acquired odor component data using an AI model, etc., to identify specific odors.
[1831] The "means for recognizing the user's emotions" is a function that uses cameras and microphones inside the vehicle to analyze the user's facial expressions and voice and grasp their emotional state in real time.
[1832] The "means for generating a fragrance recipe corresponding to the identified smell and the recognized emotion" is a function that automatically creates a formula for generating an optimal fragrance based on the identified smell data and emotion data.
[1833] The "means for automatically blending and spraying the created fragrance" is a function for automatically blending fragrances based on the created fragrance recipe and spraying them inside the vehicle at the appropriate time.
[1834] "Means for notifying users of alerts" refers to features such as displays and audio systems that notify passengers when an odor or emotion-related issue is detected or when corrective measures are implemented.
[1835] The "wireless communication module" is a communication device that transmits and receives data between the inside of the vehicle and an external server.
[1836] A "fragrance generating device" is a device that mixes multiple fragrances and generates and sprays an appropriate fragrance based on a specified fragrance recipe.
[1837] An "emotion engine" is software or hardware that analyzes a user's emotional state based on facial expression analysis, voice analysis, and biometric analysis.
[1838] The present invention is a system for improving the in-car environment by generating customized fragrances based on the smell and emotional state of passengers in autonomous vehicles. This system is realized using hardware and software such as odor sensors and cameras installed in the vehicle, a server, an emotion engine, and a fragrance generator.
[1839] System Configuration and Operation
[1840] Odor detection
[1841] The terminal (on-board device) is equipped with a built-in odor sensor that constantly monitors the air inside the vehicle. The sensor chemically detects odor components and digitizes and records the data. This data is sent to a server via a wireless communication module when a specific odor exceeds a certain threshold.
[1842] Emotion recognition by emotion engine
[1843] The device uses an in-car camera to monitor passengers' facial expressions and voices in real time and analyzes them using an emotion engine. This emotion data is also sent to the server via a wireless communication module. The emotion engine uses AI models such as OpenCV and TensorFlow.
[1844] Analysis of odor and emotion data
[1845] The server uses an AI model to analyze the odor component data sent from the device and identify specific odors (e.g., "alcohol," "garlic," etc.) and analyzes the emotion data to identify the passenger's current emotional state (e.g., "relaxed," "stressed," etc.).
[1846] Fragrance recipe creation and customization
[1847] The server searches a database for a fragrance recipe that corresponds to the identified smell and then customizes it based on that recipe, adding ingredients that have a relaxing or refreshing effect depending on the passenger's emotional state.
[1848] Auto-generation and spraying
[1849] The device activates its internal fragrance generator based on the fragrance recipe received from the server. Fragrance cartridges are loaded into the device, which automatically extracts and mixes the necessary fragrances according to the recipe. The generated fragrance is then sprayed appropriately into the vehicle interior using the device's pump system.
[1850] Alert Notifications
[1851] Once activated, the device will alert passengers with vibrations and sounds, and will also display a notification on the vehicle's display. The alert message will also be tailored to the passenger's emotional state. Examples of notifications include "The smell of alcohol will disappear, giving you a refreshing effect" and "The smell of garlic will disappear, giving you a relaxing effect."
[1852] Specific examples
[1853] Case 1: A passenger who drank alcohol last night
[1854] 1. Smell detection: Smell sensors inside the car detect the smell of alcohol.
[1855] 2. Emotion Recognition: The emotion engine detects when a passenger is relaxed.
[1856] 3. Server analysis: Alcohol is detected and passengers are confirmed to be relaxed.
[1857] 4. Fragrance Generation: Create a fragrance recipe with refreshing ingredients.
[1858] 5. Fragrance spray: Produces and sprays peppermint and rosemary fragrance.
[1859] 6. Alert notification: Displays the message "The smell of alcohol disappears and you will feel refreshed."
[1860] Case 2: A passenger who ate gyoza for lunch
[1861] 1. Odor detection: Odor sensors inside the car detect the smell of garlic.
[1862] 2. Emotion Recognition: The emotion engine detects when a passenger is in a stressful state.
[1863] 3. Server analysis: Garlic is detected and passenger is confirmed to be in a stressed state.
[1864] 4. Fragrance generation: Generate fragrance recipes with relaxing ingredients.
[1865] 5. Fragrance spray: Produces and sprays citrus and lavender fragrance.
[1866] 6. Alert notification: Displays the message "The garlic smell will disappear and have a relaxing effect."
[1867] Prompt Sentence Examples
[1868] "Was a strong odor detected inside the vehicle? If so, what was the composition and intensity of that odor?"
[1869] "What is the passenger's current emotional state? For example, stressed or relaxed?"
[1870] "Generate fragrance recipes based on scent ingredients and emotional state. For example, if you're stressed, add ingredients that have a relaxing effect."
[1871] This system will enable real-time odor control and emotional care within autonomous vehicles.
[1872] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1873] Step 1:
[1874] An odor sensor in the terminal constantly monitors the air inside the vehicle. The odor sensor detects odor components in the surrounding air and digitizes the data. The input is data on the air inside the vehicle, and the output is digitized odor component data.
[1875] Step 2:
[1876] The device analyzes the odor component data and sends it to the server if it exceeds a certain threshold. The data is processed by checking the concentration of the digitized odor component data and performing a calculation to determine whether it exceeds the threshold. The input is the odor component data, and the output is the odor component data that exceeds the threshold.
[1877] Step 3:
[1878] The device uses an in-car camera to monitor passengers' facial expressions and voices in real time. It uses an emotion engine (such as OpenCV or TensorFlow) to acquire emotion data. The input is camera footage and voice data, and the output is analyzed emotion data.
[1879] Step 4:
[1880] The terminal transmits the odor component data and emotion data to the server via the wireless communication module. The input is the odor component data that exceeds the threshold and the emotion data, and the output is the data transmitted to the server.
[1881] Step 5:
[1882] The server uses an AI model to analyze the odor component data sent from the device and identify specific odors. The AI model analyzes the odor component data and performs calculations to determine the type of odor. The input is the odor component data received from the device, and the output is the identified odor data.
[1883] Step 6:
[1884] The server analyzes the emotional data to identify the user's current emotional state. It uses an AI model for the analysis and determines the emotional state. The input is the emotional data received from the device, and the output is the determined emotional state.
[1885] Step 7:
[1886] The server generates a fragrance recipe according to the identified smell and the recognized emotion. Here, it takes a basic recipe from the database and customizes it according to the emotional state. The input is the identified smell data and the emotional state data, and the output is a customized fragrance recipe.
[1887] Step 8:
[1888] The server sends the generated fragrance recipe to the terminal, where the input is the customized fragrance recipe and the output is the fragrance recipe sent to the terminal.
[1889] Step 9:
[1890] The terminal activates the fragrance generator based on the received fragrance recipe. The fragrance generator extracts and mixes the necessary ingredients from the fragrance cartridges. The input is the fragrance recipe, and the output is the generated fragrance.
[1891] Step 10:
[1892] The terminal sprays the generated fragrance into the car interior using a pump system. The input is the generated fragrance and the output is the sprayed fragrance.
[1893] Step 11:
[1894] The terminal notifies the user that the problem has been resolved by displaying an alert message on the display or audio system. The input is the data indicating the fragrance spray success, and the output is the alert message.
[1895] This process enhances passenger comfort and safety, while also providing integrated odor management and emotional care.
[1896] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.
[1897] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1898] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.
[1899] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[1900] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.
[1901] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.
[1902] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).
[1903] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.
[1904] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."
[1905] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.
[1906] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).
[1907] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.
[1908] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.
[1909] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[1910] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.
[1911] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example ...
Claims
1. A means for detecting an odor; A means for analyzing the detected odor component data and identifying a specific odor; means for generating a fragrance recipe corresponding to the identified odor; means for automatically blending and spraying the resulting fragrance; a means for notifying a user of the alert; A system including:
2. The system according to claim 1 , further comprising means for transmitting odor component data to a server when the odor intensity exceeds a set threshold.
3. The system of claim 1 further comprising means for analyzing the odor component data using an AI model.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A