Information processing device, cartridge, delivery device, N-dimensional code, control method, and computer program
Through the information processing device and the spray control system, the olfactory or taste receptor response information encoding and control is used to solve the complex problem of combining multiple odor substances in the prior art, and a method of accurately reproducing the target odor or taste is achieved.
Patent Information
- Application Number
- CN202380023907.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-04-12
- Filing Date
- 2023-02-28
- Publication Date
- 2024-11-29
AI Technical Summary
The prior art is difficult to effectively combine substances of various odors or flavors to reproduce the target odor, and the combination method is complex, resulting in difficulty in reproducing.
An information processing device is designed to obtain the response information of the olfactory or taste receptor, encode it into an NR code, and decide to release the relevant odor or taste substance based on the information, and use the release control unit to control the spray device to release specific substances, so as to Reproduce the target smell or taste.
The target odor or taste is reproduced regardless of the differences in human individual perception, and the accuracy and simplicity of odor reproduction are improved.
Smart Images

Figure CN119053858A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an information processing device, a box, a discharging device, an N-dimensional code, a control method, and a computer program. Background Art
[0002] In recent years, technologies related to odor quantification methods have been proposed. For example, Patent Document 1 discloses a technology in which a predetermined ligand is made to act on a receptor array in which predetermined receptors are arranged throughout the entirety, and the activity of each receptor is measured. In addition, Patent Document 1 discloses a method in which two or more standard substances (fragrances) are combined based on the activation of each receptor measured for the target substance and the standard substance to reproduce the odor of the target substance.
[0003] Prior art literature
[0004] Patent Literature
[0005] Patent Document 1: International Publication No. 2019 / 035476 Summary of the invention
[0006] Problems to be solved by the invention
[0007] However, in order to reproduce the target odor, a plurality of substances related to the perception of odor or taste are combined, but the combination of substances and the combination method are relatively large, so it is difficult to reproduce the target odor.
[0008] The present invention has been made in view of such circumstances, and an object of the present invention is to reproduce a target odor or taste regardless of individual differences in human perception.
[0009] Means for solving problems
[0010] In order to achieve the above object, one solution of the present invention is an information processing device having:
[0011] an acquisition unit that acquires receptor response information, wherein the receptor response information is information indicating responses of a plurality of olfactory receptors or taste receptors;
[0012] a storage unit storing the receptor response information;
[0013] a release information determination unit that determines release information based on the receptor response information, the release information being information on the release of a plurality of substances related to the perception of smell or taste; and
[0014] The emission control unit is used to emit at least one substance among the plurality of substances related to the perception of smell or taste based on the emission information.
[0015] In addition, in order to achieve the above object, one solution of the present invention is
[0016] A cartridge for filling the above-mentioned information processing device with the substance related to the perception of smell or taste, wherein:
[0017] The cartridge is filled with a composition that causes only specific receptors to selectively respond.
[0018] In addition, in order to achieve the above-mentioned object, one solution of the present invention is a discharge device, which has:
[0019] A mounting portion for mounting the box; and
[0020] A release port releases the substance related to the perception of smell or taste based on the release control performed by the release control unit.
[0021] In addition, in order to achieve the above-mentioned object, one embodiment of the present invention is a method for producing an odor or taste, wherein:
[0022] The method comprises the step of using the above-mentioned releasing device to release the substance related to the perception of smell or taste.
[0023] In addition, in order to achieve the above-mentioned object, one embodiment of the present invention is a data structure of the receptor response information used in the above-mentioned information processing device.
[0024] In order to achieve the above object, one aspect of the present invention is a method for controlling an information processing device, comprising a coding step of converting the receptor response information into an N-dimensional code by performing a predetermined coding on the receptor response information.
[0025] In addition, in order to achieve the above-mentioned object, one solution of the present invention is a control method of an information processing device, which comprises:
[0026] an acquisition step of acquiring receptor response information, wherein the receptor response information is information indicating responses of a plurality of olfactory receptors or taste receptors;
[0027] a release information determining step of determining release information according to the receptor response information, wherein the release information is information on the release of a plurality of substances related to the perception of smell or taste; and
[0028] The step of controlling the release is used to release at least one substance among the plurality of substances related to the perception of smell or taste based on the release information.
[0029] In addition, in order to achieve the above-mentioned object, one solution of the present invention is a computer program, which is used to execute using a computer:
[0030] an acquisition step of acquiring receptor response information, wherein the receptor response information is information indicating responses of a plurality of olfactory receptors or taste receptors;
[0031] a release information determining step of determining release information according to the receptor response information, wherein the release information is information on the release of a plurality of substances related to the perception of smell or taste; and
[0032] The step of controlling the release is used to release at least one substance among the plurality of substances related to the perception of smell or taste based on the release information.
[0033] Effects of the Invention
[0034] According to the present invention, it is possible to reproduce the smell or taste of a target regardless of individual differences in human perception. BRIEF DESCRIPTION OF THE DRAWINGS
[0035] Figure 1 : is a figure which shows the outline of the smell reproduction method of this embodiment.
[0036] Figure 2 : is a figure which shows the outline of the smell reproduction method of this embodiment.
[0037] Figure 3 It is a diagram schematically showing the structure of a spray control system.
[0038] Figure 4 It is a block diagram showing the hardware structure of the server.
[0039] Figure 5 This is a functional block diagram showing an example of the functional structure of a server.
[0040] Figure 6 This is a flowchart showing the operation of the spray control process.
[0041] Figure 7 It is a diagram showing an overview of an odor reproduction method according to another embodiment.
[0042] Figure 8 is a block diagram showing the structure of a conversion device.
[0043] Fig. 9 This is an example of a graph showing the correlation between the value of the target variable when converted using the conversion device and the value after the conversion.
[0044] Fig.10 This is an example of a graph showing the correlation between the value of the target variable when converted using the conversion device and the value after the conversion.
[0045] Fig.11 This is an example of a graph showing the correlation between the value of the target variable when converted using the conversion device and the value after the conversion.
[0046] Fig.12 This is an example of a graph showing the correlation between the value of the target variable when converted using the conversion device and the value after the conversion.
[0047] Fig.13 This is a block diagram showing the structure of a prediction model creation device.
[0048] Fig.14 This is an example of a graph showing the correlation between the value of the target variable when converted using the conversion device and the value after the conversion.
[0049] Fig.15 This is an example of a graph showing the correlation between the value of the target variable when converted using the conversion device and the value after the conversion. DETAILED DESCRIPTION
[0050] (First Embodiment)
[0051] <Summary>
[0052] Generally speaking, when the receptor is an olfactory receptor, the odor molecule binds to a protein called an olfactory receptor expressed on the surface of the olfactory nerve cells in the nasal cavity, triggering information transmission in the olfactory nerve cells, and the odor information is transmitted to the brain. As for olfactory receptors, it is believed that there are about 400 types in humans based on genome analysis. It can be understood that a certain olfactory receptor group is activated to different degrees for a specific odor molecule, and these stimuli are transmitted to the brain for combination, thereby recognizing various odors in the brain.
[0053] In this embodiment, the following example is described: a predetermined ligand is made to act on a receptor array in which the above-mentioned olfactory receptors (OR: Olfactory Receptor) are fully configured, and an odor is reproduced based on the result obtained by measuring the activity of each receptor. In this embodiment, the following example is described: as the predetermined receptors, a plurality of receptors (for example, 30 types of receptors) among the olfactory receptors that have a greater impact on human perception are used. It should be noted that this is not limited to olfactory receptors, and the same can be implemented for taste receptors. The following is an illustration of this embodiment using the accompanying drawings.
[0054] Figure 1 FIG. 2 is a diagram showing an overview of a method for reproducing an odor using an information processing device according to the present embodiment. Figure 1 In the example, the following is shown: content introducing food and beverage (e.g., ramen) in a restaurant is distributed to viewers, and the smell of the food and beverage is reproduced on the viewer side using a predetermined device. It should be noted that, as content, for example, content distributed via terrestrial broadcasting, satellite broadcasting, the Internet, etc. can be cited.
[0055] exist Figure 1In the example of , a predetermined camera device is used to capture images of customers taking food and drinks in a restaurant, and an odor capturing device CO is used to capture the odor (eg, gas) of the food and drinks.
[0056] The captured odor is analyzed in the receptor information determination device 2 and converted into response information of a specified receptor.
[0057] The converted response information is sent to the server 1. Then, the server 1 sends the content and the response information to each content reproduction device RE.
[0058] The content reproduction device RE transmits the content to a predetermined display device TV based on a content viewing request, and transmits spray information based on response information corresponding to the content to the scent spray device 3.
[0059] The scent spray device 3 is provided with a plurality of scent boxes CA, and the fragrance (such as gas, liquid or powder, etc.) extracted from the plurality of scent boxes CA is sprayed (ejected, injected) via a variable spray nozzle (nozzle NO). Figure 2 Describes response information and spray information.
[0060] It should be noted that, in the present embodiment, an example of releasing fragrance from the release device (scent spray device 3) is described, but it is not limited to fragrance, and the object of release is a substance related to the perception of odor or taste. Here, the substance related to the perception of odor or taste includes agonist, antagonist, modulator, etc.
[0061] An agonist is a substance that, when bound to a receptor, causes an effect to be enhanced or expressed.
[0062] Antagonists are substances that, when bound to a receptor, act inhibitorily or prevent the binding of other agonists.
[0063] A modulator is a substance that, although it does not stimulate a response itself, amplifies or reduces the stimulus response of an agonist or antagonist. In other words, a modulator is a substance that binds to a site other than the ligand binding site and increases or decreases the action of an olfactory receptor or a taste receptor.
[0064] Figure 2 This is a diagram for explaining an example of a flow from extracting a feature amount from a captured odor, generating response information, and finally generating spray information.
[0065] At ST1, the receptor information determination device 2 allows a predetermined ligand (odor molecule) to act on a receptor array in which predetermined receptors are arranged throughout, and measures the activity of each receptor (primary receptor response information). The method for measuring the activity of each receptor is not particularly limited, and for example, data can be obtained through actual experiments as described in Patent Document 1 or as described later, or by collecting manually input data or virtual data obtained from a machine learning model.
[0066] At ST2, the receptor information determination device 2 extracts the characteristic amount of the target odor based on the measured activity of each receptor. The method of extracting the characteristic amount is not particularly limited, and for example, the method described in Patent Document 1 can be used.
[0067] The characteristic quantity is the response characteristic of the olfactory receptor to the test substance (response information; receptor response information), for example, the response intensity in each receptor, the area of response intensity, response duration, response speed, peak time, response rise (timing), number of peaks, etc.
[0068] At reference numeral ST3, response information of each receptor (secondary receptor response information) is generated based on the above-mentioned feature amount. Figure 2 In the example of , four receptors OR1 to OR4 are exemplified, but the type (number) of receptors is not particularly limited. Figure 2 In the example, the characteristic value of each receptor is illustrated by a binary number, but the method of digitizing the characteristic value is not particularly limited, for example, it can be represented by other bases such as decimal numbers, or it can be represented by a character string.
[0069] In other words, the response information is information indicating at least one characteristic quantity of the multiple receptors to the odor molecules, such as the response intensity, the area of the response intensity, the response persistence, the response speed, the peak time, the rise of the response, and the number of peaks. It should be noted that the response information is not limited to the above information, and may also be various parameters of the multiple receptors to the odor molecules.
[0070] At reference numerals ST4 and ST5, the response information is encoded and converted into an N-dimensional code (N is an integer greater than or equal to 1) and transmitted.
[0071] In this embodiment, an example in which an N-dimensional code is a two-dimensional code is described. The two-dimensional code of this embodiment has a data portion and one or more image-finding patterns arranged separately from the data portion, and the data portion represents a bit string corresponding to the object data as a pattern in which white or black units as constituent units of a symbol are arranged in a matrix. In addition, the data portion contains information based on receptor response information (e.g., the above-mentioned response characteristics, response information), and the receptor response information is obtained using an olfactory receptor or a taste receptor that is responsive to an extracellular substance (e.g., an odor molecule).
[0072] That is, the figure mark ST4 can also be understood as a coding step of converting the (receptor) response information into an N-dimensional code (for example, a two-dimensional code) by executing the control method of the information processing device (server 1) with a computer and performing a prescribed encoding on the data corresponding to the above-mentioned (receptor) response information, wherein the data is data used to determine the release information related to the release of multiple substances, and the substances are related to the perception of smell or taste.
[0073] At reference numeral ST6, on the viewer side, the N-dimensional code is decoded and converted into the original response information.
[0074] That is, reference numeral ST6 is a control method of the information processing device (server 1), and can also be understood as a decoding step of converting the N-dimensional code (eg, two-dimensional code) into (recipient) response information by performing a predetermined decoding on the N-dimensional code.
[0075] At reference numeral ST7, for example, the response information is converted into spray information for spraying the reproduced scent using the server 1. Figure 2 In FIG. 1 , spray information of cartridges CA1 to CA4 corresponding to receptors OR1 to OR4 is shown. That is, the fragrance for stimulating receptor OR1 is filled in cartridge CA1.
[0076] It should be noted that in Figure 2 In the example of one-to-one correspondence between receptors and boxes, the present invention is not limited to this, and boxes of more or less types than the types (number) of receptors can be used. That is, one box CA can provide (stimulate) or adjust (block or modulate) the response of multiple receptors. In this way, by using a box CA that stimulates multiple receptors, the size of the odor spray device 3 can be reduced and the cost can be suppressed.
[0077] For example, when stimulating the receptors OR1 and OR3, the following cartridge CA can be used to spray the odor.
[0078] ·Box CA filled with a substance that stimulates receptors OR1 and OR3
[0079] In addition, for example, when stimulating the receptors OR1 to OR5, the following three types of cartridges CA can be used to spray the odor.
[0080] · Box CA filled with a substance (agonist) that stimulates receptors OR1, OR3, OR5, OR6
[0081] · Box CA filled with a substance (agonist) that stimulates receptors OR2, OR4, OR6
[0082] ·Box CA filled with a substance (antagonist) that prevents other substances from binding to receptor OR6
[0083] Spray information is information used to reproduce the target odor by combining and spraying one or more of a variety of fragrances, such as the spray time, spray amount, spray temperature, number of sprays, spray port flow rate, spray direction, etc. of the fragrance.
[0084] At reference numeral ST8, the fragrance is sprayed by the scent spraying device 3 based on the spraying information, thereby providing the audience of the content with a scent (fragrance) that reproduces the target scent.
[0085] As the scent spray device 3, various devices such as a display device (television), a smart phone, a projection device (projector), and an HMD (head mounted display) are assumed.
[0086] It should be noted that it is not necessary to associate with the content. For example, a predetermined user-specified odor may be sprayed. In this case, the odor item and the response information or spray information corresponding to the odor item are stored in a predetermined storage unit in advance.
[0087] It should be noted that, in the above example, an N-dimensional code obtained by replacing the target odor with electronic data is used as the digital odor information, but for example, the extracted feature (reference numeral ST2) or the secondary receptor response information (reference numeral ST3) may also be used (may be circulated) as the digital odor information. That is, the feature, the secondary receptor response information or the N-dimensional code may also be understood as a thing representing the data structure of the receptor response information used in the server 1 (information processing device).
[0088] It should be noted that, as in the present embodiment, when reproducing the smell of the target, a substance related to the smell perception (e.g., fragrance) is sprayed (released), but as a modified example, when reproducing the taste of the target described later, a substance related to the taste perception (e.g., seasoning) is released. That is, the "spray" used in the present embodiment is a subordinate concept of "release".
[0089] <System Structure>
[0090] Figure 3 This is a diagram showing an overview of the system configuration of the spray control system (smell reproduction system) according to the present embodiment.
[0091] The spray control system of this embodiment is composed of a server 1, a collection device CO, a receptor information determination device 2, a content reproduction device RE, a display device TV, and an odor spray device 3 connected to each other via a predetermined network N such as the Internet.
[0092] The server 1 performs various processes in cooperation with the actions of the receptor information determination device 2, the content reproduction device RE, the display device TV, and the scent spray device 3.
[0093] The odor capture device CO captures the corresponding odor. Figure 1 As shown, the odor may be captured in real time when the image related to the content is captured, or the odor may be captured at a timing different from the timing when the image related to the content is captured.
[0094] The receptor information determination device 2 analyzes the odor captured by the above-mentioned odor capture device CO. The receptor information determination device 2 can analyze the components contained in the odor (for example, gas or liquid), but in this embodiment, the receptor response information (the result obtained by allowing a predetermined ligand to act on a receptor array in which receptors are fully arranged and measuring the activity of each receptor) obtained by using an olfactory receptor that is responsive to the above-mentioned odor (odor molecule) is analyzed. In this way, when reproducing the odor, it is possible to reproduce the target odor using a component different from the target odor.
[0095] It should be noted that the receptor information determination device 2 may use the receptor analysis response characteristics as described in Patent Document 1, or may analyze the response characteristics based on components included in the odor molecules.
[0096] The content reproduction device RE displays (reproduces) the video content etc. on the display device TV. In addition, the content reproduction device RE transmits spray information in the video content to the scent spray device 3 so that the scent spray device 3 sprays the fragrance at a predetermined timing.
[0097] It should be noted that in this embodiment, for example, since a display device TV such as a digital signage is also assumed, a content reproduction device RE is provided, but content can be sent directly from the server 1 to the display device TV. In addition, spray information can also be sent directly from the server 1 to the scent spray device 3.
[0098] The display device TV displays content. In this embodiment, an example is described in which the display device TV is provided with the odor spray device 3 described later, but the display device TV and the odor spray device 3 may be independent and different devices. In addition, the display device TV is described as an example of a display device, but it is not limited to this, and it may be a projection device such as a projector, for example.
[0099] The scent spray device 3 sprays the fragrance based on the spray information to reproduce the target scent. In this embodiment, the scent spray device 3 is provided with an installation portion (not shown) for installing the box CA (scent box) and a nozzle NO (variable spray nozzle), but it is not limited to this.
[0100] The box CA is a box for filling a fragrance for spraying a predetermined information processing device (server 1, content reproduction device RE, etc.), and is a box filled with a composition that selectively responds to only a specific receptor. It should be noted that the composition is not limited to a composition that selectively responds to only a specific receptor, and may also be a composition that responds to multiple receptors. It should be noted that a plurality of boxes CA with different compositions are installed in the odor spray device 3.
[0101] The nozzle NO is a spray port that sprays a predetermined fragrance based on spray control (spray information) performed by a predetermined information processing device (server 1, content playback device RE, etc.).
[0102] <Hardware Structure>
[0103] Figure 4 The server 1 is a block diagram showing the hardware configuration of the server 1 of the present embodiment. The server 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, an output unit 16, an input unit 17, a storage unit 18, a communication unit 19, and a driver 20.
[0104] The CPU 11 executes various processes according to the program recorded in the ROM 12 or the program loaded from the storage unit 18 into the RAM 13. The RAM 13 also stores data and the like required when the CPU 11 executes various processes. The CPU 11, the ROM 12, and the RAM 13 are connected to each other via a bus 14. In addition, an input / output interface 15 is also connected to the bus 14.
[0105] The input / output interface 15 is connected to an output unit 16, an input unit 17, a storage unit 18, a communication unit 19, and a driver 20. The output unit 16 is composed of a display, a speaker, etc., and outputs various information as images or sounds. The input unit 17 is composed of a keyboard, a mouse, etc., and inputs various information. The storage unit 18 is composed of a hard disk, a DRAM (Dynamic Random Access Memory), etc., and stores various data. The communication unit 19 communicates with other devices via a network N including the Internet.
[0106] A removable medium 21 composed of a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory is appropriately installed in the drive 20. A program read from the removable medium 21 by the drive 20 is installed in the storage unit 18 as needed. In addition, the removable medium 21 can also store various data stored in the storage unit 18 in the same way as the storage unit 18.
[0107] It should be noted that, although not shown in the figure, the collection device CO, the receptor information determination device 2, the content reproduction device RE, the display device TV, and the odor spray device 3 have Figure 4 The hardware structure shown.
[0108] <Functional Structure>
[0109] Figure 5 This is a functional block diagram showing an example of the functional configuration of the server 1 according to the present embodiment.
[0110] Server 1
[0111] In the CPU 11 of the server 1, when in operation, the response information acquisition unit 31, the captured image acquisition unit 32, the model information acquisition unit 33, the spray information determination unit 34, the spray control unit 35, the display control unit 36, and the like function.
[0112] The response information acquisition unit 31 acquires receptor response information obtained using a plurality of receptors including olfactory receptors (or taste receptors) responsive to extracellular substances. Specifically, the response information acquisition unit 31 acquires the response information analyzed using the receptor information determination device 2 .
[0113] It should be noted that the acquired response information (receptor response information) is stored in the response information DB 41. Here, the response information is bound to the above-mentioned content (or the time information of the content) and stored. Thus, for example, the target smell can be reproduced at an appropriate timing in the content.
[0114] The captured image acquisition unit 32 acquires content including at least one of audio information and video information. For example, the content is obtained by using Figure 1 The image information captured by the camera shown. In addition, the content is, for example, content distributed from a terrestrial wave method, satellite broadcasting, or various distribution servers in a non-real time situation. It should be noted that, in the case of only reproducing the smell of the target, the acquisition of various contents by the captured image acquisition unit 32 may not be performed.
[0115] The model information acquisition unit 33 acquires model information of the display device TV, the scent spray device 3, etc. Thus, for example, spray information suitable for the scent spray device 3 can be determined in the process of determining spray information described later. Specifically, spray information corresponding to the type of the cartridge CA of the scent spray device 3 can be determined. It should be noted that the acquired model information is stored in the model information DB 42.
[0116] The model information acquisition unit 33 may acquire fragrance (box) information. Thus, for example, in the process of determining spray information described later, a table (or learning model) corresponding to the box (type) in the association between receptor information and spray information can be referred to.
[0117] The spray information determination unit 34 determines spray information related to the spray of the scent among the plurality of fragrances based on the response information.
[0118] For example, the spray information determination unit 34 determines the spray information based on the response information and a predetermined association table (not shown). In addition, the response information and the spray information are associated with each other in advance in the association table and stored in the association DB 43.
[0119] Here, for example, in the association table, the response information and the spray information are associated with each other in the following correlation relationship.
[0120] The higher the "response intensity", the more "fragrance spray volume"
[0121] The higher the "response intensity area (integral value)", the greater the "fragrance spray amount"
[0122] The higher the "response duration", the longer the "fragrance spray time"
[0123] The faster the "response speed", the higher the "fragrance spray temperature"
[0124] The faster the "peak time", the higher the "fragrance spray temperature"
[0125] The more the "response rise" is, the higher the "fragrance spray temperature" is.
[0126] The more "peaks", the more "fragrance spray times"
[0127] The higher the “response intensity”, the less the “spray outlet throttling flow”
[0128] It should be noted that the following correlation between response information and spray information is an example and is not limited to the following example, and these information can be combined. For example, the greater the "response speed" and "response rise", the higher the "fragrance spray temperature" can be considered.
[0129] In addition, for example, the spray information determination unit 34 uses a learning model to determine the spray information based on the response information. It should be noted that the learning model is a machine learning-based model that uses learning data (training data) that sets receptor response information and spray information corresponding to the receptor response information, learns the correspondence between the two, and outputs the spray information based on the response information. In this embodiment, the above-mentioned learning model is stored in the associated DB43. It should be noted that the learning method in machine learning is not particularly limited, and can be unsupervised learning, reinforcement learning, deep learning, etc. In addition, multiple learning methods can be combined.
[0130] The spray information determination unit 34 may determine the spray information in consideration of the model information. That is, the spray information determination unit 34 may determine the spray information using the association table or learning model corresponding to the number (type) of cartridges CA included in the model information.
[0131] In addition, the spray information determination unit 34 can determine the spray information related to the scent spray according to the space parameters based on the above-mentioned response information.
[0132] The space parameters are parameters related to the state of the space where the scent is sprayed or the positional relationship with the object (the object person or the object) where the scent is sprayed, and specifically, various parameters such as the room where the scent is sprayed, the area of the space, the distance between the scent spray device 3 and the nose, the air volume, the wind direction, the temperature, and the humidity. With regard to the space parameters, a predetermined acquisition unit (not shown) can acquire the space parameters sensed by a sensor provided in the scent spray device 3 or other external devices.
[0133] For example, in a movie theater where the position of a person's nose (face) can be determined to some extent (in the case of direct spraying), the spray information determination unit 34 can control the spray direction, spray amount, spray concentration, etc. based on the distance from the nose or temperature, humidity, etc.
[0134] In addition, for example, in the case of a larger space such as a sports field (in the case of indirect spraying), the spray information determination unit 34 can control the spray direction, spray amount, spray concentration, etc. based on the area, wind volume, wind direction, temperature, humidity, etc. of the space.
[0135] It should be noted that the association between the environmental parameters and the spray information can be performed using the above-mentioned correspondence table or using a learning model.
[0136] The spray control unit 35 (release control unit) sprays at least one fragrance among the plurality of fragrances (plurality of cartridges CA) based on the spray information. In other words, the spray control unit 35 sends the spray information to the scent spray device 3 (display device TV).
[0137] The display control unit 36 transmits the above content to the display device TV. It should be noted that the display control unit 36 associates the content with the identification information of the spray information. Thereby, for example, multiple target scents can be sprayed multiple times at multiple timings during the display of the content.
[0138] 《Scent Spray Device 3》
[0139] As described above, the scent spray device 3 may be configured to include a mounting portion and a discharge port (nozzle NO), and a discharge control portion (discharge control means) functions in a CPU (not shown) of the scent spray device 3 during operation.
[0140] The release control unit is a functional unit for causing at least one substance among a plurality of substances to be released from the cartridge CA based on release information related to the release of the plurality of substances related to the perception of smell or taste.
[0141] In addition, the release control unit can determine (authenticity determination) whether the box CA meets the specified criteria. For example, the release control unit can make the above determination by obtaining information in the IC chip set in the box CA. Here, the box CA has a shell, an IC chip, and an interface for transferring data between the IC chip and the release control unit. The shell can be detachably installed in the installation part of the odor spray device 3 and accommodates a variety of substances related to the perception of odor or taste. The IC chip includes a non-volatile memory for storing data and a computing device for performing control processing. This structure is set because: when reproducing the odor in the odor spray device 3, if the fragrance in the box CA deteriorates over time or is reused and filled with fragrances that do not meet the specified criteria, etc., or is not of the desired quality, it may not be possible to reproduce the appropriate odor (or taste).
[0142] For example, when a predetermined number of days (e.g., half a year) has passed since the start timing of the use of the cartridge CA (e.g., at the time of manufacturing, installation, or initial use), the release control unit may warn that the cartridge CA has deteriorated over time, or output a message urging the replacement of the cartridge CA, or restrict the use of the odor spray device 3. The start timing of the use of the cartridge CA is stored in the IC chip provided in the cartridge CA as described above.
[0143] It should be noted that the identification information of the cartridge CA is stored in the nonvolatile memory of the IC chip provided in the cartridge CA, and the identification information and information such as the use start timing associated with the identification information may also be stored in the storage unit 18 in the server 1 .
[0144] It should be noted that the discharge control unit may update the above-mentioned information such as the use start timing when the cartridge CA satisfies a predetermined criterion.
[0145] In addition, the release control unit can adjust the release information according to the use state of the cartridge CA. For example, when the cartridge has been used for a predetermined period of time, the release control unit can spray more fragrance of the cartridge CA than usual or extend the spraying time.
[0146] <Processing content>
[0147] Figure 6 1 is a diagram showing an example of the spray control process of the present embodiment. In the present embodiment, an example of performing the spray control process using the server 1 is described, but the present invention is not limited thereto, and the spray control process may be performed in the scent spray device 3, for example.
[0148] In step S11 , the response information acquisition unit 31 acquires the response information of the receptor corresponding to the target odor.
[0149] In step S12 , the captured image acquisition unit 32 acquires video information as content.
[0150] In step S13 , the model information acquisition unit 33 acquires model information of the scent spray device 3 and the like.
[0151] In step S14, the spray information determination unit 34 determines spray information related to the spray of the scent among the plurality of fragrances based on the response information.
[0152] In step S15, the spray control unit 35 transmits the spray information to the scent spray device 3 (display device TV).
[0153] In step S16 , the display control unit 36 transmits the content to the display device TV.
[0154] <Beneficial Effects of the Present Embodiment>
[0155] According to the above embodiment, when the content is reproduced (when viewing and listening), the fragrance can be sprayed in association with the position of the content over time (time axis). As a result, since the content can be viewed and listened to not only visually and auditorily but also olfactorily, the sense of immersion in the content and the sense of unity with the shooting scene can be improved. In addition, for example, by using VR glasses (HMD) to function as the above-mentioned scent spray device, the sense of immersion can be further improved.
[0156] In addition, according to the above-mentioned embodiment, by emitting the target smell synchronously with the image, for example, an advertising effect can be expected. For example, even outdoors, a display model equipped with a smell spray function can be prepared, and a predetermined menu can be selected (a button can be selected by the customer), so that a smell matching the dish can be instantly reconstructed and sprayed together with the image of the dish. By changing the scheme of the reconstruction, it is possible to deal with the smell of various dishes.
[0157] In addition, according to the above-mentioned embodiment, it is possible to communicate with a friend in a remote place through smell. For example, when explaining a certain experience, not only language, gestures, images, and photos, but also smell can be introduced as an element, thereby adding depth to the sharing of the experience. In this way, smoother and deeper communication can be carried out.
[0158] In addition, the above embodiment can also be used for demonstration. For example, when developing products, it can be considered that explanations are sometimes carried out using online meetings. In particular, fragrance may become an important factor in food or cosmetics. However, it is difficult for a remote person to smell the smell directly. Therefore, by applying the above embodiment, it is possible to share the smell with a remote person on the other side of the screen in the form of screen sharing, and it can be expected that the probability of successful negotiation will increase.
[0159] As mentioned above, although one embodiment of the present invention has been described, the present invention is not limited to the above-mentioned embodiment, and modifications, improvements, etc. within the scope that can achieve the object of the present invention are also included in the present invention.
[0160] (Variation Example)
[0161] It should be noted that in the above embodiment, an example is described in which the nozzle NO sprays the fragrance according to the spray time, etc., but the nozzle NO can spray the fragrance in the direction where a person is present based on information obtained by a predetermined human sensor. In addition, when outdoors, a wind direction sensor can be used to determine the spray direction according to the wind direction. In this way, the target smell can be reproduced more accurately for the user who views the audio-visual content.
[0162] In addition, in the above-mentioned embodiment, an example of reproducing the smell of a target associated with the content is described, but it is not limited to this. For example, a specified smell (such as "the smell of soy sauce ramen") can be made independent, obtained from a specified memory (library) and reproduced. In this way, it is possible to reproduce using spices (of the box CA) that replace rare natural spices, etc., or to reproduce toxic odors with non-toxic spices. In addition, it is also possible to use pre-set (using pre-prepared response information) "spices that stabilize mood", "spices that improve concentration", "spices that promote sleep", etc. to bring a relaxing effect to the user.
[0163] In the above embodiment, there is no alarm function based on smell, but the server 1 can function as an infectious disease detector, a cancer detector, a Parkinson's disease detector, or a health management toilet based on smell. For example, the following situation can be imagined: odors are collected and reproduced to medical personnel at a remote location for diagnosis.
[0164] In addition, in the above-mentioned embodiment, an example of generating response information using human olfactory receptors or taste receptors is described, but response information can also be generated using receptors other than human. Thus, for example, it can be applied to insect repellents (such as insecticides) and attractants. In addition, this can be applied to countermeasures against harmful animals.
[0165] Furthermore, in the above-described embodiment, an example in which the target smell is reproduced at a timing corresponding to the content has been described, but the smell may be sprayed at various timings.
[0166] For example, a request can be sent from the odor spray device 3 to the server 1 according to the user's operation. When the request is accepted, the above-mentioned spray control unit 35 sends spray information. When the spray information is accepted, the odor spray device 3 reproduces the target odor.
[0167] In addition, for example, the scent spray device 3 may receive spray information in advance, and reproduce the target scent through control of the scent spray device 3 according to the user's operation.
[0168] In the above embodiment, an example in which the spray control unit 35 transmits spray information is described, but the number of sprays may be managed based on the upper limit number of sprays of the target scent.
[0169] For example, the spray control unit 35 may determine whether to transmit the spray information based on the upper limit number of times and the number of spray completions stored in a predetermined storage unit.
[0170] It should be noted that the management of the upper limit number and the number of spray completions can be managed by the odor spray device 3. In this case, the spray control unit 35 sends the upper limit number together with the spray information. In addition, the odor spray device 3 can determine whether to send the spray information based on the upper limit number and the number of spray completions stored in the specified storage unit.
[0171] Furthermore, in the above-described embodiment, the smell spray control in which a fragrance is sprayed (released) to reproduce a target smell is described, but it can also be applied to a smell release control in which a seasoning is released to reproduce a target smell.
[0172] That is, as the response information to the taste, information such as response intensity, area of response intensity, response duration, response speed, peak time, response rise, number of peaks, etc. are input instead of the above-mentioned response information to the odor molecules.
[0173] In addition, as flavor release information, information such as the release time, release amount, release temperature, release frequency, release outlet flow rate, etc. of substances related to the taste perception (such as seasonings) is output instead of the above-mentioned odor spray information.
[0174] Furthermore, in the above-described embodiment, an example of reproducing an odor (or taste) when reproducing video content or the like has been described, but the present invention can also be applied to a virtual space such as a so-called metaverse.
[0175] For example, it is possible to consider releasing the scent of perfume or the like in accordance with the words and deeds of the avatar during a trip in a virtual space (domestic travel, overseas travel, space travel, etc.). In addition, for example, it is also possible to consider using blockchain technology to convert the scent code of a specified perfume into an NFT (Non-Fungible Token), to validate it as a copyright, or to circulate it as a virtual currency.
[0176] As a result, in the circulation of products accompanied by scents or flavors (such as perfumes), the actual transportation of the products can be omitted and the products can be delivered to consumers immediately.
[0177] In the above embodiment, the response information is converted into spray information using a corresponding table or a learning model, but the response information may be directly sent without using them. In this case, it is conceivable to reproduce the smell to some extent by using a box CA corresponding to the receptor OR in the smell spray device 3.
[0178] Thus, for example, for a low-cost version of the scent spray device 3, it is possible to send response information and use it according to the situation without using a corresponding table or the like.
[0179] (Second Embodiment)
[0180] Figure 7 FIG. 2 is a diagram showing an overview of a smell reproduction method using an information processing device according to the second embodiment. Figure 7 In the example, the following is shown: content introducing food and beverages (such as ramen) in a restaurant is distributed to viewers (in real time), and the smell of the food and beverages is reproduced on the viewer side using a predetermined device. It should be noted that, as content, for example, content distributed via terrestrial broadcasting, satellite broadcasting, the Internet, etc. can be listed.
[0181] exist Figure 7 In the example of , a predetermined camera device is used to capture images of customers taking food and drinks in a restaurant, and an odor capturing device CO is used to capture the odor (eg, gas) of the food and drinks.
[0182] The collected odor is analyzed in the real-time odor analysis device NA (gas detection device U100), and converted into response information of a predetermined receptor in the receptor information determination device 2 (conversion device).
[0183] The converted response information is sent to the server 1. Then, the server 1 sends the content and spray information to each content reproduction device RE.
[0184] The content reproduction device RE transmits the content to a predetermined display device TV based on a content viewing request. In addition, the content reproduction device RE transmits spray information corresponding to the content to the scent spray device 3.
[0185] The scent spray device 3 is provided with a plurality of scent cartridges CA, and fragrances (eg, liquid or powder) extracted from the plurality of scent cartridges CA are sprayed (ejected, injected) via a variable spray nozzle (nozzle NO).
[0186] Reference Figure 8 to Figure 1 6. Description Figure 7 The receptor information determines the device 2 (conversion device).
[0187] First, before describing the conversion device U1 , the prediction model creation device U2 , the conversion information creation method, the prediction model creation method, and the program according to each embodiment, the outline of the conversion device U1 will be described.
[0188] First, the purpose of using the conversion device U1 is explained.
[0189] A system for determining the type of odor using a gas sensor has been proposed. However, it is difficult to correctly identify and determine the type of odor felt by a person using only a gas sensor. The reason for this is that the detection element of the gas sensor is composed of a material that does not conform to the human sense (smell). Therefore, even if various detection elements and analysis methods are proposed, it is difficult to determine and distinguish the type of odor.
[0190] Although there are studies that forcibly bind the output of gas sensors to human sensory tests through machine learning, the data of sensory tests are evaluated differently according to each person, so high-precision judgments based on the above studies have not yet been achieved. There are also studies that use the SMILES (Simplified molecular input lineentry system) notation method to string the chemical structure of molecules into English numbers to strengthen the binding between gas sensor output and sensory test results. However, although the prediction accuracy is improved, due to the fact that the information of molecules without odor is mixed, high-precision determination, discrimination, and prediction of odor types are not achieved. In this regard, if the gas sensor output can be expressed in quantitative numerical values of human sense of smell, the odor judgment based on human sense of smell can be performed with high precision.
[0191] The conversion device U1 is, for example, a device that converts output information output from a specified device with a gas detection function (hereinafter, also referred to as a gas detection device U100) for a specified odor molecule into response information representing the response of an olfactory receptor. Thus, the conversion device U1 converts output information of different values output from each of the gas detection devices U100 with different analysis methods for the same odor molecule into one response information as a response of the olfactory receptor U200 that can obtain the same result. Thus, the conversion device U1 can achieve binding of the output information of the gas detection device U100 with one response information regardless of the difference in the analysis method of the gas detection device U100. For example, the conversion device U1 can achieve binding of output information with different values or units for one odor molecule from multiple gas detection devices U100 with one response information as a so-called odor prototype. In the following embodiment, the conversion device U1 converts the output information into response information using a learning model obtained by pre-machine learning.
[0192] Next, the gas detection device U100 will be described.
[0193] The gas detection device U100 is, for example, a gas sensor or a mass spectrometer (gas chromatography-mass spectrometer). The gas sensor outputs a specified electrical signal (e.g., voltage value, resistance value, or current value), a frequency change, a wavelength change of light, or an activation degree caused by exposure of the odor molecules to the olfactory receptors as output information according to the type and concentration of the specified odor molecules. For example, the gas detection device U100 outputs an electrical signal with a larger voltage value as the concentration of the odor molecules it contacts increases. In addition, the mass spectrometer outputs, for example, scatter plots representing mass charge and its intensity as chart data regarding the type and concentration of the odor molecules.
[0194] Next, the olfactory receptor U200 will be described.
[0195] The olfactory receptor U200 can be realized by using a known olfactory receptor shown in Patent Document 1, etc., for example. The olfactory receptor U200 is, for example, a nucleic acid that is in contact with a substrate (not shown) and carried. The nucleic acid includes a nucleic acid containing a gene that encodes a prescribed receptor. There are multiple nucleic acids in contact with the substrate, and various nucleic acids are arranged separately from each other on the substrate. By contacting cells with nucleic acids on the substrate, cells that transiently express olfactory receptors corresponding to various nucleic acids are generated on the spot.
[0196] The receptor in this scheme is likely to change the cell state by contacting the test substance with the cell. Specifically, changes in intracellular calcium concentration or intracellular cAMP concentration may occur. For this change, it is possible to measure by using cAMP-sensitive pigments, cAMP-sensitive fluorescent proteins, calcium-sensitive pigments or calcium-sensitive fluorescent proteins. For example, by measuring the brightness changes caused by cAMP-sensitive pigments or cAMP-sensitive fluorescent proteins, the activation of the receptor can be quantitatively calculated. The activation is used as response information or response information representing the response of the olfactory receptor U200.
[0197] The olfactory receptor may be an olfactory receptor of a human, a mammal, an insect or a nematode. In addition, the olfactory receptor is not limited to a liquid test substance, but may also be in a form that contacts and responds to a gaseous (gaseous) test substance. The latter form of the olfactory receptor can also be used as either the gas detection device U100 or the olfactory receptor U200. In other words, it is also possible to convert between the response information of the olfactory receptor to the gaseous test substance and the response information of the olfactory receptor to the liquid test substance.
[0198] The olfactory receptor is not limited to the form expressed in the above-mentioned cells, and may be in a cell-free form.
[0199] For example, liposomes can be arranged on a substrate in a spaced relationship, wherein the liposomes are formed by a lipid bilayer membrane such as a cell membrane, and various olfactory receptors are present in the membrane. The size of the liposome is not particularly limited, and typically, the diameter can be about 100 nm. The method for preparing the liposome is not particularly limited, and may include the following steps: separating cells expressing olfactory receptors into a cell membrane component (which may include intracellular information transmission proteins such as G protein, adenylate cyclase, and cyclic nucleotide-dependent channels) and a cytoplasmic component (which may include intracellular information transmission substances such as GDP, GTP, ATP, and cAMP), and mixing, stirring, and fusing the two.
[0200] Alternatively, the olfactory receptor protein itself can be used as a probe of the substrate. Here, it is preferred to maintain the three-dimensional structure of the olfactory receptor in a state of penetrating the cell membrane. Nanodiscs are, for example, membrane scaffold proteins (MSP: membrane scaffold protein) composed of variants of apolipoprotein A1 (APOA1). Since they can aggregate lipid bilayer membranes into discs (Timothy H. Bayburt, Yelena V. Grinkova, and Stephen G. Sligar Nano Letters 2002 2 (8), 853-856), they can maintain membrane proteins in a state of penetrating lipid membranes even outside the cell (Civjan NR, Bayburt TH, Schuler MA, Sligar SG. Direct solubilization of heterologously expressed membrane proteins by incorporation into adenoscale lipid bilayers. Biotechniques. 2003 Sep; 35 (3): 556-60, 562-3). In addition, the substrate on which the nanodisk is arranged is not particularly limited, and may be a carbon nanotube FET (Field Effect Transistor) (Yang H, Kim D, Kim J, Moon D, Song HS, Lee M, Hong S, Park TH. Nanodisc-Based Bioelectronic Nose Using Olfactory Receptor Produced in Escherichia coli for the Assessment of the Death-Associated Odor Cadaverine. ACS Nano. 2017 Dec 26; 11(12): 11847-11855. doi: 10.1021 / acsnano), a carbon nanotube FET, etc. The method for preparing the nanodisk is not particularly limited, and may include the following steps: expressing and recovering in Escherichia coli or the like to form MSP, mixing the solubilized membrane protein with a phospholipid dissolved in water using a surfactant, removing the surfactant by dialysis or the like, thereby forming the nanodisk by self-assembly.
[0201] By using these olfactory receptors in a cell-free form and measuring changes in current, voltage, impedance, etc. caused by a test substance, it is also possible to quantitatively evaluate the degree of receptor activation.
[0202] Next, refer to Figures 8 to 12The conversion device U1, conversion information creation method, and program according to the second embodiment of the present invention will be described. Note that in this embodiment, a gas sensor will be described as an example of the gas detection device U100.
[0203] The conversion device U1 converts the output information output from the specified gas detection device U100 to the specified odor molecule into the response information indicating the response of the olfactory receptor U200. In addition, the conversion device U1 of this embodiment outputs the converted response information, and outputs the word (term) indicating the specified odor characteristic according to the converted response information. Figure 8 As shown, the conversion device U1 includes an output information acquisition unit U11, a conversion unit U12, and an output unit U13.
[0204] The output information acquisition unit U11 is implemented, for example, by CPU operation. The output information acquisition unit U11 acquires output information output from the gas detection device U100 for a specified odor molecule. The output information acquisition unit U11 acquires, for example, a voltage value output from the gas detection device U100 by sensing a specified odor (odor molecule) as output information. The output information acquisition unit U11 can acquire, for example, output information remotely measured by the gas detection device U100.
[0205] The conversion unit U12 is implemented, for example, by CPU operation. The conversion unit U12 converts the obtained output information into response information based on the output signal output from the plurality of gas detection devices U100 for each of the plurality of odor molecules and the response information indicating the response of the olfactory receptor U200 to each of the plurality of odor molecules. In the present embodiment, the conversion unit U12 converts the obtained output information into response information indicating the response of the olfactory receptor U200 using a prediction model, wherein the prediction model is a model obtained by performing machine learning using the output information output from the plurality of gas detection devices U100 for each of the plurality of odor molecules as an explanatory variable and the plurality of response information indicating the response of the olfactory receptor U200 to each of the plurality of odor molecules as a target variable.
[0206] The conversion unit U12 uses, for example, a prediction model that is a model obtained by using numerical values, functions, spatial or time series indicators calculated using mathematical, statistical or machine learning methods of the output information output from the gas detection device U100, or variables newly created using feature engineering as explanatory variables and performing machine learning. In addition, the conversion unit U12 uses a prediction model that is a model obtained by using numerical values, functions, spatial or time series indicators calculated using mathematical, statistical or machine learning methods of the response information of the olfactory receptor U200, or variables newly created using feature engineering as target variables and performing machine learning. The conversion unit U12 uses, for example, a prediction model to convert the acquired output information into response information, and the prediction model is a model obtained by using time series data and the number of eigenvalue patterns of the output information output from multiple gas detection devices U100 as explanatory variables, and using time series data and the number of eigenvalue patterns of the response information of multiple olfactory receptors U200 as target variables and performing machine learning.
[0207] In the present embodiment, the conversion unit U12 uses the presence or absence of output information of multiple gas detection devices U100 as an explanatory variable and performs machine learning to obtain a prediction model. In addition, in the present embodiment, the conversion unit U12 uses the presence or absence of reactions of multiple receptors included in the olfactory receptor U200 as a target variable and performs machine learning to obtain a prediction model. In addition, in the present embodiment, the conversion unit U12 uses the mass charge and intensity of the output information output from the gas detection device U100 as explanatory variables and performs machine learning to obtain a prediction model. Thus, the conversion unit U12 converts the conversion voltage value represented by a voltage value, a resistance value, a current value, a frequency change, or a wavelength change of light into response information representing the degree of activation of the olfactory receptor U200.
[0208] The output unit U13 is realized by, for example, the operation of a CPU. The output unit U13 outputs the converted response information. The output unit U13 outputs, for example, by displaying the response information. The output unit U13 digitizes the activation degree and outputs it as the response information.
[0209] Next, the procedure of this embodiment will be described.
[0210] Each configuration included in the conversion device U1 can be realized by hardware, software, or a combination thereof. Here, realization by software means that the computer reads a program and executes it.
[0211] The program can be stored and supplied to the computer using various types of non-transitory computer readable media. Non-volatile computer readable media include various types of tangible recording media (tangible storage medium). Examples of non-volatile computer readable media include magnetic recording media (e.g., floppy disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, semiconductor memories (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, RAMs (random access memory)). In addition, the display program can be supplied to the computer using various types of volatile computer readable media (transitory computer readable medium). Examples of volatile computer readable media include electrical signals, optical signals, and electromagnetic waves. Volatile computer readable media can supply the program to the computer via a wired communication path such as an electric wire or an optical fiber, or a wireless communication path.
[0212] Next, examples of this embodiment will be described.
[0213] (Example 1)
[0214] As the olfactory receptor U200, an array sensor including 400 olfactory receptors is used. And, a predetermined odor is exposed to the olfactory receptor expressing cells for a predetermined time. The concentration of the odor is 500 μM to 10 μM. In addition, for 12 types of gas detection devices U100 (gas sensors), the predetermined odor is exposed for a predetermined time and output information is obtained. And, the conversion device U1 is used to convert the output information into response information. In addition, the activation degree after exposure to the expression cells of the olfactory receptor U200 is measured.
[0215] Here, as the odor molecules measured, hexyl acetate, hexylbutyrate, butyl butyrate, 2,7-octadienol, cis-2-penten-1-ol, toluene, beta-ionone, benzothiazole, methylcyclopentene, acetic acid, coumarin, 1,2,4-trimethylbenzene, 2-ethylhexanol, propionaldehyde, 4-isopropylphenol, bis(methylthio)methane, 1,2,4,5-tetramethylbenzene, benzene), 3-methyl-1-butanol (3-methyl-1-butanol), E-2-nonenal (E-2-nonenal), m-cresol (m-cresol).
[0216] In data processing, Python was used as the language of the prediction model. In addition, as the algorithm of the prediction model, each of random forest, support vector machine and gradient boosting decision tree was used for evaluation. In addition, as the prediction model, a model made by regression was used. As the learning method, supervised learning was used. As the model evaluation method, the determination coefficient was mainly used for evaluation.
[0217] In the case of using random forest based regression, such as Fig. 9 As shown, the vertical axis is set to the predicted value (response information) output from the prediction model, and the vertical axis is set to the actual value of the target variable (activation degree of olfactory receptor U200 expressing cells), and a regression determination coefficient of 0.834 can be obtained (1.0 is set to the maximum).
[0218] In the case of using support vector machine-based regression, such as Fig.10 As shown, the regression coefficient of determination is 0.871. In addition, when using regression based on gradient boosting decision tree, as shown in Fig.11 As shown, the regression determination coefficient is 0.847. Therefore, it can be seen that the predicted value can be sufficiently correlated with the actual value of the target variable. In other words, it can be seen that the output information can be quantified.
[0219] (Example 2)
[0220] The sensor data for a certain odor molecule is learned to create a model of the olfactory receptor U200 that predicts the reaction and its activation degree. The experimental conditions and experimental procedures of the gas detection device U100 and the olfactory receptor U200 unit array sensor are set to be the same as those in Example 1. In data processing, category classification is used. As a language, python is used. As an algorithm, a neural network is used. When associating the output information of the gas detection device U100 with the response information of the olfactory receptor U200, a category classification model is created. The learning method is set to supervised. The number of hidden layers is not limited, and two layers are implemented in this embodiment. The model evaluation uses the overall accuracy and the loss function.
[0221] The output information of the gas detection device U100 is set as an explanatory variable, and the response information indicating the response of the olfactory receptor U200 is set as a target variable.
[0222] like Fig.12 As shown in the figure, when the number of learning times is about 500, the prediction accuracy is maintained high at about 0.9, and the loss is maintained low at about 0.3. Thus, the above prediction model can be created.
[0223] As described above, according to the conversion device U1, conversion information creation method, and program of the first embodiment, the following effects are achieved.
[0224] (1) The conversion device U1 is a conversion device that converts output information output from a specified gas detection device U100 for a specified odor molecule into response information indicating the response of the olfactory receptor U200, and includes: an output information acquisition unit U11 that acquires output information output from the gas detection device U100 for a specified odor molecule; a conversion unit U12 that converts the acquired output information into response information based on the output signal output from the multiple gas detection devices U100 for each of the multiple odor molecules and the response information indicating the response of the olfactory receptor U200 to each of the multiple odor molecules; and an output unit U13 that outputs the converted response information. Thus, the output information can be converted into a type of response information and output, and the output information can be obtained from various gas detection devices U100. Therefore, the correlation between the gas detection devices U100 can be obtained.
[0225] (2) The conversion unit U12 converts the acquired output information into response information indicating the response of the olfactory receptor U200 using a prediction model, wherein the prediction model is a model obtained by performing machine learning using the output information output from the plurality of gas detection devices U100 for each of the plurality of odor molecules as an explanatory variable and the plurality of response information indicating the response of the olfactory receptor U200 to each of the plurality of odor molecules as a target variable. By using machine learning, the conversion accuracy can be further improved.
[0226] (3) The conversion unit U12 uses a prediction model obtained by performing machine learning using numerical values, functions, spatial or time series indicators calculated using mathematical, statistical or machine learning methods of output information output from the gas detection device U100, or variables newly created using feature engineering as explanatory variables. This can improve conversion accuracy.
[0227] (4) The conversion unit U12 uses a prediction model that is obtained by performing machine learning using numerical values, functions, spatial or time series indicators calculated using mathematical, statistical or machine learning methods using the response information of the olfactory receptor U200, or variables newly created using feature engineering as target variables. This can improve conversion accuracy.
[0228] (5) The conversion unit U12 converts the acquired output information into response information using a prediction model, wherein the prediction model is a model obtained by performing machine learning using the time series data and the number of characteristic value patterns of the output information output from the plurality of gas detection devices U100 as explanatory variables and the time series data and the number of characteristic value patterns of the response information of the plurality of olfactory receptors U200 as target variables. This can improve the conversion accuracy.
[0229] (6) The conversion unit U12 uses a prediction model obtained by performing machine learning using the presence or absence of output information of a plurality of gas detection devices U100 as an explanatory variable. This can improve conversion accuracy.
[0230] (7) The conversion unit U12 uses a prediction model obtained by performing machine learning using the presence or absence of a reaction of a plurality of receptors included in the olfactory receptor U200 as a target variable. This can improve the conversion accuracy.
[0231] (Third Embodiment)
[0232] Next, refer to Fig.13 A prediction model creation device U2, a prediction model creation method, and a program according to a third embodiment of the present invention will be described. In describing the third embodiment, the same components as those in the above-described embodiment are denoted by the same reference numerals, and their descriptions are omitted or simplified.
[0233] The prediction model creation device U2, prediction model creation method, and program of the third embodiment are the device, method, and program for creating the prediction model of the first embodiment.
[0234] The prediction model making device U2 makes a prediction model that converts the output information output from the gas detection device U100 for a specified odor molecule into quantitative data. Fig.13As shown, the prediction model creation device U2 includes an explanatory variable acquisition unit U21, a target variable acquisition unit U22, and a prediction model creation unit U23.
[0235] The explanatory variable acquisition unit U21 is implemented, for example, by CPU operation. The explanatory variable acquisition unit U21 acquires output information output from a plurality of gas detection devices U100 for each of a plurality of odor molecules as an explanatory variable. The explanatory variable acquisition unit U21 may, for example, use the total value of the outputs of a plurality of gas detection devices U100 (e.g., 20 types), the average value, the presence or absence of a reaction, various indices, the product of the characteristic value of the output and the number of gas detection devices U100, and time series data, the product of the number of characteristic value patterns and the number of gas detection devices U100 as output information.
[0236] The target variable acquisition unit U22 is implemented, for example, by CPU operation. The target variable acquisition unit U22 acquires response information indicating the response of the olfactory receptor U200 to each of the plurality of odor molecules as a target variable. The target variable acquisition unit U22 may, for example, output information of the olfactory receptor U200 (e.g., 400 points), the total value of the output, the average value, the presence or absence of a reaction, various indices, the product of the output characteristic value and the number of points of the olfactory receptor U200, and time series data, the product of the number of characteristic value patterns and the number of points of the olfactory receptor U200, etc.
[0237] The prediction model creation unit U23 is realized by, for example, CPU operation. The prediction model creation unit U23 creates a prediction model by using the obtained explanatory variables and the obtained target variables in machine learning. The prediction model creation unit U23 creates a prediction model using correlation coefficients, principal factor analysis, logistic regression, and the like.
[0238] Next, the operation (prediction model creation method) of the prediction model creation device U2 will be described.
[0239] First, the explanatory variable acquisition unit U21 acquires output information as an explanatory variable. Next, the target variable acquisition unit U22 acquires response information as a target variable. Next, the prediction model creation unit U23 creates a prediction model using the explanatory variable and the target variable.
[0240] Next, the procedure of this embodiment will be described.
[0241] Each configuration included in the prediction model creation device U2 can be realized by hardware, software, or a combination thereof. Here, realization by software means that the program is read into a computer and executed to realize the program.
[0242] The program can be stored and supplied to the computer using various types of non-transitory computer readable media. Non-volatile computer readable media include various types of tangible recording media (tangible storage medium). Examples of non-volatile computer readable media include magnetic recording media (e.g., floppy disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, semiconductor memories (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, RAMs (random access memory)). In addition, the display program can be supplied to the computer using various types of volatile computer readable media (transitory computer readable medium). Examples of volatile computer readable media include electrical signals, optical signals, and electromagnetic waves. Volatile computer readable media can supply the program to the computer via a wired communication path such as an electric wire or an optical fiber, or a wireless communication path.
[0243] As described above, according to the prediction model creation device U2, the prediction model creation method, and the program of the third embodiment, the following effects are achieved.
[0244] (7) A prediction model making device U2 for making a prediction model, wherein the prediction model converts output information output from the gas detection device U100 for a specified odor molecule into quantitative data, wherein the prediction model making device U2 comprises: an explanatory variable acquisition unit U21, which acquires output information output from a plurality of gas detection devices U100 for each of a plurality of odor molecules as an explanatory variable; a target variable acquisition unit U22, which acquires response information representing the response of the olfactory receptor U200 to each of the plurality of odor molecules as a target variable; and a prediction model making unit U23, which makes a prediction model by using the acquired explanatory variables and the acquired target variables in machine learning. Thus, a prediction model can be made that converts output information that can be obtained from various gas detection devices U100 into response information and outputs it. Since the output information can be quantified by converting it into response information, a conversion device U1 that can obtain correlations between gas detection devices U100 can be formed.
[0245] (Fourth Embodiment)
[0246] Next, refer to Fig.14 and Fig.15A conversion device U1, a conversion information generating method, and a program according to a fourth embodiment of the present invention will be described. In describing the fourth embodiment, the same components as those in the above-described embodiments are denoted by the same reference numerals, and their descriptions are omitted or simplified.
[0247] The conversion device U1 of the fourth embodiment is different from the first and third embodiments in that a mass spectrometer (gas chromatograph-mass spectrometer) is used as the gas detection device U100. In addition, the conversion device U1 of the fourth embodiment is different from the first and third embodiments in that the output of the gas detection device U100 (mass spectrometer) is used as output information. The conversion device U1 of the fourth embodiment obtains a set of scattered points of intensity relative to mass charge output from the gas detection device U100 as output information. For example, the conversion device U1 obtains a set of scattered points of intensity relative to mass charge that can be obtained after detecting a gaseous compound using the gas detection device U100 as output information. That is, the conversion device U1 obtains the mass charge data (including noise) of the fragment ions generated when the gas molecules are ionized before the process of determining the molecular structure of the gaseous compound using the gas detection device U100 as output information. In addition, the conversion device U1 uses a prediction model that uses the mass charge data (including noise) as an explanatory variable to convert the output information into the response information of the olfactory receptor U200. Thus, the conversion device U1 converts the output information into the response information of the olfactory receptor regardless of the characteristics of the device which differs according to the gas detection device U100. It should be noted that the gas detection device U100 is not limited to detection, but may also be a device for collecting, measuring, and analyzing.
[0248] Next, an example of the fourth embodiment will be described.
[0249] (Example 3)
[0250] In the data acquisition method of the gas detection device U100, after diluting the odor molecule solution 10,000 times with a solvent, 1 μL is collected with a syringe and put into the gas detection device U100. The mass charge data of each molecular species obtained during the detection is used for conversion. The experimental conditions and experimental steps of the olfactory receptor unit array sensor are set to be the same as those in Example 1.
[0251] In data processing, similar to Example 1, a model was created using random forest regression. Python was used as the language. The learning method was set to supervised. The coefficient of determination was used for model evaluation. Fig.14As shown, in the data processing of the mass charge obtained by the gas detection device U100, the intensity of each pixel of the image is read out in a graph. The read out data is used as output information. The output information of the gas detection device U100 (mass spectrometer) is set as the explanatory variable, and the response information representing the response of the olfactory receptor U200 is set as the target variable.
[0252] Results, such as Fig.15 As shown, the vertical axis is set to the predicted value (response information) output from the prediction model, and the vertical axis is set to the actual value of the target variable (activation degree of olfactory receptor U200 expressing cells), and a regression determination coefficient of 0.828 can be obtained.
[0253] As described above, according to the prediction model creation device U2, the prediction model creation method, and the program of the fourth embodiment, the following effects are achieved.
[0254] (8) The conversion unit U12 uses the output signal of the mass spectrometer as output information as the gas detection device U100. Therefore, with respect to the mass spectrometer, it is also possible to obtain correlation between the gas detection devices U100 by converting the output information into response information. In particular, the conversion unit U12 uses mass charge data (including noise) as output information, thereby shortening the time from the capture of gaseous compounds to the conversion to the response information representing the response of the olfactory receptor U200, compared with the case where the data after the molecular structure is determined is used as the output information. In addition, since data closer to the detected data (unprocessed data) is used as the output information, compared with the case where the data after the molecular structure is determined is used as the output information, a conversion device U1 with a higher determination coefficient (good accuracy) can be provided.
[0255] Preferred embodiments of the conversion device, prediction model creation device, conversion information creation method, prediction model creation method, and program of the present invention have been described above, but the present disclosure is not limited to the above embodiments and can be modified appropriately.
[0256] For example, in the fourth embodiment, a gas chromatography mass spectrometer is used as the gas detection device U100, but the present invention is not limited thereto. The gas detection device U100 may be a device that does not have a gas chromatograph. In addition, the gas detection device U100 may also be a direct ionization mass spectrometer (DART-MS). The gas detection device U100 may also be an atmospheric pressure mass spectrometer that performs analysis under atmospheric pressure.
[0257] In addition, in the above-mentioned embodiment, the conversion unit U12 performs conversion using the prediction model obtained by machine learning, but the present invention is not limited to this. The conversion unit U12 may perform conversion without using the prediction model obtained by machine learning.
[0258] (other)
[0259] In addition, for example, the above series of processes can be executed by hardware or by software. In other words, the above functional structure is only an example and is not particularly limited. That is, it is sufficient to have a function that can execute the above series of processes as a whole in the information processing system. In order to realize the function, what kind of functional module is used is not particularly limited to the above example. In addition, the location of the functional module is not particularly limited and can be any location. For example, the functional module of the server (information processing device) can be transferred to other devices, etc. Conversely, the functional module of other devices can be transferred to the server, etc. In addition, a functional module can be composed of a hardware unit, a software unit, or a combination of them.
[0260] When a series of processes are executed by software, the program constituting the software is installed from a network or a recording medium to a computer, etc. The computer may be a computer incorporating dedicated hardware. In addition, the computer is a computer capable of executing various functions by installing various programs, and may be a general-purpose smartphone or personal computer in addition to a server.
[0261] The recording medium including such a program may be composed not only of a removable medium (not shown) distributed independently from the device body in order to provide the program to the user, etc., but also of a recording medium provided to the user, etc. in a state of being pre-installed in the device body. Since the program can be distributed via a network, the recording medium may be a medium mounted on a computer connected to or capable of being connected to the network or accessible to the network.
[0262] It should be noted that, in this specification, the steps of the program recorded in the recording medium include not only the processing performed in time sequence along the order, but also the processing that is not necessarily processed in time sequence but is executed in parallel or independently. In addition, in this specification, the term system refers to an overall device composed of multiple devices or multiple components.
[0263] In other words, the information processing device to which the present invention is applied can take various embodiments having the following structures.
[0264] That is, (1) an information processing device having:
[0265] An acquisition unit that acquires receptor response information, wherein the receptor response information represents responses of a plurality of olfactory receptors or taste receptors; a storage unit that stores the receptor response information; a release information determination unit that determines release information based on the receptor response information, wherein the release information is information about the release of a plurality of substances related to the perception of odor or taste; and a release control unit that is used to release at least one substance among the plurality of substances related to the perception of odor or taste based on the release information.
[0266] This makes it possible to reproduce the target odor regardless of individual differences in human perception.
[0267] Alternatively, (2) the receptor response information is information representing characteristic quantities of the odor molecules or tastes in the multiple receptors, wherein the characteristic quantity is at least one of response intensity, area of response intensity, response duration, response speed, peak time, response rise, and number of peaks.
[0268] Thus, the target smell or taste can be reproduced with good accuracy. Since the smell or taste perceived by a person varies depending on the diffusion mode and temperature of spices or seasonings, it is preferable to include more of such information in order to accurately reproduce the target smell or taste.
[0269] Furthermore, (3) the storage unit may include a correlation table for associating the receptor response information with the release information, and the release information determination unit may determine the release information based on the receptor response information and the correlation table.
[0270] Thus, once the response information is determined, it can be converted into corresponding emission information, so the target smell or taste can be reproduced regardless of individual differences in human perception.
[0271] In addition, (4) the storage unit may also store a learning model pre-generated by machine learning using the receptor response information and the release information corresponding to the receptor response information as training data, and the release information determination unit may use the learning model to determine the release information based on the receptor response information acquired by the acquisition unit.
[0272] Thus, even when it is difficult to generate the above-mentioned association table, it is possible to reproduce the target odor or taste regardless of individual differences in human perception by preparing association data (training data).
[0273] Alternatively, (5) the release information determination unit may determine at least one of the release information of the substance related to the perception of the odor or taste, including the release time, release amount, release temperature, release frequency, and release outlet flow rate.
[0274] This makes it possible to reproduce the target smell or taste with high accuracy.
[0275] Furthermore, (6) the release information determination unit may determine the release information based on the receptor response information and a space parameter, wherein the space parameter is a parameter related to a state of a space where the substance is released or a positional relationship with an object that releases the substance.
[0276] Thus, for example, in a movie theater where the position of a person's nose (face) can be determined to some extent (in the case of direct spray), the spray direction, spray amount, spray concentration, etc. can be controlled based on the distance from the nose or the temperature, humidity, etc. Also, for example, in a large space such as a sports field (in the case of indirect spray), the spray direction, spray amount, spray concentration, etc. can be controlled based on the area, wind volume, wind direction, temperature, humidity, etc. of the space.
[0277] In addition, the cartridge to which the present invention is applied can take various embodiments having the following structures.
[0278] That is, (7) a cartridge for filling the substance related to the perception of smell or taste to be released by the above-mentioned information processing device, wherein the cartridge is filled with a composition that selectively causes only specific receptors to respond.
[0279] In addition, the emission device (odor spray device 3) to which the present invention is applied can adopt various embodiments having the following structures.
[0280] That is, (8) a release device comprising: a mounting portion for mounting the above-mentioned box; and a release port, which releases the substance related to the perception of smell or taste based on the release control performed by the release control unit.
[0281] Thus, by performing appropriate release, it is possible to reproduce the target smell or taste.
[0282] In addition, the production method of the present invention can be applied in various embodiments having the following structures.
[0283] That is, (9) a method for producing an odor or taste, which includes a step of releasing the substance related to the perception of the odor or taste using the above-mentioned release device.
[0284] In addition, the data structure to which the present invention is applied can take various embodiments having the following structures.
[0285] That is, (10) the data structure of the receptor response information used in the above-mentioned information processing device.
[0286] In addition, the generation method to which the present invention is applied can take various embodiments having the following structures.
[0287] That is, (11) the method for generating an N-dimensional code includes a coding step of converting the receptor response information into an N-dimensional code by performing a predetermined coding on the receptor response information.
[0288] In addition, the generation method to which the present invention is applied can take various embodiments having the following structures.
[0289] That is, (12) a method for generating decoded receptor response information, which includes a decoding step of converting the N-dimensional code into the receptor response information by performing a predetermined decoding on the N-dimensional code, wherein the N-dimensional code is converted by performing a predetermined encoding on the receptor response information.
[0290] In addition, the discharge device to which the present invention is applied can take various embodiments having the following structures.
[0291] That is, (13) a release device comprising: a mounting portion for detachably mounting a box, wherein the box is filled with a substance related to the perception of an odor or taste; a release control unit for releasing at least one of the multiple substances related to the perception of an odor or taste from the box based on release information related to the release of the multiple substances related to the perception of an odor or taste; and a release port for releasing the substance related to the perception of an odor or taste based on release control performed using the release control unit, wherein the release control unit reads information stored in the installed box and controls the release process in response to the box satisfying a specified benchmark.
[0292] In addition, the cartridge to which the present invention is applied can take various embodiments having the following structures.
[0293] That is, (14) a box mounted on a discharge device, the discharge device comprising: a mounting portion for detachably mounting a box, the box being used to be filled with a substance related to the perception of an odor or taste; a discharge control unit for causing at least one of the multiple substances related to the perception of an odor or taste to be discharged from the box based on discharge information related to the discharge of the multiple substances related to the perception of an odor or taste; and a discharge port for causing the substance related to the perception of an odor or taste to be discharged based on discharge control performed using the discharge control unit, the discharge control unit reading information stored in the mounted box and controlling the discharge process in response to the box satisfying a prescribed benchmark, wherein the box comprises: a housing which can be mounted on the mounting portion and accommodates the multiple substances related to the perception of an odor or taste; a non-volatile memory for storing attribute information corresponding to the prescribed benchmark; and an interface for transferring data representing the information to and from the discharge control unit.
[0294] In addition, the control method to which the present invention is applied can take various embodiments having the following structures.
[0295] That is, (15) a control method for an information processing device, which comprises: an acquisition step of acquiring receptor response information, wherein the receptor response information represents the response of a plurality of olfactory receptors or taste receptors; a release information determination step of determining release information based on the receptor response information, wherein the release information is information about the release of odors or flavors of a plurality of spices or seasonings; and a release control step of causing at least one of the plurality of substances related to the perception of odor or taste to be released based on the release information.
[0296] In addition, the computer program to which the present invention is applied can take various embodiments having the following structures.
[0297] That is, (16) a computer program for executing, using a computer: an acquisition step of acquiring receptor response information, wherein the receptor response information is information indicating the responses of a plurality of olfactory receptors or taste receptors; a release information determination step of determining release information based on the receptor response information, wherein the release information is information on the release of odors or flavors of a plurality of spices or seasonings; and a release control step of causing at least one spice or seasoning among the plurality of spices or seasonings to be released based on the release information.
[0298] Description of Reference Numerals
[0299] 1: Server 2: Receptor information determination device 3: Odor spray device
[0300] 11: CPU 18: Storage unit 19: Communication unit
[0301] 31: Response information acquisition unit 32: Photographed image acquisition unit 33: Model information acquisition unit
[0302] 34: spray information determination unit 35: spray control unit 36: display control unit
[0303] 41: Response information DB 42: Model information DB 43: Related DB
[0304] CO: Odor trap CA: Box NO: Nozzle
[0305] RE: Content reproduction device TV: Display device
Claims
1. An information processing device comprising: an acquisition unit that acquires receptor response information, wherein the receptor response information is information indicating responses of a plurality of olfactory receptors or taste receptors; a storage unit storing the receptor response information; a release information determination unit that determines release information based on the receptor response information, wherein the release information is information on the release of a plurality of substances related to the perception of smell or taste; as well as A release control unit is used to release at least one substance among the plurality of substances related to the perception of smell or taste based on the release information.
2. The information processing device according to claim 1, wherein: The receptor response information is information representing characteristic quantities of the multiple receptors to odor molecules or tastes, and the characteristic quantities are at least one of response intensity, area of response intensity, response duration, response speed, peak time, response rise, and number of peaks.
3. The information processing device according to claim 1, wherein: The storage unit has an association table for associating the receptor response information with the emission information. The release information determination unit determines the release information based on the receptor response information and the association table.
4. The information processing device according to claim 1, wherein: The storage unit further stores a learning model generated in advance by machine learning using the receptor response information and the release information corresponding to the receptor response information as training data, The release information determination unit determines the release information based on the receptor response information acquired by the acquisition unit using the learning model.
5. The information processing device according to claim 1, wherein: The release information determination unit determines at least one release information of the substance related to the perception of the smell or taste, including the release time, release amount, release temperature, release frequency, and release outlet flow rate.
6. The information processing device according to claim 1, wherein: The release information determination unit determines the release information based on the receptor response information and a space parameter, wherein the space parameter is a parameter related to a state of a space where the substance is released or a positional relationship with an object where the substance is released.
7. A cartridge for filling the substance related to the perception of smell or taste to be released by the information processing device according to any one of claims 1 to 6, wherein: The cartridge is filled with a composition that causes only specific receptors to selectively respond.
8. A discharge device, comprising: a mounting portion for mounting the cartridge according to claim 7; and A release port releases the substance related to the perception of smell or taste based on the release control performed by the release control unit.
9. A method for producing an odor or a taste, wherein: The method comprises the step of releasing the substance related to the perception of smell or taste by using the releasing device as described in claim 8.
10. The data structure of the receptor response information used in the information processing device according to any one of claims 1 to 6.
11. A method for generating an N-dimensional code, wherein: The method comprises the step of performing a predetermined encoding on the receptor response information described in claim 10 to convert the receptor response information into an N-dimensional code.
12. A method for generating decoded receptor response information, wherein: The method comprises a decoding step of converting the N-dimensional code into the receptor response information by performing a predetermined decoding on the N-dimensional code, wherein the N-dimensional code is obtained by converting the receptor response information described in claim 10 by performing a predetermined encoding on the N-dimensional code.
13. A discharge device, comprising: A mounting portion, which is used to detachably mount a box, wherein the box is used to be filled with a substance related to the perception of smell or taste; a discharge control unit for causing at least one substance among the plurality of substances associated with the perception of smell or taste to be discharged from the cartridge based on discharge information associated with the discharge of the plurality of substances associated with the perception of smell or taste; and a discharge port for discharging the substance related to the perception of the smell or taste based on the discharge control performed by the discharge control unit, The discharge control unit reads information stored in the mounted cartridge and controls the discharge process in response to the cartridge satisfying a prescribed reference.
14. A cartridge mounted on a discharging device, the discharging device comprising: A mounting portion for detachably mounting a cartridge, the cartridge being used to be filled with a substance related to the perception of an odor or taste; a release control unit for causing at least one substance among the plurality of substances related to the perception of an odor or taste to be released from the cartridge based on release information related to the release of the plurality of substances related to the perception of an odor or taste; and a discharge port that discharges the substance related to the perception of the odor or taste based on discharge control performed by the discharge control unit, the discharge control unit reading information stored in the installed cartridge and controlling the discharge process in response to the cartridge satisfying a prescribed benchmark, wherein The box has: a housing, which can be mounted on the mounting portion and contains the plurality of substances related to the perception of smell or taste; a nonvolatile memory for storing attribute information corresponding to the prescribed reference; and An interface is used to exchange data representing the information with the release control unit.
15. A method for controlling an information processing device, wherein: have: an acquisition step of acquiring receptor response information, wherein the receptor response information is information indicating responses of a plurality of olfactory receptors or taste receptors; a release information determination step, determining release information according to the receptor response information, wherein the release information is information on the release of a plurality of substances related to the perception of smell or taste; as well as The step of controlling the release is used to release at least one substance among the plurality of substances related to the perception of smell or taste based on the release information.
16. A computer program for causing a computer to: an acquisition step of acquiring receptor response information, wherein the receptor response information is information indicating responses of a plurality of olfactory receptors or taste receptors; a release information determining step of determining release information according to the receptor response information, wherein the release information is information on the release of a plurality of substances related to the perception of smell or taste; and The step of controlling the release is used to release at least one substance among the plurality of substances related to the perception of smell or taste based on the release information.
