Music search device and fragrance search device

By using EEG data to measure brain wave intensity ratios, the music and aroma search devices accurately determine cross-modal interactions, enhancing the precision of matching music and aromas to desired brain states.

JP7881094B1Active Publication Date: 2026-06-26ABE ASA CO LTD

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
ABE ASA CO LTD
Filing Date
2026-03-02
Publication Date
2026-06-26

AI Technical Summary

Technical Problem

Existing music and aroma search devices rely on psychological experiments and sensory evaluations to determine cross-modal interactions, which are subjective and do not accurately reflect whether such interactions occur.

Method used

A music search device and aroma search device that utilize electroencephalogram (EEG) data to determine the intensity ratios of gamma, alpha, and beta waves when combining music and aromas, allowing for more accurate determination of cross-modal effects by measuring brain activity during exposure to specific aromas and music.

Benefits of technology

These devices can accurately identify music and aromas that induce desired cross-modal brain states, such as increased alertness or relaxation, by analyzing EEG data, providing a more precise match than conventional methods.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007881094000001_ABST
    Figure 0007881094000001_ABST
Patent Text Reader

Abstract

This invention provides a music search device that can more accurately reflect whether cross-modal listening occurs when searching for music suitable for listening while smelling a specific fragrance. [Solution] The music search device 1 includes a storage unit 9 that stores combination information 7, which is a combination of fragrance information 13, which is information about a fragrance, and music information 15, which is information about a song in which it is estimated that when the music is listened to while smelling the fragrance, the gamma / alpha ratio, which is the ratio of the intensity of gamma waves and alpha waves emitted by the person smelling the fragrance, or the alpha / beta ratio, which is the ratio of the intensity of alpha waves and beta waves, will be equal to or greater than a predetermined value; a first input unit 3 that receives input of fragrance identification information 21, which is information that identifies a fragrance; and a first determination unit 5 that determines whether the fragrance identified by the fragrance identification information 21 is included in the fragrance information 13 of the combination information 7, and if it is determined that it is included, outputs the music information 15 that is combined with the fragrance information 13 identified by the fragrance identification information 21.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a music search device and an aroma search device.

Background Art

[0002] Searching for and distributing music that is considered preferable to listen to when consuming food and drink, such as music distribution in a restaurant, is widely practiced. In addition, smell is one of the important senses when consuming food and drink, and in some cases, an aroma is intentionally added to the food and drink. Furthermore, it has been pointed out that there is a possibility of an interaction called cross-modal between smell and hearing (Non-Patent Documents 1 to 3). When cross-modal occurs, it is expected that effects such as feeling a better smell can be obtained by listening to a specific music while smelling a specific aroma.

Prior Art Documents

Non-Patent Documents

[0003]

Non-Patent Document 1

Non-Patent Document 2

Non-Patent Document 3

[0004] However, the relationship between olfaction and hearing suggested in Non-Patent Documents 1-3 is based on inferences from psychological experiments and sensory evaluations, and therefore does not accurately reflect whether cross-modal relationships occur.

[0005] The present invention has been made to solve these problems, and its objective is to provide a music search device that can search for music suitable for listening to while smelling a specific aroma, in a way that more accurately reflects whether cross-modal interaction occurs than in conventional devices, and an aroma search device that can search for aromas suitable for listening to a specific music, in a way that more accurately reflects whether cross-modal interaction occurs than in conventional devices. [Means for solving the problem]

[0006] The music search device of the present invention includes: a storage unit that stores combination information which is a combination of aroma information and music information which is information about a song in which, when listened to while smelling the aroma indicated by the aroma information, the γ / α ratio, which is the intensity ratio of gamma waves and alpha waves, or the α / β ratio, which is the intensity ratio of alpha waves and beta waves, emitted by the person smelling the aroma, is estimated to be equal to or greater than a predetermined value; a first input unit that receives input of aroma identification information which is information that identifies the aroma; and a first determination unit that determines whether the aroma identified by the aroma identification information is included in the aroma information of the combination information, and if it is determined that it is included, outputs the music information which is combined with the aroma information identified by the aroma identification information.

[0007] The aroma search device of the present invention includes: a storage unit that stores combination information which is a combination of aroma information and song information which is information about a song in which, when the person smells the aroma indicated by the aroma information listens to it, the gamma / alpha ratio, which is the intensity ratio of gamma waves to alpha waves, or the alpha / beta ratio, which is the intensity ratio of alpha waves to beta waves, emitted by the person smelling the aroma, is estimated to be equal to or greater than a predetermined value; an input unit that receives input of song identification information which is information that identifies the song; and a determination unit that determines whether the song identified by the song identification information is included in the song information of the combination information, and if it is determined that it is included, outputs the aroma information that is combined with the song information identified by the song identification information. [Effects of the Invention]

[0008] According to the present invention, it is possible to provide a music search device that can search for music suitable for listening to while smelling a specific aroma, in a way that more accurately reflects whether cross-modal interaction occurs than in the conventional method, and an aroma search device that can search for aromas suitable for smelling while listening to a specific music, in a way that more accurately reflects whether cross-modal interaction occurs than in the conventional method. [Brief explanation of the drawing]

[0009] [Figure 1]This is a block diagram showing a schematic configuration of a music search device according to an embodiment of the present invention. [Figure 2] This figure shows an example of combination information from Figure 1. [Figure 3] This flowchart shows the procedure for a music search method using a music search device according to an embodiment of the present invention. [Figure 4] This flowchart shows the procedure for a fragrance search method using a music search device according to an embodiment of the present invention. [Modes for carrying out the invention]

[0010] The present invention will be described below in accordance with preferred embodiments. It should be noted that the present invention is not limited to the embodiments shown below, and can be modified as appropriate without departing from the spirit of the invention. Furthermore, in the embodiments shown below, some illustrations and descriptions of certain components are omitted. It goes without saying that, regarding the details of the omitted technologies, publicly known or well-known technologies are applied as appropriate, to the extent that they do not contradict the content described below.

[0011] First, a brief overview of the operation of the music search device according to an embodiment of the present invention (hereinafter also referred to as this embodiment) will be described. When aroma identification information, which is information that identifies a scent, is input to the music search device of this embodiment, music information, which is information about songs that are suitable to listen to while smelling the scent indicated by the input aroma identification information, is output.

[0012] Specifically, the system outputs information about songs that, when listened to while smelling the fragrance indicated by the input fragrance identification information, are estimated to produce a gamma-alpha wave intensity ratio (γ / α ratio) or an alpha-beta wave intensity ratio (α / β ratio) that is greater than or equal to a predetermined value. Alpha waves, beta waves, and gamma waves are all brain waves, but alpha waves are more intense when the brain is relaxed (sedated), and beta waves are more intense when the brain is awake. Gamma waves are more intense when the brain is thinking, such as remembering or reasoning, and are considered to be more intense when the brain is awake. Therefore, the larger the gamma-alpha ratio, the more likely the brain is to be awake. Conversely, the larger the alpha-beta ratio, the more likely the brain is to be sedated. Therefore, songs that produce a large gamma-alpha ratio when listened to while smelling the fragrance indicated by the input fragrance identification information are estimated to cause the brain to become more awake when listened to while smelling the fragrance, i.e., cross-modal brain activity occurs. Furthermore, it is estimated that songs that produce a larger α / β ratio when listened to while smelling the fragrance identified by the input fragrance information will result in a more calming state of the brain, or in other words, a cross-modal effect, when listened to while smelling the fragrance.

[0013] Thus, the music search device of this embodiment is characterized by determining whether or not cross-modal perception may occur between olfaction and hearing based on the intensity ratio of electroencephalograms (EEGs). Here, since EEGs can be detected as electrical signals with a known electroencephalograph, they can be measured relatively easily and accurately. Therefore, compared to conventional techniques that rely on psychological experiments or sensory evaluations, it is less susceptible to the subjective opinions of the subjects and can accurately determine whether or not cross-modal perception occurs. The above is an overview of the operation of the music search device.

[0014] Next, the configuration of the music search device according to this embodiment will be described with reference to Figures 1 and 2. Figure 1 is a block diagram showing the schematic configuration of the music search device according to an embodiment of the present invention. Figure 2 is a diagram showing an example of the combination information in Figure 1. As shown in Figure 1, the music search device 1 (fragrance search device) includes a storage unit 9, a first input unit 3, and a first determination unit 5. The music search device 1 also includes a second input unit 41 (input unit) and a second determination unit 43 (determination unit).

[0015] Memory unit 9 is the part that stores combination information 7. Combination information 7 is information about the combination of aroma information 13 and musical information 15. More specifically, aroma information 13 is information about aromas, and in Figure 2, names of aromas such as "vanilla aroma" and "coffee aroma" are given as examples. Vanilla aroma here refers to the aroma of vanillin, for example, but since some commercially available flavorings that contain vanilla aroma are artificial vanilla that does not contain vanillin, "vanilla aroma" is not limited to the aroma of vanillin, but also includes the aroma of artificial vanilla. Similarly, coffee aroma can be exemplified by the aroma of roasted coffee beans, but since some commercially available flavorings that contain coffee aroma are artificial coffee aromas derived from substances other than coffee beans (2-furfurylthiol, furfural, pyrazines, methylpyrazines), "coffee aroma" also includes the aroma of artificial coffee. Furthermore, aroma information 13 may also be information indicating the specific names or product names of aroma components or substances containing those aroma components. For example, aroma information 13 may be information indicating roasted coffee beans as a substance containing coffee aroma.

[0016] Music information 15 is information on music that is estimated to have a ratio of the intensity of gamma waves to alpha waves (γ / α ratio), or a ratio of the intensity of alpha waves to beta waves (α / β ratio), emitted by a person who smells the scent indicated by the scent information 13 that is a combination target, of a predetermined value or more when listening while smelling the scent. The predetermined value is a value that can be estimated to cause a desired cross-modal effect and may be obtained through experiments in advance. For example, a case where the γ / α ratio or α / β ratio is greater than 1 can be exemplified. Here, the γ / α ratio is a value obtained by dividing the intensity of gamma waves by the intensity of alpha waves, and the α / β ratio is a value obtained by dividing the intensity of alpha waves by the intensity of beta waves. The combination of the scent information 13 and the music information 15 may be obtained through experiments in advance. For example, when a subject is made to smell a specific scent while listening to music, and the γ / α ratio or α / β ratio becomes a predetermined value or more, the combination of that scent and music may be set as the combination of the scent indicated by the scent information 13 and the music indicated by the music information 15. The combination of the scent indicated by the scent information 13 and the music indicated by the music information 15 may also be optimized for an individual by customizing the combination information 7 based on the measured value of the brain waves when the individual is made to smell the scent while listening to music.

[0017] The music information 15 includes codes as shown in, for example, FIG. 2. In FIG. 2, the combination information 7 includes information indicating a combination of a vanilla scent as the scent information 13 and a C major code as the music information 15. This information means that when listening to a C major code music while smelling the vanilla scent, the γ / α ratio is estimated to be a predetermined value or more (cross-modal effect occurs).

[0018] Similarly, in FIG. 2, the combination information 7 includes information indicating a combination of a coffee scent as the scent information 13 and a G minor code as the music information 15. This information means that when listening to a G minor code music while smelling the coffee scent, the α / β ratio is estimated to be a predetermined value or more (cross-modal effect occurs).

[0019] The music information 15 may be a specific piece of music rather than a code, as long as it can identify the music. It may also be data indicating the title of the music or the musical score, or voice data recording the music, or performance data for playing the music on an electronic musical instrument. Further, the music information 15 may be information including the tempo of the music such as BPM (Beats Per Minute).

[0020] The combination information 7 may include the value of the γ / α ratio or the α / β ratio, but it is not necessarily required to include the value of the γ / α ratio or the α / β ratio. For example, as a preliminary experiment, when a subject is made to listen to a piece of music in the C major key while smelling vanilla fragrance, assume that the γ / α ratio or the α / β ratio in the subject's electroencephalogram becomes a predetermined value or more. In this case, if information indicating the combination of vanilla fragrance as the fragrance information 13 and the C major key as the music information 15 is stored in the storage unit 9 as the combination information 7, it is not necessarily required to include the value of the γ / α ratio or the α / β ratio in the combination information 7.

[0021] The first input unit 3 shown in FIG. 1 is a part that receives the input of the fragrance identification information 21. The fragrance identification information 21 is information for identifying a fragrance. Similar to the fragrance information 13, the fragrance identification information 21 may be information indicating a fragrance such as "vanilla fragrance" or "coffee fragrance", or may be information indicating the name or product name of a specific substance containing the components of the fragrance. Further, if a substance containing the components of the fragrance (such as a specific food or drink) can be identified, an image of the substance containing the fragrance may also be used.

[0022] On the other hand, as long as the fragrance identification information 21 is information for identifying a fragrance, it may be different from the fragrance information 13. For example, the fragrance identification information 21 may be a recipe for producing a substance that emits a fragrance. The recipe referred to here is information indicating the raw materials and manufacturing methods used when producing a substance that emits a fragrance. When the substance that emits a fragrance is a specific food or drink, it is information indicating the types, amounts of raw materials and seasonings used when preparing the specific food or drink, and the cooking method using the raw materials and seasonings. Further, the recipe referred to here is not limited to information indicating the cooking method of food or drink, and also includes aroma recipes and formulation sheets of fragrance compositions.

[0023] The specific configuration of the first input unit 3 for receiving the aroma identification information 21 is not particularly limited as long as the aroma identification information 21 can be obtained. For example, the configuration may involve inputting the reading result from a camera 31 that reads characters or images displaying the aroma as the aroma identification information 21. Alternatively, the configuration may involve inputting the reading result from a reader that reads a barcode containing information such as the name of the aroma or a recipe for manufacturing the substance that emits the aroma as the aroma identification information 21. Furthermore, the configuration may involve inputting the aroma identification information 21 from a keyboard that inputs the name of the aroma. In addition, the configuration may involve setting up a monitor or the like that displays a list of aromas in advance, and inputting the aroma identification information 21 from a mouse or touch panel that selects a predetermined aroma from the displayed aromas.

[0024] The first determination unit 5 is the part that outputs the combined song information 15 when the song information 15 that is combined with the scent indicated by the scent identification information 21 input to the first input unit 3 exists in the combination information 7. The first determination unit 5 receives the scent identification information 21 from the first input unit 3.

[0025] Specifically, the first determination unit 5 determines whether the aroma identified in the aroma identification information 21 is included in the aroma indicated by the aroma information 13 of the combination information 7. If it determines that it is included, it outputs the music information 15 that is combined with the aroma information 13 identified in the aroma identification information 21. For example, if text information indicating coffee is input as the aroma identification information 21, the aroma identified in the aroma identification information 21 is the aroma of coffee, and the aroma of coffee is included in the aroma information 13 shown in Figure 2. Therefore, in this case, the first determination unit 5 determines that the aroma of coffee is included in the aroma indicated by the aroma information 13 of the combination information 7. Furthermore, the first determination unit 5 obtains and outputs the music information 15 indicating the G minor chord that is combined with the aroma of coffee from the combination information 7 stored in the storage unit 9.

[0026] In Figure 1, the output destinations for the song information 15 are shown as an example of an external device connected to the song search device 1, namely a display unit 17 and a speaker 19. The display unit 17 is a device such as a liquid crystal monitor that displays the song information 15 in the form of characters, graphics, images, etc. In this case, the first determination unit 5 outputs the song information 15 to the display unit 17 as information represented by characters, graphics, images, etc. The speaker 19 is a device that outputs the song information 15 as sound. In this case, the first determination unit 5 outputs audio data of the song recorded as the song information 15 to the speaker 19. If the speaker 19 is provided on an electronic musical instrument (not shown), the song information 15 may be output to the electronic musical instrument as performance data for playing the song on the electronic musical instrument, and the song played by the electronic musical instrument based on the performance data may be output from the speaker 19.

[0027] Thus, when fragrance information is input, the music search device 1 outputs information on songs that are estimated to have a high γ / α ratio or α / β ratio when listened to while smelling the input fragrance. Therefore, when searching for songs suitable for listening to while smelling a specific fragrance, it is possible to search for songs that more accurately reflect whether cross-modal effects occur than in conventional methods.

[0028] Furthermore, the song information 15 shown in Figure 2 includes chords. In this configuration, when aroma information is input, the chords of songs that are estimated to have a high γ / α ratio or α / β ratio when listened to while smelling the input aroma are output. Therefore, it is possible to search for chords that are likely to produce cross-modal sounds when listened to while smelling a specific aroma.

[0029] Furthermore, combination information 7 includes a combination of vanilla scent as scent information 13 and a song containing a C major chord as song information 15. In this configuration, when vanilla scent information is input, a song containing a C major chord is output. Therefore, it is possible to search for chords that are likely to produce cross-modal sounds when listening while smelling vanilla scent.

[0030] Furthermore, combination information 7 includes a combination of coffee aroma information 13 and a song containing a G minor chord as song information 15. In this configuration, when coffee aroma information is input, a song containing a G minor chord is output. Therefore, it is possible to search for chords that are likely to produce cross-modal sounds when listening while smelling coffee aroma.

[0031] Furthermore, even if the aroma identified in the aroma identification information 21 is not included in the aroma information 13 of the combination information 7, the first determination unit 5 can still output song information 15 when a recipe is input as the aroma identification information 21. Specifically, when a recipe is input as the aroma identification information 21, the first determination unit 5 estimates the aroma of the substance to be manufactured from the input recipe. In addition, the first determination unit 5 selects the estimated aroma as the aroma information 13 and outputs the code combined with the selected aroma information 13 as song information 15.

[0032] In this configuration, when a recipe is input, a code is output that is estimated to result in a high γ / α ratio or α / β ratio when listening to the aroma of the substance produced by the input recipe while smelling it. Therefore, even if the aroma identified in the aroma identification information 21 is not included in the combination information 7, a code is obtained from the recipe that is highly likely to produce a cross-modal effect when listening to the aroma of the substance being produced while smelling it.

[0033] One way to estimate aroma from a recipe is to estimate the aroma of the manufactured substance from the aromas of the raw materials specified in the recipe. The relationship between the raw materials and aromas of such a substance can be stored in advance in the memory unit 9 as raw material information 27, as shown in Figure 1.

[0034] Furthermore, if the song information 15 is a code, the first determination unit 5 may generate and output a song using the code combined with the scent information 13 identified by the input scent identification information 21. In this configuration, when scent information is input, a song is composed and output that is estimated to have a high γ / α ratio or α / β ratio when listened to while smelling the input scent. Therefore, a song optimized for listening while smelling the input scent can be composed and output. As a specific means of composition, one example is to present a code to the generating AI and have it compose the song.

[0035] The first determination unit 5 can output information indicating that the music information 15 corresponding to the aroma is not stored in the storage unit 9 if the aroma identified in the aroma identification information 21 is not included in the aroma information 13 of the combination information 7, and the aroma cannot be estimated for reasons such as the lack of a recipe.

[0036] The second input unit 41 shown in Figure 1 is the part that receives input of song identification information 23 and is provided as needed. Song identification information 23 is information that identifies a song, and can be code, data indicating the song title or sheet music, audio data of a recording of the song, or performance data for playing the song on an electronic instrument.

[0037] The specific configuration for receiving input of song identification information 23 is not particularly limited as long as song identification information 23 can be obtained. For example, the configuration may involve inputting the reading result from a camera 31 that reads the text, image, or musical score of the song, which serves as song identification information 23. Alternatively, the configuration may involve inputting the reading result from a reader that reads a barcode containing the song title or musical score, which serves as song identification information 23. Furthermore, the configuration may involve inputting song identification information 23 from a keyboard that inputs the song title, or inputting song identification information 23 from a mouse or touch panel that displays a list of songs and allows the user to select a specific song from the displayed songs. In addition, the configuration may involve inputting the audio of the song, which serves as song identification information 23, into a microphone.

[0038] The second determination unit 43 outputs the combined fragrance information 13 when the fragrance information 13 that is combined with the song indicated by the song identification information 23 input to the second input unit 41 is present in the combination information 7. The second determination unit 43 receives the song identification information 23 from the second input unit 41.

[0039] Specifically, the second determination unit 43 determines whether the song identified by the song identification information 23 is included in the song indicated by the song information 15 of the combination information 7. If it determines that it is included, it outputs the fragrance information 13 that is combined with the song identified by the song information 15. For example, if the song identification information 23 is character information indicating a C major chord, the song identified by the song identification information 23 is a C major chord, and the C major chord is included in the song information 15 shown in Figure 2. Therefore, in this case, the second determination unit 43 determines that the C major chord is included in the song indicated by the song information 15 of the combination information 7.

[0040] Furthermore, the second determination unit 43 retrieves and outputs aroma information 13 indicating vanilla aroma combined with a C major chord from the combination information 7 stored in the memory unit 9. Alternatively, the second determination unit 43 may extract the chord of the song identified by the song identification information 23 and determine whether the extracted chord is included in the song indicated by the song information 15 of the combination information 7.

[0041] Similar to the output destination of the music information 15, Figure 1 illustrates the display unit 17 and the speaker 19 as the output destinations for the aroma information 13. When the output destination of the aroma information 13 is the display unit 17, the second determination unit 43 outputs the aroma information 13 to the display unit 17 as information represented by characters, figures, and images. When the output destination of the aroma information 13 is the speaker 19, the first determination unit 5 outputs the aroma information 13 to the display unit 17 as audio data.

[0042] Thus, when song information is input, the song search device 1 can also output information on fragrances that are estimated to have a high γ / α ratio or α / β ratio when smelled while listening to the input song. Therefore, when searching for fragrances suitable for smelling while listening to a specific song, it is possible to search for fragrances that more accurately reflect whether cross-modal effects occur than in conventional methods.

[0043] The music search device 1 may also be implemented using a general-purpose computer. In this case, the programs that implement the functions of the first input unit 3, the first determination unit 5, the second input unit 41, and the second determination unit 43, along with the combination information 7, can be stored in the memory device of the general-purpose computer, and each program can be executed by the central processing unit of the general-purpose computer. In this case, the memory device of the general-purpose computer can be used as the memory unit 9. Alternatively, the music search device 1 may be implemented as a dedicated machine using integrated circuits that implement the functions of the first input unit 3, the first determination unit 5, the second input unit 41, the second determination unit 43, and the memory unit 9, similar to an embedded system. Furthermore, the music search device 1 may implement similar functions as a server device deployed in a cloud computing environment, or as a configuration using generative AI.

[0044] Examples of uses for the music search device 1 include searching for combinations of fragrances and music to be played in places that create a specific atmosphere, such as luxury hotels, department stores, apparel shops, real estate model rooms, and automobile showrooms. It can also be used in restaurants and food and beverage shops to find music suitable for specific fragrances of food and beverages. Furthermore, it can be used in perfume shops to find music suitable for the fragrances of perfumes. Additionally, it can be used in aromatherapy facilities and medical / nursing care facilities to find combinations of fragrances and music that help users relax. It can also be used to find music to enhance the sense of smell for patients whose olfactory sensitivity has decreased due to specific diseases or their after-effects. Finally, it can be used in VR-based entertainment facilities and experiential businesses to find combinations of fragrances and music. The above describes the configuration of the music search device 1.

[0045] Next, a method for searching for music using the music search device 1 will be described with reference to Figure 3. Figure 3 is a flowchart showing the procedure for searching for music using the music search device 1 according to an embodiment of the present invention.

[0046] First, the first input unit 3 determines whether aroma identification information 21 has been input. If it determines that it has been input, it sends the aroma identification information 21 to the first determination unit 5 and proceeds to S2. If it determines that it has not been input, it returns (S1 in Figure 3). If the first input unit 3 determines in S1 that aroma identification information 21 has been input, in S2, the first determination unit 5 determines whether the aroma indicated by the aroma identification information 21 is included in the combination information 7. If it determines that it is included, it proceeds to S3. If it determines that it is not included, it proceeds to S4 (S2 in Figure 3). If it determines in S2 that the aroma indicated by the aroma identification information 21 is included in the combination information 7, the first determination unit 5 selects the song information 15 that is combined with the aroma indicated by the aroma identification information 21 from the combination information 7 (S3 in Figure 3) and outputs it (S5 in Figure 3). If the song information 15 is a code, a song may be generated in S3 based on the code. Furthermore, if the fragrance identification information 21 indicates two or more types of fragrances, and the system is associated with two or more types of fragrances, it may output two or more codes corresponding to each of the two or more types of fragrances, or it may compose a song by combining two or more codes.

[0047] In S2, if the first determination unit 5 determines that the aroma indicated by the aroma identification information 21 is not included in the combination information 7, the first determination unit 5 determines whether the aroma identification information 21 is a recipe. If it is determined to be a recipe, the process proceeds to S6; otherwise, it proceeds to S7 (S4 in Figure 3). In S4, if the aroma identification information 21 is determined to be a recipe, the first determination unit 5 estimates the aroma of the substance to be manufactured from the recipe, selects the song information 15 that is combined with the estimated aroma from the combination information 7, and proceeds to S5 (S6 in Figure 3). If the first determination unit 5 determines in S4 that the aroma identification information 21 is not a recipe, it outputs information indicating that there is no corresponding song information 15 and returns (S7 in Figure 3). In addition, if the aroma of the substance to be manufactured cannot be estimated in S6 for reasons such as the raw materials of the substance indicated by the recipe not being included in the raw material information 27, it also outputs information indicating that there is no corresponding song information 15 and returns. The above is a description of the song search method using the song search device 1.

[0048] Next, the aroma search method using the music search device 1 will be described with reference to Figure 4. Figure 4 is a flowchart showing the procedure for the aroma search method using the music search device 1 according to an embodiment of the present invention.

[0049] First, the second input unit 41 determines whether song identification information 23 has been input. If it determines that it has been input, it sends the song identification information 23 to the second determination unit 43 and proceeds to S12. If it determines that it has not been input, it returns (S11 in Figure 4). If the second input unit 41 determines in S11 that song identification information 23 has been input, in S12 the second determination unit 43 determines whether the song indicated by the song identification information 23 is included in the combination information 7. If it determines that it is included, it proceeds to S13. If it determines that it is not included, it proceeds to S14 (S12 in Figure 4).

[0050] If the second determination unit 43 determines in S12 that the song indicated by the song identification information 23 is included in the combination information 7, the second determination unit 43 selects the fragrance information 13 that is combined with the song indicated by the song identification information 23 from the combination information 7 (S13 in Figure 4) and outputs it (S15 in Figure 4). On the other hand, if the second determination unit 43 determines in S12 that the song indicated by the song identification information 23 is not included in the combination information 7, the second determination unit 43 outputs information indicating that there is no corresponding fragrance information 13 and returns it (S14 in Figure 4). The above is a description of the fragrance search method using the song search device 1.

[0051] Thus, the music search device 1 of this embodiment includes a first input unit 3 that receives the input of fragrance identification information 21, and a first determination unit 5 that outputs combined music information 15 if the fragrance identified by the fragrance identification information 21 is included in the combination information 7.

[0052] In this configuration, when aroma information is input, information on songs that are estimated to have a high γ / α ratio or α / β ratio when listened to while smelling the input aroma is output. Therefore, when searching for songs suitable for listening to while smelling a specific aroma, it is possible to search for songs that more accurately reflect whether cross-modal listening occurs than before.

[0053] Furthermore, in the music search device 1 of this embodiment, the music information 15 includes a code. In this configuration, when fragrance information is input, the code of a song is output that is estimated to have a high γ / α ratio or α / β ratio when listened to while smelling the input fragrance. Therefore, it is possible to search for a code that is highly likely to produce cross-modal sounds when listened to while smelling a specific fragrance.

[0054] Furthermore, in the music search device 1 of this embodiment, the combination information 7 includes a vanilla scent as the scent information 13 and a song containing a C major chord as the music information 15.

[0055] In this configuration, when vanilla scent information is input, a song containing a C major chord is output. Therefore, listening while smelling vanilla scent allows you to search for chords that are likely to produce cross-modal sounds.

[0056] On the other hand, in the music search device 1 of this embodiment, the combination information 7 includes a combination of coffee aroma as aroma information 13 and a music piece containing a G minor chord as music information 15.

[0057] In this configuration, when coffee aroma information is input, a song containing a G minor chord is output. Therefore, by listening while smelling coffee aroma, it is possible to search for chords that are likely to produce cross-modal sounds.

[0058] Furthermore, in the music search device 1 of this embodiment, when a recipe is input as aroma identification information 21, the first determination unit 5 estimates the aroma of the substance to be manufactured from the input recipe and outputs a code that is combined with the estimated aroma.

[0059] In this configuration, when a recipe is input, a code is output that is estimated to result in a high γ / α ratio or α / β ratio when listening while smelling the aroma of the substance produced by the input recipe. Therefore, even if the aroma identified in the aroma identification information 21 is not included in the combination information 7, a code is obtained from the recipe that is highly likely to produce a cross-modal effect when listening while smelling the aroma of the substance produced.

[0060] On the other hand, in the music search device 1 of this embodiment, the first determination unit 5 generates and outputs music using a code that is combined with the aroma information 13 identified by the input aroma identification information 21.

[0061] In this configuration, when aroma information is input, a musical piece is composed and output that is estimated to have a high γ / α ratio or α / β ratio when listened to while smelling the input aroma. Therefore, it is possible to compose and output a musical piece optimized for listening while smelling the input aroma.

[0062] Furthermore, the music search device 1 of this embodiment includes a second determination unit 43 that outputs fragrance information 13 combined with music information 15 when the music identified by music identification information 23 input to the second input unit 41 is included in the music information 15 of the combination information 7.

[0063] In this configuration, when song information is input, information on fragrances that are estimated to have a high γ / α ratio or α / β ratio when smelled while listening to the input song is output. Therefore, when searching for fragrances suitable for smelling while listening to a specific song, it is possible to search for fragrances that more accurately reflect whether cross-modal effects occur than before.

[0064] (Examples) The present invention will be described in detail below based on examples, but the present invention is not limited to these examples. In the examples, subjects were made to smell a fragrance while listening to specific chords as musical pieces, and changes in brainwaves were evaluated, along with sensory evaluations, and the results were compared. The specific procedure is as follows.

[0065] First, we selected vanilla as the aroma and prepared artificial vanilla (manufactured by Kyoritsu Foods Co., Ltd., product name "Vanilla Essence," composition is 35% ethanol, 6% glycerin, and 0.1% caramel I aqueous solution by weight), which is the substance that makes up the vanilla aroma.

[0066] Furthermore, as a sample of the music to be played for the subjects, we prepared data of a recording of a C major chord (hereinafter also referred to as C; BPM 90).

[0067] Next, electroencephalograms (EEGs) were measured in 15 subjects. The EEG measuring device used was the Muse2 (sampling frequency 10 Hz) manufactured by Hakosco Co., Ltd. Of the EEGs obtained from the measurements, those with a frequency of 8 Hz or higher and less than 13 Hz were classified as alpha waves, those with a frequency of 13 Hz or higher and less than 30 Hz were classified as beta waves, and those with a frequency of 30 Hz or higher and less than 80 Hz were classified as gamma waves.

[0068] Electroencephalogram (EEG) measurements were performed using the following procedure. First, for the first 0 to 30 seconds after the start of the test, EEG measurements were taken without exposing the subjects to any fragrance or music as a comparative example (Measurement 1, hereafter also referred to as "nothing"). Then, for the second 31 to 60 seconds after the start of the test, for the third 31 to 60 seconds after the start of the test, subjects were exposed to music only, without exposing them to any fragrance, as a comparative example (Measurement 2, hereafter also referred to as "music only").

[0069] Subsequently, a break was observed between 61 and 90 seconds after the start of the test, during which no fragrance was inhaled and no music was played. Then, between 91 and 120 seconds after the start of the test, as a comparative example, vanilla fragrance was inhaled without music. Specifically, one drop of vanilla fragrance was placed in a container with a lid, the lid was closed, the lid was brought 5 cm away from the subject's nose, and then the lid was opened for 10 seconds to release the fragrance, which the subject inhaled (Measurement 3, hereinafter also referred to as "fragrance only"). Then, between 121 and 150 seconds, a break was observed during which no fragrance was inhaled and no music was played. Finally, after Measurement 3, as an example, between 151 and 180 seconds after the start of the test, the subject inhaled vanilla fragrance in the same manner as in Measurement 3, while also listening to a C major chord, and electroencephalograms were measured (Measurement 4, hereinafter also referred to as "music + fragrance").

[0070] Next, we selected coffee aroma as another aroma, and prepared ground Arabica coffee beans (manufactured by Seijo Ishii Co., Ltd., product name "French Roast"), which are the components of coffee aroma.

[0071] Furthermore, as a musical example to be played for the subjects, we prepared data of a recording of a G minor chord (hereinafter also referred to as Gm; BPM 135).

[0072] Next, electroencephalograms (EEGs) were measured in 15 subjects. The specific procedure was as follows:

[0073] Specifically, first, from 0 to 30 seconds after the start of the test, brainwaves were measured as a comparative example, without exposing participants to the scent or music (Measurement 1, hereafter also referred to as "no scent"). Then, from 31 to 60 seconds after the start of the test, as a comparative example, participants were exposed to music only, without exposing them to the scent (Measurement 2, hereafter also referred to as "music only").

[0074] Subsequently, a break was observed between 61 and 90 seconds after the start of the test, during which no aroma was smelled and no music was played. Then, between 91 and 120 seconds after the start of the test, as a comparative example, the subjects smelled coffee aroma without listening to music. Specifically, 20g of ground coffee beans were placed in a container with a lid, the lid was closed, the lid was brought within 5cm of the subject's nose, and then the lid was opened for 10 seconds to release the aroma, which the subject smelled (Measurement 3, hereafter also referred to as "aroma only"). Then, between 121 and 150 seconds, a break was observed during which no aroma was smelled and no music was played. Finally, after Measurement 3, as an example, between 151 and 180 seconds after the start of the test, the subjects smelled coffee aroma in the same way as in Measurement 3, and also listened to a G minor chord, while their electroencephalogram (EEG) was measured (Measurement 4, hereafter also referred to as "music + aroma").

[0075] Table 1 shows the electroencephalogram (EEG) intensity measured in Measurements 1 through 4. Note that the EEG intensity in Table 1 is the raw data output by Muse2, and the unit is μV.

[0076] [Table 1]

[0077] Furthermore, Table 2 shows the results of calculating the γ / α ratio and α / β ratio (rounded to four decimal places) for measurements 1 to 4 from the electroencephalogram intensity shown in Table 1.

[0078] [Table 2]

[0079] Furthermore, Table 3 shows the difference obtained by subtracting the γ / α ratios obtained in Measurements 1 to 3 (Comparative Examples) from the γ / α ratio obtained in Measurement 4 (Example), and the difference obtained by subtracting the α / β ratios obtained in Measurements 1 to 3 (Comparative Examples) from the α / β ratio obtained in Measurement 4 (Example) (rounded to four decimal places).

[0080] [Table 3]

[0081] As shown in Table 2, subjects A, B, C, D, E, and G had a γ / α ratio greater than 1 when they smelled vanilla while listening to music in C major. This suggests that cross-modal effects may occur when consuming sweet-tasting beverages while listening to music in C major. Furthermore, as is clear from Table 3, among subjects with a γ / α ratio greater than 1, subjects A, B, D, E, and G had a difference of greater than 0 between measurement 4 and measurements 1-3 when they smelled vanilla while listening to music in C major. In other words, the γ / α ratio was higher when smelling vanilla while listening to music in C major than when neither vanilla nor music was listened to, or when only music was listened to, or only vanilla was smelled. These results also showed that the γ / α ratio was less likely to increase when neither vanilla scent nor music was smelled, or when only vanilla scent was smelled, or only music was listened to, compared to when vanilla scent was smelled while listening to music in C major.

[0082] Furthermore, as shown in Table 2, subjects C, K, L, M, N, and O had an α / β ratio greater than 1 when they smelled coffee while listening to music in G minor. This result suggests that cross-modal activity may also occur when smelling coffee while listening to music in G minor. Also, as shown in Table 3, among subjects with an α / β ratio greater than 1, subjects K, L, and N had a difference of greater than 0 between measurement 4 and measurements 1-3 when they smelled coffee while listening to music in G minor. In other words, the α / β ratio was higher when smelling coffee while listening to music in G minor than when neither coffee nor music was listened to, or when only coffee was smelled, or only music was listened to. These results also showed that the α / β ratio was less likely to be large when participants did not smell coffee aroma and did not listen to music, or when they only smelled coffee aroma or only listened to music, compared to when they smelled coffee aroma while listening to music in G minor. Furthermore, it was suggested that it may be possible to generate optimized combination information 7 by customizing the combination information 7 for each individual participant based on the EEG measurements when they listened to music while smelling aroma, for example, for participants A, B, D, E, G, K, L, and N, where cross-modal activity was particularly strongly suggested.

[0083] Furthermore, as a comparative example, a sensory evaluation was also conducted using the following procedure. First, Measurement 4 was performed on 38 subjects, including those listed in Table 1. Participants were asked to select a song that they felt matched the vanilla aroma using one of three options: "C major chord," "G minor chord," or "Neither." Similarly, they were asked to select a song that they felt matched the coffee aroma using one of three options: "C major chord," "G minor chord," or "Neither." The results are shown in Table 4.

[0084] [Table 4]

[0085] As shown in Table 4, 28 out of 38 subjects responded that they felt the C major chord matched the vanilla scent. This result is consistent with the results of the example, which suggested that cross-modal interaction may occur when smelling vanilla scent while listening to music in a C major chord.

[0086] Furthermore, 20 of the 38 subjects reported feeling that the G minor chord matched the aroma of coffee. This result is consistent with the results of the previous experiment, which suggested that cross-modal interactions may occur when listening to music in the G minor chord while smelling the aroma of coffee.

[0087] From these results, it was found that the present invention correlates with the results of sensory evaluation and can be used as an alternative to sensory evaluation to assess the possibility of cross-modal phenomena occurring.

[0088] Although the present invention has been described above based on embodiments and examples, the present invention is not limited to the above embodiments and examples. Modifications may be made without departing from the spirit of the invention, and other technologies may be combined as appropriate to the extent possible. Furthermore, publicly known or well-known technologies may be combined as appropriate to the extent possible.

[0089] For example, in the embodiment described above, the song information 15 combined with the specific aroma information 13 in the combination information 7 includes only one song (chord), but it may include two or more songs.

[0090] Furthermore, in the embodiment described above, the music search device 1 is configured to output search results to an external display unit 17 and speaker 19, but the music search device 1 may also be configured to have the display unit 17 and speaker 19 built-in.

[0091] Furthermore, in the above-described embodiment, the music search device 1 has the function of a music search device 1 that outputs music information 15 when aroma identification information 21 is input, and the function of an aroma search device that outputs aroma information 13 when music identification information 23 is input. However, the music search device 1 may only have the function of a music search device 1 that outputs music information 15 when aroma identification information 21 is input. In this case, the music search device 1 does not need to include the second input unit 41 and the second determination unit 43. Also, an aroma search device that has only the function of outputting aroma information 13 when music identification information 23 is input is also included in the scope of the present invention. In this case, the aroma search device does not need to include the first input unit 3 and the first determination unit 5, as long as it includes a storage unit 9 that stores combination information 7, a second input unit 41 that receives input of music identification information 23, and a second determination unit 43 that outputs aroma information 13 that is combined with music information 15 identified by music identification information 23. [Explanation of Symbols]

[0092] 1: Music search device (fragrance search device) 3: First input section 5: 1st judgment part 7: Combination Information 9: Storage section 13: Aroma Information 15: Song Information 21: Aroma Identification Information 23: Song Identification Information 41: Second input section (input section) 43:Second judgment section (judgment section)

Claims

1. A storage unit that stores combination information consisting of aroma information and music information which is estimated to be a combination of music in which, when listened to while smelling the aroma indicated by the aroma information, the gamma / alpha ratio (intensity ratio of gamma waves to alpha waves) or the alpha / beta ratio (intensity ratio of alpha waves to beta waves) emitted by the person smelling the aroma will be equal to or greater than a predetermined value. A first input unit that receives input of aroma identification information, which is information that identifies the aforementioned aroma, A first determination unit determines whether the fragrance identified in the fragrance identification information is included in the fragrance information of the combination information, and if it determines that it is included, outputs the music information that is combined with the fragrance information identified in the fragrance identification information. Equipped with A music search device characterized by the following features.

2. The aforementioned song information includes the code. Characterized by The music search device according to claim 1.

3. The aforementioned combination information includes a combination of vanilla fragrance as the fragrance information and the aforementioned musical piece including a C major chord as the musical piece information. Characterized by The music search device according to claim 2.

4. The aforementioned combination information includes a combination of coffee aroma as the aroma information and the aforementioned musical piece including a G minor chord as the musical piece information. Characterized by The music search device according to claim 2.

5. The first determination unit is, When a recipe for manufacturing a substance that emits the aforementioned aroma is input as aroma identification information, the system estimates the aroma of the manufactured substance from the input recipe and outputs the code, which is a combination of the aroma information indicating the estimated aroma and the code, as music information. Characterized by The music search device according to claim 2.

6. The first determination unit generates and outputs the music using the code combined with the aroma information identified by the input aroma identification information. Characterized by The music search device according to claim 2.

7. A second input unit that receives input of song identification information to identify the aforementioned song, A second determination unit determines whether the song identified by the song identification information is included in the song information of the combination information, and if it determines that it is included, outputs the fragrance information that is combined with the song identified by the song information. Equipped with Characterized by The music search device according to claim 1.

8. A storage unit that stores combination information consisting of aroma information and music information which is estimated to be a combination of music in which, when listened to while smelling the aroma indicated by the aroma information, the gamma / alpha ratio (intensity ratio of gamma waves to alpha waves) or the alpha / beta ratio (intensity ratio of alpha waves to beta waves) emitted by the person smelling the aroma will be equal to or greater than a predetermined value. An input unit that accepts input of song identification information, which is information that identifies the aforementioned song, A determination unit determines whether the song identified by the song identification information is included in the song information of the combination information, and if it is determined that it is included, it outputs the fragrance information that is combined with the song information identified by the song identification information. Equipped with A fragrance detection device characterized by the following features.