Masking sound selection device, program, and masking sound selection method
The device automatically selects and outputs masking sounds based on noise type frequency characteristics, addressing the challenge of finding effective masking sounds for ambient noise, ensuring continuous noise suppression and time-based selection for enhanced effectiveness.
Patent Information
- Application Number
- PCT/JP2024/018063
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-22
- Filing Date
- 2024-05-16
- Publication Date
- 2024-11-28
AI Technical Summary
Users face difficulty in finding masking sounds with high masking effects for various types of ambient noise, such as car sounds, factory noises, and conversations, as existing solutions require manual selection which is cumbersome.
A device and method that pre-registers information about masking sounds with high masking effects for each noise type, using frequency characteristics of ambient sound to automatically select and superimpose an appropriate masking sound for effective noise suppression.
Automatically selects and outputs masking sounds with high masking effects for surrounding noise, ensuring continuous noise suppression even if ambient noise changes, and allows for time-based selection of masking sounds for enhanced effectiveness.
Smart Images

Figure JP2024018063_28112024_PF_FP_ABST
Abstract
Description
Masking sound selection device, program, and masking sound selection method
[0001] The present invention relates to a masking technique for noises and background noises such as the sound of a car running, the sound of a factory operating, and the conversation of other people.
[0002] A masking effect is known in which unpleasant noises and background noises (such as the sound of a car running, the sound of a factory operating, or other people's conversations) are made harder to hear by superimposing a sound (masking sound) with a frequency close to the frequency of the noise. By outputting a masking sound that has a masking effect on surrounding noises, a user can spend their time in a relaxed state without being bothered by the surrounding noises (Patent Document 1, Non-Patent Document 1).
[0003] JP 2015-57621 A
[0004] "Texcell SAINT COLUMN: What is sound masking? Learn about its overview, effects, and usage scenarios," [online], Gifu Plastic Industry Co., Ltd., [Retrieved April 11, 2023], Internet, <URL: http: / / teccell.co.jp / saint / column / sound-masking / >
[0005] Incidentally, the masking sound with a high masking effect differs depending on the type of noise, etc. It is very troublesome for a user to find a masking sound with a high masking effect depending on the surrounding noise, etc.
[0006] The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a technique that can automatically select a masking sound that has a high masking effect against surrounding noise and the like.
[0007] To solve the above problem, the present invention pre-registers information about masking sounds with high masking effects for each noise type, identifies the noise type of the ambient sound based on the frequency characteristics of the audio data of the collected ambient sound, and selects a masking sound identified by the pre-registered information linked to the identified noise type as the masking sound to be superimposed on the ambient sound.
[0008] For example, the present invention provides a masking sound selection device that selects a masking sound to be superimposed on an ambient sound, and includes: a masking sound information storage means that stores information about masking sounds for each noise type; a sound collection means that collects the ambient sound; a frequency characteristic analysis means that analyzes the frequency characteristics of audio data of the ambient sound collected by the sound collection means; and a masking sound selection means that identifies the noise type of the ambient sound based on the frequency characteristics analyzed by the frequency characteristic analysis means, and selects a masking sound that is identified by information associated with the noise type and stored in the masking sound information storage means as the masking sound to be superimposed on the ambient sound.
[0009] In the present invention, the noise type of the ambient sound is identified based on the frequency characteristics of the audio data of the collected ambient sound, and a masking sound identified by pre-registered information linked to the identified noise type is selected. Therefore, according to the present invention, by pre-registering information about masking sounds with high masking effects for each noise type, a masking sound with high masking effect against ambient noise, etc. is automatically selected.
[0010] Fig. 1 is a schematic diagram of an audio system according to an embodiment of the present invention. Fig. 2 is a schematic functional diagram of a wireless speaker 1. Fig. 3 is a diagram showing an example of registered contents of a masking sound information storage unit 15. Fig. 4 is a flow chart for explaining the masking sound reproduction operation of the wireless speaker 1.
[0011] An embodiment of the present invention will be described below.
[0012] FIG. 1 is a schematic diagram of an audio system according to the present embodiment.
[0013] As shown in the figure, the audio system according to this embodiment comprises a wireless speaker 1, a remote controller 2, and a media server 3 that distributes audio data including a masking sound.
[0014] The wireless speaker 1 and the remote controller 2 are connected to a network 4 such as a WAN (Wide Area Network) or a LAN (Local Area Network) via an access point 5. In addition, a media server 3 is connected to the network 4.
[0015] When the wireless speaker 1 receives a playback instruction specifying a song from the remote controller 2 via the access point 5, it accesses the media server 3 via the access point 5 and the network 4, downloads the audio data of the song specified in the playback instruction from the media server 3, and plays and outputs it. When the wireless speaker 1 receives an instruction to switch to relaxation mode from the remote controller 2 via the access point 5, it selects a masking sound that has a high masking effect against ambient sounds including noise and disturbances (such as noise). It then accesses the media server 3 via the access point 5 and the network 4, downloads the audio data of the selected masking sound from the media server 3, and plays and outputs it.
[0016] Next, the wireless speaker 1 constituting the audio system according to this embodiment will be described in detail.
[0017] Note that an existing wireless terminal such as a smartphone or tablet PC (Personal Computer) can be used as the remote controller 2, and an existing media server that delivers requested audio data to the requestor can be used as the media server 3. Therefore, detailed descriptions of the remote controller 2 and the media server 3 will be omitted.
[0018] FIG. 2 is a diagram showing a schematic functional configuration of the wireless speaker 1.
[0019] As shown in the figure, the wireless speaker 1 includes a wireless interface unit 10, an instruction receiving unit 11, an audio acquisition unit 12, an audio playback unit 13, an audio output unit 14, a masking sound information storage unit 15, a sound collection unit 16, a frequency characteristic analysis unit 17, and a masking sound selection unit 18.
[0020] The wireless interface unit 10 is an interface for connecting to the access point 5 .
[0021] The instruction receiving unit 11 receives various instructions from the remote controller 2 via the wireless interface unit 10 .
[0022] The audio acquisition unit 12 accesses the media server 3 via the wireless interface unit 10 and acquires, from the media server 3, audio data of the song specified by the instruction acceptance unit 11 or audio data of the masking sound specified by the masking sound selection unit 18.
[0023] The audio playback unit 13 plays back the audio data acquired by the audio acquisition unit 12 .
[0024] The audio output unit 14 outputs the audio data reproduced by the audio reproduction unit 13 from a built-in or external speaker (not shown).
[0025] The masking sound information storage unit 15 stores information about one or more masking sounds for each type of noise (noise type) in association with its reproduction time period.
[0026] FIG. 3 is a diagram showing an example of registered contents in the masking sound information storage unit 15. As shown in FIG.
[0027] As shown in the figure, the masking sound information storage unit 15 stores a record 150 of masking sound information for each noise type. This record 150 has a field 151 in which the noise type is registered, and one or more fields in which the names of masking sounds that have a high masking effect on noises belonging to that noise type are stored. In this embodiment, each record 150 has two fields 152 and 153 in which the names of masking sounds are stored. One field, 152, stores the name of a masking sound that is suitable for being played during the day (playback time period from 5:00 to 18:00), and the other field, 153, stores the name of a masking sound that is suitable for being played at night (playback time period from 18:00 to 5:00). In this embodiment, a day is divided into two time periods (daytime and nighttime), and the names of masking sounds appropriate for each time period are registered in record 150. However, a day may be divided into three or more time periods (morning, noon, evening, night, etc.), and the names of masking sounds appropriate for each time period may be registered in record 150.
[0028] The sound collection unit 16 collects ambient sounds using an internal or external microphone (not shown) in accordance with instructions from the masking sound selection unit 18 , and outputs audio data of the collected ambient sounds to the frequency characteristic analysis unit 17 .
[0029] The frequency characteristic analysis unit 17 analyzes the frequency characteristics of the audio data of the ambient sound collected by the sound collection unit 16. Here, when the audio playback unit 13 is playing back audio data of the masking sound, the frequency characteristic analysis unit 17 extracts difference data between the audio data of the ambient sound collected by the sound collection unit 16 and the audio data of the masking sound being played back, and analyzes the frequency characteristics of the extracted difference data.
[0030] The masking sound selection unit 18 identifies the noise type to which the ambient sound belongs based on the frequency characteristics analyzed by the frequency characteristic analysis unit 17. For example, the masking sound selection unit 18 stores typical frequency characteristics of noises of each noise type stored in the masking sound information storage unit 15, and searches these frequency characteristics for a frequency characteristic that most closely resembles the frequency characteristic analyzed by the frequency characteristic analysis unit 17. The masking sound selection unit 18 then identifies the noise type associated with the searched frequency characteristic as the noise type of the ambient sound. The masking sound selection unit 18 also selects, as the name of the masking sound to be superimposed on the ambient sound, the name of the masking sound stored in the masking sound information storage unit 15 and associated with the identified ambient sound type and a playback time period (daytime or nighttime) including the current time. The masking sound selection unit 18 then notifies the audio acquisition unit 12 of the name of the selected masking sound and instructs the audio acquisition unit 12 to play the masking sound.
[0031] 2 may be realized in hardware using an integrated logic IC such as an ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array), or in software using a computer such as a DSP (Digital Signal Processor). Alternatively, the functional configuration of the wireless speaker 1 may be realized as a process in a general-purpose computer such as a PC (Personal Computer) that includes a CPU (Central Processing Unit), memory, an auxiliary storage device such as a flash memory or a hard disk drive, a wireless communication device such as a wireless LAN adapter, and an internal or external audio device (microphone, speaker), where the CPU loads a predetermined program from the auxiliary storage device into the memory and executes it.
[0032] FIG. 4 is a flow diagram for explaining the masking sound reproduction operation of the wireless speaker 1.
[0033] This flow starts when the instruction receiving unit 11 receives an instruction to switch to the relaxation mode from the remote controller 2 via the wireless interface unit 10 .
[0034] First, the instruction receiving unit 11 instructs the audio acquiring unit 12 to transition to the relax mode. In response to this, if the audio playback unit 13 is currently playing audio data of a song (YES in S100), the audio acquiring unit 12 stops the playback of the audio data of this song (S101) and then proceeds to S102. On the other hand, if the audio playback unit 13 is not currently playing audio data of a song (NO in S100), the audio acquiring unit 12 immediately proceeds to S102.
[0035] Next, in S102, the instruction receiving unit 11 instructs the masking sound selection unit 18 to transition to the relaxation mode. In response to this, the masking sound selection unit 18 instructs the sound collection unit 16 to start collecting sound. In response to this, the sound collection unit 16 collects ambient sound (S102). Then, audio data of the collected ambient sound is passed to the frequency characteristic analysis unit 17.
[0036] Next, the frequency characteristic analysis unit 17 analyzes the frequency characteristics of the audio data of the ambient sound received from the sound collection unit 16 (S103) and passes the analysis result to the masking sound selection unit 18. In response to this, the masking sound selection unit 18 searches for the frequency characteristics that are most similar to the frequency characteristics received from the frequency characteristic analysis unit 17 from among typical frequency characteristics of noises, etc., pre-registered for each noise type. Then, it identifies the noise type associated with the searched frequency characteristics as the noise type of the ambient sound (S104).
[0037] Next, the masking sound selection unit 18 selects, as the name of the masking sound to be superimposed on the ambient sound, the name of the masking sound stored in the masking sound information storage unit 15 and associated with the identified ambient sound type and a playback time period including the current time. The audio acquisition unit 12 is then notified of the selected masking sound name and instructed to play the masking sound. In response to this, the audio acquisition unit 12 accesses the media server 3 via the wireless interface unit 10 and acquires, from the media server 3, audio data of the masking sound with the name notified by the masking sound selection unit 18 (S105). The acquired audio data of the masking sound is then output to the audio playback unit 13.
[0038] Next, the audio playback unit 13 starts playing the audio data of the masking sound received from the audio acquisition unit 12, and outputs the masking sound from the audio output unit 14 (S106).
[0039] Thereafter, when a predetermined time (e.g., 5 minutes) has elapsed since the start of playback of the masking sound audio data (YES in S107), the masking sound selection unit 18 returns to S102. In subsequent S103, the frequency characteristic analysis unit 17 extracts difference data between the audio data of the ambient sound received from the sound collection unit 16 and the audio data of the masking sound being played by the audio playback unit 13, analyzes the frequency characteristics of the extracted difference data, and passes the analysis result to the masking sound selection unit 18.
[0040] One embodiment of the present invention has been described above.
[0041] In this embodiment, the noise type of the ambient sound is identified based on the frequency characteristics of the audio data of the collected ambient sound, and a masking sound with a name associated with the identified noise type is acquired, played, and output from the media server 3. Therefore, according to this embodiment, by pre-registering the names of masking sounds with high masking effects for each noise type, it is possible to automatically select and output a masking sound with a high masking effect against ambient noise, etc.
[0042] Furthermore, in this embodiment, when audio data of a masking sound is being played back, differential data between the audio data of the collected ambient sound and the audio data of the masking sound being played back is extracted, and the noise type of the ambient sound is identified based on the frequency characteristics of the extracted differential data. Therefore, according to this embodiment, if the ambient noise, etc. changes while a masking sound is being played back, the masking sound being played back is automatically changed to a masking sound that has a high masking effect for the changed ambient noise, etc. Therefore, even if the ambient noise, etc. changes, a masking sound with a high masking effect can always be output.
[0043] Furthermore, in this embodiment, the names of multiple masking sounds are stored for each noise type, each associated with a playback time period (daytime or nighttime), and the masking sounds with names associated with the ambient noise type and playback time period including the current time are acquired from the media server 3, played, and output. Therefore, the masking sounds can be changed according to the playback time period, and from among masking sounds that have a high masking effect against ambient noise, a masking sound that is preferred for each time period, for example, can be automatically selected and output.
[0044] The present invention is not limited to the above-described embodiment, and various modifications are possible within the scope of the present invention.
[0045] For example, in the above embodiment, the wireless speaker 1 acquires, from the media server 3, and plays and outputs masking sounds whose names are associated with noise types of ambient sounds. However, the present invention is not limited to this. The wireless speaker 1 may be provided with a masking sound storage unit in which one or more masking sounds are stored, and the names of the masking sounds in the masking sound storage unit may be associated with noise types and registered in the masking sound information storage unit 15, so that the wireless speaker 1 reads, from the masking sound storage unit, the masking sounds whose names are associated with noise types of ambient sounds, and plays and outputs them.
[0046] In the above embodiment, the wireless speaker 1 stores the names of multiple masking sounds for each noise type, each associated with a playback time period. However, the present invention is not limited to this. The wireless speaker 1 may select one of the names of masking sounds associated with a noise type of ambient sound, and play and output the masking sound with the selected name.
[0047] For example, the name of a masking sound may be stored for each noise type in the masking sound information storage unit 15. In this case, the wireless speaker 1 reproduces and outputs one type of masking sound associated with the noise type of the ambient sound, regardless of the time of day.
[0048] Alternatively, the masking sound information storage unit 15 may store a plurality of masking sound names for each noise type, each associated with the user's physical and mental state (active, calm, etc.), and the wireless speaker 1 may acquire the user's biometric information from a wearable device having a function for measuring biometric information including heart rate and blood pressure, identify the user's physical and mental state from the biometric information, and play and output a masking sound with a name associated with the noise type of the ambient sound and the identified physical and mental state of the user. In this manner, a masking sound that has a high masking effect against ambient noise and is suited to the user's physical and mental state can be output from the wireless speaker 1. Here, the wearable device may be a wireless device (for example, a wireless device used as the remote controller 2).
[0049] In the above embodiment, the wireless speaker 1 collects ambient sound, analyzes the frequency characteristics of the collected sound data to identify the noise type of the ambient sound, and plays back and outputs audio data of a masking sound with a name associated with the identified noise type. However, the present invention is not limited to this. For example, the remote controller 2 may collect ambient sound, analyze the frequency characteristics of the audio data of the ambient sound to identify the noise type of the ambient sound, and then issue a playback instruction to the wireless speaker 1 specifying the name of the masking sound associated with the noise type. Alternatively, the remote controller 2 may obtain the audio data of the masking sound from the media server 3 or read it from pre-registered audio data of masking sounds and send it to the wireless speaker 1, thereby causing the wireless speaker 1 to play back and output the masking sound.
[0050] 2 are provided in the remote controller 2 and are not required for the wireless speaker 1. Furthermore, the remote controller 2 is provided with a playback instruction unit that notifies the wireless speaker 1 of a playback instruction that includes the specification of the name of the masking sound, or a masking sound transmission unit that transmits audio data of the masking sound (audio data of the masking sound obtained from the media server 3 or audio data of the masking sound read from audio data of the masking sound registered in advance) to the wireless speaker 1.
[0051] If the remote controller 2 is provided with a masking sound transmitter along with the masking sound information storage unit 15, sound collection unit 16, frequency characteristic analysis unit 17, and masking sound selection unit 18, while the wireless speaker 1 is reproducing a masking sound, the remote controller 2 collects ambient sound a predetermined time after the start of masking sound reproduction, extracts difference data between the audio data of the ambient sound and the audio data of the masking sound being reproduced that the masking sound transmitter transmitted to the wireless speaker 1, and identifies the noise type of the ambient sound based on the frequency characteristics of this difference data. The remote controller 2 then issues a reproduction instruction to the wireless speaker 1 specifying the name of a masking sound associated with the identified noise type, or obtains the audio data of the masking sound associated with the identified noise type from the media server 3 or reads it from pre-registered audio data of masking sounds and transmits it to the wireless speaker 1. This causes the wireless speaker 1 to reproduce and output a masking sound that has a high masking effect against the changed ambient noise, etc. Therefore, even if the ambient noise or the like changes while the masking sound is being reproduced by the wireless speaker 1, the masking sound that has a high masking effect against the ambient noise or the like can always be reproduced and output by the wireless speaker 1.
[0052] Furthermore, the present invention can be widely applied to devices and systems that superimpose masking sounds on ambient noises and the like.
[0053] 1: Wireless speaker 2: Remote controller 3: Media server 4: Network 5: Access point 10: Wireless interface unit 11: Instruction reception unit 12: Audio acquisition unit 13: Audio playback unit 14: Audio output unit 15: Masking sound information storage unit 16: Sound collection unit 17: Frequency characteristic analysis unit 18: Masking sound selection unit
Claims
1. A masking sound selection device that selects a masking sound to be superimposed on an ambient sound, comprising: a masking sound information storage means in which information related to masking sounds is stored for each noise type; a sound collection means for collecting the ambient sound; a frequency characteristic analysis means for analyzing frequency characteristics of audio data of the ambient sound collected by the sound collection means; and a masking sound selection means for identifying a noise type of the ambient sound based on the frequency characteristics analyzed by the frequency characteristic analysis means, and selecting a masking sound identified by information associated with the noise type and stored in the masking sound information storage means, as the masking sound to be superimposed on the ambient sound.
2. A masking sound selection device according to claim 1, further comprising: a reproduction means for reproducing audio data of the masking sound selected by said masking sound selection means; and an output means for outputting the audio data of the masking sound reproduced by said reproduction means.
3. A masking sound selection device according to claim 2, wherein the frequency characteristic analysis means, when the reproduction means is reproducing the masking sound, analyzes the frequency characteristics of differential data between the audio data of the ambient sound collected by the sound collection means and the audio data of the masking sound being reproduced.
4. A masking sound selection device according to claim 1, further comprising a reproduction instruction means for notifying an audio device of a reproduction instruction involving the specification of the masking sound selected by the masking sound selection means.
5. A masking sound selection device according to claim 1, further comprising a masking sound transmission means for transmitting audio data of the masking sound selected by said masking sound selection means to an audio device.
6. A masking sound selection device as claimed in claim 5, characterized in that the frequency characteristic analysis means, when the audio device is playing back audio data of the masking sound transmitted by the masking sound transmission means, analyzes the frequency characteristics of differential data between the audio data of the ambient sound collected by the sound collection means and the audio data of the masking sound being played back.
7. A masking sound selection device according to any one of claims 1 to 6, wherein the masking sound information storage means stores information on a plurality of masking sounds for each noise type together with a playback time period, and the masking sound selection means selects, as a masking sound to be superimposed on the ambient sound, a masking sound identified by information stored in the masking sound information storage means and linked to the noise type of the ambient sound and a playback time period including the current time.
8. A masking sound selection device as claimed in any one of claims 1 to 6, further comprising a biometric information acquisition means for acquiring biometric information of a user, wherein the masking sound information storage means stores information on a plurality of masking sounds for each noise type together with the user's respective mental and physical state, and the masking sound selection means selects, as a masking sound to be superimposed on the ambient sound, a masking sound identified by information stored in the masking sound information storage means that is linked to the noise type of the ambient sound and the user's mental and physical state indicated by the biometric information acquired by the biometric information acquisition means.
9. A program that causes a computer to function as a masking sound selection device that selects a masking sound to be superimposed on an ambient sound, comprising: a masking sound information storage means that stores information about masking sounds for each noise type; a sound collection means that collects the ambient sound; a frequency characteristic analysis means that analyzes the frequency characteristics of audio data of the ambient sound collected by the sound collection means; and a masking sound selection means that identifies the noise type of the ambient sound based on the frequency characteristics analyzed by the frequency characteristic analysis means, and selects a masking sound identified by information associated with the noise type and stored in the masking sound information storage means, as the masking sound to be superimposed on the ambient sound.
10. A method for selecting a masking sound to be superimposed on an ambient sound by a masking sound selection device, comprising the steps of: collecting the ambient sound, analyzing frequency characteristics of audio data of the ambient sound, identifying a noise type of the ambient sound based on the analyzed frequency characteristics, and selecting a masking sound identified by pre-registered information linked to the identified noise type as the masking sound to be superimposed on the ambient sound.
Citation Information
Patent Citations
Evaluation device and evaluation method for voice masking
JP2015057621A
Construction noise masking facility and construction noise masking method
JP2012247698A
Work environment improvement system
JP2017146517A
Masking sound outputting device, and masking sound outputting means
WO2012043597A1
Call system
WO2023047911A1
