Information processing device
By calculating the amplitude ratio of the sound output by multiple speakers and generating a reference signal, the problem of difficulty in effectively canceling the sound output by multiple speakers in the prior art is solved, and the effect of sound cancellation is improved.
Patent Information
- Application Number
- JP2023161675
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-09-25
- Publication Date
- 2025-04-07
- Estimated Expiration
- 2043-09-25
AI Technical Summary
The prior art is difficult to effectively cancel multiple output sounds from multiple speakers.
By acquiring a plurality of first sound outputs from a plurality of speakers, a ratio of sound amplitude is calculated, and using this ratio as the mixing ratio, a reference signal is generated to cancel the plurality of output sounds.
Effective cancellation of multiple sound outputs is achieved, especially by mixing the process according to the sound amplitude, which can better cancel the larger sound output.
Smart Images

Figure 2025052779000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to an information processing device. [Background technology]
[0002] Patent Document 1 discloses an in-vehicle voice recognition device that performs echo cancellation processing to remove echo components contained in input voice. The in-vehicle voice recognition device disclosed in Patent Document 1 removes echo components contained in input voice collected via a microphone and signals from multiple sound sources. The in-vehicle voice recognition device also performs voice recognition on the output from which the echo components have been removed. The in-vehicle voice recognition device also monitors the input voice collected via the microphone and signals from multiple sound sources, and controls the echo cancellation processing by determining whether or not removing the echo components will improve the voice recognition rate. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2009-181025 A Summary of the Invention [Problem to be solved by the invention]
[0004] An object of the present disclosure is to effectively cancel multiple sounds output from multiple speakers. [Means for solving the problem]
[0005] The information processing device according to the present disclosure includes: Obtaining a plurality of first sounds output from a plurality of speakers; Calculating a ratio of the loudness of the acquired first sounds; setting a mixing ratio, which is a ratio for mixing a plurality of sound signals, by applying the calculated ratio of the loudness of the plurality of first sounds as a mixing ratio used to generate a reference signal for canceling a plurality of output sounds output from the plurality of speakers in response to the plurality of sound signals from a sound acquired by a microphone; The control unit is configured to: Effect of the Invention
[0006] According to the present disclosure, multiple sounds output from multiple speakers can be effectively cancelled out. [Brief description of the drawings]
[0007] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of a voice recognition system according to this embodiment. [Diagram 2] FIG. 2 is a diagram showing an arrangement of a plurality of speakers and an in-vehicle device in a vehicle. [Diagram 3] FIG. 3 is a block diagram illustrating an example of a functional configuration of the in-vehicle device. [Figure 4] FIG. 4 is a diagram showing an example of a table configuration of the ratio information held in the ratio information database. [Diagram 5] FIG. 5 is a flowchart of a first process executed by the control unit of the in-vehicle device. [Figure 6] FIG. 6 is a flowchart of the second process executed by the control unit of the in-vehicle device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0008] Consider a case where sound is captured by a microphone. At this time, there may be cases where a speaker around the microphone is outputting sound. In such a case, the sound captured by the microphone will be mixed with the sound output from the speaker.
[0009] In addition, there are cases where multiple speakers output multiple sounds. In this case, a reference signal for canceling the multiple sounds output from the multiple speakers may be used to cancel the multiple sounds from the sound acquired from the microphone. The information processing device according to the present disclosure aims to cancel the multiple sounds output from the multiple speakers in such a case.
[0010] A control unit of an information processing device according to the present disclosure acquires a plurality of first sounds output from a plurality of speakers. The control unit of the information processing device calculates a ratio of the volume of the acquired plurality of first sounds. Then, the control unit sets the mixing ratio by applying the calculated ratio of the volume of the plurality of first sounds as a mixing ratio. Here, the mixing ratio is a ratio for mixing a plurality of sound signals, and is a ratio used to generate a reference signal for canceling a plurality of output sounds output from a plurality of speakers according to the plurality of sound signals from a sound acquired by a microphone.
[0011] As described above, the mixing ratio is specified by the information processing device. As a result, mixing is performed according to the volume of the first sound output from each speaker, and a reference signal is generated. Then, the multiple sounds output from the multiple speakers are cancelled out from the sound acquired from the microphone using the reference signal.
[0012] At this time, in the reference signal, the multiple sound signals are mixed according to the volume of the first sound. As a result, the louder the output sound is, the greater the mixing ratio is in the reference signal. Therefore, it is possible to place more weight on the louder output sound among the multiple output sounds. As a result, it is possible to effectively cancel out the multiple sounds output from the multiple speakers.
[0013] Specific embodiments of the present disclosure will be described below with reference to the drawings. Unless otherwise specified, the hardware configuration, module configuration, functional configuration, and the like described in each embodiment are not intended to limit the technical scope of the disclosure to only those.
[0014] <Embodiment> A voice recognition system 1 according to the present embodiment will be described with reference to Fig. 1 and Fig. 2. Fig. 1 is a diagram showing a schematic configuration of the voice recognition system 1 according to the present embodiment. The voice recognition system 1 includes an in-vehicle device 100 and an audio device 200. In the voice recognition system 1, the in-vehicle device 100 and the audio device 200 are connected to each other by an in-vehicle network via an interface (I / F).
[0015] (In-vehicle device) The in-vehicle device 100 is a device mounted on the vehicle 10. The in-vehicle device 100 provides various services, such as providing information to a user in response to an utterance from the user aboard the vehicle 10. The in-vehicle device 100 also outputs a signal for outputting a sound, such as music, or white noise, inside the vehicle 10. Specifically, the in-vehicle device 100 includes a source device 11, a microphone 12, and a canceller 13.
[0016] The source device 11 is a device that outputs an audio signal for causing the audio device 200 to reproduce sounds such as music. The source device 11 is, for example, a media reader such as a CD drive. The source device 11 reads media such as a CD and outputs an audio signal. The source device 11 is a device that outputs information such as prestored music or white noise as an audio signal. The microphone 12 is a microphone mounted on the vehicle 10. The microphone 12 acquires speech from a user aboard the vehicle 10.
[0017] The canceller 13 is a device for cancelling sounds other than the sound, including the user's speech, captured by the microphone 12. Details of the method in which the canceller 13 cancels sounds other than the sound, including the user's speech, will be described later.
[0018] The in-vehicle device 100 includes a computer having a processor 110, a main memory unit 120, and an auxiliary memory unit 130. The processor 110 is, for example, a CPU (Central Processing Unit) or a DSP (Digital Signal The main memory unit 120 is, for example, a RAM (Random Access Memory). The auxiliary memory unit 130 is, for example, a ROM (Read Only Memory). The auxiliary memory unit 130 is, for example, a HDD (Hard Disk Drive) or a disk recording medium such as a CD-ROM, a DVD disk, or a Blu-ray disk. The auxiliary memory unit 130 may be a removable medium (portable storage medium). Here, examples of the removable medium include a USB memory and an SD card.
[0019] In the in-vehicle device 100, the auxiliary storage unit 130 stores an operating system (OS), various programs, various information tables, and the like. In the in-vehicle device 100, the processor 110 loads the programs stored in the auxiliary storage unit 130 into the main storage unit 120 and executes them to realize various functions as described below. However, some or all of the functions of the in-vehicle device 100 may be realized by a hardware circuit such as an ASIC or an FPGA. Note that the in-vehicle device 100 does not necessarily have to be realized by a single physical configuration, and may be configured by a plurality of computers that cooperate with each other.
[0020] (Audio Equipment) The audio device 200 is a device mounted on the vehicle 10. The audio device 200 outputs sounds such as music using an audio signal received from the in-vehicle device 100. The audio device 200 includes a microcomputer 21, an amplifier 22, a plurality of speakers 23, and a mixer 24. Similarly to the in-vehicle device 100, the audio device 200 includes a computer.
[0021] The microcomputer 21 is a device that converts an audio signal received from the vehicle 10 into an output signal for the audio device 200 (speaker 23) to output sound. The microcomputer 21 transmits the output signal obtained by converting the audio signal to the amplifier 22. The amplifier 22 is a device that amplifies the output signal received from the vehicle 10 and outputs it to the speaker 23. In this embodiment, the output signal is a signal whose sound volume is specified by the magnitude of the voltage.
[0022] Moreover, the speaker 23 is a speaker provided in the vehicle 10. The vehicle 10 is provided with a plurality of speakers 23. The speakers 23 output sound into the vehicle 10 using the amplified output signal received from the amplifier 22. Here, the microcomputer 21 transmits a plurality of channel output signals to the microcomputer 21 in order to cause the plurality of speakers 23 to output sound. Here, the number of output signals transmitted by the microcomputer 21 may be the same as the number of the speakers 23, or may be a number smaller than the number of the speakers 23. When the number of output signals is smaller than the number of the speakers 23, at least two speakers 23 output sound using the same output signal.
[0023] At this time, the user of the vehicle 10 may speak to the in-vehicle device 100 (microphone 12). In this case, it is assumed that the microphone 12 picks up sounds such as music output by the speaker 23 together with the speech of the vehicle 10. In this case, the sounds such as music output by the speaker 23 may impede the voice recognition of the speech of the user of the vehicle 10 by the in-vehicle device 100.
[0024] Therefore, it is assumed that the audio device 200 transmits an output signal to the in-vehicle device 100, and the in-vehicle device 100 refers to the output signal and cancels the sound output by the audio device 200 (speaker 23) from the sound acquired by the microphone 12. Meanwhile, in this embodiment, the in-vehicle device 100 and the audio device 200 are connected by their respective interfaces (I / F). At this time, the audio signal transmitted by the in-vehicle device 100 and the signal used to cancel the sound output by the audio device 200 (speaker 23) are simultaneously transmitted and received between the in-vehicle device 100 and the audio device 200. In this case, there may be a shortage of the band for transmitting and receiving the signals. As described above, since it is not possible to transmit all of the multiple output signals to the in-vehicle device 100 due to the shortage of the band, it becomes necessary to mix at least some of the output signals.
[0025] Fig. 2 is a diagram showing the arrangement of a plurality of speakers 23 and an in-vehicle device 100 in a vehicle 10. As shown in Fig. 2, eight speakers 23 (speaker 23A, speaker 23B, speaker 23C, speaker 23D, speaker 23E, speaker 23F, speaker 23G, and speaker 23H) are provided in the vehicle 10. Also, in the vehicle 10, the in-vehicle device 100 is provided on the right front side of the vehicle 10. The in-vehicle device 100 is provided, for example, in front of the driver's seat of the vehicle 10.
[0026] At this time, the speaker 23C and the speaker 23D are provided at relatively close positions compared to the other speakers 23. Therefore, the speaker 23C and the speaker 23D are in a similar direction from the in-vehicle device 100 compared to the other speakers 23. Also, the difference in distance between the speaker 23C and the speaker 23D and the in-vehicle device 100 is smaller than the difference in distance between the other two speakers 23. Therefore, the positional relationship between the speaker 23C and the speaker 23D and the in-vehicle device 100 is similar compared to the positional relationship between the other speakers 23 and the in-vehicle device 100.
[0027] Therefore, it can be said that the manner in which the sounds output from the speakers 23C and 23D are reflected by the influence of a wall or the like before reaching the in-vehicle device 100 is more similar than the manner in which the sounds output from the other speakers 23 are reflected before reaching the in-vehicle device 100. It can also be said that the amount by which the sounds output from the speakers 23C and 23D are attenuated before reaching the in-vehicle device 100 is more similar than the amount by which the sounds output from the other speakers 23 are attenuated before reaching the in-vehicle device 100. In other words, it can be said that the sounds output from the speakers 23C and 23D are changed more similarly than the other speakers 23 before reaching the in-vehicle device 100. Therefore, in this embodiment, the speakers 23C and 23D are treated as one group.
[0028] 2, speakers 23G and 23H are also provided in relatively close positions compared to the other speakers 23. Therefore, speakers 23G and 23H can be treated as one group. Then, mixer 24 mixes the output signals output to speakers 23C and 23D, and the output signals output to speakers 23G and 23H, into one signal. This makes it possible to mix, for example, eight output signals into six signals. Note that in this embodiment, two speakers 23 are treated as one group, but two or more speakers 23 In this manner, a plurality of speakers 23 that are provided within a predetermined distance from each other are grouped into one group, and output signals for the plurality of speakers 23 are mixed.
[0029] Then, the mixer 24 outputs a signal (hereinafter, sometimes referred to as a "reference signal") obtained by mixing the output signals to the in-vehicle device 100. Note that the mixer 24 outputs the output signals for the other speakers 23 that do not belong to any group to the in-vehicle device 100 as they are as reference signals without mixing them with the other output signals. Specifically, the mixer 24 outputs the reference signal to the canceller 13 via the I / F. This enables the canceller 13 to cancel the sound output from the speaker 23 using the reference signal. Note that the mixer 24 outputs the reference signal (output signal) to the in-vehicle device 100 in real time.
[0030] At this time, it is necessary to determine the ratio at which the audio device 200 mixes the output signals (hereinafter, may be referred to as the "mixing ratio"). Therefore, the in-car device 100 causes each speaker 23 belonging to one group to output white noise. The in-car device 100 also obtains the loudness (sound pressure, volume, etc.) of the white noise output from each speaker 23 using the microphone 12. The in-car device 100 then specifies the ratio of the loudness of the white noise output from each speaker 23 as the mixing ratio of the output signals for each speaker 23.
[0031] By determining the mixing ratio in this way, in the reference signal, the sounds output from the multiple speakers 23 belonging to one group are mixed according to the volume of the white noise. That is, in the sounds output from the multiple speakers 23 belonging to one group, the louder the white noise is, the greater the mixing ratio is in the reference signal. Therefore, it is possible to place more importance on the louder sound among the sounds output from the multiple speakers 23 belonging to one group. As a result, it is possible to effectively cancel out the multiple sounds output from the multiple speakers 23 belonging to one group. In addition, the sounds output from the speakers 23 not belonging to the group are also output as a reference signal without being mixed. As a result, it is possible to cancel out the sounds output from the speakers 23 not belonging to the group.
[0032] (Functional configuration) Next, the functional configuration of the in-vehicle device 100 constituting the voice recognition system 1 will be described with reference to Fig. 3 and Fig. 4. Fig. 3 is a block diagram showing an example of the functional configuration of the in-vehicle device 100.
[0033] The in-vehicle device 100 includes a control unit 101, an input / output unit 102, and a ratio information database 103 (ratio information DB103). The control unit 101 has a function of performing arithmetic processing for controlling the in-vehicle device 100. The control unit 101 can be realized by a processor 110 in the in-vehicle device 100. The input / output unit 102 has a function of connecting the in-vehicle device 100 to the audio device 200 and inputting / outputting various signals. The input / output unit 102 can be realized by an I / F in the in-vehicle device 100.
[0034] The control unit 101 outputs an audio signal to the audio device 200 via the input / output unit 102. The control unit 101 also outputs an audio signal for causing each speaker 23 to output white noise to the audio device 200 via the input / output unit 102. Specifically, the control unit 101 causes the source device 11 to output an audio signal. Here, the audio signal for outputting white noise includes a signal for designating the speaker 23 from which the white noise is to be output. Note that the control unit 101 performs the steps of The control unit 101 outputs an audio signal for outputting white noise to a plurality of speakers 23 (speakers 23C and 23D, and speakers 23G and 23H in the example shown in FIG. 2) that are grouped together. Here, the control unit 101 outputs the audio signal to each speaker 23 in order so that the plurality of speakers 23 that are grouped together in one group do not output white noise at the same time.
[0035] At this time, the control unit 101, for example, causes the plurality of speakers 23 grouped together to output white noise of the same volume. Furthermore, when a set value is determined so that the volume of the sound output from each speaker 23 for the same audio signal differs, the control unit 101 causes the speaker 23 to output a sound according to the set value.
[0036] When the control unit 101 outputs an audio signal for outputting white noise, it acquires the white noise output from each speaker 23 using the microphone 12. At this time, the control unit 101 acquires the volume of the white noise output from each speaker 23 and acquired by the microphone 12 (hereinafter, may be simply referred to as "volume of white noise"). Then, the control unit 101 calculates the ratio of the volume of the white noise output from each speaker 23. Here, the control unit 101 calculates the ratio of the volume of the white noise output from the multiple speakers 23 belonging to each group.
[0037] The control unit 101 specifies the calculated ratio of the volume of the white noise as a mixing ratio. Then, the control unit 101 stores ratio information indicating the specified mixing ratio in the ratio information DB 103. The ratio information DB 103 has a function of storing ratio information. The ratio information DB 103 can be realized by the auxiliary storage unit 130 in the in-vehicle device 100. FIG. 4 is a diagram showing an example of a table configuration of ratio information held in the ratio information DB 103.
[0038] 4, the ratio information has a group ID field, a speaker ID field, and a ratio field. The group ID field stores an identifier (group ID) for identifying a group to which each speaker 23 belongs. The speaker ID field stores an identifier (speaker ID) for identifying a speaker 23. Here, when multiple speakers belong to one group, multiple speaker IDs are stored in the group ID field corresponding to one group ID.
[0039] The ratio field stores the mixing ratio (ratio of the volume of the white noise) calculated by the control unit 101. Here, the mixing ratio for each speaker 23 belonging to one group is normalized so that the sum of the mixing ratios of the multiple speakers 23 is 1. In other words, the mixing ratios stored in multiple ratio fields corresponding to one group are all added up to 1.
[0040] The control unit 101 refers to the ratio information and transmits to the audio device 200 instruction information instructing the audio device 200 to mix at the ratio of each speaker 23 belonging to each group. That is, the control unit 101 transmits to the audio device 200 instruction information instructing the mixing ratio for the multiple speakers 23 belonging to each group. Upon receiving the instruction information, the audio device 200 performs mixing at the mixing ratio for each group. Specifically, the control unit 101 transmits the instruction information via the I / Fs. Then, the audio device 200 instructs the mixer 24 to mix the output signals at the mixing ratio designated for each group. This enables the audio device 200 to mix the output signals and the in-car device 100 to receive the reference signal.
[0041] The control unit 101 determines whether or not the user of the vehicle 10 has spoken. When the user of the vehicle 10 has spoken, the control unit 101 performs voice recognition to identify the content of the user's speech. At this time, the control unit 101 acquires a reference signal for the sound output by the speaker 23. Then, the control unit 101 causes the canceller 13 to cancel the sound output by the speaker 23 from the sound acquired by the microphone 12. Here, canceling the sound output by the speaker 23 from the sound acquired by the microphone 12 (hereinafter, sometimes referred to as "input sound") includes canceling the sound output by the speaker 23 from the input sound as noise. Also, canceling the sound output by the speaker 23 from the input sound includes canceling the echo of the sound output by the speaker 23 from the input sound.
[0042] At this time, the reference signal acquired by the control unit 101 is a reference signal at the time (period) when the user of the vehicle 10 speaks. That is, the control unit 101 acquires reference information about the sound output by the multiple speakers 23 when the user of the vehicle 10 speaks, and causes the canceller 13 to cancel the sound by the multiple speakers 23 from the input sound including the user's speech. At this time, the control unit 101 may appropriately amplify or process the reference signal, and then cancel the sound by the multiple speakers 23. Note that a known method can be adopted as a method for the control unit 101 to cancel the sound using the reference signal. For example, the control unit 101 may cancel the sound output by the multiple speakers 23 by overlapping sounds having a phase opposite to that indicated by the reference signal.
[0043] (First process) A first process executed by the control unit 101 in the in-vehicle device 100 in the voice recognition system 1 will be described with reference to Fig. 5. Fig. 5 is a flowchart of the first process executed by the control unit 101. The first process shown in Fig. 5 is a process for outputting white noise to the speaker 23, determining a mixing ratio, and issuing an instruction to the audio device 200.
[0044] In the first process, first, in S101, an audio signal for outputting white noise is output to the audio device 200 using the source device 11. Next, in S102, the white noise is acquired using the microphone 12. Next, in S103, the volume of the white noise of each speaker 23 belonging to one group is designated as a mixing ratio. Next, in S105, ratio information indicating the designated mixing ratio is generated and stored in the ratio information DB 103. Next, in S106, instruction information is transmitted to the audio device 200. Then, the first process ends.
[0045] (Second Processing) Next, the second process executed by the control unit 101 in the in-vehicle device 100 in the voice recognition system 1 will be described with reference to FIG. 6. FIG. 6 is a flowchart of the second process executed by the control unit 101. The second process shown in FIG. 6 is a process for performing voice recognition on the speech of the user of the vehicle 10. The second process shown in FIG. 6 is repeatedly executed at a predetermined interval. As a result, the second process can perform voice recognition on the speech of the user of the vehicle 10 in real time. Note that the second process starts to be executed after the first process is executed.
[0046] In the second process, first, in S201, it is determined whether or not the microphone 12 has acquired the speech of the user of the vehicle 10. If a negative determination is made in S201, the user of the vehicle 10 has not spoken. Therefore, there is no need to perform voice recognition, and the second process is temporarily terminated.
[0047] If a positive determination is made in S201, an input sound is acquired in S202. In S203, a reference signal is acquired. Then, in S204, a cancellation process is performed to cancel the sound output from the speaker 23 from the input sound. Here, in S203, the control unit 101 acquires a reference signal at the time (period) when the user of the vehicle 10 speaks, from among the reference signals received from the audio device 200. Then, the cancellation process is performed using the acquired reference signal, so that it is possible to cancel the sound that was being output from the speaker 23 when the user of the vehicle 10 was speaking.
[0048] Next, in S205, a voice recognition process is executed on the sound that has been subjected to the cancellation process. As a result, it becomes possible to perform voice recognition from the sound that is acquired by the microphone 12 and includes the speech of the user of the vehicle 10 and the sounds output from the multiple speakers 23, with the sounds output from the multiple speakers 23 being cancelled out.
[0049] As described above, a mixing ratio is specified in the voice recognition system 1. As a result, mixing is performed according to the volume of sounds output from the multiple speakers 23, and a reference signal is generated. Then, the reference signal is used to cancel out the sounds output from the multiple speakers 23 from the sound acquired from the canceller 13. In this way, the multiple sounds output from the multiple speakers can be effectively canceled out.
[0050] (Variation 1) In this embodiment, the in-vehicle device 100 and the audio device 200 are provided inside the vehicle 10. However, devices similar to the in-vehicle device 100 and the audio device 200 may be provided in a location other than the vehicle 10. For example, the in-vehicle device 100 and the audio device 200 may be provided in any location, such as inside or outside the vehicle. This embodiment can also be applied to such a case.
[0051] (Variation 2) In this embodiment, the output signals are mixed for a group of multiple speakers 23 that are provided within a predetermined distance from each other. However, in this modified example, all output signals for all speakers 23 in the vehicle 10 may be mixed and output to the in-vehicle device 100 as a single reference signal. In this way, the in-vehicle device 100 can perform cancellation processing using a single reference signal without acquiring multiple reference signals. As a result, the processing load on the in-vehicle device 100 (canceller 13) can be reduced. Even in this way, multiple sounds output from the multiple speakers 23 can be effectively cancelled out.
[0052] (Variation 3) The mixer 24 may be provided in the in-vehicle device 100. In this case, the microcomputer 21 in the audio device 200 outputs an output signal to the mixer 24 provided in the in-vehicle device 100. Then, the mixer 24 mixes the output signals and outputs a reference signal to the canceller 13. This makes it possible to cancel sounds output from the multiple speakers 23 while reducing the number of reference signals processed by the canceller 13. As a result, by reducing the processing load on the in-vehicle device 100 (canceller 13), the multiple sounds output from the multiple speakers 23 can be effectively canceled.
[0053] (Variation 4) The first process shown in FIG. 5 may be configured to be executed when an input to start execution is made to the in-vehicle device 100. In other words, the first process may be executed by a person who designs the model of the vehicle 10 (designer) before the vehicle 10 is manufactured, or by a user of the vehicle 10. Assume that the designer executes the first process. In this case, the designer executes the first process when designing the model of the vehicle 10 before the vehicle 10 is manufactured. Then, By setting the calculated mixing ratio in advance in audio device 200, it becomes unnecessary to execute the first process again in the same model of vehicle 10 having the same interior, etc. Here, setting the calculated mixing ratio in advance in audio device 200 includes storing ratio information indicating the calculated mixing ratio in advance in ratio information DB 103 and transmitting instruction information to audio device 200. Setting the calculated mixing ratio in advance in audio device 200 also includes a designer directly specifying the calculated mixing ratio in advance to audio device 200 (mixer 24).
[0054] Also, assume that the user of the vehicle 10 executes the first process. In this case, the user of the vehicle 10 may execute the first process when the interior of the vehicle 10 is changed. Here, the change in the interior of the vehicle 10 is, for example, a change in the material or shape of the seats or interior trim in the vehicle 10. By changing the material or shape of the seats or interior trim in the vehicle 10, when the speaker 23 outputs a sound, the state of reflection of the sound in the vehicle 10 will be different. In this case, it is assumed that the sound acquired by the in-vehicle device 100 will change. The change in the interior of the vehicle 10 may be a change in the speaker 23. It is assumed that the sound acquired by the in-vehicle device 100 will change by changing the model or manufacturer of the speaker 23. By the user of the vehicle 10 causing the in-vehicle device 100 to execute the first process at any timing, even if the sound acquired by the in-vehicle device 100 changes, the multiple sounds output from the multiple speakers 23 can be effectively canceled.
[0055] (Variation 5) In this embodiment, the microphone 12 is provided in the in-vehicle device 100. That is, the microphone 12 is directly connected to the control unit 101. However, the connection between the microphone 12 and the control unit 101 is not limited to this example. In another example, the control unit 101 may be indirectly connected to the microphone 12 via one or more computers such as a relay device.
[0056] <Other embodiments> The above-described embodiment is merely an example, and the present disclosure may be modified as appropriate without departing from the spirit and scope of the present disclosure. Furthermore, the processes and means described in the present disclosure may be freely combined and implemented as long as no technical contradiction occurs.
[0057] Furthermore, a process described as being performed by one device may be shared and executed by multiple devices. Alternatively, a process described as being performed by different devices may be executed by one device. In a computer system, the hardware configuration (server configuration) by which each function is realized can be flexibly changed.
[0058] The present disclosure can also be realized by supplying a computer program implementing the functions described in the above embodiments to a computer, and having one or more processors of the computer read and execute the program. Such a computer program may be provided to the computer by a non-transitory computer-readable storage medium connectable to the system bus of the computer, or may be provided to the computer via a network. The non-transitory computer-readable storage medium includes any type of medium suitable for storing electronic instructions, such as, for example, a magnetic disk (such as a floppy disk or a hard disk drive (HDD)), an optical disk (such as a CD-ROM, a DVD disk, or a Blu-ray disk), a read-only memory (ROM), a random access memory (RAM), an EPROM, an EEPROM, a magnetic card, a flash memory, or an optical card. [Explanation of symbols]
[0059] 1. Voice recognition system 10. Vehicle 100...In-vehicle equipment 11. Source Device 12. Microphone 13 Canceller 101 Control section 102...Input / output section 103··Ratio Information DB 200 Audio Equipment 21 Microcomputer 22 Amplifier 23 Speaker 24 Mixer
Claims
1. acquiring a plurality of first sounds output from a plurality of speakers; Calculating a ratio of the loudness of the acquired first sounds; setting a mixing ratio, which is a ratio for mixing a plurality of sound signals, by applying the calculated ratio of the loudnesses of the plurality of first sounds as a mixing ratio used to generate a reference signal for canceling a plurality of output sounds output from the plurality of speakers in response to the plurality of sound signals from a sound acquired by a microphone; A control unit configured to execute Information processing device.
2. The control unit is further configured to output the set mixing ratio. The information processing device according to claim 1 .
3. outputting the mixing ratio includes instructing a mixer to mix with the mixing ratio; The information processing device according to claim 2 .
4. The plurality of speakers are provided within a predetermined distance from each other. The information processing device according to claim 1 .
5. The control unit is acquiring, via the microphone, an input sound including a plurality of second sounds to be output from the plurality of speakers; Obtaining a signal obtained by mixing a plurality of signals for outputting the plurality of second sounds at the mixing ratio as the reference signal; canceling the plurality of second sounds from the input sound using the obtained reference signal; and further configured to perform The information processing device according to claim 1 .
Citation Information
Patent Citations
Echo cancellation method, echo cancellation device, speech processing unit, and program
JP2018170564A
Echo canceler device
WO2016024345A1
On-vehicle speech recognition device
JP2009181025A