Method for controlling sound processing device and control device for sound processing device

Abstract

To appropriately set acoustic characteristics of a sound processing device of a vehicle.SOLUTION: A control device 100 for a sound processing device of a vehicle 1 includes a sound output part 60 for outputting sound to the outside of the vehicle, and a sound acquisition part 10 for acquiring sound around the vehicle 1. The control device 100 of the sound processing device includes: a sound analysis part 51 for analyzing the sound acquired by the sound acquisition part 10, and acquiring the value of a feature amount of a specification sound included in the sound as a second value when the specification sound for specifying magnitude of a prescribed kind of the feature amount as a first value is output from the sound output part 60; an acoustic characteristic detection part 52 for detecting acoustic characteristics of the sound output part 60 and the sound acquisition part 10 on the basis of the first value and the second value; and a device control part 53 for executing calibration processing for the sound output part 60 and the sound acquisition part 10 on the basis of the acoustic characteristics.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to a control method for a sound processing device and a control device for a sound processing device for a vehicle. [Background technology]

[0002] Conventionally, there are technologies for controlling a sound processing device of a vehicle. For example, a technology has been proposed in which, when the vehicle is running by operating a remote control switch, the volume of the speaker is made larger than when the vehicle is running by operating a manual switch provided on the vehicle (for example, see Patent Document 1). In this technology, when the vehicle is running by operating a remote control switch, the volume of the speaker is corrected based on the sound around the vehicle detected by a microphone. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2006-273015 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-mentioned conventional technology, if the acoustic characteristics of the microphone are not set appropriately, it may not be possible to properly detect sounds around the vehicle and to properly correct the volume of the speaker. Also, if the acoustic characteristics of the speaker are not set appropriately, it may not be possible to output sound at an appropriate volume from the speaker.

[0005] An object of the present invention is to appropriately set the acoustic characteristics of a sound processing device of a vehicle. [Means for solving the problem]

[0006] One aspect of the present invention is a method for controlling a sound processing device of a vehicle that includes a sound output unit that outputs sound outside the vehicle and a sound acquisition unit that acquires sounds around the vehicle. This control method for the sound processing device includes a sound analysis step of analyzing the sound acquired by the sound acquisition unit when a specified sound having a magnitude of a feature amount of a preset type as a first value is output from the sound output unit, and acquiring a value of the feature amount of the specified sound included in the sound as a second value, an acoustic characteristic detection step of detecting acoustic characteristics of the sound output unit and the sound acquisition unit based on the first value and the second value, and a calibration step of executing a calibration process for the sound output unit and the sound acquisition unit based on the acoustic characteristics. The specified sound is a sound of a first frequency, and the first frequency includes a plurality of frequencies across a preset frequency band. The sound analysis step analyzes the sound acquired by the sound acquisition unit and acquires the frequency of the specified sound included in the sound as the second frequency. The acoustic characteristic detection step detects acoustic characteristics based on the first frequency and the second frequency. Effect of the Invention

[0007] According to the present invention, the acoustic characteristics of a sound processing device of a vehicle can be appropriately set. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a simplified diagram showing an example of the configuration inside a vehicle cabin. [Diagram 2] FIG. 2 is a simplified diagram showing an example of the configuration inside a vehicle cabin. [Diagram 3] FIG. 3 is a block diagram illustrating an example of a functional configuration of a control device of a sound processing device. [Figure 4] FIG. 4 is a simplified diagram showing the relationship between the environment around the vehicle and the sound output from the sound output unit. [Diagram 5] FIG. 5 is a simplified diagram showing the relationship between the environment around the vehicle and the sound output from the sound output unit. [Figure 6] FIG. 6 is a simplified diagram showing the relationship between the environment around the vehicle and the sound output from the sound output unit. [Figure 7] FIG. 7 is a flowchart showing an example of a calibration process in the control device of the sound processing device. [Figure 8] FIG. 8 is a flowchart showing an example of device control processing in the control device of the sound processing device. [Figure 9]FIG. 9 is a flowchart showing an example of a calibration process in the control device of the sound processing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.

[0010] [Vehicle configuration example] 1 and 2 are simplified diagrams showing an example of the configuration of the interior of the vehicle 1. Note that Fig. 1 shows a simplified view of the interior of the vehicle 1 as viewed from the right side in the left-right direction of the vehicle 1, and Fig. 2 shows a simplified view of the interior of the vehicle 1 as viewed from the rear side in the front-rear direction of the vehicle 1. Also, in Figs. 1 and 2, for ease of explanation, illustrations are omitted except for the dashboard 2, steering wheel 3, windshield 4, and agent device 80.

[0011] The agent device 80 is a small robot installed on the dashboard 2 of the vehicle 1. In Figs. 1 and 2, an example is shown in which the agent device 80 is a human face type robot. Note that Figs. 1 and 2 show an example in which the agent device 80 is installed on the dashboard 2, but the present invention is not limited to this. For example, the agent device 80 may be installed on the upper part of the windshield 4. In Figs. 1 and 2, an example is shown in which the agent device 80 is a human face type robot, but the present invention is not limited to this. For example, the agent device 80 may be an animal face, a virtual object face (for example, an anime character face), or another object (for example, a television type device, a radio type device). In addition, another device (for example, a smartphone, a tablet terminal) may be used as the agent device 80. In this case, the agent device 80 is configured with a display panel and a speaker.

[0012] The agent device 80 executes various operations based on instructions from the control unit 50 (see FIG. 3). For example, the agent device 80 outputs various information related to driving assistance when the driver D1 performs driving operations based on the control of the control unit 50. For example, by changing the state of the agent device 80, the appearance of the agent device 80 is changed, the change is visually grasped, and information related to driving assistance is output. Specifically, information related to driving assistance can be output by voice output from the agent device 80, or by changing the facial expression, facial color, and facial movement of the agent device 80. In addition, for example, the facial expression can be changed by changing the display on the display panel or by moving each part of the face (for example, the eyes and mouth) by a drive unit (not shown). As a result, for example, when the driver D1 performs an appropriate driving operation, the agent device 80 outputs a praising action or a praising voice to the driver D1, which encourages the driver D1 to try to perform a better driving operation, leading to an improvement in the safety of the vehicle 1. In addition, the driver D1 who is praised by the agent device 80 can continue driving operations calmly and with peace of mind.

[0013] Also, for example, the agent device 80 executes an operation of notifying the driver D1 who is driving of the sounds outside the vehicle acquired by the sound acquisition unit 10 under the control of the control unit 50. Assumed sounds outside the vehicle to be notified to the driver D1 who is driving include, for example, a warning alarm (horn), a siren or warning sound of an emergency vehicle, a police whistle, and instructions from a police officer. When these sounds are acquired by the sound acquisition unit 10, the agent device 80 executes an operation to notify the driver D1 who is driving of these sounds. For example, the agent device 80 can perform an operation of outputting the same sounds as those sounds, and an operation indicating an emergency (for example, an operation of speaking loudly with a surprised expression) together with this output. In this way, the agent device 80 is installed in a position where the driver D1 can be easily seen, and the face of the agent device 80 is directed toward the driver D1, so that appropriate driving support can be provided when the driver D1 performs driving operations. Furthermore, for example, when a specified sound (specified sound) is to be output outside the vehicle as a startup sound when the vehicle 1 or the agent device 80 is started up, the state of the agent device 80 can be changed so that the face of the agent device 80 faces outside the vehicle. An example of a case where the state of the agent device 80 is changed so that the face of the agent device 80 faces outside the vehicle is shown in Figs. 4 to 6.

[0014] Here, we will explain acoustic characteristics. Three elements of sound are known to determine the nature of sound (sound characteristics). These three elements of sound are pitch (frequency (Hz)), loudness (sound pressure (dB)), and timbre (waveform, frequency components). In other words, humans recognize sound primarily as a combination of these three elements.

[0015] In addition, there are two types of sounds that humans recognize: pure tones and complex tones. A pure tone is a sound that is composed of only one frequency component. In other words, the waveform of a pure tone can be represented as a sine wave.

[0016] A complex sound is a sound that is composed of multiple components with different frequencies. In other words, a complex sound is a sound in which multiple pure tones overlap. The sounds that humans come into contact with on a daily basis often include a mixture of sounds made by humans (e.g., sounds made when moving, voices), sounds made by moving objects (e.g., cars, trains), sounds made by musical instruments, sounds made by nature (e.g., the sound of wind, the sound of rain), noise, etc. Strictly speaking, pure tones are said to be sounds that do not exist in nature. Therefore, sounds that humans recognize are generally complex sounds. In other words, sounds that humans come into contact with on a daily basis are classified as complex sounds.

[0017] A complex sound can be decomposed into multiple sounds by using frequency analysis (Fourier analysis) or frequency analysis. Frequency analysis is an analysis method that decomposes and analyzes waves such as light and sound, and is an analysis method that applies Fourier analysis. For example, a complex sound can be decomposed into individual frequencies using known acoustic analysis equipment. This allows the complex sound to be analyzed. A variety of acoustic analysis techniques, frequency analysis techniques, and measurement analysis techniques can be used to analyze a complex sound.

[0018] Here, we will explain musical tones, which mean musical tones (or tones used in music). Musical tones generally refer to sounds generated from sound sources such as musical instruments or people, and often refer to sounds produced by these tones. A sound consisting of only one sine wave is called a pure tone (or a single tone). When a sound generated from one sound source contains multiple frequencies, the sound is called a complex tone. Note that while in acoustics it is called a complex tone, in music it is sometimes called a chord.

[0019] In this embodiment, as described above, when the vehicle 1 or the agent device 80 is started, a specified sound is output as a startup sound. Based on this specified sound, acoustic characteristics related to the sound processing device of the vehicle 1 are detected, and based on this acoustic characteristics, the sound processing device of the vehicle 1 is calibrated. The sound processing device of the vehicle 1 is, for example, the sound acquisition unit 10, the sound output unit 60, and the agent device 80 shown in FIG. 3. In this embodiment, the relationship between the three elements of sound is obtained based on the relationship between a preset specified sound, a specified sound (output value) output from the sound output unit 60, and a specified sound (detection value) obtained by the sound acquisition unit 10. The characteristics of the sound processing device that represent the relationship between the three elements of sound obtained in this manner will be described as the acoustic characteristics of the sound processing device.

[0020] [Example of functional configuration of a control device for sound processing equipment] FIG. 3 is a block diagram showing an example of a functional configuration of the control device 100 of the sound processing device.

[0021] The control device 100 for a sound processing device includes a sound acquisition unit 10, an image acquisition unit 20, a position information acquisition unit 30, a communication unit 40, a control unit 50, a sound output unit 60, a storage unit 70, and an agent device 80. The control device 100 for a sound processing device can also be called a calibration device because it performs a calibration process for calibrating the sound processing device (e.g., the sound acquisition unit 10, the sound output unit 60).

[0022] The sound acquisition unit 10 is provided outside the vehicle 1, and acquires sounds around the vehicle 1 (sounds outside the vehicle) based on the control of the control unit 50, and outputs information about the acquired sounds to the sound analysis unit 51. As the sound acquisition unit 10, for example, one or more microphones can be used.

[0023] The image acquisition unit 20 captures an image of a subject and generates an image (image data) based on the control of the control unit 50, and outputs information about the generated image to the equipment control unit 53. The image acquisition unit 20 is configured, for example, with one or more camera devices capable of capturing images of subjects around the vehicle 1. That is, the image acquisition unit 20 can capture images of subjects present in the left-right and front-rear directions of the vehicle 1, or in all directions.

[0024] The position information acquisition unit 30 acquires position information on the position where the vehicle 1 is located under the control of the control unit 50, and outputs the acquired position information to the equipment control unit 53. The position information acquisition unit 30 can be realized by, for example, a GNSS receiver that acquires position information using a Global Navigation Satellite System (GNSS). The position information includes data on the position such as latitude, longitude, and altitude at the time of receiving the GNSS signal. The position information may be acquired by other methods of acquiring position information. For example, the position information may be derived using information from an access point or base station present in the vicinity. For example, the position information may be derived using a position estimation technique by a navigation device.

[0025] The communication unit 40 exchanges various information with other devices using wireless communication under the control of the control unit 50. For example, the communication unit 40 acquires various information from various servers via a predetermined network (e.g., the Internet). Also, for example, the communication unit 40 receives a signal from a key (e.g., a smart key) 5 (see Figs. 4 to 6) using short-distance wireless communication.

[0026] The storage unit 70 is a storage medium that stores various types of information. For example, the storage unit 70 stores various types of information (for example, a control program, a specified sound, map information) required for the control unit 50 to perform various processes. The storage unit 70 also stores various types of information acquired via the communication unit 40. As the storage unit 70, for example, various storage media such as a Read Only Memory (ROM), a Random Access Memory (RAM), a Hard Disk Drive (HDD), and a Solid State Drive (SSD) can be used.

[0027] The control unit 50 controls each unit based on various programs stored in the storage unit 70. The control unit 50 is realized by a processing device such as a CPU (Central Processing Unit). Note that the vehicle ECU (Electronic Control Unit) of the vehicle 1 may be used as the control unit 50, or a processing device different from the vehicle ECU may be provided as the control unit 50.

[0028] The control unit 50 includes a sound analysis unit 51, an acoustic characteristics detection unit 52, and a device control unit 53 as functional components related to device control processing.

[0029] The sound analysis unit 51 analyzes changes over time in sounds outside the vehicle detected by the sound acquisition unit 10, and acquires various pieces of information related to the sounds acquired by the sound acquisition unit 10 based on the analysis results.The sound analysis unit 51 outputs each piece of information related to the sounds to the acoustic characteristic detection unit 52 and the equipment control unit 53.

[0030] Specifically, the sound analysis unit 51 performs a predetermined analysis process (for example, frequency analysis) on the sound (complex sound) acquired by the sound acquisition unit 10, breaks down the complex sound into multiple sounds, and acquires three elements for each of the multiple sounds that make up the complex sound. The sound analysis unit 51 also extracts a sound that corresponds to a specified sound from among the sounds that make up the complex sound. The method of extracting the specified sound will be described in detail with reference to FIG. 7.

[0031] The acoustic characteristic detection unit 52 detects the acoustic characteristics of the sound acquisition unit 10 and the sound output unit 60 based on the analysis result by the sound analysis unit 51, and generates calibration data for calibrating the sound acquisition unit 10 and the sound output unit 60 based on the acoustic characteristics. Then, the acoustic characteristic detection unit 52 outputs the calibration data to the device control unit 53. Note that a method of detecting the acoustic characteristics and a method of generating the calibration data will be described in detail with reference to FIG. 7.

[0032] The device control unit 53 controls each device mounted on the vehicle 1, for example, a sound processing device. For example, the device control unit 53 executes control to output sound from at least one of the agent device 80 and the sound output unit 60. In addition, for example, the device control unit 53 executes a calibration process for the sound acquisition unit 10 and the sound output unit 60 based on the calibration data generated by the acoustic characteristic detection unit 52. The calibration process for the sound acquisition unit 10 and the sound output unit 60 will be described in detail with reference to FIG. 7.

[0033] The sound output unit 60 outputs sound to the outside of the vehicle 1 under the control of the control unit 50. As the sound output unit 60, for example, one or more speakers can be used.

[0034] [Example of the relationship between the vehicle's surrounding environment and the sound output from the sound output unit] 4 to 6 are diagrams showing, in a simplified manner, the relationship between the environment around the vehicle 1 and sounds 91 to 93 output from the sound output unit 60. In FIG.

[0035] FIG. 4 shows an example of a case where the driver D1 uses the key 5 to unlock the door of the vehicle 1 parked in a wide area with no buildings around during the day. Also shown is a case where parent and child U1 and U2 are walking near the vehicle 1. It is assumed that in such an environment, there are no people other than the parent and child U1 and U2, and there is little noise from the surroundings. Therefore, in such an environment, it is preferable to output, as the sound 91, music that is comfortable for the parent and child U1 and U2 walking near the vehicle 1. The key 5 is a remote control device with a wireless communication function, and can exchange various information with the control unit 50 via the communication unit 40 using wireless communication. For example, the key 5 can lock or unlock the door of the vehicle 1 using wireless communication.

[0036] 5 shows an example in which a driver D1 uses a key 5 to unlock the door of a vehicle 1 parked in a residential area in the middle of the night. In this way, in a quiet environment, it is preferable to output a relaxing sound or a quiet tune as sound 92, taking into consideration the surrounding environment.

[0037] FIG. 6 shows an example in which the driver D1 uses the key 5 to unlock the door of the vehicle 1 parked in a parking lot of a large shopping mall. In this case, many vehicles 301 to 309 are parked in the parking lot. Also, many shoppers are often present in the parking lot. In such an environment, the surroundings of the vehicle 1 are often noisy. Therefore, in such an environment, it is preferable to output a loud sound or lively music as the sound 93 in consideration of the surrounding environment to inform the driver D1 of the presence and position of the vehicle 1 and to inform surrounding shoppers that the vehicle 1 is moving.

[0038] [Calibration process example] FIG. 7 is a flowchart showing an example of the calibration process in the control device 100 of the sound processing device. The calibration process is executed by the control unit 50 based on a program stored in the storage unit 70. The calibration process is executed at a predetermined timing. The predetermined timing can be, for example, the timing when the driver D1 of the vehicle 1 uses the key 5 to unlock the door of the vehicle 1, the timing when the driver D1 uses the key 5 to start the vehicle 1 after sitting in the driver's seat, or the timing when it is detected that the driver D1 holding the key 5 has moved close to the vehicle 1. Whether the driver D1 has moved close to the vehicle 1 can be detected based on the radio wave intensity using wireless communication between the key 5 and the communication unit 40. In FIG. 7, the examples shown in FIG. 1 to FIG. 6 are appropriately referred to for explanation.

[0039] In step S201, the sound output unit 60 outputs a specified sound for a predetermined time based on the control of the device control unit 53. This predetermined time is a time that allows appropriate detection of the acoustic characteristics of the sound acquisition unit 10 and the sound output unit 60, and can be set appropriately based on, for example, experimental data, etc. The predetermined time can be set to, for example, a value of about several seconds.

[0040] Furthermore, the prescribed sound may be, for example, a single tone with a predetermined pitch (e.g., frequency: 440 Hz), a predetermined volume (e.g., sound pressure: 70 dB), and a predetermined tone (e.g., piano tone) that is output as the prescribed sound. Each piece of information about the prescribed sound can be stored in the storage unit 70 and used. By outputting such a prescribed sound from the sound output unit 60 and detecting the prescribed sound by the sound acquisition unit 10, it becomes possible to detect the acoustic characteristics of the sound output unit 60 or the sound acquisition unit 10 with higher accuracy.

[0041] Also, instead of outputting a single tone as the prescribed tone, a chord made up of a combination of single tones may be output. For example, a chord with a combination of a predetermined pitch (e.g., C frequency: 130 Hz, E frequency: 164 Hz, G frequency: 196 Hz), a predetermined sound volume (e.g., sound pressure: 70 dB), and a predetermined tone (e.g., piano tone) can be output as the prescribed tone. This allows a sound (music) that makes the driver D1 and people around the vehicle 1 feel comfortable when they hear the prescribed tone to be output as the prescribed tone.

[0042] Also, instead of outputting a single tone or a chord as the prescribed tone, a single tone and a chord may be output while changing in a time series. For example, a tone that is a tune that the driver D1 and people around the vehicle 1 like can be set as the prescribed tone. In this way, by outputting a prescribed tone from the vehicle 1 that sounds like the same tune to the listener, people around the vehicle 1 (including the driver D1) can recognize the tone as a tone emitted from the vehicle 1 when they hear the tone emitted from the vehicle 1, and can prevent confusion with other sounds.

[0043] However, the standard sound output from the sound output unit 60 may be a sound that sounds completely different each time. Also, the standard sound output from the sound output unit 60 may be a sound that changes only the atmosphere of the standard sound and sounds like the same song to the listener. For example, it is possible to change only the atmosphere of the song by changing the pitch of the sound through transposition. For example, it is possible to change the atmosphere of the sound by keeping the rhythm of the sound the same and changing only the pitch and length of the sound. For example, it is possible to make a song in D major by raising all the notes of a song in C major by a major second. In this way, it is possible to output a standard sound from the vehicle 1 that sounds like the same song to the listener even if only the atmosphere of the song is changed. In this case, as described above, when people (including the driver D1) around the vehicle 1 hear a sound emitted from the vehicle 1, they can recognize that the sound is emitted from the vehicle 1, and confusion with other sounds can be prevented.

[0044] In step S202, the sound acquisition unit 10 acquires sound outside the vehicle for a predetermined time under the control of the device control unit 53. In this manner, the sound outside the vehicle is acquired, and thereby the specified sound is also detected by the sound acquisition unit 10. This predetermined time can be set to the same value as the predetermined time during which the specified sound is output from the sound output unit 60 in step S201.

[0045] In step S203, the sound analysis unit 51 analyzes the time change of the sound outside the vehicle detected by the sound acquisition unit 10, and acquires each piece of information related to the sound acquired by the sound acquisition unit 10 based on the analysis result. Specifically, the sound analysis unit 51 performs a predetermined analysis process on the sound (complex sound) acquired by the sound acquisition unit 10 at a predetermined time, and breaks down the complex sound into multiple sounds. The sound analysis unit 51 also acquires three elements of each of the multiple sounds that constitute the complex sound. The sound analysis unit 51 also acquires the three elements of the specified sound stored in the storage unit 70, and compares the three elements of the specified sound with the three elements of each sound that constitutes the complex sound, thereby extracting a sound that corresponds to the specified sound from among the sounds that constitute the complex sound. For example, the sound that corresponds to the specified sound can be extracted based on the similarity of the three elements of each sound. In the following, the sound that corresponds to the specified sound extracted by the sound analysis unit 51 will be referred to as the specified sound extracted by the sound analysis unit 51 and described.

[0046] In step S204, the acoustic characteristic detection unit 52 detects the acoustic characteristics of the sound acquisition unit 10 and the sound output unit 60 based on the analysis result by the sound analysis unit 51, and generates calibration data for calibrating the sound acquisition unit 10 and the sound output unit 60 based on the acoustic characteristics. Specifically, the acoustic characteristic detection unit 52 compares the three elements of the specified sound extracted by the sound analysis unit 51 with the three elements of the specified sound output from the sound output unit 60, and obtains information regarding the relationship between the two three elements.

[0047] For example, the acoustic characteristic detection unit 52 acquires the three elements of the specified sound stored in the storage unit 70, compares the three elements of the specified sound with the three elements of the specified sound acquired by the sound analysis unit 51, and calculates the difference value of each element. Note that the difference value of each element over a predetermined time may be calculated and used. In this case, for example, the average value or integrated value of the difference values ​​of each element over a predetermined time may be used. Then, the acoustic characteristic detection unit 52 detects at least one acoustic characteristic of the sound output unit 60 and the sound acquisition unit 10 based on the difference value.

[0048] For example, the relationship (acoustic characteristic information) between the output value from the sound output unit 60 and the detection value by the sound acquisition unit 10 regarding the acoustic characteristics is acquired in advance by an experiment or the like, and stored in the storage unit 70. This acoustic characteristic information is information regarding ideal values ​​regarding the acoustic characteristics of the output value from the sound output unit 60 and the detection value by the sound acquisition unit 10. Then, the acoustic characteristic detection unit 52 acquires the acoustic characteristic information from the storage unit 70, and detects the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 by comparing the above-mentioned difference value with the acoustic characteristic information. That is, it checks the degree of deviation between the ideal value regarding the acoustic characteristics and the actual detection value, and detects the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 based on the confirmation result.

[0049] For example, assume that it has been confirmed through experiments, etc. that when a single-tone standard sound with a frequency of 440 Hz and a sound pressure of 70 dB is output from the sound output unit 60, the detection value of the standard sound by the sound acquisition unit 10 is a frequency of 440 Hz and a sound pressure of 65 dB. In this case, when a single-tone standard sound with a frequency of 440 Hz and a sound pressure of 70 dB is output from the sound output unit 60, if the detection value of the standard sound by the sound acquisition unit 10 is a frequency of 440 Hz and a sound pressure of 65 dB, it is a normal value when compared with the experimental data. Therefore, in such a case, it can be determined that the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 are normal. In this case, there is no need to generate calibration data.

[0050] In addition, when a single-tone standard sound with a frequency of 440 Hz and a sound pressure of 70 dB is output from the sound output unit 60, if the detection value of the standard sound by the sound acquisition unit 10 is a frequency of 440 Hz and a sound pressure of 60 dB, the sound pressure is −5 dB when compared with the experimental data. In such a case, it can be determined that the sound pressure is reduced as an acoustic characteristic of the sound output unit 60, or that the sensitivity is reduced as an acoustic characteristic of the sound acquisition unit 10. In this case, calibration data is generated so that the sound pressure level of the sound output unit 60 is set to +5 dB. Alternatively, calibration data is generated so that the sensitivity level of the sound acquisition unit 10 is increased.

[0051] It is also assumed that an abnormal signal is detected by the sound acquisition unit 10. For example, it is also assumed that the detection value of the specified sound by the sound acquisition unit 10 is higher than the output value from the sound output unit 60 by a first threshold or more (i.e., abnormally high) or is lower than the second threshold or less (i.e., abnormally low) as a result of comparison with experimental data. However, the second threshold value is less than the first threshold value. In this way, when the detection value of the specified sound by the sound acquisition unit 10 is abnormally high or abnormally low, it is also assumed that the sound acquisition unit 10 is not functioning normally. Therefore, in this case, calibration data is generated so that the function of the sound acquisition unit 10 becomes normal. For example, calibration data is generated to increase or decrease the sensitivity of the sound acquisition unit 10.

[0052] In this way, based on a change in any one of the three elements of sound (for example, a change in frequency or sound pressure), the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 can be detected and calibration data can be generated.

[0053] In step S205, the device control unit 53 executes a calibration process for the sound acquisition unit 10 and the sound output unit 60 based on the calibration data generated in step S204. For example, when it is determined that the sound pressure is low as an acoustic characteristic of the sound output unit 60, calibration data for increasing the sound pressure level of the sound output unit 60 is generated. In this case, the device control unit 53 calibrates the sound output unit 60 so as to increase the sound pressure level based on the generated calibration data. Also, for example, when it is determined that the sound pressure is high as an acoustic characteristic of the sound output unit 60, calibration data for decreasing the sound pressure level of the sound output unit 60 is generated. In this case, the device control unit 53 calibrates the sound output unit 60 so as to decrease the sound pressure level based on the generated calibration data. Also, for example, when it is determined that the sensitivity is low as an acoustic characteristic of the sound acquisition unit 10, calibration data for increasing the sensitivity level of the sound acquisition unit 10 is generated. In this case, the device control unit 53 calibrates the sound acquisition unit 10 so as to increase the sensitivity level based on the generated calibration data. Also, for example, when it is determined that the acoustic characteristics of the sound acquisition unit 10 have high sensitivity, calibration data is generated to lower the sensitivity level of the sound acquisition unit 10. In this case, the device control unit 53 calibrates the sound acquisition unit 10 based on the generated calibration data so as to lower the sensitivity level.

[0054] In this way, a specified sound is output outside the vehicle, the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 are detected based on the specified sound, and a calibration process for the sound output unit 60 and the sound acquisition unit 10 is performed based on the acoustic characteristics. As a result, after the calibration, it becomes possible to output an intended sound from the sound output unit 60. In other words, it is possible to check whether the sound output unit 60 and the sound acquisition unit 10 are functioning correctly, and to adjust the acoustic characteristics for the sound output unit 60 and the sound acquisition unit 10 based on the check result.

[0055] The calibration process shown in FIG. 7 is an example of being performed at a predetermined timing. However, even when the predetermined timing is reached, if a predetermined condition is met, the calibration process shown in FIG. 7 may not be performed. The predetermined condition is met, for example, when there is no certain change in the external environment of the vehicle 1. The external environment of the vehicle 1 is not changed, for example, when the position of the vehicle 1 has hardly changed (for example, when the parking position of the vehicle 1 is changed in the same shopping mall), or when the position of the vehicle 1 has changed but the environment around the vehicle 1 has not changed (for example, when the vehicle 1 is moved to a parking lot of a different shopping mall).

[0056] [Example of device control processing] 8 is a flowchart showing an example of device control processing in the control device 100 of a sound processing device. This device control processing is executed by the control unit 50 based on a program stored in the storage unit 70. This device control processing is executed at a predetermined timing. This predetermined timing may be the same as the predetermined timing shown in FIG.

[0057] The device control process shown in FIG. 8 may be executed in parallel with the calibration process shown in FIG. 7 at a predetermined timing, or may be executed after the calibration process shown in FIG. 7 is completed. Also, only the device control process shown in FIG. 8 may be executed at a predetermined timing. In this case, the processes (steps S201 to S205) shown in FIG. 7 may be executed immediately after starting the agent device 80 in step S211, and the calibration process for the sound acquisition unit 10 and the sound output unit 60 may be executed by each of these processes, and then step S212 may be executed. In this case, the specified sound may be, for example, a single sound with a frequency of 440 Hz and a sound pressure of 70 dB. In addition, in FIG. 8, the examples shown in FIG. 1 to FIG. 6 are appropriately referred to for explanation.

[0058] In step S 211 , the device control section 53 starts up the agent device 80 .

[0059] In step S212, the device control unit 53 acquires information related to the external environment of the vehicle 1. As the information related to the external environment of the vehicle 1, for example, the time of day (e.g., morning, afternoon, night), the location of the vehicle 1, the presence or absence of people around the vehicle 1, the distance between the people around the vehicle 1 and the vehicle 1, the weather and temperature around the vehicle 1, sounds around the vehicle 1, etc. are acquired.

[0060] The time period can be acquired by a clock function built into the control unit 50. The location where the vehicle 1 is located can be acquired based on the location information acquired by the location information acquisition unit 30 and the map information stored in the storage unit 70. The map information may be acquired from an external device via the communication unit 40 and used. The location where the vehicle 1 is located may be acquired based on information that can be acquired using another device, for example, a car navigation system.

[0061] The presence or absence of people around the vehicle 1 and the distance between the people around the vehicle 1 and the vehicle 1 can be detected based on the image acquired by the image acquisition unit 20. In this case, a known person detection technique can be used to detect people included in the image. Also, a known measurement technique can be used to measure the distance between the people and the vehicle 1. Note that the presence or absence of people around the vehicle 1 and the distance between the people around the vehicle 1 and the vehicle 1 may be detected using other sensors, such as LiDAR (Light Detection and Ranging), Sonar (Sound Navigation And Ranging), Radar (Radio Detection and Ranging), etc.

[0062] The temperature around the vehicle 1 can be acquired by a temperature sensor mounted on the vehicle 1. In addition, the weather around the vehicle 1 can be acquired from an external device (for example, a weather data providing server) via the communication unit 40.

[0063] For sounds around the vehicle 1, sounds acquired by the sound acquisition unit 10 can be used. For example, the sound analysis unit 51 can perform frequency analysis on sounds outside the vehicle 1 acquired by the sound acquisition unit 10, and use values ​​obtained by this frequency analysis.

[0064] In step S213, the device control unit 53 determines the output sound to be output from the sound output unit 60 or the agent device 80 based on the external environment of the vehicle 1. In this case, the device control unit 53 determines the frequency of the sound so as to avoid sounds having frequencies close to the sounds outside the vehicle 1 acquired by the sound acquisition unit 10. More specifically, sounds having a frequency band different from the frequency band of the sounds outside the vehicle 1 acquired by the sound acquisition unit 10 are set as candidates for the output sound. In this way, for example, even if there is an ambulance or a fire engine near the vehicle 1 or people are talking near the vehicle 1, it is possible to output a sound that is not masked by those sounds. In addition, the device control unit 53 determines a sound according to the surrounding environment of the vehicle 1 from among sounds having a frequency band different from the frequency band of the sounds outside the vehicle 1, as shown in Figs. 4 to 6.

[0065] For example, the frequency band of an ambulance siren is 770 to 960 Hz, the frequency band of a fire engine siren is 300 to 850 Hz, and the frequency band of a human voice is 0.2 to 4 kHz.

[0066] Therefore, for example, when it is detected that the vehicle 1 is in an environment where an ambulance siren can be heard based on information on the external environment of the vehicle 1, the output sound is determined while avoiding sounds with frequencies close to the frequency band (770 to 960 Hz) of the ambulance siren. More specifically, sounds with frequency bands different from the detected frequency band (770 to 960 Hz) are set as candidates for the output sound.

[0067] Also, for example, when it is detected that the vehicle 1 is in an environment where a fire engine siren can be heard based on information on the external environment of the vehicle 1, the output sound is determined while avoiding sounds with frequencies close to the frequency band (300 to 850 Hz) of the fire engine siren. More specifically, sounds in frequency bands other than the detected frequency band (300 to 850 Hz) are set as candidates for the output sound.

[0068] Also, for example, when it is detected based on information about the external environment of the vehicle 1 that the vehicle 1 is in an environment where human voices can be heard, the output sound is determined while avoiding sounds with frequencies close to the frequency band of human voices (0.2 to 4 kHz). More specifically, sounds with frequency bands different from the detected frequency band (0.2 to 4 kHz) are set as candidates for the output sound. Whether an ambulance, fire engine, or person is present around the vehicle 1 can be detected based on sounds acquired by the sound acquisition unit 10 and images acquired by the image acquisition unit 20.

[0069] For example, as shown in FIG. 5, it is assumed that the location of the vehicle 1 is a quiet residential area and the time period is night. In this case, since the vehicle 1 is in a quiet environment, it is preferable to output a sound from the sound output unit 60 that is not conspicuous and does not disturb the residents. For example, a sound with a sound pressure of 30db to 40db and a frequency equivalent to the song of a bird (for example, about 440Hz for an owl) is determined. By determining and outputting the sound in this way, it is possible to allow only the driver D1 to know the location of the vehicle 1 by the sound 92 output from the sound output unit 60, and to prevent people around the vehicle 1 (including residents of the houses around the vehicle 1) from noticing it.

[0070] Also, for example, as shown in FIG. 6, it is assumed that the location where the vehicle 1 is located is a parking lot of a shopping mall, and the time period is daytime. The parking lot of a shopping mall is an example of an environment where people are crowded together. In this case, since the vehicle 1 is in a noisy environment, it may be preferable to make people around the vehicle 1 aware of the sound 93 output from the sound output unit 60. For example, in a parking lot at night, a vehicle that is about to leave the parking lot is easily noticed by people around the vehicle due to the light of the vehicle. In contrast, in a parking lot during the day, it is often difficult to notice a vehicle that is about to leave the parking lot. Therefore, in a parking lot during the day, it is important to prevent an accident from occurring without noticing a vehicle that is about to leave the parking lot.

[0071] For example, it is preferable to output a sound 93 from the sound output unit 60 that is conspicuous, can be easily heard by people around the vehicle 1, and is noticed by the people around the vehicle 1. For example, a sound with at least one of the frequency and the sound pressure set to a large value is determined based on a specified sound (frequency: 440 Hz, sound pressure: 70 dB). In this case, it is preferable to set the frequency to a value that avoids frequencies close to the environmental sound around the vehicle 1, that is, a value in a frequency band different from the frequency band of the environmental sound around the vehicle 1. It is also preferable to change the sound pressure according to the distance to the people around the vehicle 1. For example, by setting the sound pressure so that the person U3 who is closest to the vehicle 1 hears an appropriate sound, it is possible to prevent the person U3 from being surprised by the sound from the vehicle 1. By determining and outputting in this way, it is possible to make the driver D and people around the vehicle 1 aware of the presence of the vehicle 1 by the sound 92 output from the sound output unit 60. In this way, in a parking lot or the like where people are crowded together, it is possible to inform people around the vehicle 1 that the vehicle 1 will start moving.

[0072] Also, for example, as shown in FIG. 4, assume that the environment is one in which parent and child U1 and U2 are walking near the vehicle 1 in a wide area with no buildings or the like around, and the time period is detected to be daytime. In this case, since the vehicle 1 is in a quiet environment, it may be preferable that the sound 91 output from the sound output unit 60 sounds pleasant to the parent and child U1 and U2 around the vehicle 1. For example, it is preferable to output a light and familiar sound 91 that can be heard by the driver D1 and the parent and child U1 and U2 from the sound output unit 60. Note that, when the voices of the parent and child U1 and U2 are detected, it is preferable to output a sound that avoids frequencies close to the voices, that is, a sound in a frequency band different from the frequency band of the voices of the parent and child U1 and U2.

[0073] Also, it is possible to determine a sound that sounds like the same song to the listener by changing only the atmosphere of the music of the output sound according to the environment around the vehicle 1. For example, as described above, it is possible to change only the atmosphere of the music by changing the pitch of the music through transposition. As a result, as described above, when people around the vehicle 1 (including the driver D1) hear a sound emitted from the vehicle 1, they can recognize that the sound is coming from the vehicle 1, and confusion with other sounds can be prevented.

[0074] In step S214, the device control unit 53 causes the sound output unit 60 to output an output sound determined based on the external environment of the vehicle 1. In this case, as shown in Figs. 4 to 6, the device control unit 53 preferably changes the state of the agent device 80 so that the face of the agent device 80 faces outside the vehicle, so that people outside the vehicle see the agent device 80 as if it is speaking. The output sound may be output as the second specified sound, or may be output as a sound for notifying people around the agent device 80 of the presence of the agent device 80. The output sound thus determined may be used as an output sound to be output from the agent device 80 in the vehicle cabin of the vehicle 1, as necessary. However, it is preferable that the sound to be output from the agent device 80 in the vehicle cabin of the vehicle 1 be output at a lower volume than the sound to be output from the sound output unit 60.

[0075] In addition to executing the device control process shown in Fig. 8 at a predetermined timing, a part of the device control process shown in Fig. 8 may be executed based on the external environment of the vehicle 1. For example, when a certain change occurs in the external environment of the vehicle 1, the processes of steps S212 and S213 may be executed to determine the output sound to be output from the sound output unit 60 or the agent device 80. In addition, when a certain change occurs in the external environment of the vehicle 1, for example, when the position of the vehicle 1 moves by a threshold value or more, when the startup time of the vehicle 1 becomes a threshold value or more, when a specific object (e.g., an ambulance, a fire engine) is detected around the vehicle 1, when the weather around the vehicle 1 changes suddenly (e.g., heavy rain, heavy snow), etc.

[0076] Here, as described above, it is assumed that each process (steps S201 to S205) shown in FIG. 7 is executed before the process of step S212, and the calibration process for the sound acquisition unit 10 and the sound output unit 60 is executed by each process, and then step S212 is executed. In this case, in step S214, the device control unit 53 causes the sound output unit 60 to output the output sound determined based on the external environment of the vehicle 1 as the second specified sound. Then, each process (steps S202 to S205) shown in FIG. 7 may be executed for the second specified sound, and the calibration process for the sound acquisition unit 10 and the sound output unit 60 may be executed by each process. In this way, the accuracy of the calibration process can be improved by executing the calibration process (steps S201 to S205) without considering the external environment of the vehicle 1, and then executing the calibration process (steps S211 to S214, S202 to S205) taking the external environment of the vehicle 1 into consideration.

[0077] An example of determining the specified sound in consideration of the external environment of the vehicle 1 will be described in detail with reference to FIG.

[0078] In this way, when the agent device 80 is started, a predetermined sound corresponding to the external environment of the vehicle 1 can be output from the vehicle 1. Furthermore, by outputting a predetermined sound from the vehicle 1 when the agent device 80 is started, it is possible to notify the surroundings of the vehicle 1 that the vehicle 1 is about to start moving. Furthermore, since this predetermined sound can be a sound of a different frequency from the sound of the external environment of the vehicle 1, it can be a sound that is easy for people around the vehicle 1 to hear. Furthermore, for example, assume that the frequency of the specified sound output from the sound output unit 60 to the outside of the vehicle is frequency A, and the frequency of the sound outside the vehicle used to control the agent device 80 is frequency B. In this case, frequency A may be a frequency corresponding to frequency B.

[0079] [Modification of calibration process] Fig. 9 is a flow chart showing an example of calibration processing in the control device 100 of the sound processing device. Moreover, since this calibration processing is a modified example of the calibration processing shown in Fig. 7, the following description will focus on the points that differ from Fig. 7.

[0080] Note that the processes of steps S221 to S223 shown in Fig. 9 correspond to the processes of steps S211 to S213 shown in Fig. 8. Furthermore, the processes of steps S224 to S228 shown in Fig. 9 correspond to the processes of steps S201 to S205 shown in Fig. 7. For this reason, of the processes (steps S221 to S228) shown in Fig. 9, explanations of parts common to Figs. 7 and 8 will be omitted.

[0081] In step S223, the device control unit 53 determines the specified sound to be output from the sound output unit 60 based on the external environment of the vehicle 1. In this case, the device control unit 53 determines the frequency of the specified sound so as to avoid sounds having frequencies close to the sounds outside the vehicle 1 acquired by the sound acquisition unit 10. By doing so, for example, even if there is an ambulance or a fire engine near the vehicle 1 or people are talking near the vehicle 1, it is possible to output the specified sound that is not masked by those sounds.

[0082] In step S227, the device control unit 53 may detect an abnormal signal of the sound acquisition unit 10 based on the external environment of the vehicle 1. For example, it is possible to estimate sounds that can be acquired from the surroundings of the vehicle 1 based on the external environment of the vehicle 1. For example, when a sound of an abnormal volume is acquired by the sound acquisition unit 10 of the vehicle 1 parked in a residential area in the middle of the night, it is also possible to determine that an abnormal signal has been detected by the sound acquisition unit 10. Also, for example, when the sound acquisition unit 10 of the vehicle 1 parked in a parking lot of a large shopping mall in the daytime hardly acquires surrounding sounds, it is also possible to determine that an abnormal signal has been detected by the sound acquisition unit 10. In this way, the device control unit 53 can detect an abnormal signal of the sound acquisition unit 10 based on the external environment of the vehicle 1 together with the analysis result by the sound analysis unit 51. Then, when an abnormal signal of the sound acquisition unit 10 is detected, the device control unit 53 generates calibration data so that the function of the sound acquisition unit 10 becomes normal.

[0083] In this way, the specified sound can be determined based on the external environment of the vehicle 1, and the specified sound can be output as the startup sound of the agent device 80. This startup sound can be, for example, a sound that plays a similar tune at startup, such as the startup sound of a game device or a personal computer (for example, a futuristic sound). This allows the driver D1 and his family to develop an attachment to the vehicle 1 and the agent device 80. In addition, by playing a similar tune every time the agent device 80 starts up (every time the vehicle 1 starts up), the driver can appeal to those around him that he owns a futuristic vehicle 1, and therefore the need for self-expression that leads to attachment can be satisfied. In addition, for example, it is assumed that a third party who does not own a vehicle equipped with the agent device 80 will be attracted to the vehicle 1 equipped with the agent device 80 that outputs a futuristic sound. This can promote the third party's desire to purchase the agent device 80. In addition, the safety of a third party who purchases the agent device 80 and newly installs the agent device 80 in his vehicle can be improved.

[0084] In addition, since the specified sound can be determined based on the external environment of the vehicle 1, it is possible to output the optimum specified sound in accordance with the situation around the vehicle 1. This makes it possible to prevent people around the vehicle 1 from feeling uncomfortable or being a nuisance.

[0085] Here, for example, hearing is known to have a large influence on human memory. For example, when a sound is output from the vehicle 1 equipped with the agent device 80 and the sound is heard by people around the vehicle 1, it is considered that the agent device 80 is likely to remain in their memories. In this case, the memory rate of the agent device 80 among the people around the vehicle 1 is improved. This makes it possible to widely inform people of the existence of the agent device 80, and to increase the purchase rate of the agent device 80. Furthermore, by installing the agent device 80 in each vehicle, the agent device 80 can provide driving assistance to the driver, thereby improving the safety of each vehicle.

[0086] In this way, according to this embodiment, it is possible to provide appropriate standard sounds and other sounds at an appropriate volume not only to people inside the vehicle 1 but also to people outside the vehicle. In addition, a calibration process for the sound output unit 60 and the sound acquisition unit 10 can be executed based on the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 detected by the acoustic characteristic detection unit 52. This makes it possible to prevent problems such as the sound acquisition unit 10 being unable to acquire external sounds or the sound output unit 60 outputting an abnormally loud sound due to insufficient adjustment.

[0087] In addition, by outputting a prescribed sound that matches the situation (atmosphere) around the vehicle 1, that is, a prescribed sound that blends in with the external environment, it is possible to stimulate the emotions of people outside the vehicle.

[0088] [Configuration and Effects of This Embodiment] The control method of the sound processing device according to the present embodiment is a control method of the sound processing device of the vehicle 1 including a sound output unit 60 that outputs sound to the outside of the vehicle and a sound acquisition unit 10 that acquires sounds around the vehicle 1. This control method of the sound processing device includes a sound analysis step (step S203) of analyzing the sound acquired by the sound acquisition unit 10 when a prescribed sound having a magnitude of a preset type of feature quantity (e.g., frequency, sound pressure) as a first value (e.g., frequency: 440 Hz, sound pressure: 70 dB) is output from the sound output unit 60, and acquiring the value of the feature quantity of the prescribed sound contained in the sound as a second value, an acoustic characteristic detection step (step S204) of detecting acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 based on the first value and the second value, and a calibration step (step S205) of executing a calibration process for the sound output unit 60 and the sound acquisition unit 10 based on the acoustic characteristics.

[0089] According to this configuration, the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 mounted on the vehicle 1 are detected using the sound output unit 60 and the sound acquisition unit 10, and are calibrated based on the acoustic characteristics, so that the acoustic characteristics can be appropriately set. In other words, there is no need to newly install a separate configuration for calibrating the sound processing device in the vehicle 1, and the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 (an example of a sound processing device) of the vehicle 1 can be appropriately set.

[0090] Furthermore, in the control method for a sound processing device according to this embodiment, an acoustic characteristic detection step (step S204) generates calibration data for calibrating at least one of the output level (e.g., frequency, sound pressure) of the sound output unit 60 and the sensitivity level of the sound acquisition unit 10 based on the acoustic characteristics, and a calibration step (step S205) calibrates at least one of the sound output unit 60 and the sound acquisition unit 10 based on the calibration data.

[0091] According to this configuration, for example, by generating calibration data regarding the output level of the sound output unit 60 and the sensitivity level of the sound acquisition unit 10, the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 (an example of a sound processing device) of the vehicle 1 can be appropriately set using the calibration data.

[0092] Furthermore, in the control method for the sound processing device of this embodiment, the sound output unit 60 outputs a specified sound in response to the start-up of an agent device 80 (a device that provides information regarding driving assistance to the driver D1 of the vehicle 1) installed in the vehicle 1 or the start-up of the vehicle 1.

[0093] According to this configuration, it is possible to prevent the specified sound from being output at irregular timing, and therefore to prevent the driver D1 from feeling uneasy. In addition, since the specified sound is output at a predetermined timing, it is possible to foster an attachment of the driver D1 to the vehicle 1 and the agent device 80.

[0094] In addition, the control method for a sound processing device in this embodiment further includes an external environment acquisition step (steps S212, S222) for acquiring information regarding the external environment of the vehicle 1, and an equipment control step (steps S213, S214) for controlling an agent device 80 (equipment that provides information regarding driving assistance to the driver D1 of the vehicle 1) installed in the vehicle 1 based on the information regarding the external environment.

[0095] According to this configuration, the agent device 80 installed in the vehicle 1 can be controlled based on the external environment of the vehicle 1 (for example, environmental sounds, conversation sounds).

[0096] Furthermore, in the control method for a sound processing device according to this embodiment, the device control steps (steps S213, S214) determine a sound to be output from the agent device 80 based on information relating to the external environment of the vehicle 1, and cause this sound to be output from the agent device 80.

[0097] According to this configuration, an appropriate sound according to the external environment of the vehicle 1 can be output from the agent device 80. This makes it possible to provide a comfortable sound to the driver D1 and people around the vehicle 1. Also, an appropriate sound according to the external environment of the vehicle 1 may be output from the sound output unit 60. This makes it possible to share the sound processing device (sound output unit 60 and sound acquisition unit 10) used to detect the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 with the sound processing device (sound output unit 60 and sound acquisition unit 10) used to control the agent device 80.

[0098] In addition, the control method for a sound processing device in this embodiment further includes an external environment acquisition step (step S222) for acquiring information regarding the external environment of the vehicle 1, and a determination step (step S223) for determining a standard sound based on the information regarding the external environment, and the sound output unit 60 outputs the standard sound determined in the determination step (step S223) (step S224).

[0099] According to this configuration, an appropriate prescribed sound according to the external environment of the vehicle 1 can be output from the sound output unit 60. For example, the prescribed sound can be determined so as to avoid sounds having frequencies close to the environmental sounds around the vehicle 1, and the prescribed sound can be output from the sound output unit 60. In this way, in consideration of the external environment of the vehicle 1, a prescribed sound of a suitable frequency that is easily audible to the driver D1 and people around the vehicle 1 can be output.

[0100] Furthermore, in the control method for a sound processing device according to this embodiment, an external environment acquisition step (step S222) acquires sounds outside the vehicle acquired by the sound acquisition unit 10 as information relating to the external environment of the vehicle 1, and a determination step (step S223) determines a specified sound based on the sounds outside the vehicle acquired by the sound acquisition unit 10.

[0101] According to this configuration, it is possible to determine the prescribed sound (for example, the frequency of the prescribed sound) to be output from the sound output unit 60 based on the sound outside the vehicle 1, and therefore it is possible to output a suitable prescribed sound in consideration of the sound outside the vehicle 1. In addition, since a sound according to the external environment of the vehicle 1 is output as the prescribed sound for detecting the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10, it is possible to detect the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 with higher accuracy.

[0102] Furthermore, in the control method for a sound processing device according to this embodiment, the specified sound is a sound of a first frequency, a sound analysis step (steps S203, S226) analyzes the sound acquired by the sound acquisition unit 10 and acquires the frequency of the specified sound contained in the sound as a second frequency, and an acoustic characteristic detection step (steps S204, S227) detects the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 based on the first frequency and the second frequency.

[0103] According to this configuration, the acoustic characteristics of the sound output section 60 and the sound acquisition section 10 are detected using frequency and calibrated based on the acoustic characteristics, so that the acoustic characteristics can be appropriately set.

[0104] Moreover, in the control method for a sound processing device according to the present embodiment, the first frequency is a single frequency.

[0105] According to this configuration, a single sound of a single frequency that is easy to analyze is set as the specified sound, so that it is possible to detect the acoustic characteristics of the sound output section 60 and the sound acquisition section 10 with higher accuracy.

[0106] Moreover, in the control method for a sound processing device according to the present embodiment, the first frequency includes a plurality of frequencies.

[0107] According to this configuration, it is possible to detect the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 with high accuracy, and to output a chord that is comfortable for the driver D1 and people around the vehicle 1 as the reference sound.

[0108] Moreover, in the control method for a sound processing device according to the present embodiment, the first frequency includes frequencies across a preset frequency band.

[0109] According to this configuration, the standard sound can be a sound or song (e.g., a melody-like song) that is preferred by the driver D1 or people around the vehicle 1, making it possible to output a standard sound that is more comfortable for the driver D1 and people around the vehicle 1.

[0110] Furthermore, in the control method for a sound processing device according to this embodiment, the specified sound is a sound of a first volume, a sound analysis step (steps S203, S226) analyzes the sound acquired by the sound acquisition unit 10 and acquires the volume of the specified sound contained in the sound as a second volume, and an acoustic characteristic detection step (steps S204, S227) detects the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 based on the first volume and the second volume.

[0111] According to this configuration, the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 are detected using volume (sound that has a predetermined sound pressure value) and are calibrated based on the acoustic characteristics, so that the acoustic characteristics can be set appropriately.

[0112] The control device 100 of the sound processing device is a control device of the sound processing device of the vehicle 1, which includes a sound output unit 60 that outputs sound to the outside of the vehicle, and a sound acquisition unit 10 that acquires sounds around the vehicle 1. The control device 100 of the sound processing device includes a sound analysis unit 51 that analyzes the sound acquired by the sound acquisition unit 10 when a specified sound having a magnitude of a feature amount of a preset type as a first value is output from the sound output unit 60, and acquires the value of the feature amount of the specified sound contained in the sound as a second value, an acoustic characteristic detection unit 52 that detects acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 based on the first value and the second value, and a device control unit 53 that executes a calibration process for the sound output unit 60 and the sound acquisition unit 10 based on the acoustic characteristics.

[0113] According to this configuration, the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 mounted on the vehicle are detected using the sound output unit 60 and the sound acquisition unit 10, and are calibrated based on the acoustic characteristics, so that the acoustic characteristics can be appropriately set. In other words, there is no need to newly install a separate configuration for calibrating the sound processing device in the vehicle 1, and the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 (an example of a sound processing device) of the vehicle 1 can be appropriately set.

[0114] Each process shown in the present embodiment is executed based on a program for causing a computer to execute each process procedure. Therefore, the present embodiment can also be understood as an embodiment of a program for realizing a function for executing each process, and a recording medium for storing the program. For example, an update process for adding a new function to a control device of a sound processing device can store the program in a storage device of the control device of the sound processing device. This makes it possible to cause the updated control device of the sound processing device to execute each process shown in the present embodiment.

[0115] Although the embodiments of the present invention have been described above, the above-mentioned embodiments merely show some of the application examples of the present invention, and it is not intended that the technical scope of the present invention be limited to the specific configurations of the above-mentioned embodiments. [Explanation of symbols]

[0116] 1, 301 to 309 vehicle, 2 dashboard, 3 steering wheel, 4 windshield, 5 key, 10 sound acquisition unit, 20 image acquisition unit, 30 position information acquisition unit, 40 communication unit, 50 control unit, 51 sound analysis unit, 52 acoustic characteristic detection unit, 53 device control unit, 60 sound output unit, 70 memory unit, 80 agent device, 100 control device for sound processing device

Claims

1. A method for controlling a sound processing device of a vehicle including a sound output unit that outputs sound to an outside of the vehicle and a sound acquisition unit that acquires sound around the vehicle, comprising: a sound analysis step of analyzing the sound acquired by the sound acquisition unit when a prescribed sound having a magnitude of a feature of a preset type as a first value is output from the sound output unit, and acquiring a value of the feature of the prescribed sound included in the sound as a second value; an acoustic characteristic detection step of detecting acoustic characteristics of the sound output unit and the sound acquisition unit based on the first value and the second value; a calibration step of executing a calibration process for the sound output unit and the sound acquisition unit based on the acoustic characteristics, the prescribed sound is a sound of a first frequency, the first frequency includes a plurality of frequencies across a preset frequency band; The sound analysis step includes analyzing the sound acquired by the sound acquisition unit, and acquiring a frequency of the specified sound included in the sound as a second frequency; The acoustic characteristic detection step detects the acoustic characteristic based on the first frequency and the second frequency. A method for controlling sound processing equipment.

2. A method for controlling a sound processing device according to claim 1, comprising: the acoustic characteristic detection step generates calibration data for calibrating at least one of an output level of the sound output unit and a sensitivity level of the sound acquisition unit based on the acoustic characteristic; The calibration step calibrates at least one of the sound output unit and the sound acquisition unit based on the calibration data. A method for controlling sound processing equipment.

3. A method for controlling a sound processing device according to claim 1 or 2, comprising: The sound output unit outputs the specified sound in response to activation of a device that is installed in the vehicle and provides information regarding driving assistance to a driver of the vehicle, or in response to activation of the vehicle. A method for controlling sound processing equipment.

4. A method for controlling a sound processing device according to any one of claims 1 to 3, comprising: An external environment acquisition step of acquiring information regarding an external environment of the vehicle; and controlling a device installed in the vehicle that provides information related to driving assistance to a driver of the vehicle based on the information related to the external environment. A method for controlling sound processing equipment.

5. A method for controlling a sound processing device according to claim 4, comprising: The device control step includes determining a sound to be output from the device based on information about the external environment, and outputting the sound from the device. A method for controlling sound processing equipment.

6. A method for controlling a sound processing device according to any one of claims 1 to 5, comprising: An external environment acquisition step of acquiring information regarding an external environment of the vehicle; determining the reference sound based on information about the external environment; The sound output unit outputs the specified sound determined in the determining step. A method for controlling sound processing equipment.

7. A method for controlling a sound processing device according to claim 6, comprising: the external environment acquisition step acquires the sound outside the vehicle acquired by the sound acquisition unit as information about the external environment of the vehicle; The determining step determines the specified sound based on a sound outside the vehicle acquired by the sound acquisition unit. A method for controlling sound processing equipment.

8. A method for controlling a sound processing device according to any one of claims 1 to 7, comprising: the predetermined sound is a sound of a first volume; The sound analysis step includes analyzing the sound acquired by the sound acquisition unit, and acquiring a volume of the specified sound included in the sound as a second volume; The acoustic characteristic detection step detects the acoustic characteristic based on the first volume and the second volume. A method for controlling sound processing equipment.

9. A control device for a sound processing device of a vehicle, the control device comprising a sound output unit that outputs sound to the outside of the vehicle and a sound acquisition unit that acquires sound around the vehicle, a sound analysis unit that, when a prescribed sound having a magnitude of a feature of a preset type as a first value is output from the sound output unit, analyzes the sound acquired by the sound acquisition unit and acquires, as a second value, a value of the feature of the prescribed sound included in the sound; an acoustic characteristic detection unit that detects acoustic characteristics of the sound output unit and the sound acquisition unit based on the first value and the second value; an equipment control unit that executes a calibration process for the sound output unit and the sound acquisition unit based on the acoustic characteristics; the prescribed sound is a sound of a first frequency, the first frequency includes a plurality of frequencies across a preset frequency band; The sound analysis unit analyzes the sound acquired by the sound acquisition unit, and acquires a frequency of the specified sound included in the sound as a second frequency; The acoustic characteristic detection unit detects the acoustic characteristic based on the first frequency and the second frequency. A control device for sound processing equipment.

Images