Notification device

Abstract

To provide a notification device capable of appropriately giving notice to occupants while suppressing lowering of an in-vehicle entertainment property.SOLUTION: A notification device 9 for issuing notification by emitting sound into a cabin 1S of a vehicle 1 comprises: a speaker 23 for emitting sound into the cabin; a microphone 25 installed in the vehicle and converting collected sound into a sound signal to output it; and a control device 27 for outputting sound from the speaker based on the sound signal. The control device is configured to: acquire content sound information relating to a content sound of in-vehicle entertainment; acquire alert sound information for producing an attention urging sound to attract attention; estimate a travel state of the vehicle based on the sound signal acquired by the microphone; set a sound volume of each of the content sound and the attention urging sound based on the estimated travel state; and output corresponding content sound and attention urging sound from the speaker with the set sound volume based on the content sound information and the alert sound information.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to a notification device mounted on a vehicle for performing notification by sound.

Background Art

[0002] In recent years, efforts have been actively made to provide access to a sustainable transportation system that takes into account people in vulnerable positions such as the elderly, disabled, and children among traffic participants. For the realization of this, research and development on notification to passengers has become important as a means to further improve traffic safety.

[0003] A driving support device that gives a warning in advance to a driver driving a vehicle is known (for example, Patent Document 1). The driving support device disclosed in Patent Document 1 detects an object located in the planned driving direction such as a right or left turn at an intersection where there is a possibility of turning right or left on the planned driving route, and performs notification by a caution sound.

[0004] In the driving support device of Patent Document 1, as a caution sound, a sound that can be heard from an actual object such as the engine sound of the vehicle or the road noise of the vehicle is generated from a virtual sound source. The volume at this time is set so as not to interfere with conversation or music.

[0005] A vehicle caution device provided on a vehicle seat and having a vibration device for applying vibration to a passenger to give a warning and caution to the passenger is known (for example, Patent Document 2). The vibration devices are provided on the seat back and the seat cushion, respectively. The vibration device on the seat back is arranged, for example, near the shoulders or shoulder blades of the passenger, and the vibration device on the seat cushion is arranged near the hips or feet of the passenger.

Prior Art Documents

Patent Documents

[0006]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0007] By the way, in recent years, with the ITization of vehicles, the comfort inside the vehicle has been emphasized, and in-vehicle entertainment systems such as car audio have become increasingly sophisticated. On the other hand, it is important to appropriately warn and alert passengers, especially drivers, as needed to ensure the safety of the vehicle.

[0008] In the driving support device of Patent Document 1, an alert sound is set so as not to interfere with conversation or music. Therefore, there is a risk that sufficient alert cannot be given to the driver, especially when a strong alert is required for the driver.

[0009] In the vehicle alert device of Patent Document 2, there is a risk that the vibration generated by the vibration device may not be effectively transmitted to the driver depending on the physique and posture of the driver.

[0010] In view of the above background, an object of the present invention is to provide a notification device that can appropriately notify passengers while suppressing a decrease in in-vehicle entertainment performance. And, by extension, it contributes to the development of a sustainable transportation system by further improving traffic safety.

Means for Solving the Problems

[0011] In order to solve the above problems, an aspect of the present invention is a notification device (9) that performs notification by emitting sound toward the passenger compartment (1S) of a vehicle (1), including a speaker (23) that emits sound in the passenger compartment, a microphone (25) that is provided in the vehicle, converts the collected sound into a sound signal, and outputs the sound signal, and a control device (27) that causes the speaker to output sound based on the sound signal. The control device acquires content sound information related to the content sound of in-vehicle entertainment, acquires attention sound information for generating an attention sound for attracting attention, estimates the running state of the vehicle based on the sound signal acquired by the microphone, sets the volume of each of the content sound and the attention sound based on the estimated running state, and causes the corresponding content sound and attention sound to be output from the speaker at the set volume based on the content sound information and the attention sound information.

[0012] According to this aspect, the volume of the content sound and the volume of the attention sound can be set according to the running state of the vehicle. Therefore, based on the running state of the vehicle, it is possible to determine whether attention should be attracted and appropriately set the volume, so that it is possible to provide a notification device that can appropriately notify the passenger without degrading the in-vehicle entertainment performance.

[0013] In the above aspect, preferably, the control device sets an attention level indicating the degree of attention required for the passenger based on the sound signal acquired by the microphone, and decreases the volume of the sound generated from the speaker based on the content sound information as the attention level increases.

[0014] According to this aspect, when the degree of attention required for the passenger increases, the volume of the content sound decreases. Thereby, it is possible to prevent the passenger from having difficulty hearing the attention sound due to the content sound when attention is required.

[0015] In the above aspect, preferably, as the attention level increases, the control device increases the volume of the sound generated from the speaker based on the attention sound information.

[0016] According to this aspect, when the degree of attention required of the occupant increases, the volume of the attention-calling sound based on the attention sound information increases. As a result, when attention is required to be called, the occupant can easily hear the attention-calling sound, so that the occupant can be appropriately notified.

[0017] In the above aspect, preferably, it includes a vibration device (31) that generates vibration to notify the occupant, and the control device drives the vibration device based on the estimated driving state.

[0018] According to this aspect, the vibration device can notify the occupant.

[0019] In the above aspect, preferably, when the attention level is equal to or lower than a predetermined threshold value, the control device stops the output of the sound based on the attention sound information and drives the vibration device.

[0020] According to this aspect, when the attention level is equal to or lower than the threshold value, the vibration device is driven and the output of the sound based on the attention sound information is stopped. As a result, the occupant can be notified without degrading the in-vehicle entertainment performance.

[0021] In the above aspect, preferably, when the attention level is greater than a predetermined threshold value, as the attention level increases, the control device increases the volume based on the attention sound information.

[0022] According to this aspect, when the degree of attention required of the occupant increases, the volume of the attention-calling sound increases. As a result, when attention is required to be called, the occupant can easily hear the attention-calling sound, so that the occupant can be appropriately notified.

[0023] In the above aspect, preferably, it includes a vibration device (31) that generates vibrations to notify the occupant, and the control device increases the amplitude of the vibrations generated by the vibration device as the attention level increases.

[0024] According to this aspect, when the degree of attention required of the occupant increases, the amplitude of the vibrations generated by the vibration device increases. As a result, when attention needs to be drawn, the occupant can easily sense the vibrations, so that appropriate notification can be given to the occupant.

[0025] In the above aspect, preferably, the control device estimates whether the vehicle is driving in rainy weather based on the sound signal acquired by the microphone, and when it is determined that the vehicle is driving in rainy weather, sets the attention level higher than when it is determined that the vehicle is not driving in rainy weather.

[0026] According to this aspect, when it is necessary to draw attention while driving in rainy weather, the attention level is set higher than when not driving in rainy weather, so that the attention level can be set appropriately.

[0027] In the above aspect, preferably, when it is determined that the vehicle is not driving in rainy weather, the control device determines whether the vehicle is driving at high speed based on the sound signal acquired by the microphone, and when it is determined that the vehicle is driving at high speed, sets the attention level higher than when it is determined that the vehicle is not driving at high speed.

[0028] According to this aspect, when it is necessary to draw attention while driving at high speed, the attention level is set higher than when not driving at high speed, so that the attention level can be set appropriately.

Advantages of the Invention

[0029] According to the above aspects, it is possible to provide a notification device that can appropriately notify the occupant without degrading the in-vehicle entertainment performance.

Brief Description of the Drawings

[0030]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Embodiments for Carrying Out the Invention

[0031] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0032] As shown in FIG. 1, the notification device according to the present invention is mounted on a vehicle such as an automobile, and performs notification by emitting sound toward the interior of the passenger compartment (i.e., the passenger cabin) of the vehicle.

[0033] As shown in FIGS. 1 and 2, the vehicle 1 is provided with a warning system 3 that generates information regarding warning, a navigation system 5 that generates information regarding driving guidance, a content acquisition system 7 that generates information for reproducing music or radio sound in the passenger cabin 1S, and an acoustic system 9 that generates sound in the passenger cabin 1S based on the information from the warning system 3, the navigation system 5, and the content acquisition system 7 to perform notifications and the like. In the present embodiment, the acoustic system 9 can perform notification to the passenger not only by sound but also by vibration.

[0034] The attention - arousal system 3 generates information (attention - sound information) for generating a sound (attention - arousal sound) to arouse the attention of the occupant based on various situations such as the surrounding situation of the vehicle 1. The attention - arousal system 3 includes at least one sensing device 11 and an alarm generation device 13 that generates information for arousal based on the detection result of the sensing device 11.

[0035] The sensing device 11 may be, for example, a radar 11A, a lidar 11B, a sonar 11C, a camera 11D that images the front, rear, left, and right sides of the vehicle 1, etc. In addition, the sensing device 11 may be one or more sensors that detect information related to the driver. Specifically, for example, the sensing device 11 may be a sensor that detects biometric information such as the driver's heart rate and respiratory rate, or may be a camera that detects the driver from the front to monitor the driver's dozing.

[0036] The alarm generation device 13 is composed of a computer including a processor 13A and a storage device 13B. The processor 13A of the alarm generation device 13 determines whether it is necessary to arouse the attention of the occupant based on the detection result of the sensing device 11.

[0037] Specifically, when the sensing device 11 includes, for example, a radar 11A, a lidar 11B, or a sonar 11C, the alarm generation device 13 (processor 13A) acquires information related to surrounding vehicles, pedestrians, obstacles, etc. The alarm generation device 13 determines whether it is necessary to arouse the driver's attention based on the acquired information and the distance from the vehicle 1 where it is installed. For example, when the distance between a surrounding object located behind and the vehicle 1 is equal to or less than a predetermined threshold value, the alarm generation device 13 determines that an attention - arousal sound should be generated, generates attention - sound information indicating the corresponding attention - arousal sound, and outputs it to the audio system 9.

[0038] In addition, based on the detection result of the sensing device 11, the alarm generation device 13 generates information (attention - arousal information) required for giving an alert, and outputs it to the acoustic system 9 or the like. The attention - arousal information may include, in addition to the attention sound information, information related to the mode of vibration (also referred to as attention vibration information) that the acoustic system 9 should output. The attention vibration information may include various information required for outputting vibration, such as the timing and position for generating vibration, the amplitude of vibration, and the frequency of vibration.

[0039] The navigation system 5 searches for a driving route to the set destination, and generates information for displaying the route obtained by the search and information related to the sound for guiding the driver regarding the obtained route.

[0040] The navigation system 5 includes a position detection device 15 and a guidance processing device 17.

[0041] The position detection device 15 identifies the current position of the vehicle 1 by a known method, and outputs information indicating the identified current position to the guidance processing device 17. The position detection device 15 may be constituted by, for example, a GPS receiver that receives signals from GPS satellites to identify the position of the vehicle 1.

[0042] The guidance processing device 17 is constituted by a computer including a processor 17A such as a CPU (Central Processing Unit) or an MPU (Micro - Processing Unit), various memories (not shown) such as a volatile memory and a non - volatile memory, and a storage device 17B in which map information is stored. The guidance processing device 17 searches for a driving route from the current position to the destination based on the current position of the vehicle 1 acquired by the position detection device 15 and the map information stored in the storage device 17B. The guidance processing device 17 outputs information (guidance image information) for displaying the searched route on a display device and a signal related to the sound (guidance sound information) for guiding the driver regarding the route obtained by the search to the acoustic system 9. Hereinafter, the guidance image information and the guidance sound information are collectively referred to as guidance information.

[0043] The content acquisition system 7 acquires information for providing in-vehicle entertainment such as music playback, radio reception, and movie playback to the passengers. The content acquisition system 7 acquires information related to entertainment content such as music, radio, and movies, generates a signal (content sound information) corresponding to the sound to be output, and outputs it to the audio system 9.

[0044] The content acquisition system 7 outputs to the audio system 9 a signal corresponding to the sound for playing music or videos and a signal corresponding to the video in order to provide in-vehicle entertainment to the passengers.

[0045] The content acquisition system 7 may be configured by a computer including a content acquisition device 19 and a content processing device 21. The content acquisition device 19 may be configured, for example, by various media reading devices that read content information related to music and videos from various media such as CDs (Compact Discs) and DVDs (Digital Versatile Discs). The content processing device 21 may be configured by a processor 21A that processes content information. The content acquisition device 19 may further include various memories such as a volatile memory and a non-volatile memory. The content acquisition system 7 (specifically, the processor 21A) generates information corresponding to the sound to be output (hereinafter, content sound information; also referred to as a signal corresponding to the sound) and information corresponding to the video (content video information; also referred to as a signal corresponding to the video) based on the content information acquired by the content acquisition device 19, and outputs it to the audio system 9. Hereinafter, the content sound information and the content video information are collectively referred to as content information.

[0046] The content acquisition device 19 may be configured to download content information from various servers via a mobile communication network and store it in a storage device such as a memory, SSD, or HDD. The content acquisition device 19 may also generate a signal corresponding to the sound to be output (i.e., content sound information) and a signal corresponding to a video based on content information such as radio programs and television programs received from a receiver (not shown) for radio broadcast waves and television broadcast waves, and output them to the audio system 9.

[0047] The audio system 9 includes at least one speaker 23, at least one microphone 25, and an output control device 27. In the present embodiment, the audio system 9 further includes a display device 29 and a vibration device 31 in addition to the speaker 23, the microphone 25, and the output control device 27.

[0048] The speaker 23 is provided on a wall surface defining the passenger compartment 1S, a headrest of a seat, etc., and emits sound toward the inside of the passenger compartment 1S. When the speaker 23 is provided on a wall surface defining the passenger compartment 1S such as a door trim, it is preferably fixed so that the direction in which the sound is emitted (also referred to as the sound emission direction) faces the inside of the vehicle.

[0049] Each of the speakers 23 is connected to the output control device 27 by wiring such as an audio cable. A signal is supplied to each of the speakers 23 from the output control device 27. When a signal is supplied to the speaker 23 from the output control device 27, the speaker 23 emits sound corresponding to the signal toward the inside of the passenger compartment 1S.

[0050] The sound emitted from the speaker 23 may include three types of sounds: a sound corresponding to the attention sound information generated by the attention calling system 3, a sound corresponding to the guidance sound information generated by the navigation system 5, and a sound corresponding to the content sound information generated by the content acquisition system 7.

[0051] The microphone 25 (also referred to as a microphone) is mounted on the vehicle 1, picks up sounds inside or outside the passenger compartment 1S, and converts them into electrical signals (sound signals). The microphone 25 may be provided outside the passenger compartment 1S or inside the passenger compartment 1S. For example, the microphone 25 may be provided on the roof (ceiling) near the driver's seat.

[0052] The microphone 25 is configured to be able to pick up sounds inside the passenger compartment 1S and outside sounds (hereinafter referred to as outside vehicle sounds). Examples of outside vehicle sounds picked up by the microphone 25 include the sound of rain around the vehicle 1, the wind noise associated with the high-speed driving of the vehicle 1, the sound from the road surface associated with the driving of the vehicle 1 (hereinafter referred to as road noise), and the noise caused by construction work carried out around the vehicle 1.

[0053] Rain noise, wind noise, and road noise have characteristics according to the factors that generate the sounds. For example, in the case of rain noise, the sound is generated when raindrops reach the vehicle 1. Therefore, as shown in FIG. 3, during rainy driving, spikes (see the arrows in FIG. 3) indicating the sound of raindrops appear in the sound pressure of the sound picked up by the microphone 25 (corresponding to the square of the amplitude of the sound signal detected by the microphone 25, the intensity of the sound signal). Road noise contains many frequency components below 1 kHz, and wind noise contains many frequency components above 500 Hz.

[0054] As shown in FIG. 1, the microphone 25 is connected to the output control device 27 via a harness (signal line). The microphone 25 converts the picked-up sound into a sound signal and outputs the converted sound signal to the output control device 27.

[0055] As shown in FIGS. 1 and 2, the display device 29 is provided at a position visible to the passengers in the passenger compartment 1S, and notifies the passengers of visual information by performing screen display. The display device 29 may be configured by a touch panel display or the like. The display device 29 can display map information, routes, and content information such as videos acquired by the content acquisition system 7 output by the navigation system 5. The display device 29 is connected to the output control device 27 via a harness (signal line), and performs screen display based on a signal from the output control device 27. Further, when the display device 29 is configured by a touch panel display, the display device 29 outputs information related to operation input to the screen to the output control device 27.

[0056] The vibration device 31 notifies the passengers by tactile stimulation. The vibration device 31 may be configured by a known vibration device using, for example, an eccentric motor or a linear resonance actuator.

[0057] The vibration device 31 may be provided, for example, on a seat provided in the passenger compartment 1S. In that case, the vibration device 31 may be provided at any location as long as the vibration is transmitted to the passenger sitting on the seat. For example, it may be provided on the backrest surface of the seat back or on the back side of the seating surface of the seat cushion. When provided on the seat back, the vibration device 31 may be arranged near the shoulders or scapulae of the passenger sitting on the seat. When provided on the seat cushion, the vibration device 31 may be provided near the buttocks or feet of the passenger. The vibration device 31 is connected to the output control device 27 by a harness (signal line), and the amplitude and frequency of the vibration output by the vibration device 31 are controlled by the output control device 27.

[0058] The vibration device 31 may also be provided on the steering wheel gripped by the driver. Thereby, it is possible to notify the driver who holds the steering wheel and performs driving operations.

[0059] The output control device 27 is composed of one or more electronic control units (ECUs) including a processor 33 such as a CPU (Central Processing Unit) or an MPU (Micro-Processing Unit), a volatile memory 35, a non-volatile memory 37, and a storage device 39 such as an SSD (Solid State Drive) or an HDD (Hard Disk Drive).

[0060] The output control device 27 may have an A / D converter 41 for digitally processing the sound signal from the microphone 25, and a D / A converter 43 for outputting sound from the speaker 23 and / or outputting vibration from the vibration device 31. Additionally, the output control device 27 may include an amplifier 45 for amplifying the output from the D / A converter 43. The processor 33 can set the amplification factor (also referred to as gain) corresponding to each of the attention sound information, guidance sound information, and content sound information, and set the volume of the corresponding sound, by performing arithmetic processing on the output to the D / A converter 43 and / or by controlling the amplification factor of the amplifier 45.

[0061] The output control device 27 is connected to the attention arousal system 3, the navigation system 5, and the content acquisition system 7 via a harness (signal line). The output control device 27 acquires attention arousal information from the attention arousal system 3, guidance information from the navigation system 5, and content information from the content acquisition system 7 respectively.

[0062] When the output control device 27 acquires attention sound information, guidance sound information, and content sound information, it can amplify the corresponding sounds (attention arousal sound, guidance sound, and content sound) at a predetermined amplification factor and then synthesize (mix, also referred to as superimpose) them to generate them from the speaker 23. When the output control device 27 acquires guidance image information, content video information, etc., it causes the display device 29 to perform corresponding screen displays.

[0063] When the output control device 27 acquires the content sound information and the caution sound information, it performs output setting processing and sets the amplification factor corresponding to each sound based on the driving state of the vehicle 1. The amplification factor referred to here means the ratio of the output to the input to the output control device 27, and is also called gain. In addition, the amplification factor set in the output setting processing includes a value less than 1 (that is, attenuation; negative gain), and 0 times (that is, stopping the corresponding sound).

[0064] In this embodiment, the output control device 27 sets the amplification factor corresponding to each sound signal and also sets the amplification factor for the amplitude of the vibration output from the vibration device 31. FIG. 4 shows a flowchart of the output setting processing according to this embodiment. Hereinafter, the details of the output setting processing executed by the output control device 27 will be described with reference to the flowchart of the output setting processing shown in FIG. 4.

[0065] In the first step ST1 of the output setting processing, the output control device 27 estimates the driving state of the vehicle 1 based on the sound signal acquired from the microphone 25 and acquires the caution level (ST1). The caution level indicates the degree of caution required for the occupant (especially the driver). As the caution level increases, the degree of caution required for the occupant increases, and a more cautious driving operation is required for the driver.

[0066] FIG. 5 shows a table showing the relationship between the driving state according to this embodiment and the corresponding caution level. Hereinafter, the driving state of the vehicle 1 may include the driving mode of the vehicle 1 such as the speed and acceleration of the vehicle 1, and the situation around the vehicle 1.

[0067] In the example shown in FIG. 5, as the estimated driving state, a rainy weather driving state in which the vehicle 1 is driving in an environment where relatively heavy rain is falling, a high-speed driving state in which the vehicle 1 is driving at a high speed, and a normal driving state in which the vehicle 1 is driving at a normal speed and noise is detected due to construction work being carried out around the vehicle 1 are exemplified. In the rainy weather driving state, the attention level is set to 3 (high), in the high-speed driving state, the attention level is set to 2 (medium), and in the normal driving state, the attention level is set to 1 (low), respectively. When the acquisition of the attention level is completed, the output control device 27 executes step ST2.

[0068] In step ST2, the output control device 27 refers to the table shown in FIG. 5 based on the attention level acquired in ST1, and sets the amplification factor of the sound corresponding to the attention sound information (that is, the attention-arousing sound). When the attention level acquired in ST1 is 3 (rainy weather driving state), the output control device 27 sets the amplification factor of the attention-arousing sound to a predetermined value greater than 1 times (for example, 1.5 times, etc.). When the attention level acquired in ST1 is 2 (high-speed driving state), the output control device 27 sets the amplification factor of the attention-arousing sound to 1 times. When the attention level acquired in ST1 is 1 (normal driving state), the output control device 27 sets the amplification factor of the attention-arousing sound to 0 times (that is, stops the attention-arousing sound). When the setting of the amplification factor of the sound corresponding to the attention sound information is completed, the output control device 27 executes step ST3.

[0069] In step ST3, the output control device 27 refers to the table shown in FIG. 5 based on the attention level acquired in ST1, and sets the amplification factor of the driving amount of the vibration device 31. When the attention level acquired in ST1 is 3 (rainy weather driving state) or 2 (high-speed driving state), the output control device 27 sets the amplification factor of the driving amount of the vibration device 31 to a predetermined value greater than 1 times (for example, 1.5 times, etc.). When the attention level acquired in ST1 is 1 (normal driving state), the output control device 27 sets the amplification factor to 1 times. When the setting of the amplification factor of the driving amount of the vibration device 31 is completed, the output control device 27 executes step ST4.

[0070] In step ST4, based on the attention level acquired in ST1, the output control device 27 refers to the table shown in FIG. 5 and sets the amplification factor of the sound corresponding to the content sound information (i.e., the content sound). When the attention level acquired in ST1 is 3 (rainy driving state), the output control device 27 sets the amplification factor of the content sound to a value smaller than 1 (i.e., negative gain), for example, 0.5 times. When the attention level acquired in ST1 is 2 (high-speed driving state) or 1 (normal driving state), the output control device 27 sets the amplification factor of the content sound to 1 time. When the setting of the amplification factor corresponding to the content sound is completed, the output control device 27 finishes the output setting process.

[0071] Based on the acquired attention sound information and content sound information and the amplification factor set by the output setting process, the output control device 27 amplifies the attention sound and the content sound at the corresponding amplification factors respectively, and then synthesizes (mixes, also referred to as superimposing) them and outputs them from the speaker 23.

[0072] In this embodiment, in the output setting process, the output control device 27 sets the amplification factor corresponding to the sound corresponding to the guidance sound information (i.e., the guidance sound) to the same value as the amplification factor corresponding to the attention sound. However, the output control device 27 may set the amplification factor corresponding to the guidance sound to be smaller than the amplification factor corresponding to the attention sound and larger than the amplification factor corresponding to the content sound in the output setting process.

[0073] As shown in FIG. 5, in step ST1 of the output setting process, the output control device 27 acquires the attention level by estimating the driving state based on the output of the microphone 25. FIG. 6 shows an example of the process for estimating the driving state performed by the output control device 27, that is, the flowchart of the driving state estimation process. Hereinafter, the example of the driving state estimation process shown in FIG. 6 will be described.

[0074] First, in the first step ST11 of the driving state determination process, the output control device 27 estimates the presence or absence of rainfall and the degree of rainfall based on the sound signal output from the microphone 25. Specifically, the output control device 27 counts the number of sounds (spike sounds) caused by raindrops within a predetermined time based on the sound signal output from the microphone 25. When the number of sounds caused by raindrops per unit time is equal to or greater than a predetermined threshold, the output control device 27 executes step ST12, estimates that the driving state is a rainy-day driving state, and ends the driving state estimation process. When the sound of rain caused by raindrops is not detected by the microphone 25, or when the sound of rain caused by raindrops is less than the predetermined threshold, the output control device 27 determines that the driving state is not a rainy-day driving state and executes step ST13.

[0075] In step ST13, the output control device 27 determines whether the ratio of the sound signal caused by the wind shear sound among the sound signals acquired by the microphone 25 is equal to or greater than a predetermined threshold. In the present embodiment, the output control device 27 first deletes the sound signal caused by raindrops from the sound signal acquired by the microphone 25 by performing known signal processing. At this time, for example, the output control device 27 may delete the spike-shaped sound signal caused by raindrops by applying a known filter to the sound signal acquired by the microphone 25. Further, the output control device 27 may delete the sound signal corresponding to the spike sound caused by raindrops by deleting the sound signal within a predetermined time width centered on the peak of the spike-shaped sound signal caused by raindrops. Next, the output control device 27 calculates the ratio of the sound signals having a frequency equal to or higher than a predetermined frequency threshold (for example, 500 Hz) by performing frequency analysis on the sound signal after deleting the sound signal caused by raindrops. Next, when the ratio of the sound signal is equal to or greater than a predetermined ratio threshold, the output control device 27 determines that the ratio of the sound signal caused by the wind shear sound is equal to or greater than a predetermined threshold.

[0076] When the output control device 27 determines that the ratio of the sound signal caused by the wind noise is equal to or greater than a predetermined threshold, it determines that the driving state is in the high-speed driving state (step ST14), and ends the driving state estimation process. When the output control device 27 determines that the ratio of the sound signal caused by the wind noise is less than the predetermined threshold, it determines that the driving state is in the normal driving state (step ST15), and ends the driving state estimation process.

[0077] Next, the operation and effects of the acoustic system 9 configured as described above will be described.

[0078] As shown in FIG. 5, based on the driving state of the vehicle 1 estimated in step ST1, the output control device 27 sets the amplification factor, that is, the volume, corresponding to each of the content sound and the caution sound, and generates the content sound and the caution sound from the speaker 23. Therefore, the acoustic system 9 functions as a notification device that generates a caution sound and emits sound toward the passenger compartment of the vehicle 1 to perform notification.

[0079] As shown in FIG. 5, the output control device 27 estimates the driving state of the vehicle 1 based on the sound collection result by the microphone 25. For example, the output control device 27 estimates that the vehicle is in the rainy weather driving state based on the sound of rain collected by the microphone 25. When the output control device 27 determines that the vehicle is not in the rainy weather driving state, it determines whether the vehicle 1 is in the high-speed driving state based on the intensity of the wind noise. In this way, by using the sound collection result by the microphone 25, the driving state of the vehicle 1 can be obtained appropriately and simply.

[0080] As shown in FIG. 5, when the caution level is 3 (rainy weather driving state), the output control device 27 sets the amplification factor of the content sound to be smaller than when the caution level is 2 (high-speed driving state). As a result, when the caution level changes from 2 to 3, the sound generated from the microphone 25 based on the content sound information, that is, the volume of the content sound, is set to be smaller.

[0081] Therefore, when the driving state changes from high-speed driving to rainy-day driving with a high attention level, the volume of the content sound decreases. This can prevent the content sound from making it difficult for the passenger to hear the attention sound when attention is required.

[0082] In addition, when the attention level is 2 or higher, the output control device 27 sets a larger amplification factor for the attention sound as the attention level increases. As a result, as the attention level increases and changes from 2 to 3, the sound generated from the microphone 25 based on the attention sound information, that is, the volume of the attention sound, is set to increase.

[0083] This makes it easier for the passenger to hear the attention sound when attention is required, so that appropriate notification can be provided to the passenger.

[0084] Also, as shown in FIG. 5, when the attention level is 1 or lower, that is, when the vehicle 1 is in a normal driving state, the output control device 27 sets the amplification factor of the attention sound to 0 times and stops the output of the attention sound. At the same time, the output control device 27 sets the amplification factor of the vibration device 31 to 1 and drives the vibration device 31 to notify the passenger.

[0085] As a result, when the attention level is below a predetermined threshold (in this embodiment, the threshold is 1), instead of stopping the output of the attention sound, the vibration device 31 is driven to provide notification by vibration. This maintains the volume of the content sound when providing notification, so that appropriate notification can be provided to the passenger without degrading the in-vehicle entertainment quality.

[0086] Also, when the attention level is 2 or less, the output control device 27 increases the amplitude of the vibration generated by the vibration device 31 as the attention level increases. Therefore, as the attention level changes from 1 (normal driving state) to 2 (high-speed driving state), and the degree of attention required of the occupant increases, the amplitude of the vibration generated by the vibration device 31 increases. As a result, when attention is required, the occupant can easily feel the vibration, so that appropriate notification can be made to the occupant.

[0087] In this way, the audio system 9 can set the volume of the content sound and the volume of the attention-grabbing sound according to the driving state of the vehicle 1. Therefore, it is possible to set the volumes of the content sound and the attention-grabbing sound according to the degree of attention that should be aroused. Thereby, the audio system 9 can appropriately notify the occupant without degrading the in-vehicle entertainment performance.

[0088] In this way, according to the present disclosure, there is provided a notification device (audio system 9) that can appropriately notify the occupant without degrading the in-vehicle entertainment performance. The notification device (audio system 9) of the present disclosure is considered to further improve traffic safety and contribute to the development of a sustainable transportation system.

[0089] With the above, the description of the specific embodiments is completed. However, the present invention is not limited to the above embodiments and modifications, and can be widely modified and implemented.

[0090] In the embodiment shown in FIG. 5, the output control device 27 set the amplification factor of the attention - arousing sound to increase as the attention level increased when the attention level was equal to or higher than a predetermined threshold (2 or higher in FIG. 5), but the present invention is not limited to this mode. Specifically, the output control device 27 may be set to increase the amplification factor of the attention - arousing sound as the attention level increases regardless of the threshold, and may be set to decrease the volume of the content sound as the attention level increases. Also in this case, when the degree of attention required of the occupant increases, the volume of the content sound decreases. Thereby, it is possible to prevent the occupant from having difficulty in hearing the attention - arousing sound due to the content sound when attention arousal is required.

[0091] In the above - described embodiment, the output control device 27 was configured to estimate the driving state of the vehicle 1 by the microphone 25. However, in addition to the microphone 25, it may be configured to estimate the driving state of the vehicle 1 based on the outputs of the sensing devices 11 such as the radar 11A, lidar 11B, sonar 11C, camera 11D, etc., and the outputs of various sensors such as a vehicle speed sensor and an acceleration sensor provided on the vehicle body.

[0092] In the above - described embodiment, an example in which the warning generation device 13, guidance processing device 17, content processing device 21, and output control device 27 are configured separately has been described. However, the present invention is not limited to this mode, and the warning generation device 13, guidance processing device 17, content processing device 21, and output control device 27 may be configured by one processing device.

[0093] Also, in the above - described embodiment, an example in which the attention level becomes higher in the rainy - weather driving state or high - speed driving state than in the normal driving state has been described. However, the present invention is not limited to this mode. The attention level may be set higher than in the normal driving state, for example, when the microphone 25 detects ground rumbling, booming sounds due to strong winds or lightning strikes, warning voices reported from local governments, etc.

Explanation of Reference Numerals

[0094] 1: Vehicle 1S: Passenger Compartment (Cabin) 9: Audio system (notification device) 23: Speaker 25: Microphone 27: Output control device (control device) 31: Vibration device

Claims

1. An informing device that performs notification by emitting sound toward the passenger compartment of a vehicle, comprising: a speaker that emits sound into the passenger compartment; a microphone provided in the vehicle that converts the collected sound into an audio signal and outputs it; a control device that outputs sound from the speaker based on the audio signal, wherein the control device: acquires content sound information related to content sound of in-vehicle entertainment; acquires attention sound information for generating an attention-arousing sound for attention arousal; estimates the running state of the vehicle based on the audio signal acquired by the microphone; sets the volume of each of the content sound and the attention-arousing sound based on the estimated running state; outputs the corresponding content sound and attention-arousing sound from the speaker at the set volume based on the content sound information and the attention sound information respectively; sets an attention level indicating the degree of attention required for the passengers based on the audio signal acquired by the microphone, and reduces the volume of the sound generated from the speaker based on the content sound information as the attention level increases. An informing device.

2. The informing device according to claim 1, wherein the control device increases the volume of the sound generated from the speaker based on the attention sound information as the attention level increases.

3. including a vibration device that generates vibration to notify the passengers, wherein the control device drives the vibration device based on the estimated running state. The informing device according to claim 1.

4. The informing device according to claim 3, wherein the control device stops the output of the sound based on the attention sound information and drives the vibration device when the attention level is below a predetermined threshold.

5. The informing device according to claim 1, wherein the control device increases the volume based on the attention sound information as the attention level increases when the attention level is greater than a predetermined threshold.

6. including a vibration device that generates vibration to notify the passengers, wherein the control device increases the amplitude of the vibration generated by the vibration device as the attention level increases. The informing device according to claim 5.

7. The control device estimates whether the vehicle is driving in rainy weather based on the sound signal acquired by the microphone, and when it is determined that the vehicle is driving in rainy weather, sets the attention level higher than when it is determined that the vehicle is not driving in rainy weather. The notification device according to any one of claims 1 to 5.

8. When it is determined that the vehicle is not driving in rainy weather, the control device determines whether the vehicle is driving at high speed based on the sound signal acquired by the microphone, and when it is determined that the vehicle is driving at high speed, sets the attention level higher than when it is determined that the vehicle is not driving at high speed. The notification device according to claim 7.

Images