Sound output device

Abstract

To provide a sound output device capable of outputting appropriate notification sound according to the situation to a passenger of a moving body.SOLUTION: A driver monitoring unit estimates the awakening degree of a passenger, the driving concentration degree, and the like. by using a heartbeat sensor, an in-car camera, and the like. An informing sound image localization control unit determines the importance of the informing sound from the type of the informing sound and the vehicle state information. Also, on the basis of the vehicle state information, the awakening degree, and the driving concentration level, the sensitivity of the passenger to the informing sound is determined. Also, the sound image localization of the informing sound is controlled according to the sensitivity to the informing sound. An informing sound output unit is composed of a sound source device such as a DSP and an acoustic system such as a plurality of speakers and outputs an informing sound and sets the sound image localization of the informing sound at a specific position such as a passenger's ear or the like.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a sound output device that outputs an alarm sound to a passenger of a moving body. [Background technology]

[0002] Conventionally, there is a device that outputs an alarm sound to a vehicle driver, as disclosed in, for example, JP 2010-208606 A (Patent Document 1). This conventional technology localizes the sound image of an alarm voice (alarm sound) that notifies the driver of the presence of an obstacle when the obstacle is detected, in the detected direction, thereby allowing the driver to recognize the obstacle. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2010-208606 A Summary of the Invention [Problem to be solved by the invention]

[0004] In conventional technology, the sound image position of the warning sound is determined uniquely regardless of the vehicle control state (for example, whether the vehicle is being driven automatically or manually) or the driver's state (for example, whether the driver is concentrating on driving or awake). Therefore, depending on the situation, a warning sound that is annoying to the driver may be output.

[0005] An object of the present invention is to provide a sound output device that can output an appropriate alarm sound to a passenger of a moving body according to the situation. [Means for solving the problem]

[0006] In order to solve the above problem, the invention described in claim 1 includes an alarm sound information acquisition unit that acquires information about an alarm sound for a passenger of a moving body, a sound sensitivity estimation unit that estimates a sensitivity regarding sound recognition of the passenger, and a sound image localization control unit that changes a sound image localization of the alarm sound for the passenger based on the sensitivity estimated by the sound sensitivity estimation unit. The sound output device is characterized by comprising: [Brief description of the drawings]

[0007] [Figure 1] 1 is a schematic diagram illustrating a configuration of a sound output device according to an embodiment of the present invention. [Diagram 2] 1 is a functional block diagram of a sound output device according to an embodiment of the present invention. [Diagram 3] 1 is a flowchart illustrating a program executed by a computer of a sound output device according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] A sound output device according to an embodiment of the present invention will be described below. The sound output device according to an embodiment of the present invention includes an alarm sound information acquisition unit that acquires information about an alarm sound for a passenger of a moving body, a sound sensitivity estimation unit that estimates the passenger's sensitivity regarding sound recognition, and a sound image localization control unit that changes the sound image localization of the alarm sound for the passenger based on the sensitivity estimated by the sound sensitivity estimation unit. Therefore, an appropriate alarm sound can be output with a sound image localization according to the passenger's sensitivity regarding sound recognition.

[0009] The sound sensitivity estimation unit estimates the sound recognition sensitivity of the passenger based on passenger condition information including biometric information of the passenger. The passenger condition information is, for example, the passenger's heart rate, blinking frequency, yawning frequency, driving concentration level, etc., and can output an alarm sound with a sound image localization suitable for the passenger's condition.

[0010] The vehicle state detection unit detects a state of the vehicle including a state related to sound inside the vehicle, and the sound sensitivity estimation unit estimates the sound recognition sensitivity of the passenger based on the state of the vehicle detected by the vehicle state detection unit. The vehicle information is, for example, a state of a content playback sound inside the vehicle, and the vehicle can output an alarm sound with a sound image localization suitable for the state of the vehicle.

[0011] In addition, when the passenger's sensitivity to sound recognition is low, the sound image localization control unit localizes the sound image closer to a specific position of the passenger than when the sensitivity is high. The specific position is, for example, near the passenger's ear or above the passenger's head, and the notification sound can be output to a unique position that is rarely experienced in normal situations.

[0012] The sound image localization control unit changes the sound image localization in accordance with the sensitivity and the importance of the notification sound, thereby making it possible to output the notification sound with a sound image localization in accordance with the importance of the notification sound.

[0013] The vehicle control system further includes a driving control information acquisition unit that acquires driving control information related to driving control of the moving body, and the sound image localization control unit changes the sound image localization in accordance with the driving control information, the sensitivity, and the importance. The driving control information is information indicating a control state of the vehicle, such as whether the vehicle is being driven automatically or manually, and the notification sound can be output with a sound image localization suitable for the state of the vehicle.

[0014] Furthermore, when the importance determination unit determines that the importance of the alarm sound is high, the sound image localization control unit localizes the sound image to a specific position of the occupant regardless of the sensitivity, thereby making it possible to output the alarm sound with a sound image localization according to the importance of the alarm sound.

[0015] The sound sensitivity estimation unit detects the occupant's level of alertness and / or level of concentration on driving as the occupant state information.

[0016] The moving object state detection unit detects, as the moving object state, a state related to a sound reproduced by a content reproduction device in the moving object.

[0017] In addition, a sound output method according to one embodiment of the present invention includes an alarm sound information acquisition process for acquiring information regarding an alarm sound for an occupant of a moving body, a sound sensitivity estimation process for estimating the occupant's sensitivity regarding sound recognition, and a sound image localization control process for changing the sound image localization of the alarm sound for the occupant based on the sensitivity estimated by the sound sensitivity estimation unit.

[0018] The above-described sound output method may be implemented as a sound output program that causes a computer to execute the sound output method. EXAMPLES

[0019] A sound output device according to an embodiment of the present invention will be described with reference to FIGS.

[0020] FIG. 1 is a schematic diagram of a sound output device according to an embodiment of the present invention, and FIG. 2 is a functional block diagram of the sound output device according to the same embodiment.

[0021] As shown in FIG. 1, the sound output device of the embodiment is equipped with a control unit 1 mounted on a vehicle and operated by a computer or the like, a storage device 2 storing a sound output program of the embodiment of the present invention or the like, a sound source device 3 that outputs an acoustic signal using a DPS or the like, an audio system 4 consisting of a plurality of speakers or the like, and an input system 5 that inputs various data from a navigation device, biometric information from a biometric sensor (such as a pulse sensor), image data from an in-vehicle camera, etc.

[0022] In the functional block diagram of FIG. 2, the navigation unit outputs, for example, navigation guidance sounds that guide the driving route. The driving support information output unit outputs information on vehicle braking notice (for example, "Move to the right lane," "Emergency stop will be made," etc.) during autonomous driving, and outputs safe driving support information such as lane departure warning and following distance warning during manual driving. The "alert sound source information" is information including the navigation guidance voice from the navigation unit, and alert sounds such as braking warning sounds and hazard warning sounds from the driving support information output unit, as well as type information indicating the types of these alert sounds, and this information is input to the alert sound image localization control unit.

[0023] In addition, in the functional block diagram of FIG. 2, the automatic driving control unit automatically controls all or part of the driving operations of acceleration, steering, and braking. More specifically, automatic control of acceleration, steering, and braking differs depending on the automatic driving level. The automatic driving control unit outputs information indicating whether the driving is automatic or manual, and information indicating the control state of the vehicle according to the automatic driving level. In addition, the content playback unit has the following functions. For example, content playback here refers to playback of package media such as CDs and DVDs, playback of broadcast content such as television and radio, playback of content acquired by wireless communication, and the like, and playback of video and audio for the passenger to view. The content playback unit outputs information on the content being played. And, "vehicle state information" refers to information such as information output by the automatic driving control unit, and information such as content information output by the content playback unit when the content playback unit is playing, and these information are input to the notification sound image localization control unit.

[0024] The "driver monitoring unit" estimates the driver's level of alertness and level of concentration while driving using a heart rate sensor, an in-car camera, etc., and outputs information indicating the estimated state. The driver's level of alertness is determined by a decrease in heart rate, the frequency of blinking, the frequency of yawning, etc. The level of concentration while driving is determined by the frequency of looking away, etc. Then, information indicating these estimated states is input to the alarm sound image localization control unit.

[0025] The "alert sound sound image localization control unit" includes an "alert sound importance determination unit," a "sensitivity determination unit," and a "sound image localization control unit." The "alert sound importance determination unit" determines the importance of the alert sound from the type of alert sound included in the alert sound source information and the vehicle state information. The "sensitivity determination unit" determines the driver's sensitivity to the alert sound based on the vehicle state information, the level of alertness, and the level of driving concentration. The "sound image localization control unit" controls the sound image localization of the alert sound depending on the determined sensitivity to the alert sound.

[0026] The "alert sound output unit" is composed of a sound source device 3 consisting of a DSP or the like, and an audio system 4 consisting of multiple speakers, etc. The alert sound output unit changes the driver's perception of the direction and distance of the sound source of the alert sound (sound image localization of the alert sound) based on the control of the sound image localization control unit. In other words, the alert sound output unit processes the alert sound and outputs it so that the position of the virtual sound source of the alert sound changes based on the control of the sound image localization control unit.

[0027] 3 is a flowchart of a sound output program executed by a computer in the control unit 1 of the sound output device of the embodiment. Note that this flowchart is a flowchart of the main part of the control program executed by the computer (its CPU) of the control unit 1, and is configured as a subroutine for the main processing of the control program.

[0028] First, in step S1, a sound reproduction instruction process is executed. In step S1, an instruction to reproduce an alarm sound output from the navigation unit and the driving assistance information output unit, and information on the type of the alarm sound are received, and the process proceeds to step S2. In the sound importance determination process in step S2, the importance of the alarm sound instructed to reproduce in step S1 is determined from the type of the alarm sound received (e.g., navigation guidance voice, braking warning sound, danger warning sound, etc.) and the vehicle control state (automatic driving / manual driving, or automatic driving level) acquired from the automatic driving control unit at this time.

[0029] In this importance determination process, the importance of the notification sound is set, for example, as follows. A low importance state is a notification sound that the driver may miss hearing (such as a navigation guidance voice during automatic driving). A medium importance state is a notification sound that does not cause a sudden change in the control of the vehicle (such as a navigation guidance voice during manual driving, a lane change notification during automatic driving, etc.). A high importance state is a notification sound that causes a sudden change in the control of the vehicle (such as a sudden braking notification during automatic driving, an obstacle warning during manual driving, a lane departure warning, etc.). Alternatively, the importance of each type of notification sound may be determined according to the level of automatic driving. If the importance is medium, the process proceeds to step S3, if the importance is high, the process proceeds to step S6, and if the importance is low, the process proceeds to step S7.

[0030] In the sound sensitivity determination process in step S3, the driver's sensitivity to the notification sound for which playback is instructed is determined. This sensitivity is determined based on the playback state of other sound sources (e.g., playback sound of the content being played, etc.) at this time, the driver's wakefulness estimated by the driver monitoring unit, the driver's concentration on driving, etc. For example, the playback state of other sound sources is evaluated for each element as follows: if the playback is in progress, it is "NG"; if the playback is stopped, it is "OK"; if the wakefulness of the driver is low, it is "NG"; if the wakefulness of the driver is high, it is "OK"; if the concentration on driving is low, it is "NG"; if the concentration on driving is high, it is "OK". If any one of the above three elements is "NG", the driver's sensitivity is "low", and if all are "OK", the driver's sensitivity is "high". The above determination conditions are merely examples and may be set as appropriate. For example, if there are two or more "OK", the sensitivity may be determined to be "high".

[0031] If the sensitivity is low, the process of setting the sound image localization of the alarm sound to the ear (specific position) is performed in step S4, and if the sensitivity is high, the process of setting the sound image localization of the alarm sound to the standard position is performed in step S5, and then the process proceeds to step S8.

[0032] On the other hand, if the importance is determined to be high in step S2 and the process proceeds to step S6, the sound image localization of the alarm sound is set to the ear in step S6, and the process proceeds to step S8. If the importance is determined to be low in step S2 and the process proceeds to step S7, the sound image localization of the alarm sound is set to the standard position in step S7, and the process proceeds to step S8.

[0033] Here, in the process of setting the sound image localization of the notification sound at the ear in steps S4 and S6, the sound image localization of the notification sound specified in step S1 is set so that it can be heard at the driver's ear. Note that the position at the ear is an example of a "specific position", and the "specific position" is not limited to the ear, and may be localized at a specific position (for example, above the head). In this way, the notification sound is heard from a specific position that is rarely experienced normally, making it easier for the driver to recognize the notification sound. The control of the sound image localization may be a method of controlling in real time (for example, processing by DSP), or multiple sound sources with the same original sound source but different localization positions may be prepared in advance, and which sound source is to be played at the appropriate time may be selected.

[0034] In the process of setting the sound image localization of the notification sound to the standard position in steps S5 and S7, the sound image localization of the notification sound specified in step S1 is set to the standard position. This standard position is, for example, in front of the driver, a location where the notification sound alone is not perceived as having a distinctive localization when played simultaneously with the content playback sound.

[0035] Then, in the informative sound reproducing process in step S8, the informative sound is reproduced based on the set sound image localization.

[0036] Although one embodiment has been described above, other embodiments are as follows. A microphone or the like may be further provided for measuring the noise level inside the vehicle cabin, and the volume level of the notification sound may be changed according to the amount of various noises inside the vehicle cabin, such as voices, content playback sounds, running sounds, noise leaking in from outside the vehicle, etc. For example, when the amount of noise inside the vehicle cabin is low, the notification sound is output at a low volume level, and when the amount of noise inside the vehicle cabin is high, the notification sound is output at a high volume level.

[0037] In this way, by outputting an alarm sound according to the noise environment, when the sound image of the alarm sound is localized in a standard position, the driver can hear the alarm sound without feeling uncomfortable, and when the sound image of the alarm sound is localized in a specific position, the driver can recognize the alarm sound even more easily.

[0038] In the above embodiment, the sound image of the notification sound is localized near the ear when the importance of the notification sound is high or when the sensitivity to the notification sound is low among the importance of the notification sound, but the specific position is not limited to near the ear, and may be a position that is easy for the driver to notice. For example, the position of the sound image localization of the playback sound of the content being played in the vehicle cabin may be acquired in real time, and the sound image localization of the notification sound may be controlled so that the position of the sound image localization of the playback sound of the content and the position of the sound image localization of the notification sound that should be noticed are located at positions apart from each other. This allows the notification sound to be heard from a position different from the playback sound of the content being viewed, for example, making it easier for the driver to recognize the notification sound. In addition, in order to acquire the position of the sound image localization of the playback sound of the content in real time, for example, the phase and volume of the sound data of the content may be analyzed, or if the content contains such information, such information may be used.

[0039] In the above embodiment, the sound image of the alarm sound is localized to a specific position relative to the driver when the importance of the alarm sound is high or when the sensitivity to the alarm sound is low among the importance levels, but the specific position may be relative to at least one of the vehicle occupants, including the passengers, without being limited to the driver. In this case, the same processing as in the above embodiment may be performed on the passengers based on the output of the passenger biosensor and the image of the passenger taken by the in-vehicle camera.

[0040] The present invention is not limited to the above-mentioned embodiment. In other words, a person skilled in the art can implement the present invention by modifying it in various ways according to the conventionally known knowledge without departing from the gist of the present invention. As long as such modifications still have the configuration of the sound output device of the present invention, they are of course included in the scope of the present invention. [Explanation of symbols]

[0041] 1. Control section 2 Storage device 3 Sound source device 4. Sound System 5. Input Systems

Claims

[Claim 1] an alarm sound information acquisition unit that acquires information regarding an alarm sound for a passenger of the moving body; A sound sensitivity estimation unit that estimates the sound recognition sensitivity of the passenger; a sound image localization control unit that changes a sound image localization of the notification sound for the passenger based on the sensitivity estimated by the sound sensitivity estimation unit; A sound output device comprising:

Images