Information notification device, information notification method, program, and recording medium

Abstract

This information notification device uses a sound output unit installed inside a cabin of a moving body to notify a driver of information relating to shaking occurring in an occupant, and comprises: a moving body shaking information acquiring unit that detects shaking occurring in the moving body and acquires moving body shaking information; an occupant shaking information acquiring unit that detects shaking of the occupant and acquires occupant shaking information; a determining unit that determines whether or not the shaking of the occupant is caused by shaking of the moving body on the basis of the moving body shaking information and the occupant shaking information; and a sound control unit that, if the determining unit has determined that shaking of the occupant is caused by shaking of the moving body, controls the sound output unit to output a sound for generating a sound image having a position that moves relative to the driver in accordance with the shaking of the moving body.

Description

Information notification device, information notification method, program, and recording medium

[0001] The present invention relates to an information notification device, an information notification method, a program, and a recording medium, and for example, relates to an information notification device, an information notification method, a program, and a recording medium that notify a driver of a vehicle of information.

[0002] While a vehicle is traveling, a driver can predict the behavior of the vehicle, so they are less sensitive to shaking and cannot objectively grasp the magnitude and direction of the vehicle's shaking. Out of consideration for passengers in the vehicle, it is necessary to encourage the driver to drive in a way that reduces shaking. The effect of shaking on passengers may, for example, manifest as motion sickness, and countermeasures against motion sickness using stereophonic sound have been proposed (see, for example, Patent Documents 1 to 3).

[0003] Japanese Patent Application Laid-Open No. 2010-105643, Japanese Patent Application Laid-Open No. 2021-052326, Japanese Patent Application Laid-Open No. 2023-123079

[0004] One object of the present invention is to provide an information notification device capable of encouraging a driver to drive with less shaking out of consideration for passengers of a vehicle.

[0005] The invention according to claim 1 is an information notification device that notifies a driver of information related to shaking experienced by a passenger via a sound output unit installed in a cabin of a moving body, the information notification device comprising: a moving body shake information acquisition unit that detects shaking occurring in the moving body and acquires moving body shake information; a passenger shake information acquisition unit that detects shaking of the passenger and acquires passenger shake information; a determination unit that determines, based on the moving body shake information and the passenger shake information, whether the passenger's shaking is caused by shaking of the moving body; and a sound control unit that controls the sound output unit to output a sound that generates a sound image whose position changes relative to the driver according to the shaking of the moving body, when the determination unit determines that the passenger's shaking is caused by the shaking of the moving body.

[0006] The invention described in claim 10 is an information notification method performed by an information notification device that notifies a driver of information regarding shaking occurring to an occupant via a sound output unit installed inside the cabin of a mobile vehicle, the method comprising: a mobile vehicle shaking information acquisition step of detecting shaking occurring to the mobile vehicle and acquiring mobile vehicle shaking information; an occupant shaking information acquisition step of detecting shaking of the occupant and acquiring occupant shaking information; a determination step of determining whether the shaking of the occupant is caused by shaking of the mobile vehicle based on the mobile vehicle shaking information and the occupant shaking information; and a sound control step of controlling the sound output unit to output a sound that generates a sound image whose position moves relative to the driver in accordance with the shaking of the mobile vehicle, when the determination step determines that the shaking of the occupant is caused by shaking of the mobile vehicle.

[0007] The invention described in claim 11 is a program that causes a computer in an information notification device, which notifies the driver of information about shaking occurring to the passengers via a sound output unit installed inside the cabin of a mobile vehicle, to execute: a mobile vehicle shaking information acquisition step of detecting shaking occurring to the mobile vehicle and acquiring mobile vehicle shaking information; a passenger shaking information acquisition step of detecting shaking of the passengers and acquiring passenger shaking information; a determination step of determining whether the shaking of the passengers is caused by shaking of the mobile vehicle based on the mobile vehicle shaking information and the passenger shaking information; and a sound control step of controlling the sound output unit to output a sound that generates a sound image that moves relative to the driver in accordance with the shaking of the mobile vehicle, if the determination step determines that the shaking of the passengers is caused by shaking of the mobile vehicle.

[0008] The invention described in claim 12 is a recording medium for recording a program that causes a computer in an information notification device, which notifies the driver of information about shaking occurring to the passengers via a sound output unit installed inside the cabin of a mobile body, to execute: a mobile body shaking information acquisition step of detecting shaking occurring to the mobile body and acquiring mobile body shaking information; a passenger shaking information acquisition step of detecting shaking of the passengers and acquiring passenger shaking information; a determination step of determining whether the shaking of the passengers is caused by shaking of the mobile body based on the mobile body shaking information and the passenger shaking information; and a sound control step of controlling the sound output unit to output a sound that generates a sound image that moves relative to the driver in accordance with the shaking of the mobile body, when the determination step determines that the shaking of the passengers is caused by shaking of the mobile body.

[0009] This is a schematic diagram showing a transparent view from above of the passenger compartment of a vehicle, which is a mobile body equipped with an information notification device according to Embodiment 1 of the present invention. This is a block diagram showing the configuration of the information notification device according to Embodiment 1. This is a block diagram showing an example of the configuration of the functional part of the information notification device according to Embodiment 1. This is a schematic diagram showing a transparent view from above of the passenger compartment of a vehicle, which is a mobile body equipped with an information notification device according to Embodiment 2. This is a block diagram showing the configuration of the information notification device according to Embodiment 2. This is a block diagram showing an example of the configuration of the functional part of the information notification device according to Embodiment 1.

[0010] Preferred embodiments of the present invention are described in detail below. In the descriptions and accompanying drawings of the following embodiments, substantially identical or equivalent parts are denoted by the same reference numerals. By using the same reference numerals, redundant descriptions of identical or equivalent parts are omitted. Furthermore, the present invention is not limited to the following embodiments.

[0011] Figure 1 is a schematic diagram showing a top-down view of the passenger compartment of a vehicle M, which is a mobile vehicle equipped with the information notification device 10 according to this embodiment. Figure 1 shows an example of the arrangement of the information notification device 10 and the equipment and sound output unit connected thereto.

[0012] The information notification device 10 is located, for example, in the center of the dashboard inside the vehicle M. The information notification device 10 according to this embodiment is a device that notifies the driver of information regarding vibrations occurring to passengers via a sound output unit installed inside the vehicle M.

[0013] The information notification device 10 is connected to speakers SP1 to SP4, which are sound output units installed inside the vehicle cabin and realize three-dimensional sound, and controls them.

[0014] Speakers SP1 to SP4 are installed, for example, on the interior side of the front, rear, left, and right doors inside the vehicle. Speaker SP1 is located to the right of the driver's seat DS when looking at the steering wheel HL. Speaker SP2 is located to the left of the passenger's passenger seat PS. Speakers SP3 and SP4 are located to the left and right of the passenger's rear seat BS.

[0015] Furthermore, the vehicle M is equipped with a group of vibration detection sensors to detect vibrations occurring to the occupants. For example, the passenger compartment of the vehicle M is equipped with a camera CA as a photographic sensor. The camera CA is communicably connected to the information notification device 10. For example, the camera CA may be placed on top of the rearview mirror RM above the dashboard. The camera CA may be an in-car camera with a field of view capable of capturing the faces of the driver and passengers in the driver's seat DS, passenger seat PS, and rear seat BS. Note that the camera CA is not limited to being placed on the dashboard, but may be installed anywhere in the passenger compartment as long as it can capture the faces of the passengers. The camera CA is connected to an image recognition unit (not shown) in the information notification device 10 so as to be able to input images. The image recognition unit detects the vibrations of the passengers by comparing the changes in the input images over time. Note that the method for detecting the vibrations of the passengers is not particularly limited to a camera, and a proximity sensor may also be used.

[0016] Furthermore, since shaking during driving mainly occurs in the front-to-back and side-to-side directions, detection in at least one direction is acceptable, but it is desirable to be able to detect shaking in two or more directions. To detect shaking in two or more directions, two or more sensors or cameras may be installed. Since the cameras photograph the interior of the vehicle from an oblique angle, it is preferable to use two or more cameras to photograph from different directions.

[0017] Furthermore, the vehicle M is equipped with a group of vibration detection sensors SG for detecting the vibration of the vehicle M, such as an acceleration sensor and an angular velocity sensor integrated into the engine control unit (ECU) (not shown). Since vibration detection sensors SG need to detect vibration in two or three dimensions, it is preferable to use a three-axis acceleration / gyro sensor.

[0018] Furthermore, the vehicle M may be equipped with a position detection sensor, such as a GPS (Global Positioning System) device, for detecting the position of the vehicle M. The GPS device can function as part of an installable navigation system (not shown).

[0019] The information notification device 10 can acquire data such as the position and acceleration of the vehicle M from the GPS device GPS and the vibration detection sensor SG via an in-vehicle network (not shown) standardized by, for example, "ISO 11898" and "ISO 11519".

[0020] Furthermore, the touch panel display TD, which serves as an interface for the driver and other users, is connected to the information notification device 10 in a manner that allows it to communicate with the information notification device 10 and is positioned on the dashboard.

[0021] The touch panel display TD is a device that combines a display that shows screen information based on the control of the information notification device 10 and a touch panel that transmits signals representing input operations from the driver or other user to the information notification device 10. The information notification device 10 receives operation input from the driver or other user via the touch panel display TD. When the information notification device 10 is connected to a navigation system, it can display information from the system on the touch panel display TD. The information notification device 10 can also present various types of information to the driver or other user by voice through speakers SP1 to SP4. The navigation system can also provide the driver or other user with information such as the optimal route to reach the vehicle M's destination, as well as directions, traffic information, and points of interest (POIs). The navigation system also functions as a voice guidance device that speaks to the driver or other user.

[0022] Figure 2 is a block diagram showing the configuration of the information notification device 10 according to this embodiment. The information notification device 10 is a computer device consisting of an input unit 23, an output unit 25, a storage unit 27, and a controller unit 29, each connected via a system bus (not shown).

[0023] The input unit 23 is an interface for acquiring data from equipment installed in the vehicle M. The input unit 23 is connected to the vibration detection sensor SG, GPS device GPS, camera CA, and touch panel display TD. The information notification device 10 receives input signals from the vibration detection sensor SG, GPS device GPS, camera CA, and touch panel display TD via the input unit 23.

[0024] The output unit 25 is connected to the touch panel display TD and speakers SP1 to SP4. The output unit 25 is an interface for supplying information signals and drive signals to the touch panel display TD and speakers SP1 to SP4, respectively. In the information notification device 10, the drive signal output side of the output unit 25 is provided with corresponding DA amplifiers (not shown) for analog drive signals to speakers SP1 to SP4, and each amplifier outputs an analog signal with a corresponding drive waveform to each speaker.

[0025] For example, the information notification device 10 supplies audio signals of information such as messages to be presented to the driver to speakers SP1 to SP4 via the output unit 25.

[0026] The storage unit 27 is a storage device composed of, for example, a hard disk drive, an SSD (solid state drive), or flash memory. The storage unit 27 stores various programs that are executed in the information notification device 10. These programs may be obtained from, for example, a communication device (not shown), and the programs in this embodiment may be recorded on a recording medium and read via a specified reading device.

[0027] The controller unit 29 includes a CPU (Central Processing Unit), ROM (Read Only Memory), and RAM (Random Access Memory), and controls the operation of the information notification device 10. The CPU reads various programs stored in the ROM and the storage unit 27, loads them into the storage unit 27, and executes them, thereby realizing various functional units (information acquisition unit 31, determination unit 32, sound control unit 33) as shown in Figure 2.

[0028] Figure 3 is a block diagram showing an example of the configuration of the functional unit of the information notification device 10 according to this embodiment.

[0029] The information acquisition unit 31 in the information notification device 10 includes a vehicle sway detection unit 31A that receives signals from a sway detection sensor SG and a passenger sway detection unit 31B that receives signals from a camera CA. The vehicle sway detection unit 31A is a vehicle sway information acquisition unit that detects swaying occurring in the vehicle M and acquires sway information. The passenger sway detection unit 31B is a passenger sway information acquisition unit that detects swaying of passengers and acquires passenger sway information.

[0030] The passenger sway detection unit 31B is an image recognition unit that detects passenger sway by comparing the temporal changes of input images received from the camera CA, and also includes a face recognition unit 31BB that acquires attribute information such as the number of passengers, gender, and age. The face recognition unit 31BB can be realized, for example, by having the computer of the information notification device execute a program that performs face detection using an object detection algorithm called SSD (Single Shot Multibox Detector), and then performs gender estimation and age estimation using a convolutional neural network (CNN).

[0031] The determination unit 32 in the information notification device 10 determines whether the passenger's shaking is caused by the shaking of the vehicle M, based on the vehicle shaking information and passenger shaking information input from the vehicle shaking detection unit 31A and the passenger shaking detection unit 31B, respectively. The method for determining the cause of the shaking is, for example, determined from the orientation of the face and the direction in which the face is shaking in the image acquired from the face recognition unit 31BB.

[0032] The determination unit 32 includes a vibration synchronization detection unit 32A that detects whether the vibration of the passenger is synchronized with the vibration of the vehicle M in order to determine that the vibration of the passenger is caused by the vibration of the vehicle M, and a notification sound determination unit 32B that determines the sound image from speakers SP1 to SP4 based on the detection result of the vibration synchronization detection unit 32A and the vibration of the vehicle M.

[0033] The vibration synchronization detection unit 32A of the determination unit 32 can evaluate the degree of synchronization between vehicle vibration and passenger vibration, and determines that the passenger vibration is caused by the vehicle M vibration when the degree of synchronization is above a predetermined threshold. The vibration synchronization detection unit 32A sends the determination result of the degree of synchronization to the notification sound determination unit 32B. Here, synchronization means that the timing and direction of the vibrations are almost the same and the degree of synchronization is above a predetermined threshold. For example, even if the passenger's body leans forward while the vehicle is turning to the right, it is not determined that the vehicle vibration is the cause.

[0034] The notification sound determination unit 32B of the determination unit 32 is a functional unit that sets a sound image of a predetermined notification intensity. Based on the magnitude, direction, and degree of vibration synchronization of the vehicle M in the vehicle vibration information, it sets the notification intensity, including the volume from speakers SP1 to SP4, the type of sound source, and the distance the sound image moves. Notification intensity refers to the volume from speakers SP1 to SP4, the setting of the type of sound source such as ambient sound, sound effect, and siren, and the order in which they are played (for example, the notification intensity is highest in the order of ambient sound → sound effect → siren (non-ambient sound such as beep)), and the distance the sound image moves (for example, the notification intensity is highest in the order of short → medium → long).

[0035] The notification sound determination unit 32B changes the notification intensity based on the magnitude and frequency of the vibration. For example, if the synchronized vibration is small or infrequent, the notification intensity is set to "weak". If the synchronized vibration is moderate or occurs at a certain frequency or higher, the notification intensity is set to "medium". If the synchronized vibration is large, such as a sudden brake, or occurs continuously, the notification intensity is set to "high". In this way, the notification intensity setting in the notification sound determination unit 32B can suppress the increase in the magnitude and frequency of vibrations.

[0036] Furthermore, the notification sound determination unit 32B of the determination unit 32 can set the notification intensity for speakers SP1 to SP4 based on attribute information of the number of passengers, gender, and age from the face recognition unit 31BB. If there are multiple passengers, the notification intensity may be switched according to the number of passengers whose shaking is synchronized. By determining the notification intensity with weights according to the attributes of the passengers (gender, adult, child, etc.), it is possible to encourage the driver to drive with less shaking as a thoughtful consideration for the passengers of the vehicle.

[0037] Based on the determination result of the vibration synchronization detection unit 32A, the notification sound determination unit 32B controls the output of sound from speakers SP1 to SP4 via the sound control unit 33 to produce a notification sound to notify the driver of the vibration of a passenger, for example, so that the sound image moves from a position near the driver's ear to a position corresponding to the direction of the vehicle's vibration.

[0038] Furthermore, the notification sound determination unit 32B notifies via speakers SP1 to SP4 at a vibration notification timing that includes a post-notification timing after detecting that the vibration of vehicle M has subsided in the vehicle vibration information, or an immediate notification timing synchronized with the detection of vibration synchronization between the vibration of vehicle M and the vibration of the passenger.

[0039] For example, in cases where vehicle sway and passenger sway are synchronized in the front-to-back direction, the sound conversion index for synchronized sway in the notification sound determination unit 32B may be set such that the decision on whether or not to start sound notification depends on the frequency of sway, the distance of movement of the sound image localization depends on the magnitude of the sway, and the direction of movement depends on the direction of the sway.

[0040] In one example of the settings for the notification sound determination unit 32B, when vehicle and passenger movements are synchronized during sudden braking, the sound image is positioned forward from the driver's seat, the distance the sound image moves is long, and the volume is increased. Furthermore, in another example of the settings for the notification sound determination unit 32B, when vehicle and passenger movements are synchronized during gentle braking, the sound image is positioned forward from the driver's seat, the distance the sound image moves is short, and the volume is decreased.

[0041] Furthermore, if the passenger is experiencing lateral shaking, the notification sound determination unit 32B controls the sound control unit 33 to output a notification sound so that the sound image moves back and forth in the left-right direction relative to the driver's seat (driver's seat DS position). In addition, the notification sound determination unit 32B controls the sound control unit 33 to output a notification sound to speakers SP1 to SP4 with an intensity corresponding to the magnitude of the shaking; for example, if the shaking is large, the sound pressure is large, so that the sound image moves back and forth in the left-right direction.

[0042] In this way, the information notification device 10 determines that the passenger's swaying is caused by the vehicle M's swaying, and controls speakers SP1 to SP4 to output a sound of a predetermined notification intensity that generates a sound image that moves relative to the driver in accordance with the synchronized swaying of the vehicle M and the passenger's swaying.

[0043] According to this embodiment, speakers SP1 to SP4 are controlled to output sound that generates a sound image whose position moves relative to the driver in accordance with the movement of the vehicle M, only when there is a passenger other than the driver, passenger sway information can be acquired, and swaying of the vehicle M and the passenger is detected. In other words, the direction and magnitude of the sway can be notified to the driver in three-dimensional sound only when the swaying of the vehicle and the occupant are detected and synchronized. Therefore, notifications are only made when there is a passenger, and there are no unnecessary notifications when there is no passenger, thus reducing annoyance for the driver. In addition, because the notification is in three-dimensional sound, the driver can intuitively grasp the sway and reliably understand it while driving without having to look at the display.

[0044] The program according to the present embodiment causes a computer of an information notification device 10, which notifies a driver of information related to shaking occurring to a passenger via speakers SP1 to SP4 installed in a cabin of a vehicle M, to function as: a moving body shaking information acquisition unit (vehicle shaking detection unit 31A) that detects shaking occurring to the vehicle M and acquires moving body shaking information; a passenger shaking information acquisition unit (passenger shaking detection unit 31B) that detects shaking of the passenger and acquires passenger shaking information; a determination unit 32 that determines whether the shaking of the passenger is caused by the shaking of the vehicle M based on the vehicle M shaking information and the passenger shaking information; and a sound control unit 33 that controls the speakers SP1 to SP4 to output a sound that generates a sound image whose position moves relative to the driver in accordance with the shaking of the vehicle M when the determination unit 32 determines that the shaking of the passenger is caused by the shaking of the vehicle M.

[0045] FIG. 4 is a schematic diagram showing a perspective view from above of a cabin portion of a vehicle M as a moving body equipped with the information notification device 10 according to the present embodiment. FIG. 4 shows an arrangement example of the information notification device 10 according to the second embodiment, and devices, sound output units and the like connected thereto.

[0046] The vehicle M according to the present embodiment is the same as the arrangement configuration example (FIG. 1) of the vehicle M according to the first embodiment, except that it is additionally equipped with: a communication device RC capable of performing network communication with a road information server (not shown) such as a road traffic system (Intelligent Transport Systems) that provides road information including past traffic accident data (map position information ITS such as hazard perception data); and a vibration device VP arranged at a seat surface position of a driver's seat DS in contact directly below the biceps femoris muscles of the left and right thighs of the driver's body, and driven by the information notification device 10. The communication device RC is connected to the information notification device 10 so as to be able to receive data of the map position information ITS via a predetermined in-vehicle network (not shown). Note that the vibration device VP may be arranged at any position on the driver's seat DS as long as it is provided at a position substantially in contact with the driver's body, and the number thereof is not limited.

[0047] FIG. 5 is a block diagram showing the configuration of an information notification device 10 according to the present embodiment. The information notification device 10 according to the present embodiment is the same as the configuration example (FIG. 2) of the information notification device 10 according to Embodiment 1, except that an input unit 23 receives map position information ITS from a communication device RC, and an output unit 25 supplies a drive signal to a vibration device VP.

[0048] FIG. 6 is a block diagram showing an example of the configuration of functional units of the information notification device 10 according to the present embodiment. An example of the configuration of the functional units of the information notification device 10 according to the present embodiment is as follows: an information acquisition unit 31 includes a predicted vibration point detection unit 31C that receives a signal of map position information ITS from the communication device RC, and a current position detection unit 31D that receives a current position signal of the vehicle M from a GPS device GPS; a determination unit 32 includes a vibration history DB 32C (vibration history database) that is read, written and updated by a notification sound determination unit 32B, and a predicted vibration determination unit 32D interposed between the predicted vibration point detection unit 31C and the notification sound determination unit 32B; and the information notification device 10 further includes a vibration control unit 34 that is controlled by the determination unit 32 to drive the vibration device VP, and is configured such that the notification sound determination unit 32B supplies information such as a message to be presented to a driver to a touch panel display TD. With the exception of the above, the configuration is substantially the same as the configuration example (FIG. 3) of the information notification device 10 according to Embodiment 1.

[0049] The predicted vibration point detection unit 31C detects, during traveling, a predicted vibration point where vibration of the vehicle M will occur from a road information server (not shown) via network communication of the communication device RC. The predicted vibration point detection unit 31C acquires topography and road information such as curves, right turns and left turns where turning or deceleration is predicted from the road information server, and sets the acquired information as the predicted vibration point.

[0050] In the second embodiment, the vibration history DB 32C of the determination unit 32 stores a history of vibration of the vehicle M in vehicle vibration information from a vehicle vibration detection unit 31A via the notification sound determination unit 32B.

[0051] The notification sound determination unit 32B of the determination unit 32 sets notification intensity including the volume output by speakers SP1 to SP4, the type of sound source (ambient sound→sound effect→siren), and the movement distance of the sound image (short→medium→long) based on the magnitude and direction of vibration of the vehicle M in the vehicle vibration information and the frequency of vibration of the vehicle M stored in the vibration history DB 32C.

[0052] Furthermore, the notification sound determination unit 32B notifies via speakers SP1 to SP4 at the following timings: a post-notification timing after detecting that the shaking of vehicle M has subsided in the vehicle shaking information; an immediate notification timing synchronized with the detection of shaking synchronization between the shaking of vehicle M and the shaking of the passengers; or a pre-notification timing including a pre-notification before reaching a predicted shaking point acquired during driving. The notification timing is performed at the following levels: Level 1 (post-notification): notification after the shaking has subsided (at the time when driving has settled down); Level 2 (immediate notification): notification as soon as shaking is detected; Level 3 (pre-notification): notification in advance if shaking is predicted.

[0053] For example, if the frequency and intensity of vibrations recorded in the vibration history DB32C are gradually increasing, the notification sound determination unit 32B will make the notification timing earlier. In other words, if the situation does not improve with a post-vibration notification timing, the notification sound determination unit 32B can more strongly encourage driving with less vibration by switching to a pre-vibration notification timing.

[0054] The notification sound determination unit 32B may issue a notification when approaching a predicted shaking point where a right or left turn or sudden braking is predicted based on the map position information ITS from the communication device RC, and also when it detects turning or deceleration even if there is no shaking. The notification sound determination unit 32B may also issue a notification in advance even if it does not detect turning or deceleration. In this case, the predicted shaking determination unit 32D estimates the turning direction and deceleration direction based on the terrain and road information acquired by the predicted shaking point detection unit 31C and determines the direction of shaking. The magnitude of the shaking is set to a predetermined value. Based on the determined direction and magnitude of shaking, the notification sound determination unit 32B may issue a notification in advance.

[0055] Furthermore, the notification sound determination unit 32B of the determination unit 32 can generate a sound image via the sound control unit 33 and a speaker, and can also notify the driver of information regarding passenger swaying via all or at least one of the following: the touch panel display TD which displays a message about passenger swaying to the driver, the voice guidance device (navigation system) which speaks a message about passenger swaying to the driver, and the vibration device VP.

[0056] In other words, the notification sound determination unit 32B may combine other notification means (vibration device VP, touch panel display TD, etc.) in addition to stereophonic sound. The notification levels are as follows: Level 4: Display (message display on the touch panel display TD screen or illumination of other indicators, etc.) and stereophonic sound from speakers SP1 to SP4; Level 5: Stereophonic sound from speakers SP1 to SP4 only (it is desirable to notify with only stereophonic sound that can be intuitively understood because the driver is concentrating on driving); Level 6: Voice guidance such as "Caution: Sharp curve" and stereophonic sound from a vibration device and speakers SP1 to SP4, etc.

[0057] Furthermore, the following are examples of situations in which vehicle and passenger motion synchronization may occur: (1) Synchronization of longitudinal motion due to sudden braking (unexpected sudden movement), Driving scene: When decelerating unevenly, such as with sudden braking, Vehicle motion: When acceleration occurs in the longitudinal direction or when the pitching of the vehicle body changes, Passenger motion: The head and upper body move significantly forward, (2) Synchronization of lateral motion due to sharp turns (radial direction (opposite direction of travel) due to centrifugal force), Driving scene: When taking sharp turns or turning left or right without sufficient deceleration, Vehicle motion: When acceleration occurs in the turning direction or when the yawing of the vehicle body changes, Passenger motion: The upper body tilts in the opposite direction to the turning direction, (3) Synchronization of vertical motion due to driving on rough roads, Driving scene: When driving on roads with large bumps or large unevenness, Vehicle motion: When acceleration occurs in the vertical direction, Passenger motion: The head and upper body move up and down.

[0058] In each embodiment, an information notification device can be provided that can notify the driver of the degree of vehicle vibration through sound, allowing them to intuitively perceive the magnitude and direction of the vehicle's vibration. By detecting the intensity (magnitude and direction) of the vehicle's vibration using a speed sensor or the like, and processing the information, a sound image can be localized using three-dimensional sound based on a predetermined position in the vehicle's interior (e.g., the driver's seat), and the sound image can be changed in a manner corresponding to the type of vibration, thereby appropriately notifying the driver of the vibrations of the passengers.

[0059] 10 Information notification device 31 Information acquisition unit 31A Vehicle vibration detection unit 31B Passenger vibration detection unit 31BB Face recognition unit 32 Judgment unit 32A Vibration synchronization detection unit 32B Notification sound judgment unit 33 Sound control unit SP1 to SP4 Speakers

Claims

1. An information notification device that notifies a driver of information regarding shaking occurring to an occupant via a sound output unit installed inside a mobile vehicle, comprising: a mobile vehicle shaking information acquisition unit that detects shaking occurring to the mobile vehicle and acquires mobile vehicle shaking information; an occupant shaking information acquisition unit that detects shaking of the occupant and acquires occupant shaking information; a determination unit that determines whether or not the occupant shaking is caused by shaking of the mobile vehicle based on the mobile vehicle shaking information and the occupant shaking information; and a sound control unit that controls the sound output unit to output a sound that generates a sound image whose position moves relative to the driver in accordance with the shaking of the mobile vehicle when the determination unit determines that the occupant shaking is caused by shaking of the mobile vehicle.

2. The information notification device according to claim 1, characterized in that the determination unit includes a vibration synchronization detection unit that detects whether the vibration of the passenger is synchronized with the vibration of the moving body in order to determine that the vibration of the passenger is caused by the vibration of the moving body, and a notification sound determination unit that determines a sound image by the sound output unit based on the detection result of the vibration synchronization detection unit and the vibration of the moving body.

3. The information notification device according to claim 1, characterized in that the determination unit sets a notification intensity including at least one of the volume, type of sound source, and distance traveled of the sound image, based on the magnitude and direction of the shaking of the moving body in the moving body shaking information.

4. The information notification device according to claim 1, wherein the determination unit further comprises a shaking history database that stores the history of shaking of the moving body in the moving body shaking information, and the determination unit sets a notification intensity including at least one of the volume of the sound output unit, the type of sound source, and the distance of movement of the sound image, based on the magnitude and direction of shaking of the moving body in the moving body shaking information and the frequency of shaking of the moving body stored in the shaking history database.

5. The information notification device according to claim 1, further comprising a face recognition unit that acquires attribute information of the passenger, wherein the determination unit sets the notification intensity by the sound output unit based on the attribute information.

6. The information notification device according to claim 1, characterized in that the determination unit notifies via the sound output unit at a post-notification timing that includes the detection of the cessation of the shaking of the moving body in the moving body shaking information, or at an immediate notification timing that includes the detection of the synchronization of shaking between the shaking of the moving body and the shaking of the passenger.

7. The information notification device according to claim 1, further comprising a predictive sway detection unit for detecting predicted sway points where swaying of a moving body occurs, wherein the determination unit notifies via the sound output unit at sway notification timings including a post-notification timing after detecting the cessation of swaying of the moving body in the moving body sway information, an immediate notification timing synchronized with the detection of sway synchronization between the swaying of the moving body and the swaying of the passenger, or a pre-notification timing before reaching the predicted sway point.

8. The information notification device according to claim 1, characterized in that the sound output unit is controlled to output a sound that generates a sound image whose position moves relative to the driver in accordance with the shaking of the moving body, only when there is a passenger other than the driver and passenger shaking information can be obtained and shaking of the moving body and the passenger is detected.

9. The information notification device according to claim 1, further comprising a display device for displaying a message to the driver, an audio guidance device for speaking to the driver, and a vibration device positioned at a location in contact with the driver's body, wherein the determination unit, along with generating the sound image, notifies the driver of information regarding the passenger's shaking via at least one of the display device, the audio guidance device, and the vibration device.

10. An information notification method performed by an information notification device that notifies a driver of information regarding shaking occurring to a passenger via a sound output unit installed inside the cabin of a mobile vehicle, the method comprising: a mobile vehicle shaking information acquisition step of detecting shaking occurring to the mobile vehicle and acquiring mobile vehicle shaking information; a passenger shaking information acquisition step of detecting shaking of the passenger and acquiring passenger shaking information; a determination step of determining whether the shaking of the passenger is caused by shaking of the mobile vehicle based on the mobile vehicle shaking information and the passenger shaking information; and a sound control step of controlling the sound output unit to output a sound that generates a sound image whose position moves relative to the driver in accordance with the shaking of the mobile vehicle, when the determination step determines that the shaking of the passenger is caused by shaking of the mobile vehicle.

11. A program characterized in that it causes the computer of an information notification device, which notifies the driver of information about shaking occurring to the passengers via a sound output unit installed inside the cabin of a mobile vehicle, to execute: a mobile vehicle shaking information acquisition step of detecting shaking occurring to the mobile vehicle and acquiring mobile vehicle shaking information; a passenger shaking information acquisition step of detecting shaking of the passengers and acquiring passenger shaking information; a determination step of determining whether the shaking of the passengers is caused by shaking of the mobile vehicle based on the mobile vehicle shaking information and the passenger shaking information; and a sound control step of controlling the sound output unit to output a sound that generates a sound image that moves relative to the driver in accordance with the shaking of the mobile vehicle, when the determination step determines that the shaking of the passengers is caused by shaking of the mobile vehicle.

12. A recording medium for recording a program that causes the computer of an information notification device, which notifies the driver of information about shaking occurring to the passengers via a sound output unit installed inside the cabin of a mobile vehicle, to execute: a mobile vehicle shaking information acquisition step of detecting shaking occurring to the mobile vehicle and acquiring mobile vehicle shaking information; a passenger shaking information acquisition step of detecting shaking of the passenger and acquiring passenger shaking information; a determination step of determining whether the passenger shaking is caused by shaking of the mobile vehicle based on the mobile vehicle shaking information and the passenger shaking information; and a sound control step of controlling the sound output unit to output a sound that generates a sound image that moves relative to the driver in accordance with the shaking of the mobile vehicle, when the determination step determines that the passenger shaking is caused by shaking of the mobile vehicle.

Images