Safety aid

Abstract

The present application is to provide a safety assistance device capable of appropriately and easily informing a driver of the danger of collision by outputting stereo sound based on the state of the driver. To solve the above problem, the safety assistance device (1) includes: an object detection camera (21) and a radar device (22) as detection units; and a control unit (10) that controls a dual-purpose speaker (31), a dual-purpose speaker (32), and a mono speaker (4) as sound output units based on detection information from a monitoring camera (5) as a monitoring unit. The control unit (10) selects outputting stereo sound from the dual-purpose speaker (31) and the dual-purpose speaker (32), or outputting sound from the dual-purpose speaker (31), the dual-purpose speaker (32), and the mono speaker (4), according to the position of the ear of the driver (101) detected by the monitoring camera (5).

Description

Technical Field

[0001] This invention relates to a safety assistance device for vehicles. Background Technology

[0002] In recent years, efforts have been intensified to provide a sustainable transportation system that also takes into account vulnerable groups among transportation participants. To achieve this, research and development is underway to further improve transportation safety and convenience through advancements related to preventative safety technologies.

[0003] Regarding the aforementioned safety prevention technology, a vehicle safety assistance device is known that uses sound to inform the driver of the potential danger of collision with other vehicles (for example, see Patent Document 1). In Patent Document 1, a stereo sound is output from a speaker located near the driver's ear, directing the alarm sound in the direction of the potential danger object around the vehicle.

[0004] [Previous Technical Documents]

[0005] (Patent Documents)

[0006] Patent Document 1: Japanese Patent Application Publication No. 5-250589 Summary of the Invention

[0007] [The problem the invention aims to solve]

[0008] Stereo sound systems can position sound images at desired locations, thus enabling drivers to perceive the location of sound. However, for stereo systems to function effectively, the driver's ears must be positioned close to and in an appropriate relative position to the speakers. Since the driver's head position changes frequently during driving, if the speakers are not positioned correctly relative to the driver, the driver may not be able to properly identify the location of the sound.

[0009] The purpose of this invention is to provide a safety assistance device that can appropriately and easily inform the driver of the danger of a collision by outputting stereo sound based on the driver's status.

[0010] [Technical means to solve the problem]

[0011] (1) The present invention relates to a safety assistance device, which is a safety assistance device (e.g., safety assistance device 1) for a vehicle (e.g., vehicle 100), and includes: a detection unit (e.g., object detection camera 21, radar device 22 or both) for detecting the position of an object (e.g., object 150) around the vehicle; a stereo sound output unit (e.g., dual-purpose speaker 31 and dual-purpose speaker 32) for outputting stereo sound to make the driver (e.g., driver 101) aware of the direction of the object's presence; a sound output unit (e.g., mono speaker 4) for outputting sound to make the driver aware of the object's presence; a monitoring unit (e.g., surveillance camera 5) for monitoring changes in the position of the driver's ears; and a control unit (e.g., control unit 10) for controlling the stereo sound output unit and the sound output unit based on the detection information from the detection unit and the monitoring unit; and the control unit selects to output the stereo sound from the stereo sound output unit or the sound from the sound output unit based on the position of the driver's ears detected by the monitoring unit.

[0012] Therefore, it is possible to distinguish between stereo systems that can locate the sound image in the required position when the driver's ears are in an appropriate position, and systems that can still indicate the presence of an object even when the driver's ears are in an unsuitable position for stereo systems. Thus, it is possible to avoid situations where the sound image is not properly located when using stereo systems due to ear position, thereby achieving effective notification processing corresponding to the driver's ear position.

[0013] (2) In the safety auxiliary device of (1), the sound output by the aforementioned sound output unit may also be a non-stereo sound mono sound or a stereo sound.

[0014] Therefore, because the output of a stereo system is highly dependent on the position of the ears, even when the driver's ear position changes significantly, the driver can still perceive the presence of objects by using non-stereo mono or stereo sound.

[0015] (3) In the safety assistance device of (1) or (2), the aforementioned control unit may also output the aforementioned stereo sound when the driver's head is facing within a preset specific angle (for example, the specific angle α below) when viewed from above, as detected by the aforementioned monitoring unit; and output the aforementioned sound when the head is facing outside the aforementioned specific angle.

[0016] Therefore, by detecting changes in ear position based on the angle of the head, it is possible to appropriately switch between stereo and sound.

[0017] (4) In any of the safety auxiliary devices in (1) to (3), the aforementioned stereo output unit may also be the backrest or headrest (e.g., the headrest 34) of the driver’s seat (e.g., seat 33 below) respectively, with the driver as the center.

[0018] Therefore, the stereo output unit is positioned close to the driver's ears, thus enabling a more accurate presentation of stereo sound to the driver.

[0019] (5) In any of the safety auxiliary devices in (1) to (4), the aforementioned stereo sound can also be presented by simultaneously outputting from the aforementioned plurality of stereo sound output units (e.g., the dual-purpose speaker 31 and dual-purpose speaker 32 described below), wherein the aforementioned stereo sound output unit also serves as the aforementioned sound output unit, and the sound output unit outputs the aforementioned sound to replace the aforementioned stereo sound.

[0020] This reduces the number of audio output units that do not output stereo sound, thereby reducing manufacturing costs or the space required for safety auxiliary devices.

[0021] (6) In any of the safety auxiliary devices in (1) to (5), the aforementioned sound output unit (e.g., the dual-purpose speaker 31, dual-purpose speaker 32 and mono speaker 4 described below) may also be provided in multiple directions when viewed from the driver's perspective, and the aforementioned control unit selects the aforementioned sound output unit corresponding to the direction of the aforementioned object from the multiple aforementioned sound output units to output the aforementioned sound.

[0022] Therefore, even without using stereo speakers, the driver can perceive the direction of an object by using the sound output unit that corresponds to the direction of the object.

[0023] (7) In any of (1) to (6) of the safety assistance device, the aforementioned safety assistance device further includes a line-of-sight monitoring unit (e.g., the monitoring camera 5 described below), the line-of-sight monitoring unit monitors the driver's line of sight, the aforementioned control unit determines whether the driver sees the aforementioned object based on the detection information of the aforementioned detection unit and the aforementioned line-of-sight monitoring unit, and when it is determined that the driver sees the aforementioned object, the output of the aforementioned stereo sound or sound is reduced or stopped.

[0024] Therefore, when the driver recognizes an object, there is no need to present the object's presence to the driver. Consequently, less necessary stereo or sound output will not be provided to some drivers, thus reducing the level of annoyance.

[0025] (The effect of the invention)

[0026] According to the present invention, a safety assistance device can be provided that can appropriately and easily inform the driver of the danger of a collision by outputting stereo audio based on the driver's status. Furthermore, the present invention can contribute to the development of sustainable transportation systems. Attached Figure Description

[0027] Figure 1 This is a block diagram illustrating the structure of a safety assistance device according to an embodiment of the present invention.

[0028] Figure 2 This is a schematic diagram showing the positional relationship between the dual-purpose loudspeaker and the mono loudspeaker of the safety auxiliary device in this embodiment.

[0029] Figure 3 This is a block diagram illustrating an example of the hardware structure of the control unit of the safety assistance device in this embodiment.

[0030] Figure 4 This is a schematic diagram illustrating the relationship between the driver's line of sight and the notification processing of the safety assistance device in this embodiment.

[0031] Figure 5 This is a schematic diagram illustrating the notification process of the safety assistance device in this embodiment before the driver identifies an object.

[0032] Figure 6 This is a schematic diagram illustrating the notification processing of the safety assistance device in this embodiment after the driver identifies an object.

[0033] Figure 7 This is a flowchart illustrating the notification processing flow of the safety auxiliary device in this embodiment. Detailed Implementation

[0034] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

[0035] Figure 1 This is a block diagram illustrating the structure of a safety assistance device 1 according to an embodiment of the present invention. The safety assistance device 1 is a system mounted on a vehicle 100 that informs the driver of the danger of a collision. The safety assistance device 1 includes an object detection camera 21, a radar device 22, a dual-purpose speaker 31, a dual-purpose speaker 32, a mono speaker 4, a monitoring camera 5, and a control unit 10.

[0036] The object detection camera 21 is a detection unit that detects objects outside the vehicle 100 by capturing images of the exterior of the vehicle 100. By analyzing the images acquired by the object detection camera 21, detection information such as the position, speed, and azimuth of the objects outside the vehicle 100 is obtained.

[0037] Radar device 22 is a detection unit that transmits electromagnetic waves and receives reflected electromagnetic waves to detect objects outside the vehicle 100. By analyzing the received electromagnetic wave signals acquired by radar device 22, detection information such as the position, speed, and azimuth of objects outside the vehicle 100 is obtained.

[0038] The object detection information acquired by the object detection camera 21 or the object detection information acquired by the radar device 22 is sent to the control unit 10. Furthermore, the detection of objects outside the vehicle 100 can be performed independently by the object detection camera 21 or independently by the radar device 22.

[0039] Figure 2 This is a schematic diagram showing the positional relationship between the dual-purpose loudspeakers 31 and 32 and the mono loudspeaker 4 of the safety auxiliary device 1 in this embodiment. Figure 2 The image shows the positional relationship of the driver 101, dual-purpose speaker 31, dual-purpose speaker 32, mono speaker 4, and monitoring camera 5 inside the vehicle 100 when viewed from above.

[0040] The dual-purpose speaker 31 and dual-purpose speaker 32 also function as a stereo output unit that outputs stereo sound to the driver 101 and a sound output unit that outputs mono sound to the driver 101. The dual-purpose speaker 31 and dual-purpose speaker 32 can be switched by the control unit 10 to function as a stereo output unit that outputs stereo sound or as a sound output unit that outputs mono sound.

[0041] In this embodiment, the dual-purpose speaker 31 and dual-purpose speaker 32 are arranged in the headrest 34 of the seat 33 such that they sandwich the head 102 of the driver 101 in the left-right direction. The dual-purpose speaker 31 and dual-purpose speaker 32 are configured so that the driver 101 can appropriately perceive the sound image by means of stereo sound when the head 102 of the driver 101 is facing forward.

[0042] The mono speaker 4 is a sound output unit that outputs mono sound to the driver 101. In this embodiment, the mono speaker 4 is positioned in front of the driver 101 who is sitting in the seat 33.

[0043] The monitoring camera 5 is a monitoring unit that determines the position of the driver 101's ears and a gaze monitoring unit that identifies the driver 101's gaze. The monitoring camera 5 is positioned to capture the orientation and gaze of the driver 101's head 102. In this embodiment, the monitoring camera 5 is positioned diagonally in front of the right of the driver 101.

[0044] The control unit 10 is a computer that controls the safety auxiliary device 1. The control unit 10 can be communicatively connected to electronic devices such as the object detection camera 21, radar device 22, dual-purpose speaker 31, dual-purpose speaker 32, mono speaker 4, and surveillance camera 5. In addition, the control unit 10 can be directly connected to electronic devices, or it can be connected to electronic devices through an electronic control unit (ECU) that controls other systems, or the control unit 10 itself can be an ECU.

[0045] Figure 3 This is a block diagram illustrating an example of the hardware structure of the control unit 10 of the safety assistance device 1 in this embodiment. Additionally, the following references... Figure 3 The hardware configuration of the control unit 10 described is only one example and is not limited to this configuration.

[0046] The control unit 10 is a computer that includes a processor 11, a read-only memory (ROM) 12, a random-access memory (RAM) 13, an auxiliary storage device 14, and a communication interface (I / F) 15, and the various parts are connected via a bus or the like.

[0047] The processor 11 is the central part of the computer that performs calculations and control processing required for the operation of the safety assistance device 1, and performs various calculations and processing. The processor 11 may be, for example, a central processing unit (CPU), a microprocessor unit (MPU), a system-on-a-chip (SoC), a digital signal processor (DSP), a graphics processing unit (GPU), an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a field-programmable gate array (FPGA). Alternatively, the processor 11 may combine multiple of these. Furthermore, the processor 11 may also incorporate hardware accelerators.

[0048] The processor 11 controls various components based on firmware, system software, and application software stored in the ROM 12 or auxiliary storage device 14, etc., to realize various functions of the safety auxiliary device 1. Furthermore, the processor 11 performs the following processing based on this program. In addition, this program may be partially or wholly integrated into the circuitry of the processor 11.

[0049] ROM 12 and RAM 13 are the main storage devices of the computer centered on processor 11. ROM 12 is a non-volatile memory specifically used for data reading. ROM 12 stores, for example, firmware in the aforementioned program. In addition, ROM 12 also stores data used by processor 11 during various processes. RAM 13 is a memory used for data reading and writing. RAM 13 serves as a working area for storing data temporarily used by processor 11 during various processes. Typically, RAM 13 is volatile memory.

[0050] The auxiliary storage device 14 is, for example, an electrically erasable programmable read-only memory (EEPROM), a hard disk drive (HDD), or flash memory. The auxiliary storage device 14 stores, for example, system software and application software from the aforementioned programs. Additionally, the auxiliary storage device 14 stores data used by the processor 11 during various processes, data generated by the processing in the processor 11, and various setting values.

[0051] The communication I / F15 is an interface for communicating with external electronic devices. The control unit 10 obtains various detection information from the object detection camera 21, radar device 22, or surveillance camera 5 via the communication I / F15 to control the dual-purpose speaker 31, dual-purpose speaker 32, or mono speaker 4.

[0052] Next, the notification processing of the safety auxiliary device 1 implemented by the control unit 10 will be explained. Figure 4 This is a schematic diagram illustrating the relationship between the driver's line of sight and notification processing in the safety assistance device 1 of this embodiment. Figure 4 The orientation of the driver's head 102 when viewed from above is shown, and the direction of the driver's line of sight is indicated by a hollow arrow.

[0053] If the control unit 10 detects an object 150 that should be reported to the driver 101 based on detection information from the object detection camera 21 or radar device 22, it performs a notification process based on the driver 101's state, and notifies the driver 101 of the presence of the object 150 by sound. More specifically, the control unit 10 selects a speaker from the dual-purpose speaker 31, dual-purpose speaker 32, and mono speaker 4 to emit sound based on the position of the driver 101's ears.

[0054] The control unit 10 determines the position of the driver 101's ears based on the orientation of the head 102 obtained by analyzing the image captured by the monitoring camera 5. The orientation of the head 102 is the orientation of the driver 101's face when looking down. Furthermore, when the driver 101's ears are in a position where they can appropriately perceive stereo sound, the control unit 10 selects the dual-purpose speaker 31 or dual-purpose speaker 32 to output stereo sound; when the driver 101's ears are not in a position where they can appropriately perceive stereo sound, it uses the dual-purpose speaker 31, dual-purpose speaker 32, or a mono speaker 4 to output non-stereo sound. Non-stereo sound can be, for example, mono or stereo sound.

[0055] First, the case where the control unit 10 selects to output stereo sound will be explained. In this embodiment, when the orientation of the head 102 is within a specific angle α, the control unit 10 outputs stereo sound using the dual-purpose speaker 31 and dual-purpose speaker 32. The specific angle α is empirically or theoretically set to be the range within which the driver 101 can appropriately perceive the stereo sound output by the dual-purpose speaker 31 and dual-purpose speaker 32. The specific angle α is set as the apex angle of a roughly fan-shaped area centered on the driver 101 and in front of the driver 101.

[0056] Next, the case where the control unit 10 selects to output non-stereo sound will be explained. In this embodiment, when the orientation of the head 102 is outside the range of a specific angle α, the control unit 10 outputs mono sound as non-stereo sound. Furthermore, the control unit 10 selects the speaker that outputs mono sound based on the positional relationship between the object 150, which is a potential risk, and the dual-purpose speaker 31, dual-purpose speaker 32, and mono speaker 4.

[0057] To determine the positional relationship with the object 150, which is a risk target, three angle ranges are defined: angle A in front of the driver 101, angle B to the left rear of the driver 101, and angle C of the driver 101. Angle range A is defined as the range in front of the driver 101 that coincides with a specific angle α, and the specific angle α is included within the range of angle range A.

[0058] Centered on driver 101, when the azimuth angle (direction of object 150) corresponding to the position of the object 150 (the target of the risk) is within angle range A, the mono speaker 4 is designated as the target for outputting mono sound. When the azimuth angle corresponding to the position of the object 150 is within angle range B, the dual-purpose speaker 31 located at the left rear is designated as the target for outputting mono sound. When the azimuth angle corresponding to the position of the object 150 is within angle range C, the dual-purpose speaker 32 located at the right rear is designated as the target for outputting mono sound.

[0059] Furthermore, in this embodiment, whether the driver 101 recognizes the object 150 is also set as a condition for generating a warning sound from the dual-purpose speaker 31, dual-purpose speaker 32, and mono speaker 4. The control unit 10 analyzes the image acquired by the monitoring camera 5 and determines whether the driver 101 recognizes the object 150 based on whether the driver 101's line of sight coincides with the position of the object 150. In addition, the line of sight may sometimes differ from the direction of the driver 101's head 102. For example, sometimes the driver 101's head 102 may be facing forward, but the line of sight may coincide with the object 150 on the right.

[0060] When the driver's line of sight coincides with the position of the object 150, the control unit 10 determines that the driver 101 has identified the object 150 and does not trigger a warning sound. Figure 4 In the example shown, since the orientation of the head 102 is outside the range of a specific angle α, and the position of the object 150 is inside the angle range C, the dual-purpose speaker 32 is set as a speaker for outputting mono sound. However, since the line of sight intersects with the object 150, no warning sound is generated.

[0061] In addition, the control unit 10 also performs control taking into account the driver 101's line of sight after the warning sound is generated. (Reference) Figure 5 Instructions are provided on how to handle the warning sound. Figure 5 This is a schematic diagram illustrating the notification process of the safety assistance device 1 in this embodiment before the driver 101 identifies the object 150.

[0062] like Figure 5 As shown, when the driver 101's line of sight does not intersect with the object 150 or the object 150's predetermined path of travel, and the driver 101's head 102 is facing within a specific angle α, the control unit 10 outputs stereo sound using dual-purpose speakers 31 and 32. The stereo sound output using dual-purpose speakers 31 and 32 is as follows... Figure 5The stereo image 151 shown is an audio image designed to make the driver 101 aware of the position of the object 150. In this example, the stereo sound is created with the object 150 located to the right of the vehicle 100. Furthermore, when the driver 101's head 102 is oriented outside a specific angle α, the control unit 10 selects a speaker from the dual-purpose speaker 31, the dual-purpose speaker 32, and the mono speaker 4 to output mono sound based on the position of the object 150. For example, when the object 150 is inside the angle range C, the dual-purpose speaker 32 outputs mono sound.

[0063] Figure 6 This is a schematic diagram illustrating the notification processing of the safety assistance device 11 in this embodiment after the driver 101 identifies the object 150. Figure 6 As shown, if the driver 101's line of sight is detected to intersect with the object 150 or the object 150's predetermined path of travel after the warning sound is generated, the control unit 10 performs a process to weaken or stop the generated warning sound. When the warning sound is a stereo sound, the stereo sound is weakened or stopped; when the warning sound is a mono sound, the mono sound is weakened or stopped.

[0064] The stereo sound output from the dual-purpose speaker 31 and dual-purpose speaker 32, or the mono sound output from the dual-purpose speaker 31, dual-purpose speaker 32, and mono speaker 4, is not particularly limited as long as it makes the position of the object 150 noticeable. For example, it could be an alarm sound such as a buzzer, a sound that announces danger by voice, or the sound of a vehicle engine or driving. It can also be preset to simulate the engine sound or driving sound of a four-wheeled car or a two-wheeled motorcycle, and set according to the vehicle determined by the image analysis captured by the object detection camera 21. Alternatively, a microphone as a sound collection unit can be installed on the vehicle 100, and the sound of the object 150 can be output in real time. In addition, when the dual-purpose speaker 31, dual-purpose speaker 32, and mono speaker 4 are used for playing music or animation, the volume of the music or animation playback can be reduced to output a warning sound.

[0065] Next, refer to Figure 7 The overall process for handling the notification is explained. Figure 7 This is a flowchart illustrating the notification processing flow of the safety auxiliary device 1 in this embodiment. Furthermore, the flowchart shown below is only one example, and its processing content or order can be appropriately modified.

[0066] First, the control unit 10 performs object detection processing on the outside of the vehicle 100 using the object detection camera 21, radar device 22, or both (step S101). Next, the control unit 10 determines whether the warning sound generation conditions are met (step S102). In this embodiment, the warning sound generation conditions are set as follows: the object 150's position relative to the vehicle 100 poses a danger that should be reported to the driver 101, and the driver 101 fails to recognize the object 150.

[0067] In step S102, whether the position of object 150 relative to vehicle 100 poses a danger that should be reported to driver 101 is determined, for example, based on the position, speed, and direction of movement of vehicle 100, or the position, speed, and direction of movement of object 150. Additionally, as mentioned above, whether driver 101 recognizes object 150 is determined based on whether the driver 101's line of sight intersects with the position of object 150 or the planned path of travel.

[0068] In step S102, if the detection information obtained by the object detection camera 21, radar device 22, and monitoring camera 5 does not meet the conditions for generating a warning sound, the control unit 10 continues the object 150 detection process (step S102, No). In step S102, if the obtained detection information meets the conditions for generating a warning sound, the control unit 10 moves the process to step S103 (step S102, Yes).

[0069] In step S103, the control unit 10 determines whether the detection information acquired by the monitoring camera 5 meets the stereo sound output conditions. In this embodiment, when the orientation of the driver's head 102 is within a specific angle α, the process moves to step S104; when the orientation of the driver's head 102 is outside the specific angle α, the process moves to step S105.

[0070] In step S104, the control unit 10 controls the dual-purpose speaker 31 and dual-purpose speaker 32 to output a stereo sound that forms an audio image that makes the driver 101 aware of the position of the object 150 (step S104). After the control unit 10 outputs the stereo sound as a warning sound, the process moves to step S106.

[0071] In step S105, the control unit 10 selects a speaker from the dual-purpose speaker 31, dual-purpose speaker 32, and mono speaker 4 based on the direction of the object 150, and outputs a mono sound (step S105). After the control unit 10 outputs the mono sound as a warning sound, the processing moves to step S106.

[0072] In step S106, after the warning sound is output, the control unit 10 determines whether the driver 101 has detected the object 150. In this embodiment, it determines whether the driver 101's line of sight intersects with the position of the object 150 or the planned path forward.

[0073] When it is successfully determined that the driver 101 has detected object 150, the control unit 10 moves the processing to step S107 (step S106, Yes) and performs a fading-out process for the warning sound (step S107). The fading-out process gradually reduces the volume to weaken the stereo sound when the warning sound is stereo, and gradually reduces the volume to weaken the mono sound when the warning sound is a non-stereo mono sound. After the fading-out process, the control unit 10 returns the processing to step S101.

[0074] When it cannot be determined that the driver 101 has detected the object 150, the control unit 10 moves the processing to step S108 (step S106, No) to determine whether the warning sound termination condition is met. The warning sound termination condition can be set as follows: when the object detection camera 21 or radar device 22 can no longer detect the object 150 that causes the warning sound, or when a specific time has elapsed, etc., to appropriately end the process. If the termination condition is not met, the control unit 10 returns the processing to step S106 and continues monitoring the driver 101's line of sight (step S108, No). When the termination condition is met, the control unit 10 stops the warning sound and returns the processing to step S101 (step S108, Yes).

[0075] As described above, the safety assistance device 1 for the vehicle 100 in this embodiment includes: an object detection camera 21 and a radar device 22 as detection units, which detect the position of objects 150 around the vehicle 100; a dual-purpose speaker 31 and a dual-purpose speaker 32 as stereo sound output units, which output stereo sound to make the driver 101 aware of the direction of the object 150; a mono speaker 4 as a sound output unit, which outputs sound to make the driver 101 aware of the presence of the object 150; a monitoring camera 5 as a monitoring unit, which monitors changes in the position of the driver 101's ears; and a control unit 10, which controls the dual-purpose speaker 31, the dual-purpose speaker 32, and the mono speaker 4 based on the detection information from the object detection camera 21, the radar device 22, and the monitoring camera 5. The control unit 10 selects to output stereo sound from the dual-purpose speaker 31 and the dual-purpose speaker 32, or to output sound from the dual-purpose speaker 31, the dual-purpose speaker 32, and the mono speaker 4, based on the position of the driver 101's ears detected by the monitoring camera 5.

[0076] Therefore, based on the position of the driver 101's ears, it is possible to distinguish between using stereo sound that can locate the sound image at the required position when the driver 101's ears are in an appropriate position, and using sound that can still indicate the presence of an object even when the driver 101's ears are in an unsuitable position for using stereo sound. Thus, it is possible to avoid situations where the sound image positioning is inappropriate due to ear position when using stereo sound, thereby achieving effective notification processing corresponding to the position of the driver 101's ears.

[0077] In addition, in this embodiment, the sound output by the dual-purpose speaker 31, the dual-purpose speaker 32 and the mono speaker 4 is non-stereo sound mono sound or stereo sound.

[0078] Therefore, because the output of a stereo system is highly dependent on the position of the ears, by using non-stereo mono or stereo sound, the driver 101 can be properly made aware of the presence of objects even when the position of the driver's ears changes significantly.

[0079] In addition, in this embodiment, the control unit 10 outputs stereo sound when the orientation of the driver 101's head 102 detected by the monitoring camera 5 is within a preset specific angle α when viewed from above; and outputs sound when the orientation of the head 102 is outside the specific angle α.

[0080] Therefore, by detecting changes in the ear position based on the orientation of the head 102, the stereo sound and audio can be switched appropriately.

[0081] In addition, in this embodiment, the dual-purpose speaker 31 and dual-purpose speaker 32 are respectively arranged on the left and right sides with the driver 101 as the center, relative to the backrest or headrest 34 of the seat 33 of the driver 101.

[0082] Therefore, the stereo output unit is positioned near the driver's ear, thus enabling more accurate stereo sound to be presented to the driver 101.

[0083] In addition, in this embodiment, stereo sound is indicated by simultaneous output from multiple dual-purpose speakers 31 and 32. The dual-purpose speakers 31 and 32 also serve as sound output units, which output mono or stereo sound instead of stereo sound.

[0084] Therefore, the number of speakers used for mono sound that do not output stereo can be reduced, thereby reducing manufacturing costs or the space required for the safety auxiliary device 1.

[0085] In addition, in this embodiment, multiple dual-purpose speakers 31, 32 and 4 are provided in different directions when viewed from the driver 101. The control unit 10 selects the speaker corresponding to the direction of the object 150 from the dual-purpose speakers 31, 32 and 4 to output sound.

[0086] Therefore, even without using stereo, the driver 101 can perceive the direction of the object 150 by using any one of the dual-purpose speaker 31, dual-purpose speaker 32 and mono speaker 4, which are corresponding to the direction 150 of the object.

[0087] In addition, in this embodiment, the safety assistance device 1 is a vision monitoring unit that monitors the direction of the driver 101's gaze by the monitoring camera 5. The control unit 10 determines whether the driver 101 sees the object 150 based on the detection information of the object detection camera 21, the radar device 22 and the monitoring camera 5. When it is determined that the driver 101 sees the object, the output of the stereo sound or sound is reduced or stopped.

[0088] Therefore, when the driver 101 recognizes the object 150, there is no need to present the existence of the object to the driver 101. As a result, no stereo sound or sound that is less necessary to the driver 101 will be output, thereby reducing the level of disturbance.

[0089] In the above embodiment, an example of selecting a speaker based on the direction of the object 150 when outputting mono sound as non-stereo sound has been described, but the embodiment is not limited to this configuration. It is also possible to configure a system that selects two speakers from three or more speakers for stereo sound output based on the direction of the object.

[0090] In the above embodiment, the dual-purpose speaker 31 and dual-purpose speaker 32 are configured to output both stereo sound and audio, but are not limited to this configuration. The dual-purpose speaker 31 and dual-purpose speaker 32 can also be used exclusively for stereo sound.

[0091] Furthermore, without departing from the spirit of the present invention, the constituent elements in the above embodiments may be appropriately replaced with well-known constituent elements, and the above variations may also be appropriately combined.

[0092] Figure Labels

[0093] 1. Safety auxiliary devices

[0094] 4. Mono speaker (sound output section)

[0095] 5. Surveillance cameras (monitoring department, line-of-sight monitoring department)

[0096] 10. Control Department

[0097] 21. Object Detection Camera (Detection Department)

[0098] 22. Radar Equipment (Detection Department)

[0099] 31, 32 Dual-purpose speaker (stereo output unit)

Claims

1. A safety assistance device, which is a vehicle safety assistance device, and includes: The inspection department is responsible for detecting the position of objects around the aforementioned vehicle. The stereo output unit outputs stereo sound to enable the driver to perceive the direction of the aforementioned object. The sound output unit outputs a sound that makes the driver aware of the presence of the aforementioned object. The monitoring unit monitors changes in the position of the driver's ears; and, The control unit controls the stereo output unit and the sound output unit based on the detection information from the aforementioned detection unit and the aforementioned monitoring unit. and, When the control unit determines that the driver's ear, as detected by the monitoring unit, is in a position where the driver can appropriately perceive the stereo sound, it outputs the stereo sound from the stereo sound output unit. When it is determined that the position of the aforementioned ear is not in a position where the aforementioned stereo sound can be properly perceived, the aforementioned sound is output from the aforementioned sound output unit.

2. A safety assistance device, which is a vehicle safety assistance device, and includes: The inspection department is responsible for detecting the position of objects around the aforementioned vehicle. The stereo output unit outputs stereo sound to enable the driver to perceive the direction of the aforementioned object. The sound output unit outputs a sound that makes the driver aware of the presence of the aforementioned object. The monitoring unit monitors the direction the driver's head is facing; and, The control unit controls the stereo output unit and the sound output unit based on the detection information from the aforementioned detection unit and the aforementioned monitoring unit. and, Specifically, the control unit outputs the stereo sound when the driver's head is facing within a preset specific angle when viewed from above, as detected by the monitoring unit; and outputs the sound when the head is facing outside the aforementioned specific angle.

3. The safety auxiliary device according to claim 1 or 2, wherein, The sound output by the aforementioned sound output unit is either a non-stereo sound or a mono sound or a stereo sound.

4. The safety auxiliary device according to claim 1 or 2, wherein, The aforementioned stereo output unit is positioned on the left and right sides of the driver's seat back or headrest, with the driver as the center.

5. The safety auxiliary device according to claim 1 or 2, wherein, The aforementioned stereo sound is presented by simultaneously outputting from multiple of the aforementioned stereo output units. The aforementioned stereo output unit also serves as the aforementioned sound output unit, and the sound output unit outputs the aforementioned sound to replace the aforementioned stereo system.

6. The safety auxiliary device according to claim 1 or 2, wherein, The aforementioned sound output units are provided in multiple locations in different directions when viewed from the driver's perspective. The aforementioned control unit selects from the plurality of aforementioned sound output units the sound output unit corresponding to the direction of the aforementioned object and outputs the aforementioned sound.

7. The safety auxiliary device according to claim 1 or 2, wherein, It further includes a gaze monitoring unit that monitors the driver's gaze direction. Based on the detection information from the aforementioned detection unit and the aforementioned line-of-sight monitoring unit, the aforementioned control unit determines whether the driver has seen the aforementioned object. When it is determined that the driver has seen the aforementioned object, the control unit reduces or stops the output of the aforementioned stereo or sound.

Images