Vehicle information providing device, vehicle information providing method, and storage medium

Abstract

The present invention provides a vehicle information providing device, a vehicle information providing method, and a storage medium that can improve traffic safety by pursuing appropriate preventive safety. The vehicle information providing device includes: a risk indicator acquisition unit that acquires a risk indicator associated with the situation ahead of the vehicle; a display device that superimposes an image on the scenery ahead of the vehicle for visual recognition by the driver of the vehicle; a vibration unit that vibrates the seat in which the driver is seated; and a control unit that controls the display device based on the risk indicator so that the driver can visually recognize an image moving toward the vehicle, and controls the vibration unit to vibrate the seat based on the timing of the image approaching the driver.

Description

Technical Field

[0001] The present invention relates to a vehicle information providing device, a vehicle information providing method and a storage medium. Background Art

[0002] In the field of transportation, addressing environmental issues has become a top priority. For example, by providing various driving assistance services while drivers are driving, smooth traffic flow can be maintained, reducing vehicle travel and thereby reducing CO2 emissions and other environmental impacts. Furthermore, by providing vehicles that provide driving assistance to public transportation, it is easier to operate public transportation on a stable schedule, thereby improving the convenience of public transportation. Improving the convenience of public transportation will enrich public transportation, and further enhancing the convenience of public transportation requires, for example, the creation of a safer transportation environment.

[0003] To create a safer traffic environment, it is effective to promote preventive safety measures, such as urging drivers to decelerate when risks to the vehicle increase, such as when the driver is accelerating excessively or when the gap between the driver and the vehicle ahead is too close. Previously, a technique has been disclosed that utilizes the forward tilt and lift functions of a motor vehicle's passenger seat to create a virtual vibration, as if the vehicle were climbing over a step, to give the driver a sense of the vehicle's speed (see, for example, Japanese Patent No. 6665685). Summary of the Invention

[0004] Problems to be solved by the invention

[0005] However, even when a virtual vibration, such as a vehicle going over a step, occurs, it is difficult for the driver to understand the relationship between the vehicle's speed and the vibration. Consequently, when the risk to the vehicle increases, the driver may not take action to slow the vehicle even if the seat vibrates, making it difficult to fully ensure traffic safety, which is achieved through preventive safety.

[0006] The present invention has been made in consideration of such circumstances, and one of its objects is to provide a vehicle information providing device, a vehicle information providing method, and a storage medium that can improve traffic safety by achieving appropriate preventive safety.

[0007] Solutions to Problems

[0008] The vehicle information providing device, vehicle information providing method, and storage medium of the present invention employ the following configurations.

[0009] (1): A vehicle information providing device according to one embodiment of the present invention comprises: a risk indicator acquisition unit that acquires a risk indicator associated with a condition ahead of the vehicle; a display device that overlaps an image with scenery ahead of the vehicle for visual recognition by the driver of the vehicle; a vibration unit that imparts vibration to a seat on which the driver is seated; and a control unit that controls the display unit based on the risk indicator so that the driver can visually recognize an image that moves toward the vehicle, and controls the vibration unit according to the timing at which the image approaches the driver so as to impart vibration to the seat.

[0010] (2): In the above-mentioned aspect (1), the risk indicator includes at least one of the inter-vehicle distance between the host vehicle and a preceding vehicle traveling ahead of the host vehicle, and the host vehicle speed.

[0011] (3): In the solution of (2) above, the risk indicator further includes a time headway between vehicles calculated based on the vehicle distance and the vehicle speed.

[0012] (4): In the above-mentioned schemes (1) to (3), the display device enables the driver to visually recognize the image as approaching the vehicle on the road in front of the vehicle, and the control unit controls the vibration unit to impart a first vibration to the seat, and imparts a second vibration to the seat after the first vibration, the first vibration representing a situation in which the front wheels of the vehicle virtually run over the image, and the second vibration representing a situation in which the rear wheels of the vehicle virtually run over the image.

[0013] (5): In the above schemes (1) to (4), the control unit will perform the following processing multiple times in a manner separated by a first time interval, and the processing refers to: controlling the display device to enable the driver to visually recognize the image, and then controlling the vibration unit to impart vibration to the seat.

[0014] (6): In the above-mentioned aspect (5), the control unit calculates the first time interval to be shorter as the risk index is larger.

[0015] (7): In the above aspects (1) to (6), the control unit controls the vibration unit to vibrate the seat after a second time interval has elapsed after the driver visually recognizes the image.

[0016] (8): In the above-mentioned scheme (7), the control unit calculates the second time interval based on the distance between the front wheels of the vehicle and the area where the image is superimposed on the road in front of the vehicle and can be visually recognized by the driver, and the speed of the vehicle.

[0017] (9): In the above-mentioned aspect (7) or (8), the control unit calculates the second time interval to be shorter as the eye point of the driver becomes higher.

[0018] (10): In the above-mentioned aspect (5), the control unit increases the speed of the image approaching the host vehicle according to an increase in the risk index, and calculates the first time interval to be short.

[0019] (11): In any one of the above-mentioned schemes (7) to (9), the control unit increases the speed of the image approaching the host vehicle according to the increase of the risk index, and calculates the second time interval to be short.

[0020] (12): In the above-mentioned scheme (10) or (11), the control unit controls the amplitude of the vibration to be larger according to the increase of the risk index.

[0021] (13): A vehicle information providing method according to one embodiment of the present invention causes a computer to perform the following processing: obtaining a risk index associated with the front condition of the vehicle; controlling a display device that overlaps an image with the scenery in front of the vehicle for visual recognition by the driver of the vehicle based on the risk index associated with the front condition of the vehicle, so that the driver of the vehicle can visually recognize the image that is moving in a manner approaching the vehicle; and controlling a vibration unit according to the timing when the image approaches the driver to impart vibration to the seat on which the driver is seated.

[0022] (14): A storage medium of a vehicle according to one embodiment of the present invention stores a program, wherein the program causes a computer to perform the following processing: obtaining a risk index associated with a condition ahead of the vehicle; controlling a display device that overlaps an image with scenery ahead of the vehicle for visual recognition by the driver of the vehicle based on the risk index associated with the condition ahead of the vehicle, so that the driver of the vehicle can visually recognize the image that is moving in a manner approaching the vehicle; and controlling a vibration unit to impart vibration to a seat on which the driver is seated, according to the timing at which the image approaches the driver.

[0023] Effects of the Invention

[0024] According to the solutions (1) to (14), traffic safety can be improved by pursuing appropriate preventive safety.

[0025] According to the solution (3), the contact risk with the preceding vehicle can be accurately calculated.

[0026] According to the aspect (4), the first vibration and the second vibration are applied to the seat, so that the driver can recognize the risk more effectively.

[0027] According to the solution of (6), the driver can be strongly urged to take actions to avoid risks.

[0028] According to (8), the driver who visually recognizes the approaching virtual image can be made to feel as if the image is being run over by the wheels of his vehicle.

[0029] According to the scheme of (9), the situation of urging the avoidance of risks can be made less susceptible to the influence of the driver's body size and the like.

[0030] According to (12), it is possible to make the driver more aware of the risk. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1 1 is a diagram showing an example of the configuration of the vehicle information providing device 100 .

[0032] Figure 2 1 is a diagram illustrating a configuration inside a vehicle interior of a host vehicle M on which the vehicle information providing apparatus 100 is mounted.

[0033] Figure 3 FIG. 1 is a partial structural diagram of the display device 110 .

[0034] Figure 4 This is a flowchart showing an example of the processing of the control unit 180.

[0035] Figure 5 1 and 2 are diagrams for explaining changes in the position of the virtual image VI visually recognized by the driver via the display device 110 .

[0036] Figure 6 1 and 2 are diagrams showing a scene viewed through the windshield by a driver who visually recognizes a virtual image VI.

[0037] Figure 7 1 is a diagram showing temporal changes in the shape of the virtual image VI visually recognized by the driver within the displayable area A1.

[0038] Figure 8 1 and 2 are diagrams showing a state in which the seat 40 vibrates.

[0039] Figure 9 This is a graph showing temporal changes in the intensity of stimulation given to the driver by the first warning operation.

[0040] Figure 10 This is a graph showing temporal changes in the intensity of stimulation given to the driver by the first warning operation and the second warning operation.

[0041] Figure 11 1 and 2 are diagrams for explaining the distance relationship around the host vehicle M on which the virtual image VI is displayed.

[0042] Figure 12This is a graph showing temporal changes in the intensity of stimulation given to the driver when the second stimulation is given to the driver twice after the first stimulation.

[0043] Figure 13 This is a graph used to illustrate cumulative time.

[0044] Figure 14 This is a graph showing temporal changes in the intensity of stimulation given to the driver when the second stimulation is given to the driver twice after the first stimulation taking the accumulated time of THW or TTC into consideration.

[0045] Figure 15 1 and 2 are diagrams illustrating the distance relationship around the host vehicle M when the driver's eye point is high.

[0046] Figure 16 3 is a diagram illustrating the distance relationship around the host vehicle M when the driver's eye point is low. DETAILED DESCRIPTION

[0047] Hereinafter, embodiments of a vehicle information providing device, a vehicle information providing method, and a storage medium according to the present invention will be described with reference to the accompanying drawings.

[0048] Figure 1 This figure shows an example of the structure of a vehicle information providing device 100. The vehicle information providing device 100 includes, for example, a display device 110, an operating switch 140, an in-cabin camera 145, a vehicle sensor 150, a risk indicator acquisition unit 160, a vibration unit 170, and a control unit 180. The display device 110 is mounted on, for example, a four-wheeled vehicle and superimposes an image, such as an icon simulating a speed bump, on the landscape for visual recognition. The display device 110 may be referred to as a HUD (Head Up Display) device. Hereinafter, a vehicle equipped with the vehicle information providing device 100 is referred to as the vehicle M.

[0049] Figure 2This is a diagram illustrating the structure of the interior of the vehicle M equipped with the vehicle information providing device 100. As an example, the vehicle information providing device 100 is a device that allows a viewer to visually recognize a virtual image by projecting light containing an image onto the windshield of the vehicle M. The viewer is, for example, the driver, but may also be a passenger other than the driver. In addition, the display device can also be realized by projecting a real image onto a light-transmitting display device (such as a liquid crystal display, organic EL (Electroluminescence), or a transparent component (mask, glasses lens, etc.) of a device worn on a person's body) installed on the windshield of the vehicle M. The display device can also be obtained by installing a light-transmitting display device on a device. In the following description, the display device is assumed to be a device that is installed on the vehicle M and projects light containing an image onto the windshield.

[0050] The vehicle M is provided with, for example, a steering wheel 10 for controlling the steering of the vehicle M, a windshield 20 for distinguishing between the outside of the vehicle and the interior of the vehicle, and an instrument panel 30. The windshield 20 is a light-transmitting member. The display device 110 projects light (projection) containing an image onto a displayable area A1 provided on a portion of the windshield 20 in front of the driver's seat 40, thereby allowing the driver seated on the seat 40 to visually recognize a virtual image VI. In the following description, the virtual image is sometimes referred to as an "image." An interior camera 145 is installed on the right side of the windshield 20. A vibration unit 170 is provided in the seat 40.

[0051] The vehicle information providing device 100 allows the driver to visually recognize an image, such as a virtual image VI, for providing information including risk-related information to the driver. The image for providing risk-related information may include, for example, a virtual image (virtual line) that visualizes the collision risk (possibility of collision) with the preceding vehicle and simulates a speed bump. The vehicle information providing device 100 allows the driver to visually recognize the virtual image VI, for example, while moving at a speed that varies depending on the vehicle's travel speed, the magnitude of the risk, and the like. The display device 110 in the vehicle information providing device 100 allows the driver to visually recognize the virtual image VI as approaching the vehicle M on the road ahead.

[0052] In addition to the vehicle information providing device 100, the vehicle M may also be provided with a first display unit 50-1 and a second display unit 50-2. The first display unit 50-1 is provided, for example, near the front of the driver's seat 40 in the instrument panel 30, and is a display device that the driver can visually recognize through the gap between the steering wheel 10 or through the steering wheel 10. The second display unit 50-2 is installed, for example, in the center of the instrument panel 30. The second display unit 50-2 displays, for example, an image corresponding to the navigation processing executed by a navigation device (not shown) installed in the vehicle M, or an image of the other party in a video call. In addition, the second display unit 50-2 can also display items such as television programs, play DVDs, or display downloaded movies.

[0053] The vehicle M is provided with an operating switch 140. The operating switch 140 is mounted, for example, at a position where the driver, seated in the seat 40, can operate the switch without significantly changing his or her body posture. The operating switch 140 may be provided, for example, in front of the first display unit 50-1, on the hub of the steering wheel 10, or on a spoke connecting the steering wheel 10 to the instrument panel 30.

[0054] Figure 3 1 is a partial structural diagram of a display device 110. Display device 110 includes, for example, a light projector 120, an optical mechanism 122, a plane mirror 123, a concave mirror 124, and a light-transmitting cover 125 housed within a housing 121. Display device 110 also includes various sensors and actuators, which will be described later.

[0055] The light projection device 120 includes, for example, a light source 120A and a display element 120B. The light source 120A is, for example, a cold cathode tube, which outputs visible light corresponding to the virtual image VI visually recognized by the driver. The display element 120B controls the transmittance of the visible light from the light source 120A. The display element 120B is, for example, a thin film transistor (TFT) type liquid crystal display device (LCD). In addition, the display element 120B controls each of a plurality of pixels to control the transmittance of each color element of the visible light from the light source 120A, thereby making the virtual image VI include image elements and determining the form (appearance) of the virtual image VI. Hereinafter, the visible light that contains an image through the display element 120B is referred to as image light IL. It should be noted that the display element 120B may also be an organic EL display, in which case the light source 120A may be omitted.

[0056] The optical mechanism 122 includes, for example, one or more lenses. The position of each lens can be adjusted, for example, in the direction of the optical axis. The optical mechanism 122 is, for example, provided on the path of the image light IL output by the light projecting device 120, so that the image light IL incident from the light projecting device 120 passes through and is emitted toward the windshield 20. The optical mechanism 122 can adjust the distance from the driver's line of sight position P1 to the formation position P2 of the virtual image based on the image light IL (hereinafter referred to as the virtual image visual recognition distance DT) by changing the position of the lens, for example. The driver's line of sight position P1 is the position where the image light IL is converged by reflection from the concave mirror 124 and the windshield 20, and is a position where the driver's eyes are assumed to be present. The virtual image visual recognition distance DT is strictly the distance of a line segment having an inclination in the up-down direction, but in the following description, when it is expressed as "the virtual image visual recognition distance DT is 7 [m]", etc., the distance may also refer to the distance in the horizontal direction.

[0057] In the following description, the depression angle θ is defined as the angle formed by the horizontal plane passing through the driver's line of sight position P1 and the line segment from the driver's line of sight position P1 to the formation position P2. The further the virtual image VI is formed downward, that is, the more the driver's line of sight when viewing the virtual image VI is directed downward, the greater the depression angle θ. The depression angle θ is based on the reflection angle of the concave mirror 124. The reflection angle is determined by the display position of the original image in the display element 120B as described later. It is an angle formed by the incident direction of the image light IL reflected by the plane mirror 123 and entering the concave mirror 124 and the emitting direction of the image light IL from the concave mirror 124 .

[0058] When the formation position P2 of the virtual image VI is, for example, on the road ahead of the vehicle, the position of the virtual image VI on the windshield 20 becomes higher as the position of the virtual image VI moves away from the host vehicle M. Therefore, for example, when the virtual image VI moves so as to approach the host vehicle M, the position of the virtual image VI on the windshield 20 moves so as to become lower.

[0059] The plane mirror 123 reflects the visible light (ie, image light IL) emitted from the light source 120A and passing through the display element 120B toward the concave mirror 124 .

[0060] The concave mirror 124 reflects the image light IL incident from the plane mirror 123 and emits it toward the windshield 20. The concave mirror 124 is supported so as to be rotatable (pivotable) about the Y-axis which is an axis in the width direction of the host vehicle M.

[0061] The light-transmitting cover 125 allows the image light IL from the concave mirror 124 to pass through and reach the windshield 20, while preventing foreign matter such as dust, dirt, and water droplets from entering the housing 121. The light-transmitting cover 125 is disposed in an opening formed in the upper member of the housing 121. Furthermore, the instrument panel 30 is also provided with an opening or a light-transmitting member, and the image light IL passes through the light-transmitting cover 125 and the opening or light-transmitting member of the instrument panel 30 to reach the windshield 20.

[0062] The image light IL incident on the windshield glass 20 is reflected by the windshield glass 20 and converges at the driver's sight line position P1. At this time, the driver perceives that an image projected by the image light IL is displayed in front of the host vehicle M.

[0063] return Figure 1 , the various parts of the vehicle information providing device 100 are described. Figure 3 The light projection device 120 shown further includes a lens position sensor 131 , a concave mirror angle sensor 132 , an environment sensor 133 , an optical system controller 134 , a display controller 135 , a lens actuator 136 , and a concave mirror actuator 137 .

[0064] The lens position sensor 131 detects the position of one or more lenses included in the optical mechanism 122. The lens position sensor 131 generates a lens position signal indicating the position of the detected lens and outputs it to the control unit 180. The concave mirror angle sensor 132 detects the angle of the concave mirror 124. Figure 3 The concave mirror angle sensor 132 generates a rotation angle signal indicating the detected rotation angle and outputs the signal to the control unit 180 .

[0065] The environmental sensor 133 detects, for example, the temperature of the light projector 120 or the optical mechanism 122 as the surrounding environment of the display device 110. The environmental sensor 133 generates an environmental signal representing the detected surrounding environment and outputs it to the control unit 180. The environmental sensor 133 may also detect, as the surrounding environment, the illuminance around the vehicle M, the speed and steering angle of the vehicle M, or objects in the surrounding area (e.g., obstacles such as other vehicles and pedestrians).

[0066] The optical system controller 134 controls the lens actuator 136 and the concave mirror actuator 137 under the control of the control unit 180 . The display controller 135 controls the light projection device 120 under the control of the control unit 180 .

[0067] The lens actuator 136 includes a motor connected to the optical mechanism 122 and is used to move the position of one or more lenses in the optical mechanism 122 to adjust the virtual image visual recognition distance DT. The concave mirror actuator 137 includes a motor connected to the rotation axis of the concave mirror 124 and is used to adjust the reflection angle of the concave mirror 124. The concave mirror actuator 137 receives a drive signal from the optical system controller 134 and, based on the received drive signal, drives the motor to rotate the concave mirror actuator 137 about the Y axis to adjust the reflection angle of the concave mirror 124. Thereby, the depression angle θ is adjusted.

[0068] The operation switch 140 receives an instruction to switch on / off the display and an instruction to adjust the position of the virtual image VI from the display device 110. The interior camera 145 is a driver monitoring camera (DMC) that captures the driver's face.

[0069] The vehicle sensor 150 includes a speed sensor for measuring the speed of the vehicle M (host vehicle speed), a radar device for detecting the position and speed of the preceding vehicle, a camera, etc. The vehicle sensor 150 outputs the detected information to the risk index acquisition unit 160 and the control unit 180 .

[0070] The risk indicator acquisition unit 160 detects risk indicators related to the forward conditions of the host vehicle M based on information output by the vehicle sensors 150. Examples of risk indicators detected by the risk indicator acquisition unit 160 include indicators related to the likelihood of contact between the host vehicle M and the preceding vehicle, such as the time headway (THW) and time-to-collision (TTC) between the host vehicle M and the preceding vehicle. Other risk indicators may also be used, such as the headway between the host vehicle M and the preceding vehicle, the speed of the host vehicle M, or indicators indicating the likelihood of contact between the host vehicle M and a stationary object (obstacle) or pedestrian.

[0071] The risk indicator acquisition unit 160 calculates the time headway between the vehicle M and the preceding vehicle (in other words, the headway) based on the vehicle speed of the vehicle M and the headway distance between the vehicle M and the preceding vehicle output by the vehicle sensor 150. The risk indicator acquisition unit 160 acquires the calculated headway as a risk indicator. The risk indicator acquisition unit 160 outputs a headway signal indicating the headway as the acquired risk indicator to the control unit 180. The risk indicator acquisition unit 160 may also be an ECU (Electronic Control Unit) that performs driving assistance such as ACC (Adaptive Cruise Control) and LKAS (Lane Keeping Assist System). The risk indicator acquisition unit 160 may also be a software function unit included in the control unit 180.

[0072] The vibration unit 170 applies vibration to the seat 40 based on a vibration control signal output by the control unit 180. The vibrations applied by the vibration unit 170 to the seat 40 include, for example, tilting vibrations that move the front end of the seat surface of the seat 40 up and down, sliding vibrations that move the seat surface back and forth, and lifting vibrations that move the seat surface and backrest up and down. The vibrations applied by the vibration unit 170 to the seat 40 may be at least one of tilting vibrations, sliding vibrations, and lifting vibrations. The vibrations applied by the vibration unit 170 to the seat 40 may also be other vibrations; for example, the vibration unit 170 may cause the entire seat 40 to vibrate as a whole.

[0073] The control unit 180 includes, for example, an acquisition unit 181, a provision information determination unit 182, a display device control unit 183, and a vibration control unit 184. The display device control unit 183 includes a drive control unit 185 and a display control unit 186. These components are each implemented by, for example, a hardware processor such as a CPU (Central Processing Unit) executing a program (software). Furthermore, some or all of these components may be implemented by hardware (including circuitry) such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a GPU (Graphics Processing Unit), or by a combination of software and hardware. The program may be pre-stored in a storage device (not shown) such as an HDD or flash memory of the control unit 180, or may be stored in a removable storage medium such as a DVD or CD-ROM and installed in the HDD or flash memory of the control unit 180 by attaching the storage medium to a drive device.

[0074] Acquisition unit 181 acquires the time headway signal output by risk indicator acquisition unit 160. Based on the acquired time headway signal (risk indicator signal), acquisition unit 181 acquires the time headway as a risk indicator. If risk indicator acquisition unit 160 is a software function unit included in control unit 180, acquisition unit 181 functions as the risk indicator acquisition unit.

[0075] The provided information determination unit 182 determines provided information to be provided to the driver based on the time headway indicated by the time headway signal acquired by the acquisition unit 181 .

[0076] The drive control unit 185 in the display device control unit 183 adjusts the position of the virtual image VI visually recognized by the driver, for example, based on the operation content from the operation switch 140. For example, when the operation of the operation switch 140 for receiving the following instruction is received, the drive control unit 185 outputs a first control signal to the optical system controller 134, wherein the instruction is an instruction to move the position of the virtual image VI visually recognized as being in the space after passing through the displayable area A1 from the driver's line of sight position P1 to the upper side (hereinafter referred to as the upper direction) in the vertical direction Z, and the first control signal is a signal to move the position of the virtual image VI to the upper direction of the displayable area A1. Moving the virtual image VI in the upward direction means, for example, reducing Figure 3 The shown diagram shows a depression angle θ formed by the horizontal direction relative to the driver's line of sight position and the direction in which the virtual image VI is visually recognized from the line of sight position.

[0077] Furthermore, when the operation switch 140 for receiving an instruction to move the position of the aforementioned virtual image VI downward (hereinafter referred to as the downward direction) in the vertical direction Z is operated, the drive control unit 185 outputs a first control signal to the optical system controller 134 for moving the position of the virtual image VI downward within the displayable area A1. Moving the virtual image VI downward means, for example, increasing the depression angle θ.

[0078] In addition to the above-described processing, the drive control unit 185 generates a drive control signal for causing the driver to visually recognize the virtual image VI in a visual recognition manner corresponding to the provided information determined by the provided information determination unit 182. The provided information determination unit 182 outputs the drive control signal generated by the drive control unit 185 to the optical system controller 134 of the display device 110.

[0079] Display control unit 186 in display device control unit 183 controls display element 120B in light projection device 120 of display device 110. Display control unit 186 generates, for example, a display control signal for causing the driver to visually recognize a virtual image VI in a visual recognition manner corresponding to the provided information determined by provided information determination unit 182. Display control unit 186 outputs the generated display control signal to display controller 135 of display device 110.

[0080] After receiving the drive control signal and the display control signal (hereinafter referred to as the display drive control signal) output by the display device control unit 183, the optical system controller 134 and the display controller 135 of the display device 110 are subjected to display drive control according to the output display drive control signal, and the display in the light projection device 120, the depression angle θ of the light projected by the light projection device 120, and the virtual image visual recognition distance DT are adjusted, and the driver is enabled to visually recognize the virtual image VI as part of the alarm action.

[0081] The optical system controller 134 drives the lens actuator 136 or the concave mirror actuator 137 based on a drive control signal output by the drive control unit 185. The display controller 135 controls the content and display mode of the image displayed on the display element 120B of the light projection device 120 based on a display control signal output by the display control unit 186, thereby causing the light projection device 120 to project a predetermined image light IL. The image display mode includes, for example, the brightness of the image, the image display position (formation position P2), and the size of the image.

[0082] Vibration control unit 184 outputs a vibration control signal to vibrate seat 40 to vibrate vibrator 170, thereby controlling vibrator 170. Vibration control unit 184 outputs a vibration control signal to vibrator 170 for vibrating seat 40 in a vibration pattern corresponding to the provided information determined by provided information determination unit 182. Vibration control unit 184 controls vibrator 170 to vibrate seat 40, for example, based on the timing at which virtual image VI approaches host vehicle M.

[0083] Upon receiving the vibration control signal output by the vibration control unit 184, the vibration unit 170 is vibrated in accordance with the output vibration control signal, thereby vibrating the seat 40 as part of the warning operation. The optical system controller 134 and the display controller 135 causing the driver to visually recognize the virtual image VI, and the vibration unit 170 vibrating the seat 40, are both executed as a combination of the warning operation. The vibration unit 170 vibrating the seat 40 during the warning operation may also generate a first vibration and a second vibration, as described below.

[0084] After causing the display device 110 and the vibration unit 170 to perform the first warning, the control unit 180 may also cause the display device 110 and the vibration unit 170 to perform a second warning if the driver does not decelerate within the first time interval. The first time interval may be, for example, a predetermined fixed value or determined based on a predetermined condition, such as a risk indicator such as the headway distance indicated by the headway distance signal obtained by the acquisition unit 181. Alternatively, the control unit 180 may calculate the first time interval to be shorter as the risk indicator obtained by the acquisition unit 181 increases.

[0085] The control unit 180 may also perform the alarm operation multiple times at intervals of the first time interval, for example, causing the display device 110 and the vibration unit 170 to perform the alarm operation three times.

[0086] Next, the processing in the control unit 180 will be described. Figure 4 This is a flowchart illustrating an example of processing by the control unit 180. As a previous stage of control within the control unit 180, the risk indicator acquisition unit 160 calculates the time headway between the host vehicle M and the preceding vehicle based on the inter-vehicle distance between the host vehicle M and the preceding vehicle and the vehicle speed of the host vehicle M detected by the vehicle sensor 150, by dividing the inter-vehicle distance by the vehicle speed of the host vehicle M. The risk indicator acquisition unit 160 outputs a time headway signal indicating the calculated time headway to the control unit 180.

[0087] Control unit 180 acquires the time headway signal output by risk indicator acquisition unit 160 at acquisition unit 181 (step S101). Next, provision information determination unit 182 determines whether the headway indicated by the headway signal acquired by acquisition unit 181 is less than a preset headway threshold (step S103).

[0088] When the provision information determination unit 182 determines that the time headway indicated by the time headway signal acquired by the acquisition unit 181 is not less than the threshold value (is greater than the threshold value), the control unit 180 ends the process. Figure 4 When it is determined that the time headway indicated by the time headway signal acquired by the acquisition unit 181 is less than the threshold value, the display device control unit 183 and the vibration control unit 184 output the display drive control signal and the vibration control signal to the display device 110 and the vibration unit 170, respectively (step S105).

[0089] The display device 110 and the vibration unit 170 perform a first warning operation (hereinafter referred to as a first warning operation). Specifically, as the warning operation, the display device 110 allows the driver to visually recognize the virtual image VI, and then the vibration unit 170 applies vibration to the seat 40.

[0090] Here, the movement of the virtual image VI visually recognized by the driver and the vibration of the seat 40 in the first warning operation will be described. First, the movement of the virtual image VI will be described. Figure 5 This diagram illustrates the changes in the position of the virtual image VI visually recognized by the driver via the display device 110. The vehicle M is traveling in the direction indicated by arrow Y. In the diagram, P2-1 represents the initially set position of the virtual image VI, P2-3 represents the last set position of the virtual image VI, and P2-2 represents a position of the virtual image VI set during the process. The positions referred to here are relative positions as viewed from the vehicle M and differ from absolute positions on the road R. The control unit 180 controls the lens actuator 136 and concave mirror actuator 137 or the display controller 135 to move the position of the virtual image VI so that the driver perceives that the virtual image VI is approaching the vehicle M along the road R.

[0091] In the figure, L is the length (distance) from position P2-1 to position P2-3. The depression angle θ corresponding to position P2-1 is, for example, the minimum depression angle at which the display device 110 can visually recognize the virtual image VI. However, an arbitrarily set depression angle may be used instead. The depression angle θ corresponding to position P2-3 corresponds to the road boundary position that is not obscured by the hood of the vehicle M and is visually recognizable to the driver. If the depression angle θ is increased, the virtual image VI is visually recognized in front of the hood, which may cause a greater sense of discomfort to the driver.

[0092] By controlling the position of the virtual image VI in such a manner, the scenery ahead viewed from the driver becomes Figure 6 and 7 It should be noted that, instead of changing the relative position of the virtual image VI when viewed from the vehicle M, the control unit 180 may change the display position and size of the original image of the virtual image VI on the projection surface (display surface) of the light projection device 120, thereby allowing the virtual image VI to be observed to be virtually approaching.

[0093] Figure 6 This figure shows the scenery seen through the windshield by a driver visually recognizing a virtual image VI. The display device 110 displays a virtual image VI simulating a speed bump on the road R, within a displayable area A1 between the hood BN of the host vehicle M and the preceding vehicle MF, and allows the driver to visually recognize the virtual image VI approaching the host vehicle M.

[0094] Figure 7This is a diagram showing the time change in the shape of the virtual image VI visually recognized by the driver within the displayable area A1. The display device 110 allows the driver to visually recognize the virtual image VI as described above, so that it appears to the driver that the virtual image VI is gradually approaching. In this way, the control unit 180 causes the formation position P2 of the virtual image VI to gradually approach the driver, giving the driver the feeling that the vehicle M is approaching a speed bump. When the control unit 180 causes the formation position P2 of the virtual image VI to approach the driver for visual recognition by the driver, the display controller 135 may, for example, control the light projection device 120 to change the range occupied by the virtual image VI in the light projection device 120 so that the width becomes wider as the formation position P2 of the virtual image VI approaches the driver.

[0095] Next, vibration control of the seat 40 will be described. Figure 8 4 is a diagram showing a state where the seat 40 vibrates. The seat 40 includes, for example, a seat surface 45, a backrest 46, and a headrest 47. The seat surface 45 is a member for the driver U to sit on. The backrest 46 is a member for the driver U to lean on. The headrest 47 is a member that supports the driver U's head.

[0096] The vibrating unit 170, controlled by the control unit 180, vibrates the seat surface 45, backrest 46, and other components of the seat 40. A driver U seated in the vibrating seat 40 feels the vibrations of the seat 40 through tactile sensation. The vibrations of the seat 40 alert the driver to the fact that the vehicle M has run over a speed bump. This awareness of the speed bump can urge the driver to slow down. The control unit 180 causes the display device 110 and the vibrating unit 170 to perform warning operations. The display device 110 allows the driver to visually recognize the virtual image VI, while the vibrating unit 170 vibrates the seat 40, thereby providing the driver with information about the risk.

[0097] Figure 9 This is a graph showing the temporal changes in the intensity of stimulation imparted to the driver by the first warning operation. When the first warning operation is initiated, the control unit 180 controls the display device 110 to visually recognize the virtual image VI. In the figure, the width of G1 represents the time span during which the virtual image VI is visually recognized. The width of G1 can be changed according to the speed of the vehicle M. Next, the control unit 180 controls the vibration unit 170 to vibrate the seat 40 at second time intervals t2. The width of G2 represents the time span during which the seat 40 vibrates.

[0098] While the vehicle M is traveling, the driver first visually recognizes the virtual image VI as the first stimulus, thereby becoming aware that there is a speed bump in front of the vehicle M. While the vehicle M is traveling forward in this state, the wheels of the vehicle M immediately reach the position where they run over the speed bump after a second time interval t2 has elapsed. The second time interval t2 is the time interval from the application of the first stimulus to the application of the second stimulus. When the wheels of the vehicle M reach the position where they run over the speed bump, the control unit 180 controls the vibration unit 170 to generate vibrations in the seat 40, which serve as the second stimulus. The vibration unit 170 may also apply vibrations to the headrest 47.

[0099] The first stimulus causes the driver to visually recognize a virtual image VI created by simulating a speed bump between the host vehicle M and the vehicle ahead, thereby stimulating the driver's sense of sight by causing the driver to perceive the virtual image VI. The second stimulus actually imparts a vibration to the seat 40 that simulates the vibration that would be generated by the host vehicle M virtually running over the virtual image VI perceived by the driver as the first stimulus, thereby stimulating the driver's sense of touch by causing the driver to perceive the vibration of the seat 40.

[0100] return Figure 4 After the display device control unit 183 and the vibration control unit 184 have executed the first warning action, the provided information determination unit 182 begins measuring the time the driver has not performed a deceleration action (step S107). For example, a deceleration action may include releasing or releasing the accelerator pedal in addition to depressing the brake pedal. Next, the provided information determination unit 182 determines whether the driver has performed a deceleration action (step S109).

[0101] When it is determined that the driver has not performed a deceleration action, the information provision decision unit 182 determines whether the first time interval has passed (step S111). When the information provision decision unit 182 determines the first time interval based on the inter-vehicle time interval represented by the inter-vehicle time interval signal obtained by the acquisition unit 181, for example, the shorter the inter-vehicle time interval represented by the inter-vehicle time interval signal, in other words, the greater the risk index, the shorter the first time interval is calculated by the information provision decision unit 182. The first time interval is set to a fixed time interval such as 1 second. The first time interval can also be set to any time between 10% and 90% of the inter-vehicle time interval. The first time interval can also be set to other times.

[0102] If the provided information determining unit 182 determines that the first time interval has not elapsed, the process returns to step S109. If the provided information determining unit 182 determines that the first time interval has elapsed, the display device control unit 183 and the vibration control unit 184 generate a second alarm signal including a display drive control signal and a vibration control signal, and output the second alarm signal to the display device 110 and the vibration unit 170 instead of the first alarm signal (step S113).

[0103] The display device 110 performs a second warning action (hereinafter referred to as the second warning action) based on the output second warning signal. As a specific warning action, the display device 110 causes the driver to visually recognize the virtual image VI. In addition, the vibration unit 170 vibrates the seat 40. As in the case of executing the first warning action, the control unit 180 provides the driver with the feeling of the vehicle M running over a speed bump by coordinating the display control performed on the display device 110 and the vibration control performed on the vibration unit 170 for vibrating the seat 40 as a second warning action.

[0104] Here, the movement of the virtual image VI visually recognized by the driver and the vibration of the seat 40 in the second warning operation will be described. Figure 10 Graph showing temporal changes in the intensity of stimulation given to the driver by the first warning action and the second warning action. Figure 10 In FIG. 5 , regarding the timing of applying the second stimulus, an example of the stimulus applied to the driver by the first warning operation is indicated by a solid line, and an example of the stimulus applied to the driver by the second warning operation is indicated by a virtual line.

[0105] If the driver does not perform a deceleration action and the first time interval elapses, the risk index detected by the risk index acquisition unit 160 increases. In this case, the second time interval t22 between the application of the first stimulus and the application of the second stimulus by the second warning action is calculated to be shorter than the second time interval t21 between the application of the first stimulus and the application of the second stimulus by the first warning action. Therefore, in the second warning action, the time between the application of the first stimulus and the application of the second stimulus to the driver is shorter than in the first warning action. This can thus more strongly urge the driver to decelerate the host vehicle M.

[0106] After the display device control unit 183 and the vibration control unit 184 execute the second warning operation, the provided information determination unit 182 determines whether the driver has decelerated (step S115). If the provided information determination unit 182 determines that the driver has not decelerated, the process returns to step S113.

[0107] The control unit 180 may also repeat the process of step S115. If the driver does not decelerate after the second warning action is executed and the first time interval has elapsed, the control unit 180 may output a third warning signal for a third time to execute the second warning action. In this manner, the control unit 180 may output two or more warning signals to execute multiple warning actions. In this case, the first time interval may be different from the first time interval measured after the first warning action is executed, for example, shorter.

[0108] If the information determination unit 182 determines that the driver has performed a deceleration action, the display device control unit 183 and the vibration control unit 184 stop outputting the second warning signal (step S117). If the information determination unit 182 determines that the driver has performed a deceleration action in step S109, the drive control unit 185, the display control unit 186, and the vibration control unit 184 also stop outputting the warning signal (step S117). Thereafter, the control unit 180 stops Figure 4 The processing shown.

[0109] The vehicle information providing device 100 of the embodiment notifies the driver of risks ahead of the vehicle by providing the driver with stimulation based on passing perception, which causes the driver to visually recognize a virtual image VI, and stimulation based on vibration of the seat 40. Furthermore, the first stimulation is the virtual image VI causing the driver to visually recognize a speed bump, while the second stimulation is the vibration that represents the vehicle M running over the speed bump. Therefore, the driver can recognize the risk through multiple stimuli that closely resemble the sensation of running over a speed bump, thereby achieving appropriate preventive safety measures and improving traffic safety.

[0110] In the above-described embodiment, the vehicle information providing device 100 does not specify the number of times the seat 40 is vibrated after the virtual image VI is visually recognized in a single warning operation. However, the seat 40 may be vibrated twice after the virtual image VI is visually recognized. In this case, after the first stimulus is provided to the driver, the second stimulus is provided twice. For example, when a vehicle passes over a speed bump, the front wheels of the vehicle run over the speed bump, followed by the rear wheels of the vehicle running over the speed bump. This causes the driver to experience the vibrations of the vehicle running over the speed bump twice.

[0111] Therefore, the control unit 180 can also control the vibration unit 170 to impart a first vibration to the seat 40 in an alarm action, and impart a second vibration to the seat 40 after the first vibration, wherein the first vibration represents that the front wheels of the vehicle M virtually run over the virtual image VI, and the second vibration represents that the rear wheels of the vehicle M virtually run over the virtual image VI. Figure 11 1 and 2 are diagrams for explaining the distance relationship around the host vehicle M on which the virtual image VI is displayed. Figure 12Graph showing temporal changes in the intensity of stimulation given to the driver when the second stimulation is given to the driver twice after the first stimulation. Figure 12 In the graph G1 , the first stimulation is represented by the graph G1 , the first vibration stimulation in the second stimulation is represented by the graph G21 , and the second vibration stimulation in the second stimulation is represented by the graph G22 .

[0112] For example, the length (distance) from position P2-1 to position P2-3 is set as the first distance L, the length between the front wheel FW of the vehicle M and the position P2-3 closest to the vehicle M where the virtual image VI is displayed is set as the second distance D, the wheelbase length of the vehicle M is set as the third distance W, and the vehicle speed of the vehicle M is set as V. In this case, the time for imparting the first stimulus (the time for the driver to visually recognize the virtual image VI, hereinafter referred to as the first stimulus time) is set as, for example, the first distance L / vehicle speed V. In addition, the time interval from the imparting of the first stimulus to the imparting of the stimulus based on the first vibration in the second stimulus is set as, for example, the second distance D / vehicle speed V. This time interval is the same as the second time interval. In addition, the time from the imparting of the stimulus based on the first vibration in the second stimulus to the imparting of the second vibration (hereinafter referred to as the second stimulus time) is set as, for example, the third distance W / vehicle speed V.

[0113] In this way, in one alarm operation, after the virtual image VI is visually recognized, the seat 40 is vibrated twice. After the first stimulus is given to the driver, the second stimulus is given twice. This can provide the driver with a stimulus that is closer to reality. Furthermore, by calculating the first stimulus time, the second time interval, and the second stimulus time using the above-mentioned formulas, it is possible to provide the driver with a stimulus that is closer to reality.

[0114] In addition, the control unit 180 may adjust the first stimulation time, the second time interval, and the second stimulation time based on the accumulated time of THW or TTC. Figure 13 This is a graph for explaining the cumulative time. For example, while the vehicle M is traveling, the cumulative time of THW or TTC is calculated by accumulating the time during which THW or TTC is less than a predetermined threshold value TH1.

[0115] Figure 14It is a graph showing the change over time in the intensity of the stimulus given to the driver when the driver is given two second stimuli after the first stimulus taking into account the accumulated time of THW or TTC. In this case, the control unit 180 sets a coefficient α (0<α≤1) obtained based on the accumulated time, for example. The longer the accumulated time, the smaller the value to which the coefficient α is set. That is, when the accumulated time becomes longer, in order to feel that the speed of the vehicle M is getting faster, the interval between each stimulus is gradually shortened. Therefore, the first stimulus time, the second time interval, and the second stimulus time become the values ​​obtained by multiplying the first stimulus time, the second time interval, and the second stimulus time when the accumulated time of THW or TTC is 0, respectively, by the coefficient α. In this way, the first stimulus time, the second time interval, and the second stimulus time are adjusted based on the accumulated time of THW or TTC, thereby appropriately urging deceleration.

[0116] In addition, the control unit 180 may also adjust the second time interval based on the driver's eye point. An example of adjusting the second time interval based on the driver's eye point will be described below. Figure 15 3 is a diagram illustrating the distance relationship around the host vehicle M when the driver's eye point is high. Figure 16 3 is a diagram illustrating the distance relationship around the host vehicle M when the driver's eye point is low.

[0117] When the driver's eyepoint is high, the driver's field of view EF includes the area of ​​the road R up to the area closest to the host vehicle M. On the other hand, when the driver's eyepoint is low, the driver's field of view only includes the area up to the area farther from the host vehicle M, compared to when the eyepoint is high. Therefore, the second distance DH when the driver's eyepoint is high is shorter than the second distance DL when the eyepoint is low.

[0118] Therefore, the control unit 180 calculates the second time interval (second distance D / vehicle speed V) to be shorter due to the driver's eye point being higher. By calculating the second time interval in this way, the driver can be stimulated to feel closer to reality. The height of the driver's eye point can be detected arbitrarily. For example, the height of the driver's eye point can be detected by performing image analysis on an image containing the driver's face captured by the in-cabin camera 145. The height of the driver's eye point can also be estimated based on the position of the visually recognized virtual image VI manually set by the driver.

[0119] In the above-described embodiment, the control unit 180 adjusts the vibration imparted to the seat 40 by the vibrating unit 170 independently of the risk index output by the risk index acquisition unit 160. Alternatively, the control unit 180 may adjust the vibration imparted to the seat 40 by the vibrating unit 170 based on the risk index output by the risk index acquisition unit 160. For example, the control unit 180 may increase the speed at which the virtual image VI approaches the driver, shorten the vibration interval, and increase the amplitude of the vibration imparted to the seat 40 by the vibrating unit 170, as the risk index output by the risk index acquisition unit 160 increases. In this case, the vibration interval may be shortened and the amplitude increased in conjunction with an increase in the risk index, for example, proportionally or inversely proportionally to the risk index. By performing such control, deceleration can be appropriately urged.

[0120] In the above embodiment, the vehicle information providing device 100 is mounted on a four-wheeled vehicle, but it can also be mounted on a two-wheeled vehicle. In this case, when the vehicle information providing device 100 is mounted on a two-wheeled vehicle, the driver who is visually viewing the visor of a helmet worn by the driver can visually view a virtual image instead of the display device 110. Furthermore, a vibrating unit that vibrates the seat of the two-wheeled vehicle can be provided instead of the vibrating unit 170 that vibrates the seat 40.

[0121] The above-described embodiment can be expressed as follows.

[0122] A vehicle information providing device comprising:

[0123] a storage device storing a program; and

[0124] Hardware processor,

[0125] The hardware processor executes the program stored in the storage device to perform the following processing:

[0126] Obtaining a risk indicator associated with a forward condition of the host vehicle;

[0127] Based on a risk index associated with a situation ahead of the host vehicle, controlling a display device that causes an image to be superimposed on scenery ahead of the host vehicle for visual recognition by a driver of the host vehicle, so that the driver of the host vehicle visually recognizes the image moving toward the host vehicle;

[0128] The vibration unit is controlled according to a timing when the image approaches the driver so as to apply vibration to a seat on which the driver is seated.

[0129] While specific embodiments of the present invention have been described above, the present invention is not limited to these embodiments at all, and various modifications and substitutions can be made without departing from the spirit of the present invention.

Claims

1. A vehicle information providing device, wherein: The vehicle information providing device includes: a risk index acquisition unit that acquires a risk index associated with a forward condition of the host vehicle; a display device that overlaps an image with scenery in front of the host vehicle for visual recognition by a driver of the host vehicle; a vibration unit that applies vibration to a seat on which the driver sits; as well as a control unit that controls the display device based on the risk index so that the driver can visually recognize an image moving toward the host vehicle, and controls the vibration unit to vibrate the seat according to a timing when the image approaches the driver. The control unit controls the vibration unit to vibrate the seat at intervals of a second time interval calculated based on an eye point of the driver after the driver visually recognizes the image.

2. The vehicle information providing device according to claim 1, wherein: The risk indicator includes at least one of a distance between the host vehicle and a preceding vehicle traveling ahead of the host vehicle, and a speed of the host vehicle.

3. The vehicle information providing device according to claim 2, wherein: The risk indicator further includes a time headway between vehicles calculated based on the vehicle distance and the vehicle speed.

4. The vehicle information providing device according to any one of claims 1 to 3, wherein: The display device allows the driver to visually recognize the image as approaching the host vehicle on the road ahead of the host vehicle. The control unit controls the vibration unit to impart a first vibration to the seat, and then imparts a second vibration to the seat after the first vibration. The first vibration represents a situation in which the image is virtually run over by the front wheels of the host vehicle. The second vibration expresses a situation in which the image is virtually run over by the rear wheels of the host vehicle.

5. The vehicle information providing device according to any one of claims 1 to 3, wherein: The control unit executes a process of controlling the display device so that the driver can visually recognize the image and then controlling the vibration unit to vibrate the seat a plurality of times at intervals of a first time interval.

6. The vehicle information providing device according to claim 5, wherein: The control unit calculates the first time interval to be shorter as the risk index increases.

7. The vehicle information providing device according to claim 1, wherein: The control unit calculates the second time interval based on a distance between a region where the image is superimposed on a road ahead of the host vehicle and is visually recognized by the driver and the front wheels of the host vehicle, and the vehicle speed.

8. The vehicle information providing device according to any one of claims 1 to 3, wherein: The control unit calculates the second time interval to be shorter in response to the driver's eye point becoming higher.

9. The vehicle information providing device according to claim 5, wherein: The control unit increases the speed of the image approaching the host vehicle and calculates the first time interval to be shorter in accordance with an increase in the risk index.

10. The vehicle information providing device according to any one of claims 1 to 3, wherein: The control unit increases the speed of the image approaching the host vehicle and calculates the second time interval to be shorter in accordance with an increase in the risk index.

11. The vehicle information providing device according to claim 9, wherein: The control unit controls the amplitude of the vibration to be larger in accordance with an increase in the risk index.

12. A method for providing information for a vehicle, wherein: The vehicle information providing method causes a computer to perform the following processing: Obtaining a risk indicator associated with a forward condition of the host vehicle; Based on a risk index associated with a situation ahead of the host vehicle, controlling a display device that causes an image to be superimposed on scenery ahead of the host vehicle for visual recognition by a driver of the host vehicle, so that the driver of the host vehicle visually recognizes the image moving toward the host vehicle; controlling a vibration unit to impart vibration to a seat on which the driver is seated, according to a timing when the image approaches the driver; as well as After the driver visually recognizes the image, the vibration unit is controlled to vibrate the seat at intervals of a second time interval calculated based on the driver's eye point.

13. A storage medium storing a program, wherein: The program causes the computer to perform the following processing: Obtaining a risk indicator associated with a forward condition of the host vehicle; Based on a risk index associated with a situation ahead of the host vehicle, controlling a display device that causes an image to be superimposed on scenery ahead of the host vehicle for visual recognition by a driver of the host vehicle, so that the driver of the host vehicle visually recognizes the image moving toward the host vehicle; controlling a vibration unit to impart vibration to a seat on which the driver is seated, according to a timing when the image approaches the driver; as well as After the driver visually recognizes the image, the vibration unit is controlled to vibrate the seat at intervals of a second time interval calculated based on the driver's eye point.

Images