Vehicle display device

By obtaining and predicting driving environment information, the vehicle displays predicted behavior with a display device, which solves the problem that drivers find it difficult to intuitively understand the impact of driving environment and improves driving safety.

CN115122913BActive Publication Date: 2025-08-29YAZAKI CORP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202210185376.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2021-03-10
Filing Date
2022-02-28
Publication Date
2025-08-29
Estimated Expiration
2042-02-28

AI Technical Summary

Technical Problem

It is difficult for drivers to intuitively understand the impact of the driving environment on their vehicle, especially the instability of vehicle behavior under factors such as wind.

Method used

The vehicle display device obtains driving environment information through the acquisition unit, and the prediction unit predicts the behavior of other vehicles and the vehicle, and displays the predicted behavior on the display to remind the driver.

Benefits of technology

The driver can intuitively understand the impact of the driving environment on the vehicle, especially the instability of the vehicle behavior under factors such as wind, which improves driving safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115122913B_ABST
    Figure CN115122913B_ABST
Patent Text Reader

Abstract

The present invention provides a vehicle display device that can intuitively convey to the driver how the driving environment affects the vehicle. The vehicle display device includes: an acquisition unit that acquires the driving environment; a prediction unit that predicts the behavior of another vehicle (300) driving in front of the vehicle based on the driving environment; and a display that displays the predicted behavior of the other vehicle (300) to the driver of the vehicle when it is predicted that the behavior of the other vehicle (300) will become unstable. The vehicle display device may also include: a prediction unit that predicts the behavior of the vehicle based on the driving environment; and a display that displays the predicted behavior of the vehicle to the driver of the vehicle when it is predicted that the behavior of the vehicle will become unstable.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a display device for a vehicle. Background Art

[0002] Conventional technologies exist for displaying wind direction. Patent Document 1 discloses a display control device comprising: a weather information acquisition unit; and a display control unit that controls the display of wind information, including wind direction, in a stereoscopic manner based on the weather information acquired by the weather information acquisition unit. Patent Document 1 enables the driver to intuitively understand wind direction.

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: WO2018 / 020546 Summary of the Invention

[0006] Technical problem that the invention aims to solve

[0007] It is hoped that the driver can intuitively understand how driving conditions such as wind affect the vehicle.

[0008] An object of the present invention is to provide a vehicle display device that can intuitively convey to the driver how the driving environment affects the vehicle.

[0009] Technical means to solve the problem

[0010] The vehicle display device of the present invention is characterized in that it comprises: an acquisition unit, which acquires a driving environment; a prediction unit, which predicts the behavior of other vehicles driving in front of the vehicle based on the driving environment; and a display, which displays the predicted behavior of the other vehicle to the driver of the vehicle when it is predicted that the behavior of the other vehicle becomes unstable.

[0011] The vehicle display device of the present invention is characterized in that it comprises: an acquisition unit, which acquires a driving environment; a prediction unit, which predicts the behavior of the vehicle based on the driving environment; and a display, which displays the predicted behavior of the vehicle to the driver of the vehicle when it is predicted that the behavior of the vehicle becomes unstable.

[0012] Effects of the Invention

[0013] The vehicle display device according to the present invention includes: a prediction unit that predicts the behavior of another vehicle traveling ahead of the vehicle based on the driving environment; and a display that displays the predicted behavior of the other vehicle to the driver of the vehicle when the other vehicle's behavior is predicted to become unstable. The vehicle display device according to the present invention can intuitively convey to the driver how the driving environment affects the vehicle.

[0014] The vehicle display device according to the present invention includes: a prediction unit that predicts the behavior of the vehicle based on the driving environment; and a display that displays the predicted behavior of the vehicle to the driver of the vehicle when the vehicle's behavior is predicted to become unstable. The vehicle display device according to the present invention can intuitively convey to the driver how the driving environment affects the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 It is a diagram showing a vehicle equipped with the vehicle display device according to the embodiment.

[0016] Figure 2 This is a block diagram of a vehicle display device according to an embodiment.

[0017] Figure 3 A diagram showing a plurality of display graphics displayed in the display area.

[0018] Figure 4 It is a diagram showing display graphics and icons of an embodiment.

[0019] Figure 5 This diagram explains the flatness of the displayed graphics.

[0020] Figure 6 This is a diagram showing the direction in which the displayed graphic moves.

[0021] Figure 7 This is a diagram showing the direction in which the displayed graphic moves.

[0022] Figure 8 A diagram showing a display pattern having an inclined major axis.

[0023] Figure 9 This figure shows display graphics corresponding to winds in the up and down directions.

[0024] Figure 10 This is a diagram illustrating a display graph in the case of a headwind.

[0025] Figure 11 This is an illustration of the first animation.

[0026] Figure 12 This is a diagram showing a first animation corresponding to the weather.

[0027] Figure 13 This is an illustration of the second animation.

[0028] Figure 14 This is a diagram showing a second animation corresponding to the weather.

[0029] Figure 15 This is a flowchart involved in the implementation method.

[0030] Figure 16 This is a map related to risk assessment.

[0031] Figure 17 This is a map related to risk assessment.

[0032] Explanation of symbols

[0033] 1: Vehicle display device

[0034] 2: First acquisition unit, 3: Second acquisition unit, 4: Driving information acquisition unit

[0035] 5: Navigation information acquisition unit, 6: Prediction unit, 7: Display control unit, 8: Generation unit

[0036] 9: Display

[0037] 30: Display graphics

[0038] 31: Wind display graphics, 32: Wind and rain display graphics, 33: Snow and wind display graphics

[0039] 40: Icon

[0040] 41: Wind icons, 42: Wind and rain icons, 43: Snow and wind icons

[0041] 44: Icon representing a tornado

[0042] 91: Image projection unit, 92: Reflecting mirror

[0043] 100: Vehicle, 101: Dashboard, 102: Windshield

[0044] 102a: Display area, 110: Communication unit, 120: Onboard sensor

[0045] 130: Navigation device

[0046] 200: Driver, 201: Eyepoint

[0047] 300: Other vehicles

[0048] F: Flatness

[0049] L1: length of the major axis, L2: length of the minor axis

[0050] Ln1, Ln2: lanes

[0051] VI: virtual image, V1: first virtual image, V2: second virtual image

[0052] X: vehicle width direction, Y: travel direction, Z: up and down direction DETAILED DESCRIPTION

[0053] Hereinafter, a vehicle display device according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings. The present invention is not limited to this embodiment. Furthermore, the constituent elements of the following embodiments include elements that are readily apparent to those skilled in the art or are substantially the same.

[0054] [Implementation Method]

[0055] Reference Figures 1 to 17 , an embodiment will be described. This embodiment relates to a display device for a vehicle. Figure 1 FIG. 1 is a diagram showing a vehicle equipped with a vehicle display device according to an embodiment. Figure 2 is a block diagram of a vehicle display device according to an embodiment. Figure 3 is a diagram showing a plurality of display graphics displayed in the display area, Figure 4 is a diagram showing display graphics and icons of an embodiment, Figure 5 This is a diagram illustrating the flatness of the displayed graphic. Figure 6 is a diagram showing the direction of movement of the displayed graphic. Figure 7 is a diagram showing the direction of movement of the displayed graphic. Figure 8 is a diagram showing a display pattern with an inclined major axis, Figure 9 This is a diagram showing a display graphic corresponding to wind in the up and down directions. Figure 10 This is a diagram illustrating a display graph in the case of a headwind.

[0056] like Figure 1 As shown, a vehicle display device 1 according to an embodiment is mounted on a vehicle 100. The vehicle display device 1 according to the embodiment is a so-called head-up display device. The vehicle display device 1 displays a virtual image VI in front of an eye point 201 of the vehicle 100. The eye point 201 is a predetermined position as the viewpoint of the driver 200 seated in the driver's seat.

[0057] The vehicle display device 1 is disposed inside an instrument panel 101 of the vehicle 100. An opening 101a is provided on the upper surface of the instrument panel 101. The vehicle display device 1 projects display light of an image onto the windshield 102 via the opening 101a. The windshield 102 is a reflective portion located in front of an eye point 201 in the vehicle 100. The windshield 102 has, for example, semi-transmissive properties and reflects the display light incident from the vehicle display device 1 toward the eye point 201. The driver 200 recognizes the image reflected from the windshield 102 as a virtual image VI. The driver 200 recognizes the virtual image VI as existing in front of the windshield 102.

[0058] In this specification, unless otherwise specified, the "front-rear direction" refers to the front-rear direction of the vehicle 100 equipped with the vehicle display device 1. Furthermore, unless otherwise specified, the "vehicle width direction" refers to the width direction of the vehicle 100, and the "up-down direction" refers to the up-down direction of the vehicle 100.

[0059] like Figure 2 As shown, the vehicle display device 1 includes a first acquisition unit 2, a second acquisition unit 3, a driving information acquisition unit 4, a navigation information acquisition unit 5, a prediction unit 6, a display control unit 7, a generation unit 8, and a display 9. The first acquisition unit 2, the second acquisition unit 3, the driving information acquisition unit 4, the navigation information acquisition unit 5, the prediction unit 6, the display control unit 7, and the generation unit 8 are, for example, computers having a computing unit, a storage unit, a communication interface, etc. The first acquisition unit 2, the second acquisition unit 3, the driving information acquisition unit 4, the navigation information acquisition unit 5, the prediction unit 6, the display control unit 7, and the generation unit 8 operate, for example, based on a pre-stored program.

[0060] The first acquisition unit 2 acquires weather information, road information, and traffic information via the communication unit 110 of the vehicle 100. The weather information and road information acquired by the first acquisition unit 2 are examples of the driving environment that affects the driving of the vehicle 100 and the driving of other vehicles. The communication unit 110 performs V2X (Vehicle to Everything) communication. The communication unit 110 can, for example, wirelessly communicate with an infrastructure system via road-to-vehicle communication. The communication unit 110 can wirelessly communicate with other vehicles via vehicle-to-vehicle communication. In addition, the communication unit 110 can also connect to a cloud network through wireless communication with a communication base station. The communication standard used by the communication unit 110 when performing wireless communication is arbitrary.

[0061] The weather information acquired by the first acquisition unit 2 is information about a predetermined location ahead of the vehicle 100. Prescribed locations include tunnel exits, underpasses, bridges, elevated roads, coastal roads, streets along buildings, and mountain roads. The weather information includes information related to wind speed and direction, the presence and amount of rainfall, the presence and amount of snowfall, and temperature. Wind speed and direction are detected, for example, by an anemometer installed at a predetermined location.

[0062] The first acquisition unit 2 of this embodiment calculates wind components in three directions based on wind speed and direction. These three directions are the vehicle width direction X of the vehicle 100, the vehicle travel direction Y, and the vehicle vertical direction Z. The vehicle width direction X, the travel direction Y, and the vertical direction Z are mutually orthogonal. Based on the wind speed and direction at the specified location, the first acquisition unit 2 divides the wind blowing at the specified location into a first wind component along the vehicle width direction X, a second wind component along the travel direction Y, and a third wind component along the vertical direction Z.

[0063] The road information acquired by the first acquisition unit 2 is information regarding the state of the road surface at a predetermined location in front of the vehicle 100. This road information includes, for example, information regarding frozen road surfaces, water accumulation on the road surface, and flooding on the road surface. The traffic information acquired by the first acquisition unit 2 is traffic information regarding the vicinity of the vehicle 100. This traffic information includes, for example, information regarding the locations, models, and travel directions of other vehicles surrounding the vehicle 100.

[0064] The second acquisition unit 3 acquires information about other vehicles in the surrounding area and road information from the onboard sensor 120 mounted on the vehicle 100. The road information acquired by the second acquisition unit 3 is an example of the driving environment that affects the driving of the vehicle 100 and the driving of other vehicles. The onboard sensor 120 includes, for example, a sensor that detects the relative position and relative speed of other vehicles relative to the vehicle 100. Examples of such sensors include LIDAR (Laser Imaging Detection and Ranging) and radar sensors. The onboard sensor 120 may also include a sensor that detects the shape of other vehicles. The onboard sensor 120 may also include a camera that captures the surrounding area of ​​the vehicle 100. The second acquisition unit 3 acquires information about other vehicles and road information based on the detection results of the onboard sensor 120.

[0065] The driving information acquisition unit 4 acquires driving information of the vehicle 100 as the host vehicle. The driving information is, for example, the speed and steering angle of the vehicle 100. The driving information acquisition unit 4 acquires the driving information from, for example, a speed sensor and a steering angle sensor mounted on the vehicle 100.

[0066] The navigation information acquisition unit 5 acquires the current driving position, map information, and guidance route information of the vehicle 100. The navigation information acquisition unit 5 acquires various information from, for example, a navigation device 130 mounted on the vehicle 100. The navigation information acquisition unit 5 may also acquire information from a portable navigation device or a navigation application on a smartphone.

[0067] Prediction unit 6 predicts the travel route and danger. Prediction unit 6 makes various predictions based on information acquired by first acquisition unit 2, second acquisition unit 3, travel information acquisition unit 4, and navigation information acquisition unit 5. For example, prediction unit 6 predicts the travel route of vehicle 100 and the travel routes of other vehicles. Prediction unit 6 also predicts danger based on wind speed, wind direction, and other factors.

[0068] The display control unit 7 determines whether to display a warning for the driver 200 of the vehicle 100. The display control unit 7 determines whether the warning is necessary based on the prediction result of the prediction unit 6. If the warning is to be displayed, the display control unit 7 determines the display method. If the warning is to be displayed, the display control unit 7 instructs the generator 8 on the display method.

[0069] The generating unit 8 generates a display image and outputs the generated display image to the display 9. The generating unit 8 of this embodiment generates a display graphic 30 representing the weather. Figure 3 , an example of a display graphic 30 and an icon 40 displayed as a virtual image is shown. Figure 3 In the example shown, multiple display graphics 30 are displayed dispersedly in display area 102a, and a single icon 40 is also displayed in display area 102a. Display area 102a is an area where the virtual image VI can be displayed on display 9. In the example, display area 102a is rectangular in shape. The greater the wind speed at a predetermined location, the greater the number of display graphics 30 displayed in display area 102a. Alternatively, the transmittance of display graphics 30 may increase as the number of displayed display graphics 30 increases.

[0070] The display graphic 30 shown in the example is an image indicating the presence of a crosswind. The generator 8 of this embodiment makes the shape of the display graphic 30 and the icon 40 different depending on the weather. Figure 4 The shape of the display graphic 30 and the icon 40 corresponding to the weather are shown in FIG. Figure 4 As shown, the display graphics 30 include a display graphic 31 for wind, a display graphic 32 for wind and rain, and a display graphic 33 for wind and snow.

[0071] The wind-related display graphic 31 is displayed when there is no rain or snowfall at the specified location, or when no rain or snowfall is predicted at the specified location. It should be noted that the wind-related display graphic 31 can also be displayed when strong winds are observed at the specified location, or when a tornado is observed at or near the specified location. The illustrated wind-related display graphic 31 is circular in shape. The wind-related display graphic 31 is displayed in white or a white-based color. The wind-related display graphic 31 can also be displayed in a light gray color.

[0072] The wind and rain display graphic 32 is displayed when rainfall is occurring or predicted at a specified location. Alternatively, the wind and rain display graphic 32 may be displayed when heavy rain or localized rainstorms are observed at the specified location. The wind and rain display graphic 32 may also be displayed when flooding, submergence, or high tide is observed or predicted at the specified location. The illustrated wind and rain display graphic 32 is in the shape of a raindrop. The wind and rain display graphic 32 is displayed in a water-based color.

[0073] The snow and wind display graphic 33 is displayed when snow is falling at a specified location, or when snow is predicted at the specified location. It should be noted that the snow and wind display graphic 33 can also be displayed when hail or sleet is falling at the specified location, or when the specified location is a frozen road. The exemplary snow and wind display graphic 33 is a hexagon. The snow and wind display graphic 33 is displayed, for example, in white or a white-based color.

[0074] Generator 8 adjusts the flatness of display graphic 30 based on the wind speed and direction at the specified location. More specifically, if the wind at the specified location includes a crosswind, generator 8 adjusts the shape of display graphic 30 to a horizontally long, flat shape. By displaying display graphic 30 in a horizontally long, flat shape, driver 200 can easily recognize the presence of a crosswind.

[0075] The stronger the crosswind at a predetermined position, the greater the flatness F of the display graphic 30. For example, when the length of the major axis of the display graphic 30 is L1 and the length of the minor axis of the display graphic 30 is L2, the flatness F is expressed by the following equation (1). That is, when the crosswind is strong, the generator 8 generates the display graphic 30, which is elongated along the vehicle width direction X. The vehicle display device 1 of this embodiment can call the driver's attention to the crosswind by setting the display graphic 30 to become flatter as the crosswind becomes stronger.

[0076] F=(L1-L2) / L1 (1)

[0077] Furthermore, the generator 8 may adjust the flatness F according to the degree of the crosswind. The generator 8 may change the display angle of the display graphic according to the crosswind intensity and the vertical wind intensity.

[0078] In addition, the generator 8 moves the display graphic 30 according to the wind direction on the cross section perpendicular to the traveling direction Y of the vehicle 100. In the following description, the cross section perpendicular to the traveling direction Y is simply referred to as a "predetermined cross section". The predetermined cross section is a cross section along the vehicle width direction X and the vertical direction Z. In the case where there is no third wind component along the vertical direction Z and a side wind blows, as shown in FIG. Figure 6 The generator 8 moves the display graphic 30 horizontally along the vehicle width direction X as indicated by the middle arrow Ar1 .

[0079] In the case of a crosswind, that is, a third wind component in addition to the first wind component, the generator 8 Figure 7 As indicated by arrow Ar2, the display graphic 30 is moved diagonally. The direction of movement indicated by arrow Ar2 is, for example, the direction of a vector resulting from the synthesis of the vectors of the first wind component and the second wind component. The vehicle display device 1 of this embodiment moves the display graphic 30 according to the wind direction, enabling the driver to intuitively understand the wind direction.

[0080] Generator 8 changes the moving speed of display graphic 30 based on the wind speed in a predetermined cross section. For example, as the wind speed in the predetermined cross section increases, generator 8 increases the moving speed of display graphic 30. The vehicle display device 1 of this embodiment changes the moving speed of display graphic 30 based on the wind speed, allowing the driver to intuitively understand the wind intensity.

[0081] The generator 8 may also tilt the display graph 30 according to the wind direction on a predetermined cross section. Figure 8 The display graphic 30 shown has a major axis Ax1 that is inclined with respect to the vehicle width direction X. The direction of the major axis Ax1 is, for example, the same direction as the moving direction indicated by the arrow Ar2.

[0082] It should be noted that, when the wind in the vertical direction Z is blown at the specified position and there is no side wind, Figure 9 As shown in FIG, the generator 8 may also make the display graphic 30 a vertically long shape. In this case, the generator 8 may also move the display graphic 30 along the vertical direction Z as shown by the arrow Ar3.

[0083] When there is a second wind component along the traveling direction Y, the generator 8 executes an animation that changes the size of the display graphic 30 as described below. Figure 10shows the change in size of the display graphic 30 when the wind at the specified location is headwind relative to the vehicle 100. When the display graphic 30 represents a headwind, the generator 8 increases the size of the display graphic 30 over time. For example, the generator 8 varies the size of the display graphic 30 while maintaining a constant flatness F within the display graphic 30. By varying the size of the display graphic 30, the driver can intuitively understand the wind direction along the travel direction Y. When the wind at the specified location is tailwind relative to the vehicle 100, the generator 8 may also decrease the size of the display graphic 30 over time.

[0084] The icon 40 is displayed in the display area 102a together with the display graphic 30, including text indicating weather information. Figure 4 As shown, the icons 40 include a wind icon 41 , a wind and rain icon 42 , and a snow and wind icon 43 .

[0085] A wind icon 41 is displayed along with the wind display graphic 31. In this example, the wind icon 41 includes a graphic representing wind and text indicating wind speed. Furthermore, when a tornado occurs at a predetermined location, the generator 8 generates a tornado icon 44 in place of the wind icon 41. The tornado icon 44 includes a graphic representing a tornado and text indicating a tornado. The wind icon 41 and the tornado icon 44 are displayed, for example, in the same color as the wind display graphic 31.

[0086] An icon 42 for the wind and rain category is displayed along with the wind and rain category display graphic 32. In this example, the wind and rain category icon 42 includes a graphic representing rain and text indicating wind speed. The wind and rain category icon 42 is displayed, for example, in the same color as the wind and rain category display graphic 32. An icon 43 for the snow category is displayed along with the snow category display graphic 33. The snow category icon 43 includes text indicating snow and text indicating wind speed. The snow category icon 43 is displayed, for example, in the same color as the snow category display graphic 33.

[0087] Generator 8 of this embodiment adjusts the size of display graphic 30 based on the distance from vehicle 100 to the predetermined location. For example, if the distance from vehicle 100 to the predetermined location is short, generator 8 increases the size of display graphic 30. On the other hand, if the distance from vehicle 100 to the predetermined location is long, generator 8 decreases the size of display graphic 30. By expressing a sense of perspective in this way, driver 200 can recognize whether the current location is far away or close to the predetermined location. For example, generator 8 gradually increases the size of display graphic 30 as the distance from vehicle 100 to the predetermined location decreases.

[0088] Furthermore, if the display 9 includes a mechanism for adjusting the imaging position of the virtual image VI, a sense of perspective can be expressed on the display 9. This mechanism is, for example, a mechanism that changes the optical path length from the image projection unit 91 to the windshield 102. The display 9 including the adjustment mechanism can also set the imaging position of the virtual image VI to a position closer to the driver 200 when the distance from the vehicle 100 to the predetermined position is shorter than when the distance from the vehicle 100 to the predetermined position is longer.

[0089] The vehicle display device 1 of this embodiment has a function of producing an animation showing the predicted behavior of the vehicle 100. In the following description, the animation showing the predicted behavior of the vehicle 100 is simply referred to as "first animation". Figure 11 An example of the first animation when heading toward the exit of the tunnel is shown in FIG.

[0090] The first animation is executed based on the prediction result of the prediction unit 6. For example, suppose the prediction unit 6 predicts that the vehicle 100 will sway to the right as indicated by arrow Ar4 due to the crosswind at the tunnel exit. In this case, the generation unit 8 generates an animation that moves a virtual image V1 representing the vehicle 100 (hereinafter referred to as the "first virtual image") from left to right. The shape of the first virtual image V1 imitates the shape of the vehicle 100. The first virtual image V1 is displayed in white or a white-based color, for example. The first animation is an animation that shows the swaying behavior of the vehicle 100.

[0091] Furthermore, when it is predicted that the vehicle 100 will roll to the left, the generator 8 may generate an animation that moves the first virtual image V1 from right to left. In this case, the first animation is an animation that shows the behavior of the vehicle 100 rolling to the left.

[0092] The first virtual image V1 is displayed superimposed on the predicted future position of the vehicle 100. The predicted position of the vehicle 100 is calculated based on the speed of the vehicle 100. The display position of the first virtual image V1 is, for example, the position of the vehicle 100 several seconds from now, such as a position ahead of the current position of the vehicle 100, such as the exit of a tunnel.

[0093] The vehicle display device 1 of this embodiment combines the display graphic 30 and the first virtual image V1 to generate a display screen. That is, the vehicle display device 1 executes the animation of the display graphic 30 and the first animation simultaneously. However, the first animation may be executed independently of the animation of the display graphic 30.

[0094] The generating unit 8 may also make the display mode of the first virtual image V1 different depending on whether it is raining or snowing. Figure 12As shown, during rainfall, the generator 8 superimposes a wavy virtual image Vr on the lower portion of the first virtual image V1. The virtual image Vr is an image that evokes the impression that the road surface at the specified location is wet or flooded. During snowfall, the generator 8 superimposes a flat virtual image Vs on the lower portion of the first virtual image V1. The virtual image Vs is an image that evokes the impression that the road surface at the specified location is covered in snow.

[0095] The vehicle display device 1 may be configured to execute the second animation described below instead of the first animation. The second animation is an animation that shows the predicted behavior of other vehicles. Figure 13 An example of the second animation when heading towards the exit of the tunnel is shown in FIG. Figure 13 , lane Ln1 is the lane in which the vehicle 100 is traveling. The other vehicle 300 is a two-wheeled vehicle traveling in the adjacent lane Ln2. The other vehicle 300 is located diagonally in front of the vehicle 100 and is traveling in the same traveling direction Y as the vehicle 100.

[0096] The second animation is executed based on the prediction result of the prediction unit 6. For example, it is assumed that the prediction unit 6 predicts that the other vehicle 300 will shake toward the left as shown by the arrow Ar5 due to the side wind at the exit of the tunnel. In this case, the generation unit 8 generates an animation that moves the virtual image (hereinafter referred to as the "second virtual image") V2 representing the other vehicle 300 from right to left. The shape of the second virtual image V2 imitates the shape of the other vehicle 300. The second virtual image V2 is, for example, an image of a colored frame, and the inside of the frame is colorless. The second animation is an animation that represents the shaking behavior of the other vehicle 300. The shaking direction of the other vehicle 300 is the direction of the lane Ln1 in which the vehicle 100 is approaching. That is, the vehicle display device 1 executes the second animation when it is predicted that the other vehicle 300 will shake in a manner close to the vehicle 100.

[0097] Furthermore, when the other vehicle 300 is traveling in a lane on the left side of the vehicle 100 , it is preferable to execute the second animation when it is predicted that the other vehicle 300 will sway to the right.

[0098] In the first frame of the second animation, the generator 8 displays the second virtual image V2 at a position overlapping with the other vehicle 300. In subsequent frames, the generator 8 moves the second virtual image V2 from the position overlapping with the other vehicle 300 in the direction indicated by arrow Ar5. This animation may be displayed repeatedly.

[0099] The vehicle display device 1 generates a display screen by, for example, combining the display graphic 30 and the second virtual image V2. That is, the vehicle display device 1 executes the animation of the display graphic 30 and the second animation simultaneously. However, the second animation may be executed independently of the animation of the display graphic 30.

[0100] The generating unit 8 may also display the second virtual image V2 in different ways depending on whether it is raining or snowing. Figure 14 As shown, the generating unit 8 overlaps the wavy virtual image Vr with the lower portion of the second virtual image V2 during rain, and overlaps the flat virtual image Vs with the lower portion of the second virtual image V2 during snow.

[0101] The display 9 is a device that displays the image of the display graphic 30 in front of the driver 200 of the vehicle 100. The display 9 of this embodiment is a projector that displays the virtual image of the display graphic 30 by projecting display light onto the windshield 102 of the vehicle 100 so as to overlap with the foreground of the vehicle 100. Figure 1 As shown, the display 9 includes an image projection unit 91 and a reflection mirror 92. The image projection unit 91 generates display light of an image including the display pattern 30 based on the image information generated by the generation unit 8.

[0102] Image projection unit 91 is, for example, a liquid crystal display device such as a TFT-LCD (Thin Film Transistor-Liquid Crystal Display). In this case, image projection unit 91 includes a liquid crystal display unit that displays images, and display light is emitted from the liquid crystal display unit. However, image projection unit 91 is not limited to a liquid crystal display device; for example, it may be a device that generates an image on a screen using lasers. In this case, image projection unit 91 emits image display light from the screen.

[0103] The reflector 92 is a reflective component that reflects the display light emitted from the image projection unit 91 toward the windshield 102. The reflector 92 has a reflective surface that reflects the display light. The reflective surface may be, for example, a free-form surface. The reflector 92 is preferably a magnifying reflector that amplifies the display light while reflecting it. The windshield 102 reflects the display light toward the eyepoint 201 of the driver 200. The reflector 92 reflects the display light toward the area of ​​the windshield 102 that overlaps with the foreground of the vehicle 100. As a result, the resulting virtual image VI is displayed overlapping the foreground of the vehicle 100.

[0104] Reference Figure 15 The operation of the vehicle display device 1 is described with reference to the flowchart of FIG. In step S10, various information is acquired. The first acquisition unit 2 acquires weather information, road information, and traffic information via the communication unit 110. The second acquisition unit 3 acquires information about other vehicles and road information from the vehicle-mounted sensor 120. The driving information acquisition unit 4 acquires driving information related to vehicle speed and steering angle. The navigation information acquisition unit 5 acquires the current driving position, map information, route guidance information, etc. from the navigation device 130. Once step S10 is executed, the process proceeds to step S20.

[0105] In step S20, the prediction unit 6 performs route prediction, hazard prediction, and behavior prediction. For example, the prediction unit 6 predicts the route of the vehicle 100 based on the current location of the vehicle 100, map information, guidance path, vehicle speed, steering angle, and the like. The prediction unit 6 can also predict the routes of other vehicles. For example, the prediction unit 6 can predict the routes of other vehicles and their future locations based on the relative positions and relative speeds of other vehicles acquired from the onboard sensors 120. Furthermore, the prediction unit 6 performs hazard prediction and behavior prediction based on the information acquired in step S10.

[0106] When the vehicle display device 1 is configured to be able to execute the first animation, the prediction unit 6 predicts the behavior of the vehicle 100. The prediction unit 6 predicts the behavior of the vehicle 100 based on, for example, the wind speed in front of the vehicle 100. When the wind speed in front is high, it can be predicted that the behavior of the vehicle 100 will become unstable. For example, at the exit of a tunnel, an underpass, a bridge, an elevated road, a road along the coast, a building street, a mountain road, etc., the vehicle 100 may be subjected to strong winds or the wind pressure on the vehicle 100 may change rapidly. In the following description, a place where the vehicle 100 is subjected to strong winds or the wind pressure on the vehicle 100 may change rapidly is referred to as a caution point. For example, when there is a caution point in front of the vehicle 100 and wind blows at the caution point, the prediction unit 6 predicts that the behavior of the vehicle 100 will become unstable. The prediction unit 6 can predict the shaking direction of the vehicle 100 based on the wind direction and can predict the shaking amount of the vehicle 100 based on the wind speed.

[0107] The prediction unit 6 may also predict the behavior of the vehicle 100 based on information about the road ahead of the vehicle 100. For example, if the road ahead of the vehicle 100 is frozen, if there is water on the road ahead, or if the road ahead is flooded, the prediction unit 6 may predict that the behavior of the vehicle 100 will become unstable. For example, if sand falls on the road ahead of the vehicle 100 or if the road ahead is rough, the prediction unit 6 may predict that the behavior of the vehicle 100 will become unstable. If there is an obstacle on the road ahead, the prediction unit 6 may also predict that the behavior of the vehicle 100 will become unstable. For example, the degree of instability of the behavior of the vehicle 100 may be predicted based on the degree of danger described below.

[0108] When the vehicle display device 1 is configured to execute the second animation, the prediction unit 6 predicts the behavior of the other vehicle 300. For example, the prediction unit 6 predicts the behavior of the other vehicle 300 based on the wind speed ahead of the other vehicle 300. When the wind speed ahead is high, the behavior of the other vehicle 300 can be predicted to become unstable. For example, if there is a caution point ahead of the other vehicle 300 and the wind blows toward the caution point, the prediction unit 6 predicts that the behavior of the other vehicle 300 will become unstable. The prediction unit 6 can predict the direction of the sway of the other vehicle 300 based on the wind direction and the amount of sway of the other vehicle 300 based on the wind speed.

[0109] The prediction unit 6 can also predict the behavior of the other vehicle 300 based on the road information ahead of the other vehicle 300. For example, if the road ahead of the other vehicle 300 is frozen, if there is water on the road ahead, or if the road ahead is flooded, the prediction unit 6 can predict that the behavior of the other vehicle 300 will become unstable. For example, if sand falls on the road ahead of the other vehicle 300 or if the road ahead is rough, the prediction unit 6 can predict that the behavior of the other vehicle 300 will become unstable. If there is an obstacle on the road ahead, the prediction unit 6 can also predict that the behavior of the other vehicle 300 will become unstable. For example, the degree of instability of the behavior of the other vehicle 300 can be predicted based on the degree of danger described below.

[0110] For example, the prediction unit 6 can determine the degree of danger based on the wind speed at a predetermined location. In this case, the prediction unit 6 can determine that the degree of danger at the predetermined location is high if the wind speed at the predetermined location is greater than a threshold value. When the degree of danger based on the wind speed is high, the behavior of the vehicle 100 and other vehicles 300 is likely to become unstable.

[0111] Even if the wind speed is the same, if the speed of the vehicle 100 is high, the behavior of the vehicle 100 is likely to become unstable. The prediction unit 6 may determine the risk level based on the speed of the vehicle 100 in addition to the wind speed at the predetermined position. In this case, the prediction unit 6 may determine the risk level based on, for example, the wind speed at the predetermined position. Figure 16 The degree of risk is determined using the map shown.

[0112] exist Figure 16In the figure, the horizontal axis represents the speed of the vehicle 100, and the vertical axis represents the wind intensity at a specified position. The wind intensity can be the wind speed along the wind direction at the specified position, or it can be the wind speed of the crosswind. The boundary line Th1 is a criterion for judging whether it is necessary to display the display graphics 30, the first animation, the second animation, and other attention reminders. In the case where the point determined by the vehicle speed and the wind intensity is a point on the origin O side relative to the boundary line Th1, it is judged that it does not need to be displayed. On the other hand, in the case where the point determined by the vehicle speed and the wind intensity is a point on the opposite side of the origin relative to the boundary line Th1, it is judged that it needs to be displayed. In addition, the boundary line Th1 in the example is a straight line, but it is not limited to a straight line. In addition, when making a judgment based on the boundary line Th1, a hysteresis is set to suppress the fluctuation of the control.

[0113] Furthermore, when the vehicle display device 1 is configured to be able to execute the second animation, the second animation can be displayed based on the second animation. Figure 16 In this case, the horizontal axis of the map represents the speed of the other vehicle 300. Even if the wind intensity is the same, the greater the speed of the other vehicle 300, the more unstable the behavior of the other vehicle 300 is predicted to be.

[0114] The prediction unit 6 may determine the risk level based on the wind direction at the predetermined location in addition to the wind speed at the predetermined location. Figure 17 The map shown is used to determine the degree of risk. Figure 17 In the map shown, the values ​​along the horizontal axis represent the crosswind intensity at a given location, and the values ​​along the vertical axis represent the wind intensity along the travel direction Y at a given location. Points to the left of the origin O represent rightward crosswinds. Points to the right of the origin O represent leftward crosswinds. Points below the origin O represent tailwinds. Points above the origin O represent headwinds.

[0115] Boundary lines Th2 and Th3 serve as a criterion for determining whether or not to display warnings such as display graphic 30, the first animation, and the second animation. In areas where the crosswind is stronger than those along boundary lines Th2 and Th3, a warning is determined to be necessary. On the other hand, in the area between boundary lines Th2 and Th3 in the horizontal direction, a warning is determined not to be necessary.

[0116] The prediction unit 6 can also determine the degree of danger based on the state of the road surface at the specified location in addition to the wind speed at the specified location. The state of the road surface can be, for example, whether the road surface is slippery, frozen, sandy, or paved. The degree of danger can also be changed based on the slipperiness of the road surface. Figure 16 The boundary line Th1, Figure 17When the road surface is slippery, the values ​​of the boundary lines Th1, Th2, and Th3 are set so that it is easier to judge as dangerous than when the road surface is not slippery.

[0117] For example, when the road surface is slippery, the Figure 16 The boundary line Th1 may be set near the origin O. For example, when the road surface is slippery, the interval between the boundary lines Th2 and Th3 in the horizontal axis direction may be narrower than when the road surface is not slippery.

[0118] Boundary lines Th1, Th2, and Th3 may also be changed according to the driving state of driver 200. For example, when driver 200 is in a state where his hands are loose and not gripping the steering wheel, the values ​​of boundary lines Th1, Th2, and Th3 may be set so that it is easier to judge as dangerous than when driver 200 is gripping the steering wheel.

[0119] Alternatively, consider a situation where the hands are released, where the vehicle 100 is in an autonomous driving state. In this case, the likelihood of judging a situation as dangerous can be set based on the level of autonomous driving. For example, in an autonomous driving state where the driver is responsible, the values ​​of the boundary lines Th1, Th2, and Th3 can be set so that the situation is easily judged as dangerous.

[0120] The boundary lines Th1, Th2, and Th3 may also be changed according to the type of the other vehicle 300. For example, when the other vehicle 300 is a two-wheeled vehicle, the values ​​of the boundary lines Th1, Th2, and Th3 may be set so that the other vehicle 300 is more likely to be judged as dangerous than when the other vehicle 300 is a car other than a two-wheeled vehicle. Figure 16 When determining whether the second animation is necessary based on the same mapping as the mapping of FIG. 3 , the boundary line Th1 may be set closer to the origin O when the other vehicle 300 is a two-wheeled vehicle than when the other vehicle 300 is a car other than a two-wheeled vehicle. As a result, even when the wind speed is the same, the behavior of the other vehicle 300 is more likely to become unstable when the other vehicle 300 is a two-wheeled vehicle than when the other vehicle 300 is a car other than a two-wheeled vehicle.

[0121] When the prediction based on the prediction unit 6 is performed in step S20, step S30 is entered. In step S30, the display control unit 7 determines whether display is necessary. The display control unit 7 determines whether to display the display graphics 30, the first animation, the second animation and other attention reminders based on the information obtained in step S10 and the prediction result in step S20. For example, when the prediction unit 6 determines that a display for attention reminders is necessary, the display control unit 7 determines to display the attention reminder. In addition to the prediction result based on the prediction unit 6, the display control unit 7 can also determine whether display is necessary based on the wind strength at the current location and the relationship with other vehicles. In this case, the display control unit 7 determines that display is necessary when, for example, the following first condition, second condition or third condition is met.

[0122] The first condition is that the wind at vehicle 100's current position is stable, but the conditions at the upcoming predetermined location are predicted to be dangerous. The second condition is that the wind at vehicle 100's current position is dangerous, and it is predicted that vehicle 100 will run parallel to a vehicle in an adjacent lane at the upcoming location. The third condition is that the wind at vehicle 100's current position is dangerous, and it is predicted that vehicle 100 will pass a vehicle in an adjacent lane at the upcoming location. Furthermore, the distance from the current position to the upcoming location is, for example, the distance at which the location is approximately within the driver's field of vision. In other words, the upcoming location is a location within the range that driver 200 can visually recognize.

[0123] In step S30 , if an affirmative determination is made, that is, if it is determined that display is necessary, the process proceeds to step S40 . If a negative determination is made, the process is temporarily terminated.

[0124] In step S40, the generator 8 generates a display screen. For example, the generator 8 combines the display graphic 30 and the icon 40 to generate the display screen. When executing the first animation, the generator 8 combines the display graphic 30, the icon 40, and the image of the first virtual image V1 to generate the display screen. When executing the second animation, the generator 8 combines the display graphic 30, the icon 40, and the image of the second virtual image V2 to generate the display screen. The generator 8 outputs the generated display screen to the display 9. The display 9 projects the display light of the display screen obtained from the generator 8 toward the windshield 102. When step S40 is executed, the process temporarily ends.

[0125] Furthermore, the display 9 is not limited to displaying the virtual image VI overlapping with the foreground of the vehicle 100. That is, the virtual image VI may also be displayed at a location that does not overlap with the foreground. The display 9 is not limited to a device that displays the virtual image VI. For example, the display 9 may be a device that allows the driver 200 to visually recognize a real image displayed on a screen. In this case, the screen of the display 9 is positioned in front of the driver 200 and is visually recognized by the driver 200. The display 9 may be, for example, part of an instrument device or may be positioned adjacent to the instrument device.

[0126] As described above, the vehicle display device 1 according to this embodiment includes a first acquisition unit 2 and a second acquisition unit 3, a prediction unit 6, and a display 9. The first acquisition unit 2 and the second acquisition unit 3 are examples of acquisition units that acquire the driving environment. The prediction unit 6 predicts the behavior of another vehicle 300 traveling ahead of the vehicle 100 based on the driving environment. If the behavior of the other vehicle 300 is predicted to become unstable, the display 9 displays the predicted behavior of the other vehicle 300 to the driver 200 of the vehicle 100. The vehicle display device 1 according to this embodiment can intuitively convey to the driver 200 how the driving environment affects the vehicle.

[0127] In this embodiment, the driving environment includes information related to the wind speed ahead. Prediction unit 6 predicts the behavior of other vehicles 300 based on this wind speed information. The vehicle display device 1 of this embodiment predicts the behavior of other vehicles 300 by taking wind speed into account, enabling a more appropriate prediction of the impact on vehicle 100.

[0128] In this embodiment, another vehicle 300 is traveling in lane Ln2, which is adjacent to vehicle 100. When a crosswind blows from lane Ln2, in which other vehicle 300 is traveling, toward lane Ln1, in which vehicle 100 is traveling, prediction unit 6 predicts that the behavior of another vehicle 300 will become unstable. Therefore, the vehicle display device 1 of this embodiment can display the behavior of another vehicle 300 in a situation where the impact on vehicle 100 is likely to be significant.

[0129] In this embodiment, the driving environment includes information about the condition of the road ahead. The prediction unit 6 predicts the behavior of the other vehicle 300 based on the information about the road condition. Therefore, the vehicle display device 1 of this embodiment can more appropriately predict the behavior of the other vehicle 300.

[0130] The first acquisition unit 2 of the present embodiment acquires the model of the other vehicle 300. The prediction unit 6 predicts that the behavior of the other vehicle 300 will become unstable when the other vehicle 300 is a two-wheeled vehicle.

[0131] Furthermore, when the vehicle display device 1 is configured to execute the first animation, the prediction unit 6 predicts the behavior of the host vehicle 100 based on the driving environment. If the behavior of the vehicle 100 is predicted to become unstable, the display 9 displays the predicted behavior of the vehicle 100 to the driver 200 of the vehicle 100. Therefore, the vehicle display device 1 according to this embodiment can intuitively convey to the driver 200 how the driving environment affects the host vehicle.

[0132] [Modification of the embodiment]

[0133] The shape and display position of the first virtual image V1 are not limited to those exemplified in the embodiment. The movement direction of the first virtual image V1 in the first animation is not limited to a single direction. For example, if the vehicle 100 is predicted to become unstable due to slippery road conditions ahead, the generator 8 may cause the first virtual image V1 to move alternately left and right in the first animation.

[0134] The determination of whether to execute the first animation and the determination of whether to display the display graphic 30 may be independent. For example, if the wind at a predetermined location is weak and the road surface is slippery, the vehicle display device 1 may execute the first animation without displaying the display graphic 30.

[0135] The shape and display position of the second virtual image V2 are not limited to those exemplified in the embodiment. In the second animation, the movement direction of the second virtual image V2 is not limited to a single direction. For example, if it is predicted that the road ahead is slippery and the behavior of the other vehicle 300 is becoming unstable, the generator 8 may cause the second virtual image V2 to move alternately left and right in the second animation.

[0136] The determination of whether to execute the second animation and the determination of whether to display the display graphic 30 may be independent. For example, when the wind at a predetermined location is weak and the road surface is slippery, the vehicle display device 1 may execute the second animation without displaying the display graphic 30 .

[0137] The contents disclosed in the above-mentioned embodiments and modifications can be implemented in combination as appropriate.

Claims

1. A vehicle display device, characterized in that: have: an acquisition unit, the acquisition unit acquiring a driving environment; a prediction unit configured to predict a behavior of another vehicle traveling ahead of the vehicle based on the driving environment; as well as a display that displays the predicted behavior of the other vehicle to the driver of the host vehicle when the behavior of the other vehicle is predicted to become unstable, The driving environment includes information related to the wind speed ahead, The prediction unit predicts the behavior of the other vehicle based on the information related to the wind speed, The other vehicle is a vehicle traveling in a lane adjacent to the host vehicle. The prediction unit predicts that the behavior of the other vehicle will become unstable when a side wind blows from the lane in which the other vehicle is traveling toward the lane in which the host vehicle is traveling.

2. The vehicle display device according to claim 1, wherein: The driving environment includes information related to the condition of the road ahead. The prediction unit predicts the behavior of the other vehicle based on information related to the condition of the road surface.

3. A vehicle display device, characterized in that: have: an acquisition unit, the acquisition unit acquiring a driving environment; a prediction unit that predicts a behavior of the host vehicle based on the driving environment; and a display that, when it is predicted that the behavior of the host vehicle becomes unstable, displays the predicted behavior of the host vehicle to the driver of the host vehicle using an animation representing a virtual image of the vehicle, wherein the prediction unit predicts the shaking direction of the vehicle based on the wind direction, When the vehicle is predicted to shake, the display displays the animation representing the virtual image of the vehicle, wherein the animation represents the shaking behavior of the vehicle in the shaking direction, and the virtual image of the vehicle is displayed overlapping with the predicted position of the vehicle.

Citation Information

Patent Citations

  • Display control apparatus and display control method

    WO2018020546A1

  • Display method for pre-judging driving trajectory

    CN110316202A

  • Detection of vehicle operating conditions

    CN112285740A

  • Vehicle surroundings information display unit

    JP2008070998A

  • Image display system for vehicle

    WO2017082067A1