Vehicle display device, method for controlling vehicle display device, and computer program product

Abstract

A vehicle display apparatus, a control method of the vehicle display apparatus, and a computer program product are provided. Thus, it is possible to improve the possibility that a driver of the vehicle (1) ascertains the risk indicator (2) while suppressing the feeling that an image is displayed on the front windshield (20). A vehicle display device (23) is provided with: a detection unit (101) that detects a risk indicator (2) that is present in front of a vehicle (1) and that is likely to come into contact with the vehicle (1); and a display control unit (108) that displays an image on a front windshield (20) of the vehicle (1), the display control unit (108) temporarily displaying a reduced visibility image (VG) that reduces visibility of a driver (P) of the vehicle (1) in a range other than a risk indicator range (R1) corresponding to the risk indicator (2) detected by the detection unit (101) on the front windshield (20).

Description

Technical Field

[0001] This invention relates to a vehicle display device, a control method for the vehicle display device, and a computer program product. Background Technology

[0002] Previously, there were known technologies that enabled drivers of vehicles to grasp indicators, or risk indicators, of the vehicles they might come into contact with.

[0003] For example, Patent Document 1 discloses a technique that, by displaying an image on the windshield, restricts the field of vision for salient parts that do not require visual confirmation by the driver, thereby suppressing unnecessary eye guidance for objects other than those that should be visually confirmed.

[0004] Furthermore, for example, Patent Document 2 discloses a technique for displaying images on a windshield. In the technique disclosed in Patent Document 2, when the dividing line information displayed on the windshield overlaps with an obstacle, the visibility of the obstacle is improved by restricting the display of the dividing line information.

[0005] Existing technical documents

[0006] Patent documents

[0007] Patent Document 1: Japanese Patent Application Publication No. 2018-016117

[0008] Patent Document 2: Japanese Patent Application Publication No. 2020-128172 Summary of the Invention

[0009] The problem that the invention aims to solve

[0010] Patent documents 1-2 describe technologies that improve the ability of vehicle drivers to grasp risk indicators. However, in patent document 1, during the extraction of salient portions from the camera's captured image that do not require visual confirmation by the driver, an image limiting the field of vision is displayed on the windshield, which may annoy the driver. Furthermore, in patent document 2, since the dividing line information is displayed on the windshield while obtaining information about the road markings ahead of the vehicle, the driver may also become annoyed by the image display.

[0011] Therefore, the object of this invention is to increase the likelihood that vehicle drivers can grasp risk indicators while suppressing boredom caused by images displayed on the windshield. Furthermore, this contributes to further improving traffic safety and promoting the development of sustainable transportation systems.

[0012] Methods for solving problems

[0013] One aspect of the present invention is a vehicle display device comprising: a detection unit that detects a risk indicator present in front of the vehicle and potentially in contact with the vehicle; and a display control unit that displays an image on the windshield of the vehicle, wherein the display control unit temporarily displays a visibility-reducing image on the windshield, in a range other than the risk indicator range corresponding to the risk indicator detected by the detection unit, thereby reducing the visibility of the driver of the vehicle.

[0014] Invention Effects

[0015] According to one aspect of the present invention, it is possible to increase the likelihood that the driver of a vehicle can grasp risk indicators while suppressing boredom with images displayed on the windshield. Attached Figure Description

[0016] Figure 1 This is a diagram showing the structure of the vehicle.

[0017] Figure 2 It is a diagram showing the structure inside the vehicle's interior.

[0018] Figure 3 This is a diagram showing the structure of a vehicle display device.

[0019] Figure 4 This is a diagram used to illustrate the calculation of distances between viewpoint indicators.

[0020] Figure 5 This is a diagram used to illustrate the processing of the display control unit.

[0021] Figure 6 This is a diagram illustrating an example of an image with reduced visibility.

[0022] Figure 7 This is a flowchart illustrating the operation of the vehicle display device.

[0023] Explanation of reference numerals in the attached figures

[0024] 1…Vehicle, 2…Risk indicator, 2J…Upper position, 2K…Lower position, 2S…Left position, 2U…Right position, 10A…Driver's seat, 10B…Passenger seat, 10C…Right rear seat, 10D…Left rear seat, 12…Touch panel, 13, 14, 15, 16, 17…Speaker (stimulus output device), 18…Front camera, 19…HUD, 20…Windshield, 21…Instrument panel, 22…Driver monitoring camera, 23…Vehicle display device, 24…Position detection device, 25…Vehicle speed sensor, 26…Driver assistance device, 27…Autonomous driving device, 100…Processor, 101…Risk indicator detection unit (detection unit), 102…Gaze detection unit, 103…Eye detection unit, 104…Driver status detection unit, 105…Judgment unit, 106…TTC calculation unit, 107…Speaker control unit (stimulus control unit), 110…Memory, 111…Control program, HD…Head, HJ…Corrected upper position, HK…Corrected lower position, HS…Corrected left position, HU…Corrected right position, KJ…Transformed upper position, KK…Transformed lower position, KS…Transformed left position, KU…Transformed right position, L1…Dashed line, L2…Distance, P…Driver, P1…Viewpoint, P2-1…First risk indicator position, P2-2…Second risk indicator position, P2…Risk indicator position, R1…Risk indicator range, S1…Step (detection step), S6, S9, S12…Step (display step), SG…Image capture, VG…Visibility reduction image. Detailed Implementation

[0025] The first embodiment will be described with reference to the accompanying drawings.

[0026] exist Figure 1 , Figure 2 , Figure 4 , Figure 5 as well as Figure 6 The diagram illustrates the X, Y, and Z axes. The X, Y, and Z axes are orthogonal to each other. The Z axis represents the vertical direction. The X and Y axes are parallel to the horizontal direction when vehicle 1 is in motion. The X axis represents the left-right direction as the vehicle's width. The Y axis represents the front-back direction. The positive direction of the X axis represents the right. The positive direction of the Y axis represents the front. The positive direction of the Z axis represents the top.

[0027] [1. Vehicle Structure]

[0028] Figure 1 This is a diagram showing the structure of vehicle 1.

[0029] Figure 1 The vehicle 1 illustrated is a four-wheeled vehicle. Vehicle 1 includes a driver's seat 10A, a front passenger seat 10B, a right rear seat 10C, and a left rear seat 10D. Figure 1In vehicle 1, the driver P is shown sitting in the driver's seat 10A.

[0030] Vehicle 1 is equipped with a touch panel 12. The touch panel 12 is composed of a display panel for displaying text and images and a touch sensor for detecting contact with the display panel, which may be overlapped or integrated.

[0031] Vehicle 1 is equipped with speakers 13, 14, 15, and 16. Speaker 13 outputs sound to the driver P seated in the driver's seat 10A. Speaker 14 outputs sound to the passenger seat 10B. Speaker 15 outputs sound to the passenger seat 10C. Speaker 16 outputs sound to the passenger seat 10D. Furthermore, the positions of speakers 13, 14, 15, and 16 are not limited to... Figure 1 Any location that can output sound to the occupant sitting in the corresponding seat is acceptable.

[0032] In the following text, without distinguishing between speakers 13, 14, 15, and 16, the symbol “17” will be used to represent “speaker 17”.

[0033] Speaker 17 is an example of a "stimulus output device". The sound output by speaker 17 is an example of a "stimulus".

[0034] Vehicle 1 is equipped with a front camera 18 for capturing images of the front of vehicle 1. The front camera 18 is positioned at the front of vehicle 1 and captures images of the front of vehicle 1. The front camera 18 captures images at predetermined intervals, such as when vehicle 1 is ignited or when auxiliary power is supplied. Each time an image is captured, the front camera 18 records the captured image SG (e.g., referring to...) Figure 4 The image data is output to the vehicle display device 23.

[0035] Vehicle 1 is equipped with a HUD (Head-Up Display) 19. The HUD 19 projects light onto the windshield 20 to display an image. Thus, by displaying the image on the windshield 20 via the HUD 19, the driver P, seated in the driver's seat, can simultaneously observe the scene in front of vehicle 1 and the displayed image.

[0036] Figure 2 This is a diagram showing the structure of the interior of vehicle 1.

[0037] exist Figure 2 The vehicle 1 shown has an instrument panel 21 in its interior, which is equipped with a HUD 19. In addition, the instrument panel 21 is equipped with a steering wheel for operating the vehicle 1, a touch panel 12, and a speaker 13.

[0038] exist Figure 1In the diagram, the displayable area A1, which allows the HUD19 to display images, is shown as the area enclosed by the dashed line L1. The size of the displayable area A1 corresponds to the size of the magnifying glass (concave mirror) provided with the HUD19. Furthermore, the size of the displayable area A1 on the windshield 20 is not limited to... Figure 2 The size shown. Additionally, in Figure 2 The example illustrates a shape where the longer side of the displayable area A1 is in the vehicle width direction, but the shape of the displayable area A1 is not limited to this. Figure 2 The shape shown.

[0039] Return to Figure 1 As described above, vehicle 1 is equipped with a driver monitoring camera 22. The driver monitoring camera 22 is a camera installed at a predetermined location inside the vehicle 1 to capture images of the driver P seated in the driver's seat 10A. The field of view of the driver monitoring camera 22 includes at least the area of ​​the driver P's head HD. The driver monitoring camera 22 captures images at predetermined intervals, such as when the vehicle 1 is ignited or when the vehicle 1's auxiliary power is on. Each time an image is captured, the driver monitoring camera 22 outputs the image data of the captured image to the vehicle display device 23.

[0040] Vehicle 1 is equipped with a vehicle display device 23. The vehicle display device 23 is a device that displays images on the windshield 20 via a HUD 19.

[0041] [2. Structure of the vehicle display device]

[0042] Figure 3 This is a diagram showing the structure of the vehicle display device 23.

[0043] The vehicle display device 23 includes a processor 100 such as a CPU (Central Processing Unit) and an MPU (Micro-processing unit), a memory 110, and interface circuits for connecting other devices and sensors.

[0044] The processor 100 controls various parts of the vehicle display device 23 by reading and executing the control program 111 stored in the memory 110. The processor 100 functions as the risk indicator detection unit 101, the gaze detection unit 102, the eye detection unit 103, the driver state detection unit 104, the judgment unit 105, the TTC calculation unit 106, the speaker control unit 107, and the display control unit 108 by executing the control program 111 stored in the memory 110.

[0045] Risk indicator detection unit 101 is an example of a "detection unit". Speaker control unit 107 is an example of a "stimulus control unit".

[0046] Memory 110 is a storage device that stores programs executed by processor 100 and data processed by processor 100. Memory 110 stores control program 111 executed by processor 100 and various other data. Memory 110 has non-volatile storage areas. In addition, memory 110 has volatile storage areas that constitute the working area of ​​processor 100. Memory 110 is composed, for example, of ROM (Read Only Memory) or RAM (Random Access Memory).

[0047] Control program 111 is equivalent to "program".

[0048] The vehicle display device 23 is connected to a speaker 17, a front camera 18, a head-up display (HUD) 19, a driver monitoring camera 22, a position detection device 24, and a vehicle speed sensor 25. Additionally, when the vehicle 1 has driver assistance functions, the vehicle display device 23 is connected to a driver assistance device 26. Furthermore, when the vehicle 1 has autonomous driving functions, the vehicle display device 23 is connected to an autonomous driving device 27. Moreover, the devices connected to the vehicle display device 23 are not limited to these; they can also be connected to vehicle-to-vehicle communication devices for inter-vehicle communication, GNSS (Global Navigation Satellite System) units, rear cameras, and other devices.

[0049] The position detection device 24 is a device capable of detecting the position of objects existing around the vehicle 1. The position detection device 24 is composed of at least one of the following: sonar, radar, lidar, which can determine the distance between the vehicle 1 and the object, and a stereo camera that can determine the distance between the vehicle 1 and the object using parallax.

[0050] The vehicle speed sensor 25 is a sensor that detects the speed of vehicle 1. The vehicle speed sensor 25 detects the speed of vehicle 1 at a predetermined period, and outputs a signal corresponding to the detected speed of vehicle 1 to the vehicle display device 23 whenever a speed is detected.

[0051] The driver assistance device 26 is a device for performing driver assistance functions that assist the driver P in driving the vehicle 1. Examples of driver assistance functions performed by the driver assistance device 26 include one or more functions such as collision damage mitigation, lane departure prevention (lane keeping assist), straight-ahead assist, and rear cross-traffic alert (blind spot monitor). Furthermore, the collision damage mitigation function refers to the function of slowing down the vehicle 1 to avoid or mitigate collision damage in the event of a potential collision with an object in the direction of travel. To achieve these functions, the driver assistance device 26 is connected to a front camera 18, a rear camera that captures images of the area behind the vehicle 1, and a radar unit that detects objects around the vehicle 1.

[0052] The autonomous driving device 27 is a device for enabling the vehicle 1 to perform autonomous driving functions.

[0053] As described above, the processor 100 of the vehicle display device 23 functions as a risk indicator detection unit 101, a gaze detection unit 102, an eye detection unit 103, a driver state detection unit 104, a judgment unit 105, a TTC calculation unit 106, a speaker control unit 107, and a display control unit 108.

[0054] [2-1. Risk Indicator Monitoring Department]

[0055] Risk indicator detection unit 101 detects risk indicators 2 present in front of vehicle 1. Risk indicator 2 refers to an indicator that suggests a possibility of contact with vehicle 1, such as other vehicles, pedestrians, etc. Risk indicator detection unit 101 detects risk indicators 2 reflected in the captured image SG obtained by the front camera 18 based on image data received from the front camera 18. Risk indicator detection unit 101 detects risk indicators 2 reflected in the captured image SG by performing pattern matching and color-based image processing on the captured image SG. In addition, the data required for detecting risk indicator 2 (e.g., shape data, color data) is stored in memory 110 according to the type of risk indicator 2 to be detected.

[0056] Furthermore, the risk indicator detection unit 101 detects the position of the detected risk indicator 2. More specifically, the risk indicator detection unit 101 detects the relative position of the risk indicator 2 with respect to the vehicle 1 when viewed from above. The risk indicator detection unit 101 detects the relative position of the detected risk indicator 2 based on at least one of the detection results from the position detection device 24 and the image SG captured by the front camera 18. In addition, if the detected risk indicator 2 is another vehicle and the vehicle display device 23 is connected to a vehicle-to-vehicle communication device and a GNSS unit, the risk indicator detection unit 101 can detect the relative position of the detected risk indicator 2 based on the position of the other vehicle received by the vehicle-to-vehicle communication device and the position of the vehicle 1 received by the GNSS unit.

[0057] In addition to the front camera 18, the vehicle-to-vehicle communication device and the GNSS unit, the risk indicator detection unit 101 can also use V2X (road-to-vehicle, person-to-vehicle, etc.) based communication to detect the risk indicator 2 reflected in the captured image and the relative position of the risk indicator 2.

[0058] When the risk indicator detection unit 101 detects the risk indicator 2, it outputs data indicating the relative position of the detected risk indicator 2 with respect to the vehicle 1 to the judgment unit 105 and the TTC calculation unit 106.

[0059] In addition, when the risk indicator detection unit 101 detects the risk indicator 2, it outputs data indicating the position of the detected risk indicator 2 in the captured image SG to the speaker control unit 107 and the display control unit 108.

[0060] [2.2. Line of sight detection unit]

[0061] The gaze detection unit 102 detects the direction of the driver P's gaze. The gaze detection unit 102 detects the direction of the driver P's gaze based on image data from the captured image received from the driver monitoring camera 22. The gaze detection unit 102 detects the driver P's eyes from the captured image obtained by the driver monitoring camera 22 using pattern matching, color analysis, etc., and determines the direction in which the detected eyes are looking as the direction of the gaze. Furthermore, the data required for eye detection (data on eye shape and color) is stored in the memory 110.

[0062] When the gaze detection unit 102 detects the direction of the driver P's gaze, it outputs data indicating the direction of the detected gaze to the display control unit 108.

[0063] [2-3. Eye Examination Department]

[0064] The eye detection unit 103 detects the eyes of the driver P, who is seated in the driver's seat 10A. The eye detection unit 103 detects the driver P's eyes based on image data from images captured by the driver's monitoring camera 22. The eye detection unit 103 detects the head (HD) from the captured images obtained by the driver's monitoring camera 22 using pattern matching, color analysis, etc. Next, the eye detection unit 103 detects the position of the eyes in the captured images using pattern matching, color analysis, etc. Then, based on the position of the eyes in the captured images, the eye detection unit 103 detects the position of the eyes in the vertical, horizontal, and lateral directions of the vehicle 1. Furthermore, the position of the eyes in the vertical, horizontal, and lateral directions of the vehicle 1, corresponding to the position of the eyes in the captured images, is determined through prior testing and simulation, and stored as data in the memory 110.

[0065] [2-4. Driver Status Detection Unit]

[0066] The driver status detection unit 104 detects whether the driver P, seated in the driver's seat 10A, is in a normal or abnormal state. The driver status detection unit 104 detects whether the driver P is in a normal or abnormal state based on image data from images captured by the driver monitoring camera 22.

[0067] In detail, the driver state detection unit 104 detects the driver P's face from the captured image obtained by the driver monitoring camera 22 using pattern matching and other methods. Next, the driver state detection unit 104 detects whether the driver P's face detected from the captured image is the face of the driver P in a normal state or the face of the driver P in an abnormal state.

[0068] For example, if the driver's state detection unit 104 detects from the captured image that the driver P's face is one where the eyes have been closed for a predetermined period of time, or one that is angry or flustered, it will detect the face as the driver P's face when in an abnormal state. On the other hand, if the driver's state detection unit 104 detects from the captured image that the driver P's face is neither one where the eyes have been closed for a predetermined period of time, nor one that is angry or flustered, it will detect the face as the driver P's face when in a normal state. Furthermore, the detection of what kind of face it is is based on pattern matching or color.

[0069] If the driver state detection unit 104 detects that the face of driver P detected from the captured image is the face of driver P when driver P is in a normal state, it detects driver P's state as normal. On the other hand, if the driver state detection unit 104 detects that the face of driver P detected from the captured image is the face of driver P when driver P is in an abnormal state, it detects driver P's state as abnormal.

[0070] Furthermore, when driver P is wearing a wearable device, driver status detection unit 104 can also receive biometric data of driver P from the wearable device and detect whether driver P is in a normal or abnormal state based on the received biometric data.

[0071] [2-5. Judgment Section]

[0072] The determination unit 105 determines whether the visibility-reduced image VG, which will be described later, can be displayed.

[0073] The following examples illustrate the determination methods of multiple determination units 105.

[0074] [2-5-1. Judgment Method 1]

[0075] In determination method 1, the determination unit 105 determines whether the visibility reduction image VG can be displayed based on information about the road on which the vehicle 1 is traveling. For example, if the road on which the vehicle 1 is traveling is a highway, the determination unit 105 determines that the visibility reduction image VG cannot be displayed; if the road on which the vehicle 1 is traveling is a regular road, the determination unit 105 determines that the visibility reduction image VG can be displayed. As will be explained later, by displaying the visibility reduction image VG, the vehicle display device 23 increases the likelihood that the driver P can grasp the risk indicator 2. Therefore, based on the location of the risk indicator 2, the driver P will look away. Therefore, if the vehicle 1 is traveling on a highway where the estimated speed is high, the determination unit 105 determines that the visibility reduction image VG cannot be displayed; if the vehicle 1 is traveling on a regular road where the estimated speed is low, the determination unit 105 determines that the visibility reduction image VG can be displayed.

[0076] In addition, the determination unit 105 can obtain information about the road on which the vehicle 1 travels from the map data stored in the memory 110, or it can obtain information about the road on which the vehicle 1 travels from an external server by communicating with an external server.

[0077] [2-5-2. Judgment Method 2]

[0078] In determination method 2, the determination unit 105 determines whether the image VG with reduced visibility can be displayed based on the time up to the point of contact with the risk indicator 2. Hereinafter, the time up to the point of contact with the risk indicator 2 will be appropriately expressed as TTC (Time to Collision). The determination unit 105 calculates TTC when determining whether the image VG with reduced visibility can be displayed.

[0079] Here, the calculation of TTC will be explained.

[0080] When calculating TTC, the determination unit 105 calculates the distance between vehicle 1 and risk indicator 2 and the relative speed between vehicle 1 and risk indicator 2.

[0081] For example, the determination unit 105 calculates the distance between vehicle 1 and risk indicator 2 based on the data representing the relative position received from the risk indicator detection unit 101.

[0082] Additionally, for example, the determination unit 105 calculates the relative speed between the vehicle 1 and the risk indicator 2 based on the data representing multiple relative positions received from the risk indicator detection unit 101 and the detection results of the vehicle speed sensor 25.

[0083] Additionally, for example, suppose the vehicle display device 23 is connected to a vehicle-to-vehicle communication device and a GNSS unit, and the risk indicator 2 detected by the risk indicator detection unit 101 is another vehicle. That is, the determination unit 105 calculates the relative speed between vehicle 1 and risk indicator 2, and the distance between vehicle 1 and risk indicator 2, based on the speed of vehicle 1 detected by the vehicle speed sensor 25, the position of vehicle 1 received by the GNSS unit, and the positions and speeds of other vehicles received by the vehicle-to-vehicle communication device.

[0084] When the determination unit 105 calculates the distance between vehicle 1 and risk indicator 2 and the relative speed between vehicle 1 and risk indicator 2, it calculates TTC by dividing the calculated distance by the calculated relative speed.

[0085] If the calculated TTC is lower than a predetermined value (e.g., 7 seconds), the determination unit 105 determines that the image VG with reduced visibility can be displayed; if the calculated TTC is higher than the predetermined value, it determines that the image VG with reduced visibility cannot be displayed. Furthermore, the predetermined value of 7 seconds is merely one example. This predetermined value is not limited to 7 seconds; it can be a value greater than 7 seconds or a value less than 7 seconds. This predetermined value is appropriately determined through prior testing and simulation.

[0086] [2-5-3. Judgment Method 3]

[0087] In determination method 3, determination unit 105 determines whether a visibility reduction image VG can be displayed based on the distance from the driver P's viewpoint P1 to the risk indicator 2 on the windshield 20 (hereinafter referred to as the distance between viewpoint indicators).

[0088] When making the determination, the determination unit 105 calculates the distance between viewpoint indicators.

[0089] Here, we will refer to Figure 4 Explain the calculation of the distance between viewpoint indicators.

[0090] Figure 4This is a diagram used to illustrate the calculation of distances between viewpoint indicators.

[0091] The determination unit 105 detects the viewpoint P1 of the driver P on the windshield 20 based on the direction of the gaze shown in the data received from the gaze detection unit 102. For example, if the memory 110 stores data that corresponds the direction of the driver P's gaze to the viewpoint P1 of the driver P on the windshield 20, the determination unit 105 refers to this data to detect the viewpoint P1 of the driver P on the windshield 20. Furthermore, the determination unit 105 loads a coordinate system that defines the shape, size, and vertical and horizontal directions of the displayable area A1 into the memory 110, and determines the viewpoint P1 by referring to the loaded coordinate system.

[0092] Next, the determination unit 105 determines the risk indicator position P2. The risk indicator position P2 is the position of the risk indicator 2 on the windshield 20 when observed by the driver P. In addition, the determination unit 105 loads a coordinate system that defines the shape, size, and vertical and horizontal directions of the displayable area A1 into the memory 110, and determines the risk indicator position P2 by referring to the loaded coordinate system.

[0093] In determining the risk indicator position P2, the determination unit 105 determines the risk indicator position P2 in the vertical direction of the displayable area A1 (hereinafter, it is referred to as "first risk indicator position P2-1" by the reference numeral "P2-1"). Furthermore, the vertical direction of the displayable area A1 corresponds to the vertical direction of the windshield 20 and the direction of the short side of the displayable area A1.

[0094] Furthermore, in determining the risk indicator position P2, the determination unit 105 determines the risk indicator position P2 in the left-right direction of the displayable area A1 (hereinafter, it is referred to as "second risk indicator position P2-2" by the reference numeral "P2-2"). In addition, the left-right direction of the displayable area A1 corresponds to the left-right direction of the windshield 20 and the long side direction of the displayable area A1.

[0095] First, let me explain the decision to position the first risk indicator, P2-1.

[0096] The determination unit 105 obtains the position of risk indicator 2 in the vertical direction of the captured image SG from the data output by the risk indicator detection unit 101. The vertical direction of the captured image SG corresponds to the vertical direction of the scene reflected in the captured image SG. Next, the determination unit 105 transforms the obtained position of risk indicator 2 into the vertical position of the displayable area A1, and determines the transformed position as the first risk indicator position P2-1. Furthermore, the relationship between the vertical position of the captured image SG and the vertical position of the displayable area A1 is determined through prior simulation, etc., and stored as data in the memory 110.

[0097] Next, the decision on the position of the second risk indicator, P2-2, will be explained.

[0098] The determination unit 105 obtains the position of risk indicator 2 in the left-right direction of the captured image SG from the data output by the risk indicator detection unit 101. Furthermore, the left-right direction of the captured image SG is orthogonal to the up-down direction of the captured image SG. Next, the determination unit 105 converts the obtained position of risk indicator 2 into its position in the left-right direction of the displayable area A1. Furthermore, the relationship between the position in the left-right direction of the captured image SG and the position in the left-right direction of the displayable area A1 is determined through prior testing, simulation, etc., and stored as data in the memory 110.

[0099] When the determination unit 105 changes its position to the left-right direction of the displayable area A1, it corrects the changed position in the left-right direction of the displayable area A1 based on the eye position detected by the eye detection unit 103. For example, if the eye position in the left-right direction of the vehicle 1 is located to the left of a predetermined reference, the determination unit 105 corrects the changed position to the left based on the distance between the predetermined reference and the eye position in the left-right direction. Conversely, if the eye position in the left-right direction of the vehicle 1 is located to the right of a predetermined reference, the determination unit 105 corrects the changed position to the right based on the distance between the predetermined reference and the eye position.

[0100] Then, the determination unit 105 determines the corrected position as the second risk indicator position P2-2.

[0101] When determining the first risk indicator position P2-1 and the second risk indicator position P2-2, the determination unit 105 determines the position defined by the first risk indicator position P2-1 and the second risk indicator position P2-2 as the risk indicator position P2.

[0102] When determining the viewpoint P1 and the risk indicator position P2, the determination unit 105 calculates the distance L2 between the viewpoint P1 and the risk indicator position P2 on the windshield 20 as the distance between the viewpoint indicators. The determination unit 105 calculates the straight-line distance between the viewpoint P1 and the risk indicator position P2 in the coordinate system loaded in the memory 110, transforms it into a distance on the windshield 20, and thereby calculates the distance between the viewpoint indicators.

[0103] When calculating the distance between viewpoint indicators, the determination unit 105 determines whether the distance between viewpoint indicators is greater than or equal to a predetermined distance. If the distance between viewpoint indicators is less than or equal to the predetermined distance, the determination unit 105 determines that the image VG with reduced visibility cannot be displayed; if the distance between viewpoint indicators is greater than the predetermined distance, the determination unit 105 determines that the image VG with reduced visibility can be displayed.

[0104] [2-5-4. Judgment Method 4]

[0105] In determination method 4, the determination unit 105 determines whether the reduced visibility image VG can be displayed based on the state of the driver P. If the driver state detection unit 104 determines that the driver P is in a normal state, the determination unit 105 determines that the reduced visibility image VG can be displayed. On the other hand, if the driver state detection unit 104 determines that the driver P is in an abnormal state, the determination unit 105 determines that the reduced visibility image VG cannot be displayed.

[0106] [2-5-5. Judgment Method 5]

[0107] In determination method 5, the determination unit 105 determines whether the reduced visibility image VG can be displayed based on whether the vehicle 1 has a driver assistance function. If the vehicle 1 has a driver assistance function, the determination unit 105 determines that the reduced visibility image VG can be displayed. Conversely, if the vehicle 1 does not have a driver assistance function, the determination unit 105 determines that the reduced visibility image VG cannot be displayed. Furthermore, whether the vehicle 1 has a driver assistance function is stored as data in the memory 110. Then, the determination unit 105 refers to this data stored in the memory 110 to determine whether the reduced visibility image VG can be displayed.

[0108] As described above, the determination method of the determination unit 105 is illustrated. The determination unit 105 can determine whether or not to display the image VG with reduced visibility by any of the determination methods 1 to 5, or it can combine any of the processing methods 1 to 5 to determine whether or not to display the image VG with reduced visibility.

[0109] [2-6. TTC Computing Department]

[0110] The TTC calculation unit 106 calculates the TTC. Furthermore, the TTC calculation unit 106 calculates the TTC using the same calculation method as the determination unit 105.

[0111] [2-7. Speaker Control Section]

[0112] The speaker control unit 107 activates the speaker 17 to output sound to the driver P.

[0113] [2-8. Display Control Unit]

[0114] The display control unit 108 controls the operation of the HUD 19 to temporarily display a reduced visibility image VG on the windshield 20. The reduced visibility image VG is an image that reduces the visibility of the driver P through the windshield 20. The display control unit 108 displays the reduced visibility image VG by performing the following processing.

[0115] Reference Figure 5 The processing of the display control unit 108 will be explained.

[0116] Figure 5 This diagram illustrates the processing of the display control unit 108.

[0117] The display control unit 108 obtains the upper position 2J and lower position 2K of the risk indicator 2 in the captured image SG from the data detected by the risk indicator detection unit 101. Additionally, the display control unit 108 obtains the left position 2S and right position 2U of the risk indicator 2 in the captured image SG from the data detected by the risk indicator detection unit 101.

[0118] Next, the display control unit 108 transforms the acquired upper position 2J into a position in the vertical direction of the displayable area A1. This transformed position is labeled with the reference numeral "KJ" and is referred to as the transformed upper position KJ.

[0119] Furthermore, the display control unit 108 transforms the acquired lower position 2K into a position in the vertical direction of the displayable area A1. This transformed position is labeled with the reference numeral "KK" and is referred to as the transformed lower position KK.

[0120] Furthermore, the display control unit 108 transforms the acquired left-end position 2S into a position in the left-right direction of the displayable area A1. This transformed position is labeled with the reference numeral "KS" and is referred to as the transformed left-end position KS.

[0121] Furthermore, the display control unit 108 transforms the acquired right-end position 2U into a position in the left-right direction of the displayable area A1. This transformed position is labeled with the reference numeral "KU" and is referred to as the transformed right-end position KU.

[0122] Furthermore, the relationship between the position of the captured image SG in the up, down, left, and right directions and the position of the displayable area A1 in the up, down, left, and right directions is determined through prior simulation and stored as data in the memory 110. Then, the display control unit 108 refers to the data stored in the memory 110 and changes the four positions obtained from the captured image SG.

[0123] Next, the display control unit 108 corrects the transformed upper position KJ, transformed lower position KK, transformed left position KS, and transformed right position KU based on the eye position detected by the eye detection unit 103. Furthermore, the display control unit 108 loads a coordinate system defining the shape, size, and vertical / horizontal directions of the displayable area A1 into the memory 110, plots the transformed upper position KJ, transformed lower position KK, transformed left position KS, and transformed right position KU in the loaded coordinate system, and then corrects these four positions.

[0124] For example, if the position of the eye in the vertical direction of the display control unit 108 is higher than a predetermined reference, the upper position KJ and the lower position KK after transformation are corrected downward in the vertical direction of the displayable area A1 according to the distance between the predetermined reference and the position of the eye.

[0125] Additionally, for example, if the position of the eye of the display control unit 108 in the vertical direction of the vehicle 1 is lower than a predetermined reference, the upper position KJ and the lower position KK after transformation are corrected upwards in the vertical direction of the displayable area A1 according to the distance between the predetermined reference and the eye position.

[0126] Additionally, for example, if the position of the eye of the display control unit 108 in the left-right direction of the vehicle 1 is located to the left of a predetermined reference, the left end position KS and the right end position KU after transformation are corrected to the left in the left-right direction of the displayable area A1 according to the distance between the predetermined reference and the eye position.

[0127] Additionally, for example, if the position of the eye of the display control unit 108 in the left-right direction of the vehicle 1 is located to the right of a predetermined reference, the left-end position KS and the right-end position KU after the change are corrected to the right in the left-right direction of the displayable area A1 according to the distance between the predetermined reference and the position of the eye.

[0128] Hereinafter, the upper position KJ after correction and transformation will be labeled "HJ" and referred to as the corrected upper position HJ. Similarly, the lower position KK after correction and transformation will be labeled "HK" and referred to as the corrected lower position HK. Furthermore, the left position KS after correction and transformation will be labeled "HS" and referred to as the corrected left position HS. Finally, the right position KU after correction and transformation will be labeled "HU" and referred to as the corrected right position HU.

[0129] Next, the display control unit 108 determines the risk index range R1. The risk index range R1 is the range in the windshield 20 that corresponds to the risk index 2. In addition, the display control unit 108 loads a coordinate system that defines the shape, size, and vertical and horizontal directions of the displayable area A1 into the memory 110, plots points on the corrected upper position HJ, corrected lower position HK, corrected left position HS, and corrected right position HU in the loaded coordinate system, and then determines the risk index range R1.

[0130] The display control unit 108 determines the risk index range R1 as the range of the following circle, which makes at least one of the corrected upper position HJ, corrected lower position HK, corrected right position HU, and corrected left position HS on the circumference and includes the other three positions within the circumference.

[0131] Furthermore, the shape of the risk indicator range R1 is not limited to a circle. For example, the display control unit 108 may also use a rectangular range formed by connecting the corrected upper position HJ, the corrected lower position HK, the corrected right position HU, and the corrected left position HS with straight lines as the risk indicator range R1.

[0132] Alternatively, the risk index range R1 may not be a range that includes at least one of the corrected upper position HJ, corrected lower position HK, corrected right position HU, and corrected left position HS within the circumference. For example, the risk index range R1 may also be a range that includes all of the corrected upper position HJ, corrected lower position HK, corrected right position HU, and corrected left position HS within the circumference.

[0133] As described above, the display control unit 108 can determine the risk indicator range R1 within a range based on the position and size of the risk indicator 2 and the position of the driver P's eyes in the vehicle 1.

[0134] Furthermore, the display control unit 108 can also determine the risk index range R1 by referring to information about the road on which the vehicle 1 is traveling. In this case, the display control unit 108 obtains information about the road on which the vehicle 1 is traveling from the map data stored in the memory 110 and from an external server to determine the risk index range R1.

[0135] For example, the display control unit 108 may determine the risk index range R1 such that at least one of the four positions is located on the circumference when the road on which the vehicle 1 travels is a general road, and determine the range with a larger radius than the range in the case of a general road as the risk index range R1 when the road on which the vehicle 1 travels is a highway.

[0136] Alternatively, for example, the display control unit 108 may determine the aforementioned risk index range R1 such that at least one of the four positions is located on the circumference when the road width of the road on which the vehicle 1 travels is above a predetermined value, and when the road width of the road on which the vehicle 1 travels is below a predetermined value, it may determine the range with a larger radius than the case where the road width is above a predetermined value as the risk index range R1.

[0137] Furthermore, if the risk indicator 2 detected by the risk indicator detection unit 101 includes people and objects other than people (e.g., motorcycles and their drivers), the display control unit 108 determines the risk indicator range R1 containing people or objects other than people based on information about the road on which the vehicle 1 is traveling. In this case, the display control unit 108 obtains the map data stored in the memory 110 and the information about the road on which the vehicle 1 is traveling from an external server to determine the risk indicator range R1. Alternatively, in this case, the display control unit 108 obtains four locations from the captured image SG for people or objects other than people to determine the risk indicator range R1.

[0138] For example, if the road on which the vehicle 1 is traveling is a general road, the display control unit 108 determines a risk index range R1 that includes people, and if the road on which the vehicle 1 is traveling is a highway, it determines a risk index range R1 that includes objects other than people.

[0139] When the display control unit 108 determines the risk index range R1, it displays a reduced visibility image VG in the area outside the determined risk index range R1 in the displayable area A1.

[0140] Figure 6 This is a diagram illustrating an example of an image VG with reduced visibility.

[0141] As described above, the reduced visibility image VG is an image that reduces the visibility of the driver P through the windshield 20. The reduced visibility image VG is displayed in the displayable area A1 outside the risk indicator range R1. The reduced visibility image VG is an image with a lower transmittance than the windshield 20. The transmittance of the reduced visibility image VG is set to a transmittance at which the driver P can still observe the scene through the windshield 20 even through the reduced visibility image VG.

[0142] As described above, the display control unit 108 temporarily displays the reduced visibility image VG on the windshield 20. This allows for the temporary emphasis of the risk indicator 2 on the windshield 20, providing stimulation to the driver P regarding the risk indicator 2 for a short period, to a degree that the driver P is unaware of. In other words, regarding the risk indicator 2, an effect similar to a subconscious effect can be exerted on the driver P. Therefore, while suppressing boredom with the image displayed on the windshield 20, the likelihood of the driver P grasping the risk indicator 2 can be increased.

[0143] [3. Operation of the vehicle display device]

[0144] Next, the operation of the vehicle display device 23 in this embodiment will be explained.

[0145] Figure 7This is a flowchart illustrating the operation of the vehicle display device 23.

[0146] The risk indicator detection unit 101 detects the risk indicator 2 present in front of the vehicle 1 (step S1).

[0147] Step S1 is equivalent to the "detection step".

[0148] The determination unit 105 determines whether risk indicator 2 was detected in step S1 (step S2). The determination in step S2 is based on whether data was received from the risk indicator detection unit 101.

[0149] If the determination unit 105 determines that risk indicator 2 is not detected (step S2: No), the processor 100 returns the processing to step S1 and performs the processing of step S1 again.

[0150] On the other hand, if risk indicator 2 is detected (step S2: yes), the determination unit 105 determines whether the image VG with reduced visibility can be displayed or not (step S3).

[0151] If the determination unit 105 determines that the image VG with reduced visibility can be displayed (step S3: can be displayed), the TTC calculation unit 106 calculates the TTC for the risk index 2 detected by the risk index detection unit 101 (step S4).

[0152] Next, the display control unit 108 determines whether the TTC calculated in step S4 is above a predetermined value (step S5). This predetermined value is set to a value larger than the predetermined value used by the determination unit 105 in determination method 2, for example, 8 seconds.

[0153] If the display control unit 108 determines that the TTC calculated in step S4 is above a predetermined value (step S5: Yes), it temporarily displays the image VG with reduced visibility (step S6).

[0154] Step S6 is equivalent to "display step".

[0155] In step S6, the display control unit 108 displays the visibility reduction image VG for a first time period. The first time is a time shorter than the second time described later, for example, 0.03 seconds. However, this example of the first time is just one example and is not limited to 0.03 seconds. The first time is only required to be a time shorter than the second time, and it can be considered a "temporary" time (for example, less than 0.5 seconds).

[0156] Next, the gaze detection unit 102 detects the direction of the driver P's gaze (step S7).

[0157] Next, the display control unit 108 determines whether the driver P's line of sight is directed toward risk indicator 2 (step S8).

[0158] In step S8, the display control unit 108 makes a determination based on the direction of the line of sight detected in step S7 and the position of the risk indicator 2 in the captured image SG shown by the data received from the risk indicator detection unit 101.

[0159] If the display control unit 108 determines that the driver P's gaze is directed toward risk indicator 2 (step S8: Yes), the processor 100 ends the process.

[0160] On the other hand, if the display control unit 108 determines that the driver P's line of sight is not directed toward the risk indicator 2 (step S8: no), it temporarily displays the visibility reduction image VG (step S9).

[0161] Step S9 is equivalent to "display step".

[0162] In step S9, the display control unit 108 displays the visibility reduction image VG for a second time period. The second time is a longer time than the aforementioned first time, for example, 0.5 seconds. However, this example of the second time is just one example and is not limited to 0.5 seconds. The second time can be any time longer than the first time, as long as it can be considered a "temporary" time (e.g., less than 0.5 seconds).

[0163] Additionally, in step S9, the display control unit 108 displays a visibility reduction image VG that further reduces the visibility of the driver P compared to the visibility reduction image VG displayed in step S6.

[0164] Returning to the explanation of step S5, it is shown that if the control unit 108 determines that the TTC calculated in step S4 is lower than the specified value (step S5: no), it determines whether the vehicle 1 has an automatic driving function (step S10).

[0165] Step S10 will be described in detail. Whether vehicle 1 has autonomous driving capabilities is stored as data in memory 110. Then, display control unit 108 refers to the data stored in memory 110 to determine whether vehicle 1 has autonomous driving capabilities.

[0166] If it is determined that vehicle 1 has autonomous driving function (step S10: Yes), the display control unit 108 sends an autonomous driving start instruction to the autonomous driving device 27 to start autonomous driving (step S11). As a result, the display control unit 108 enables the autonomous driving function of vehicle 1.

[0167] Next, the processor 100 transfers the processing to step S6 and executes the processing after step S6.

[0168] On the other hand, if it is determined that vehicle 1 does not have autonomous driving function (step S10: No), the display control unit 108 temporarily displays the reduced visibility image VG (step S12). In step S12, the display control unit 108 displays the reduced visibility image VG for a first time period.

[0169] Step S12 is equivalent to "display step".

[0170] Returning to the explanation of step S3, if the determination unit 105 determines that the image VG with reduced visibility cannot be displayed (step S3: not displayable), the display control unit 108 determines whether the vehicle 1 has an autonomous driving function (step S13). The determination in step S13 is performed using the same method as the determination in step S10.

[0171] If the display control unit 108 determines that the vehicle 1 has an autonomous driving function (step S13: Yes), the processor 100 transfers the processing to step S6 and executes the processing after step S6.

[0172] On the other hand, if the display control unit 108 determines that the vehicle 1 does not have an autonomous driving function (step S13: No), the speaker control unit 107 outputs sound through the speaker 17 (step S14).

[0173] Step S14 will be described in detail.

[0174] The speaker control unit 107 selects the speaker 17 to output sound based on the position of the risk indicator 2 in the captured image SG shown in the data received from the risk indicator detection unit 101. For example, if the position of the risk indicator 2 in the captured image SG is to the left of the area that can be considered the center in the left-right direction of the captured image SG, the speaker control unit 107 selects speaker 14 as the speaker 17 to output sound. Alternatively, if the position of the risk indicator 2 in the captured image SG is within the area that can be considered the center in the left-right direction of the captured image SG, the speaker control unit 107 selects speakers 14 and 15 as the speakers 17 to output sound. For example, if the position of the risk indicator 2 in the captured image SG is to the right of the area that can be considered the center in the left-right direction of the captured image SG, the speaker control unit 107 selects speaker 15 as the speaker 17 to output sound.

[0175] Next, the speaker control unit 107 outputs sound from the selected speaker 17.

[0176] Furthermore, if sound such as content has already been output from speaker 17 during step S14, speaker control unit 107 cancels the sound such as content and outputs sound through the selected speaker 17.

[0177] [4. Other Implementation Methods]

[0178] The above-described implementation is merely one approach, which can be arbitrarily modified and applied.

[0179] In the above embodiment, a speaker 17 is exemplified as a "stimulus output device," outputting sound as a "stimulus." That is, in the above embodiment, the speaker 17 outputs sound to the driver P when the determination unit 105 determines that the reduced visibility image VG cannot be displayed, and the display control unit 108 does not display the reduced visibility image VG. However, the type of "stimulus" applied to the driver P in this case is not limited to sound; for example, it could also be vibration. For example, in other embodiments, a vibration output device that vibrates the steering wheel and driver's seat 10A may be connected to the vehicle display device 23, and vibration may be applied to the driver P by the vibration output device when the determination unit 105 determines that the reduced visibility image VG cannot be displayed and the display control unit 108 does not display the reduced visibility image VG.

[0180] In other embodiments, the display control unit 108 may also emphasize the display risk indicator range R1 on the windshield 20 when the TTC calculated by the TTC calculation unit 106 is lower than a predetermined value, without displaying the reduced visibility image VG on the windshield 20. In this other embodiment, the display control unit 108 may emphasize the display risk indicator range R1, for example, by making the entire area of ​​the risk indicator range R1 display a predetermined color, or by making the edges of the risk indicator range R1 display a predetermined color. Alternatively, in this other embodiment, regardless of the determination result of the determination unit 105, the display control unit 108 may emphasize the display risk indicator range R1 on the windshield 20 when the TTC calculated by the TTC calculation unit 106 is lower than a predetermined value. Furthermore, this predetermined value is preferably set to be lower than the predetermined value compared in step S5.

[0181] In the above embodiments, vehicle 1, which is a four-wheeled automobile, is exemplified as a "vehicle", but any "vehicle" with a windshield 20 is acceptable, and the number of wheels is not limited to four.

[0182] In the above embodiment, the image is displayed on the windshield 20 by the HUD19. However, the unit that displays the image on the windshield 20 can be any unit that displays a virtual image on the windshield 20, and is not limited to the HUD19. For example, it can also be a display unit such as an LED (Light Emitting Diode).

[0183] The processor 100 can be composed of multiple processors or a single processor. The processor 100 can be hardware programmed to implement the functions described above. In this case, the processor 100 is, for example, composed of an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0184] in addition, Figure 3 The structure of each part of the vehicle 1 shown is an example, and the specific installation method is not particularly limited. That is, it is not necessarily necessary to install hardware corresponding to each part separately; of course, it is also possible to configure the vehicle so that the functions of each part are implemented by a processor executing a program. In addition, some of the functions implemented by software in the above embodiments can be implemented as hardware, or some of the functions implemented by hardware can be implemented by software.

[0185] in addition, Figure 7 The steps shown are divided according to the main processing content, and this invention is not limited by the method of dividing the processing units or their names. It is also possible to divide the process into more step units based on the processing content. Alternatively, it is possible to divide the process into units containing more processes within a single step unit. Furthermore, the order of these steps can be appropriately changed without affecting the spirit of this invention.

[0186] Furthermore, when using the processor 100 to implement the control method of the vehicle display device 23 described above, the program executed by the processor 100 can also be configured as a recording medium or a transmission medium for transmitting the program. That is, the control program 111 can also be implemented by recording the control program 111 in a removable information recording medium. Examples of information recording media include magnetic recording media such as hard disks, optical recording media such as CDs, USB (Universal Serial Bus) memory, SSD (Solid State Drive) and other semiconductor storage devices, or other recording media can be used.

[0187] The above implementation supports the following structures.

[0188] (Structure 1)

[0189] A vehicle display device includes: a detection unit that detects a risk indicator present in front of the vehicle and that may come into contact with the vehicle; and a display control unit that displays an image on the windshield of the vehicle, wherein the display control unit temporarily displays a visibility-reducing image on the windshield in a range other than the risk indicator range corresponding to the risk indicator detected by the detection unit, thereby reducing the visibility of the driver of the vehicle.

[0190] According to the vehicle display device of Structure 1, risk indicators can be temporarily emphasized in the windshield, and the driver can be stimulated regarding the risk indicators for a short period of time. Therefore, it can increase the driver's ability to grasp the risk indicators while suppressing boredom with the images displayed on the windshield.

[0191] (Structure 2)

[0192] According to the vehicle display device of structure 1, the vehicle display device has a determination unit that determines whether the reduced visibility image can be displayed. The determination unit determines whether the reduced visibility image can be displayed based on at least one of the following: information about the road on which the vehicle is traveling, the time until contact with the risk indicator, the distance from the driver's viewpoint to the risk indicator on the windshield, the driver's state, and the presence or absence of the vehicle's driving assistance functions.

[0193] Depending on the road the vehicle is traveling on, there may be situations where it is preferable not to display the reduced visibility image. Additionally, depending on the time until contact with the risk indicator, there may be situations where it is preferable not to display the reduced visibility image. Furthermore, depending on the distance between the driver's viewpoint on the windshield and the risk indicator, there may be situations where it is preferable not to display the reduced visibility image. Furthermore, depending on the driver's state, there may be situations where it is preferable not to display the reduced visibility image. Additionally, depending on the presence or absence of driver assistance functions in the vehicle, there may be situations where it is preferable not to display the reduced visibility image. Therefore, according to structure 2, a reduced visibility image can be displayed under appropriate conditions.

[0194] (Structure 3)

[0195] According to the vehicle display device of structure 2, when the determination unit determines that the visibility reduction image can be displayed, the display control unit displays the visibility reduction image for a first time period. If the driver's gaze is not directed toward the risk indicator after the visibility reduction image is displayed for the first time period, the display control unit displays the visibility reduction image for a second time period longer than the first time period.

[0196] According to the vehicle display device in Structure 3, when the driver's gaze is not directed towards the risk indicator, the image with reduced visibility is temporarily displayed again. Therefore, it is possible to increase the driver's ability to perceive the risk indicator while suppressing the unnecessary display of the image on the windshield.

[0197] (Structure 4)

[0198] According to the vehicle display device of structure 3, the visibility reduction image displayed at the second time is an image that reduces the driver's visibility compared to the visibility reduction image displayed at the first time.

[0199] According to the vehicle display device of structure 4, risk indicators can be further emphasized compared with the first-display image with reduced visibility, thus further increasing the likelihood that the driver can grasp the risk indicators.

[0200] (Structure 5)

[0201] According to any one of structures 2 to 4, in the case where the determination unit determines that the reduced visibility image cannot be displayed, the display control unit, if the vehicle has an automatic driving function, enables the automatic driving function and then displays the reduced visibility image.

[0202] According to the vehicle display device of structure 5, compared with the case where the vehicle does not have autonomous driving function, it can display images with reduced visibility for more risk indicators, which can increase the likelihood that the driver can grasp more risk indicators.

[0203] (Structure 6)

[0204] According to any one of structures 2 to 5, the vehicle display device is connected to a stimulus output device that outputs stimuli other than those displayed to the driver. The vehicle display device has a stimulus control unit that controls the stimulus output device. If the determination unit determines that the reduced visibility image cannot be displayed, the display control unit does not display the reduced visibility image if the vehicle does not have an autonomous driving function, and the stimulus control unit causes the stimulus output device to output the stimulus.

[0205] According to the vehicle display device of structure 6, by applying stimulation, the likelihood of the driver grasping risk indicators can be increased even when images with reduced visibility cannot be displayed.

[0206] (Structure 7)

[0207] According to any one of structures 1 to 6, the range of the risk indicator is based on the position and magnitude of the risk indicator and the position of the driver's eyes in the vehicle.

[0208] According to the vehicle display device of structure 7, when the driver observes the windshield, the risk indicators can be appropriately emphasized to the driver without any sense of incongruity, which can further increase the driver's ability to grasp the risk indicators.

[0209] (Structure 8)

[0210] According to the vehicle display device of structure 7, the range of risk indicators is based on the range of information about the road on which the vehicle is traveling.

[0211] According to the vehicle display device of structure 8, the risk indicator range can be set to a range that takes into account information about the road on which the vehicle is traveling, and the risk indicator can be emphasized according to the road on which the vehicle is traveling. Therefore, the likelihood of the driver mastering the risk indicator can be further improved.

[0212] (Structure 9)

[0213] According to the vehicle display device of structure 8, when the risk indicator includes people and objects other than people, the display control unit displays the reduced visibility image based on information about the road on which the vehicle is traveling, such that the people or objects are included in the risk indicator range.

[0214] According to the vehicle display device of structure 9, when the risk indicators include people and objects other than people, it is possible to emphasize the risk indicators corresponding to the road on which the vehicle is traveling.

[0215] (Structure 10)

[0216] According to any one of structures 1 to 9, the vehicle display device wherein the display control unit emphasizes the range of the risk indicator when the time until the vehicle comes into contact with the risk indicator is less than a predetermined value.

[0217] According to the vehicle display device of structure 10, when the possibility of contact with risk indicators is high, it can increase the likelihood of the driver mastering the risk indicators, thereby increasing the likelihood of avoiding contact between the risk indicators and the vehicle.

[0218] (Structure 11)

[0219] A control method for a vehicle display device includes: a detection step of detecting a risk indicator present in front of the vehicle and potentially in contact with the vehicle; and a display step of displaying an image on the windshield of the vehicle, wherein, in the display step, a visibility-reducing image that reduces the visibility of the driver of the vehicle is temporarily displayed on the windshield in a range other than the risk indicator range corresponding to the risk indicator detected by the detection step.

[0220] According to the control method of the vehicle display device of structure 11, it will achieve the same effect as the vehicle display device of structure 1.

[0221] (Structure 12)

[0222] A computer program product includes a program that causes a processor to function as: a detection unit that detects risk indicators present in front of a vehicle and potentially in contact with the vehicle; and a display control unit that displays an image on the windshield of the vehicle, wherein the display control unit temporarily displays a visibility-reducing image on the windshield, in a range other than the risk indicator range corresponding to the risk indicator detected by the detection unit, thereby reducing the visibility of the driver of the vehicle.

[0223] The computer program product according to Structure 12 will have the same effect as the vehicle display device of Structure 1.

Claims

1. A vehicle display device, comprising: The detection unit detects risk indicators located in front of the vehicle that may come into contact with it; and The display control unit displays an image on the windshield of the vehicle. The display control unit temporarily displays a visibility-reducing image on the windshield, outside the range of the risk indicator corresponding to the risk indicator detected by the detection unit, which reduces the visibility of the driver of the vehicle.

2. The vehicle display device according to claim 1, wherein, The vehicle display device includes a determination unit that determines whether the reduced visibility image can be displayed. The determination unit determines whether the visibility reduction image can be displayed based on at least one of the following: information about the road the vehicle is traveling on, the time until it comes into contact with the risk indicator, the distance from the driver's viewpoint to the risk indicator on the windshield, the driver's state, and the presence or absence of the vehicle's driver assistance functions.

3. The vehicle display device according to claim 2, wherein, If the determination unit determines that the image with reduced visibility can be displayed, the display control unit displays the image with reduced visibility for a first time period. If the driver's gaze is not directed toward the risk indicator after the reduced visibility image is displayed at the first time, the display control unit displays the reduced visibility image for a second time period longer than the first time.

4. The vehicle display device according to claim 3, wherein, The reduced visibility image displayed at the second time is an image that reduces the driver's visibility compared to the reduced visibility image displayed at the first time.

5. The vehicle display device according to claim 2, wherein, If the determination unit determines that the image with reduced visibility cannot be displayed, When the vehicle has an autonomous driving function, the display control unit activates the autonomous driving function and then displays the image with reduced visibility.

6. The vehicle display device according to claim 2, wherein, The vehicle display device is connected to a stimulus output device that outputs stimuli other than those displayed to the driver. The vehicle display device has a stimulation control unit that controls the stimulation output device. If the determination unit determines that the image with reduced visibility cannot be displayed, The display control unit does not display the reduced visibility image when the vehicle does not have autonomous driving function, and the stimulation control unit causes the stimulation output device to output the stimulation.

7. The vehicle display device according to any one of claims 1 to 6, wherein, The risk indicator range is based on the location and magnitude of the risk indicator, as well as the range of the driver's eye position in the vehicle.

8. The vehicle display device according to claim 7, wherein, The risk indicator range is based on information about the roads the vehicle is traveling on.

9. The vehicle display device according to claim 8, wherein, When the risk indicator includes people and objects other than people, the display control unit displays the reduced visibility image based on information about the road the vehicle is traveling on, such that the people or objects are included in the risk indicator range.

10. The vehicle display device according to any one of claims 1 to 6, wherein, If the time until the vehicle comes into contact with the risk indicator is less than a predetermined value, the display control unit will emphasize the range of the risk indicator.

11. A control method for a vehicle display device, comprising: The detection steps include detecting risk indicators located in front of the vehicle that may come into contact with it; and The display step involves displaying an image on the windshield of the vehicle. In the display step, A visibility-reducing image that reduces the visibility of the vehicle driver is temporarily displayed on the windshield, except for the range of risk indicators corresponding to the risk indicators detected by the detection steps.

12. A computer program product comprising a program that causes a processor to function as a component: The detection unit detects risk indicators located in front of the vehicle that may come into contact with it; and The display control unit displays an image on the windshield of the vehicle. The display control unit temporarily displays a visibility-reducing image on the windshield, outside the range of the risk indicator corresponding to the risk indicator detected by the detection unit, which reduces the visibility of the driver of the vehicle.

Images