In-vehicle display device and program

The in-vehicle display device addresses the lack of timely and informative warnings by generating distance-based images on the vehicle's front window, enhancing driver awareness of obstacles and reducing eye fatigue.

JP7577991B2Active Publication Date: 2024-11-06RICOH CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2020204820
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-12-26
Filing Date
2020-12-10
Publication Date
2024-11-06
Estimated Expiration
2040-12-10

AI Technical Summary

Technical Problem

Existing technologies fail to provide appropriate warnings to drivers when the time to reach an obstacle is less than 2 seconds and do not inform the driver of the type of obstacle or necessary actions.

Method used

An in-vehicle display device that calculates the distance to an object and generates attention-grabbing images using characters or figures when the distance is less than a threshold, and displays these images on the vehicle's front window using a head-up display.

Benefits of technology

The device effectively alerts drivers to potential and actual risks by displaying appropriate images, reducing eye strain and improving reaction time through clear and timely warnings.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007577991000001
    Figure 0007577991000001
  • Figure 0007577991000002
    Figure 0007577991000002
  • Figure 0007577991000003
    Figure 0007577991000003
Patent Text Reader

Abstract

To make it possible to give more proper display of alerting to a driver of a vehicle.SOLUTION: An onboard display device is mounted in a vehicle, and includes: a calculation unit that calculates a distance from the vehicle to an object; an image production unit that, when the distance calculated by the calculation unit is smaller than a predetermined first threshold, uses a character string alone or a character string and graphic to produce a first image of alerting to the object, and that, when the distance calculated by the calculation unit is larger than the first threshold, uses the graphic alone to produce a second image of alerting to the object; and a display unit that uses a display device to display the first or second image produced by the image production unit.SELECTED DRAWING: Figure 6
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an in-vehicle display device and a program. [Background technology]

[0002] The technology disclosed in Patent Document 1 below predicts the arrival time of an obstacle with the aim of reducing the sense of annoyance felt by the driver, and immediately sounds an alarm if the arrival time is within 2 seconds, and presents a visual alarm if the arrival time is 2 seconds or more. Summary of the Invention [Problem to be solved by the invention]

[0003] However, the technology disclosed in the following Patent Document 1 cannot display a warning when the arrival time to an obstacle is within 2 seconds. The technology disclosed in the following Patent Document 1 only issues an alarm sound when the arrival time to an obstacle is within 2 seconds, so the driver cannot know the type of obstacle or the action that the driver should take.

[0004] As such, the conventional technology is unable to provide a more appropriate warning display to the driver of the vehicle.

[0005] In order to solve the above-mentioned problems of the conventional technology, the present invention has an object to make it possible to display a more appropriate warning to a driver of a vehicle. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems, the in-vehicle display device of the present invention is an in-vehicle display device mounted on a vehicle, and includes a calculation unit that calculates the distance from the vehicle to an object, an image generation unit that generates a first image that draws attention to the object using only character strings or character strings and figures when the distance calculated by the calculation unit is smaller than a predetermined first threshold, and generates a second image that draws attention to the object using only figures when the distance calculated by the calculation unit is greater than the first threshold, and a display unit that displays the first image or the second image generated by the image generation unit using a display device. Effect of the Invention

[0007] According to the present invention, a more appropriate warning message can be displayed to a driver of a vehicle. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an example of a virtual image displayed on a front window by the in-vehicle display device according to the first embodiment of the present invention. [Diagram 2] FIG. 1 is a diagram showing a schematic diagram of an example of an internal arrangement of a vehicle equipped with an in-vehicle display device according to a first embodiment of the present invention; [Diagram 3] FIG. 2 is a diagram showing a schematic configuration example of an optical system included in the in-vehicle display device according to the first embodiment of the present invention; [Figure 4] FIG. 1 is a diagram showing an example of the configuration of a control system included in an in-vehicle display device according to a first embodiment of the present invention; [Diagram 5] FIG. 1 is a diagram showing an example of a schematic configuration of an in-vehicle display device and peripheral devices according to a first embodiment of the present invention; [Figure 6] FIG. 1 is a diagram showing a functional configuration of an in-vehicle display device according to a first embodiment of the present invention; [Figure 7] 1 is a flowchart showing a procedure of processing by an in-vehicle display device according to a first embodiment of the present invention; [Figure 8] FIG. 1 is a diagram showing an example of a displayed image of an actual risk notifying the user of the vehicle-mounted display device according to the first embodiment of the present invention; [Figure 9] FIG. 1 is a diagram showing an example of a displayed image of an actual risk notifying the user of the vehicle-mounted display device according to the first embodiment of the present invention; [Figure 10] FIG. 1 is a diagram showing an example of a potential risk notification image displayed by the in-vehicle display device according to the first embodiment of the present invention; [Figure 11] 10 is a flowchart showing a procedure of processing by an in-vehicle display device according to a second embodiment of the present invention. [Figure 12] FIG. 13 is a diagram showing a functional configuration of an in-vehicle display device according to a third embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0010] [First embodiment] Fig. 1 is a diagram showing an example of a virtual image displayed on a front window 21 by the in-vehicle display device 100 according to the first embodiment of the present invention. Fig. 2 is a diagram showing a schematic diagram of an example of the internal arrangement of a host vehicle 30 equipped with the in-vehicle display device 100 according to the first embodiment of the present invention. Fig. 3 is a diagram showing a schematic diagram of an example of the configuration of an optical system 230 provided in the in-vehicle display device 100 according to the first embodiment of the present invention.

[0011] 2, the in-vehicle display device 100 according to the present embodiment is installed, for example, in the dashboard of the vehicle 30, which is a traveling body as a moving body. Projection light L, which is image light emitted from the in-vehicle display device 100 in the dashboard, is reflected by the windshield 21, which is a light-transmitting member, and is irradiated toward the driver 20, who is a viewer. This allows the driver 20 to view a route navigation image, etc., described later, as a virtual image G. Note that a combiner, which is a light-transmitting member, may be installed on the inner wall surface of the windshield 21, so that the driver 20 can view the virtual image G by the projection light L reflected by the combiner.

[0012] A forward photographing camera 22 and a driver camera 23 are disposed above the windshield 21. The forward photographing camera 22 photographs the forward area. The forward area photographed by the forward photographing camera 22 includes the display information displayed by the in-vehicle display device 100 on the windshield 21 and its background. That is, the forward photographing camera 22 photographs the display information displayed by the in-vehicle display device 100 reflected on the windshield 21, and also photographs the background through the windshield 21. The background photographed by the forward photographing camera 22 through the windshield 21 is the environment in front of the vehicle 30 (i.e., the vehicle ahead, the road surface, etc.). The driver camera 23 photographs the driver 20 to detect the driver 20's viewpoint position.

[0013] In this embodiment, the optical system 230 of the in-vehicle display device 100 is designed so that the distance from the driver 20 to the virtual image G is 5 m or more. If the distance to the virtual image G is 5 m or more as in this embodiment, the driver 20 moves the crystalline lens of the eye less than in the past, shortening the time required for focusing on the virtual image G and allowing the driver 20 to recognize the contents of the virtual image G early. In addition, eye fatigue of the driver 20 can be reduced. Furthermore, the driver 20 is more likely to notice the contents of the virtual image G, and it becomes easier to provide information to the driver 20 appropriately through the virtual image G. If the distance to the virtual image G is 5 m or more, the driver 20 can focus on the virtual image G with almost no convergence movement of the eyes. Therefore, the effect of using motion parallax to perceive a sense of distance (change in perceived distance) and a sense of depth (difference in perceived distance) is suppressed from being diluted by the convergence movement of the eyes. Therefore, the information perception effect of the driver 20 using the sense of distance and the sense of depth of the image can be effectively exerted.

[0014] The optical system 230 of the in-vehicle display device 100 shown in Fig. 3 includes red, green, and blue laser light sources 201R, 201G, and 201B, collimator lenses 202, 203, and 204 provided for each laser light source, and two dichroic mirrors 205 and 206. The optical system 230 further includes a light amount adjustment unit 207, an optical scanning device 208 as an optical scanning unit, a free curved surface mirror 209, a microlens array 210 as a light diverging member, and a projection mirror 211 as a light reflecting member. In the light source unit 220, the laser light sources 201R, 201G, and 201B, the collimator lenses 202, 203, and 204, and the dichroic mirrors 205 and 206 are unitized by an optical housing.

[0015] LDs (semiconductor laser elements) can be used as the laser light sources 201R, 201G, and 201B. The wavelength of the light beam emitted from the red laser light source 201R is, for example, 640 nm, the wavelength of the light beam emitted from the green laser light source 201G is, for example, 530 nm, and the wavelength of the light beam emitted from the blue laser light source 201B is, for example, 445 nm.

[0016] In the in-vehicle display device 100 according to this embodiment, an intermediate image formed on the microlens array 210 is projected onto the front window 21 of the vehicle 30, and an enlarged image of the intermediate image is visually recognized by the driver 20 as a virtual image G. The laser light of each color emitted from the laser light sources 201R, 201G, and 201B is converted into approximately parallel light by the collimator lenses 202, 203, and 204, respectively, and then combined by the two dichroic mirrors 205 and 206. The combined laser light has its light amount adjusted by the light amount adjustment unit 207, and is deflected by the mirror of the optical scanning device 208 to two-dimensionally scan the free-form surface mirror 209. The scanning light L' that is deflected by the optical scanning device 208 to two-dimensionally scan the free-form surface mirror 209 is reflected by the free-form surface mirror 209 and distortion is corrected, and then the scanning light L' is focused on the microlens array 210, and an intermediate image G' is drawn on the microlens array 210.

[0017] In this embodiment, the microlens array 210 is used as a light diverging member that individually diverges and emits the light beam for each pixel (point in the intermediate image) of the intermediate image G', but other light diverging members may be used. Also, the intermediate image G' may be formed by a method using a liquid crystal display (LCD) or a fluorescent display tube (VFD). However, in order to display a large virtual image G with high brightness, the laser scanning method as in this embodiment is preferable.

[0018] According to the laser scanning method as in the present embodiment, the laser light sources 201R, 201G, and 201B are turned off to completely prevent light from being irradiated onto the non-image portion in the display area of ​​the virtual image G. This makes it possible to avoid a situation in which the visibility of the scenery ahead of the vehicle 30 through the non-image portion is reduced by the light irradiated from the in-vehicle display device 100, and the visibility of the scenery ahead can be further improved. Furthermore, the laser scanning method is also suitable for performing display control such as partially increasing the brightness of a part of the image included in the virtual image G displayed by the in-vehicle display device 100.

[0019] The optical scanning device 208 tilts the mirror in the main scanning direction and the sub-scanning direction using a known actuator driving system such as MEMS (Micro Electro Mechanical Systems), and deflects the laser light incident on the mirror to two-dimensionally scan (raster scan) the free curved mirror 209. The mirror is driven and controlled in synchronization with the emission timing of the laser light sources 201R, 201G, and 201B. Note that the optical scanning device 208 is not limited to the above-mentioned configuration, and may be, for example, an optical scanning device of a mirror system including two mirrors that oscillate or rotate around two axes that are perpendicular to each other.

[0020] FIG. 4 is a diagram showing an example of the configuration of a control system 250 included in the in-vehicle display device 100 according to the first embodiment of the present invention. As shown in FIG. 4, the control system 250 includes a field programmable gate array (FPGA) 251, a central processing unit (CPU) 252, a read-only memory (ROM) 253, a random access memory (RAM) 254, an interface (hereinafter referred to as I / F) 255, a bus line 256, an LD driver 257, and a MEMS controller 258. The FPGA 251 controls the operation of the laser light sources 201R, 201G, and 201B of the light source unit 220 using the LD driver 257, and controls the operation of the MEMS 208a of the optical scanning device 208 using the MEMS controller 258. The CPU 252 realizes each function of the in-vehicle display device 100. The ROM 253 stores various programs such as an image processing program executed by the CPU 252 to realize each function of the in-vehicle display device 100. The RAM 254 is used as a work area for the CPU 252. The I / F 255 is an interface for communicating with an external controller or the like, and is connected to a vehicle navigation device 40, various sensors 50, and the like via a controller area network (CAN) of the host vehicle 30, for example.

[0021] The I / F 255 is also connected to a front-side photographing camera 22 that photographs the area in front of the vehicle 30, i.e., the front-side photographing camera 22 that photographs the display information displayed by the in-vehicle display device 100 and reflected on the windshield 21, and photographs the background through the windshield 21. The I / F 255 is further connected to a driver camera 23 for detecting the viewpoint position of the driver 20. Based on the detected viewpoint position of the driver 20, the control system 250 performs image processing on the image of the display information and its background photographed by the front-side photographing camera 22, thereby converting the image into an image viewed from the viewpoint position of the driver 20. The control system 250 detects the viewpoint position of the driver 20, for example, by performing image analysis on the image of the head of the driver 20 photographed by the driver camera 23.

[0022] 5 is a diagram showing an example of a schematic configuration of an in-vehicle display device 100 and peripheral devices according to the first embodiment of the present invention. In this embodiment, a vehicle navigation device 40, a sensor 50, and the like are provided as an information acquisition unit that acquires driver-provided information provided to a driver 20 by a virtual image G. The in-vehicle display device 100 mainly includes an optical system 230, which is an example of a display unit, and a control system 250, which is an example of a control unit.

[0023] As the vehicle navigation device 40 according to this embodiment, a known vehicle navigation device mounted on an automobile or the like can be widely used. Information used to generate a route navigation image to be displayed as a virtual image G is output from the vehicle navigation device 40, and this information is input to the control system 250. The route navigation image includes, for example, an image showing information such as the number of lanes (driving lanes) of the road on which the vehicle 30 is traveling, the distance to the point where the next course change (right turn, left turn, branch, etc.) should be made, the direction of the next course change, etc., as shown in FIG. 1. This information is input from the vehicle navigation device 40 to the control system 250. As a result, under the control of the control system 250, the in-vehicle display device 100 displays route navigation images such as a driving lane indication image 711, a vehicle distance presentation image 712, a course designation image 721, a remaining distance image 722, and an intersection name image 723 as a virtual image G in the upper image display area A.

[0024] 1, the in-vehicle display device 100 displays an image indicating road-specific information (road name, speed limit, etc.) as a virtual image G in the lower image display area B. This road-specific information is also input from the vehicle navigation device 40 to the control system 250. As a result, under the control of the control system 250, the in-vehicle display device 100 displays a road name display image 701, a speed limit display image 702, an overtaking prohibition display image 703, etc., corresponding to the road-specific information, as virtual images in the lower image display area B.

[0025] The sensor 50 in FIG. 5 includes one or more sensors for detecting various information indicating the behavior of the host vehicle 30, the state of the host vehicle 30, the situation around the host vehicle 30, and the like. The sensor 50 outputs sensing information used to generate an image to be displayed as a virtual image G, and this sensing information is input to the control system 250. For example, in the image example shown in FIG. 1, the in-vehicle display device 100 displays a vehicle speed display image 704 (a text image of "83km / h" in the example of FIG. 1) indicating the vehicle speed of the host vehicle 30 as a virtual image in the lower image display area B. That is, the vehicle speed information included in the CAN information of the host vehicle 30 is input from the sensor 50 to the control system 250, and under the control of the control system 250, the in-vehicle display device 100 displays the text image indicating the vehicle speed as a virtual image G in the lower image display area B.

[0026] The sensor 50 may include, in addition to a sensor for detecting the vehicle speed of the vehicle 30, for example, (1) a laser radar device or an imaging device for detecting the distance to other vehicles, pedestrians, or structures (guardrails, utility poles, etc.) present around the vehicle 30 (in front, on the side, or behind), a sensor for detecting external environmental information of the vehicle (outside temperature, brightness, weather, etc.), (2) a sensor for detecting the driving operation of the driver 20 (brake operation, accelerator opening and closing degree, etc.), (3) a sensor for detecting the remaining amount of fuel in the fuel tank of the vehicle 30, (4) a sensor for detecting the state of various in-vehicle devices such as the engine and the battery, etc. By sending the information detected by the sensor 50 to the control system 250, the in-vehicle display device 100 can display the information as a virtual image G and provide it to the driver 20.

[0027] Next, a description will be given of the virtual image G displayed by the in-vehicle display device 100. In the in-vehicle display device 100 of this embodiment, the driver-provided information provided to the driver 20 by the virtual image G may be any information that is useful to the driver 20. In this embodiment, for convenience, the driver-provided information is broadly divided into passive information and active information.

[0028] Passive information is information that is passively recognized by the driver 20 when a predetermined information provision condition is satisfied. Therefore, information provided to the driver 20 at a set timing of the in-vehicle display device 100 is included in the passive information. In addition, information having a certain relationship between the timing at which the information is provided and the content of the information provided is also included in the passive information. Examples of passive information include information related to safety during driving, route navigation information, and the like. Examples of information related to safety during driving include information indicating the distance between the vehicle 30 and the preceding vehicle 350 (vehicle distance presentation image 712), and information of urgency related to driving (warning information or attention calling information such as emergency operation instruction information that instructs the driver to perform an emergency operation). In addition, the route navigation information is information for guiding the driver along a driving route to a preset destination, and may be the same information as information provided to the driver by a known vehicle navigation device. Examples of route navigation information include driving lane instruction information (driving lane instruction image 711) that indicates the driving lane to be driven in at the nearest intersection, and course change operation instruction information that indicates the course change operation at the next intersection or branch point where the course should be changed from the straight ahead direction, etc. Examples of course change operation instruction information include course designation information (course designation image 721) that specifies which course to take at an intersection, etc., information showing the remaining distance to the intersection, etc. where the course change operation is performed (remaining distance image 722), information showing the name of the intersection, etc. (intersection, etc. name image 723), etc.

[0029] Active information is information that is actively recognized by the driver 20 at a timing that the driver decides for himself / herself. It is sufficient for the active information to be provided to the driver 20 at a timing desired by the driver 20. For example, information in which there is a low or no relationship between the timing at which the information is provided and the content of the information is included in the active information. Since the active information is information that the driver 20 obtains at a timing desired by the driver 20, the active information is information that is displayed for a certain long period of time or all the time. For example, the active information includes information specific to the road on which the vehicle 30 is traveling, vehicle speed information of the vehicle 30 (vehicle speed display image 704), current time information, etc. Examples of the road specific information include information related to the road that is useful to the driver 20, such as information indicating the road name (road name display image 701), information indicating the regulation details such as the speed limit of the road (speed limit display image 702, no-overtaking display image 703), etc.

[0030] In this embodiment, the passive information and active information, which are broadly classified as described above, are displayed in the corresponding display areas capable of displaying the virtual image G. Specifically, in this embodiment, two display areas aligned vertically are set as areas in which the in-vehicle display device 100 displays the virtual image. Of these, the upper image display area A mainly displays passive information images corresponding to passive information, and the lower image display area B mainly displays active information images corresponding to active information. When a part of an active information image is displayed in the upper image display area A, the active information image is displayed in a manner that prioritizes the visibility of the passive information image displayed in the upper image display area A.

[0031] In this embodiment, a stereoscopic image expressed using stereoscopic vision is used as the virtual image G displayed by the in-vehicle display device 100. Specifically, a perspective image expressed using perspective is used as the following distance presenting image 712 and the driving lane indication image 711 displayed in the upper image display area A where the in-vehicle display device 100 displays the virtual image.

[0032] Specifically, the five horizontal lines included in the following distance presenting image 712 are displayed so that the lengths become shorter toward the upper side. That is, the following distance presenting image 712 is a perspective image drawn by a perspective projection method so as to move toward one vanishing point. In particular, in this embodiment, the following distance presenting image 712 is formed so that the vanishing point is determined near the gaze point of the driver 20. As a result, the driver 20 who is driving can easily perceive the sense of depth of the following distance presenting image 712. Furthermore, in this embodiment, the following distance presenting image 712 as a perspective image is displayed in such a manner that the width of the horizontal lines becomes thinner toward the upper side, or the brightness of the horizontal lines becomes lower toward the upper side. As a result, the driver 20 who is driving can more easily perceive the sense of depth of the following distance presenting image 712.

[0033] (Functional configuration of the in-vehicle display device 100) Fig. 6 is a diagram showing a functional configuration of an in-vehicle display device 100 according to a first embodiment of the present invention. As described with reference to Figs. 1 to 5, the in-vehicle display device 100 shown in Fig. 6 is a device mounted on a vehicle such as an automobile. The in-vehicle display device 100 can display information that calls the driver's attention to objects around the vehicle at a position visible to the driver inside the vehicle (for example, on the front window). Examples of objects include people, animals, installations, obstacles, vehicles, etc.

[0034] As shown in FIG. 6, the in-vehicle display device 100 includes a vehicle information acquisition unit 102, an environmental information acquisition unit 104, a calculation unit 110, an image generation unit 112, and an image display unit 114.

[0035] The vehicle information acquisition unit 102 acquires information about the vehicle (hereinafter, referred to as "own vehicle information"). For example, the vehicle information acquisition unit 102 acquires vehicle speed information, steering wheel steering angle information, and the like (but is not limited to these) from an ECU (Electronic Control Unit) equipped in the vehicle via a CAN (Controller Area Network).

[0036] The environmental information acquisition unit 104 acquires information on the environment around the vehicle (hereinafter, referred to as "environmental information"). For example, the environmental information acquisition unit 104 acquires a relative speed ΔVt between the vehicle and an object, and a distance D between the vehicle and the object, as an example of environmental information. For example, the environmental information acquisition unit 104 acquires the relative speed ΔVt from a speed calculation device (e.g., ECU, etc.) capable of calculating the relative speed ΔVt. Also, for example, the environmental information acquisition unit 104 acquires the distance D from a distance calculation device (e.g., distance sensor, etc.) capable of calculating the distance D. Note that the in-vehicle display device 100 may include at least one of the speed calculation device and the distance calculation device. Also, the environmental information acquisition unit 104 may acquire various environmental information from an in-vehicle device (e.g., ECU, various sensors, etc.) or may acquire it from outside the vehicle via communication.

[0037] The calculation unit 110 calculates an arrival time t required for the vehicle to reach the object, based on the relative speed ΔV and the distance D acquired by the environmental information acquisition unit 104. For example, the calculation unit 110 calculates the arrival time t by the formula {t=D / ΔV}.

[0038] The image generating unit 112 generates an image for calling the driver's attention to the object, based on the arrival time t calculated by the calculating unit 110.

[0039] For example, when the arrival time t is greater than a predetermined first threshold th1, the image generator 112 generates a potential risk notification image (an example of a "second image") that relatively lightly alerts the driver to the object. The potential risk notification image is an image that alerts the driver to the object using only a graphic.

[0040] Also, for example, when the arrival time t is equal to or less than a predetermined first threshold th1, the image generating unit 112 generates an apparent risk notification image (an example of a "first image") that relatively strongly draws the driver's attention to the object. The apparent risk notification image is an image that draws attention to the object by using only a character string, or a character string and a graphic.

[0041] The image display unit 114 uses the head-up display 120 (optical system 230) to display the image (potential risk notification image or actual risk notification image) generated by the image generation unit 112 at a position on the vehicle's front window (or a transparent plate) that can be seen by the driver. The image display unit 114 can also use the head-up display 120 (optical system 230) to display various types of host vehicle information (e.g., vehicle speed information, steering wheel steering angle information, etc.) acquired by the vehicle information acquisition unit 102 at a position on the vehicle's front window (or a transparent plate) that can be seen by the driver.

[0042] In this embodiment, the head-up display 120 (optical system 230) is used as an example of the display device, but is not limited thereto. For example, a meter panel, a navigation device, etc. may be used as the display device. In addition, the display device may be one that is integrally provided in the main body of the in-vehicle display device 100, or one that is externally connected to the main body of the in-vehicle display device 100.

[0043] 4, the in-vehicle display device 100 has a computer including a CPU 252, a ROM 253, a RAM 254, etc. The in-vehicle display device 100 realizes each of the above functions by the CPU 252 using the RAM 254 as a storage area and executing a program stored in the ROM 253.

[0044] In addition, each of the above functions of the in-vehicle display device 100 may be physically realized by one device, or may be physically realized by multiple devices. In addition, some of the above functions may be realized by using those provided in other devices (for example, ECU, external server, etc.).

[0045] (Processing procedure by the in-vehicle display device 100) FIG. 7 is a flowchart showing the procedure of processing by the in-vehicle display device 100 according to the first embodiment of the present invention.

[0046] First, the environmental information acquisition unit 104 acquires the relative speed ΔV between the vehicle and the dangerous object and the distance D between the vehicle and the dangerous object as environmental information (step S201). Note that instead of acquiring the relative speed ΔV, the in-vehicle display device 100 may acquire the host vehicle speed V2 and the object speed V1, respectively, and calculate the relative speed ΔV by the formula {ΔV=V2-V1}.

[0047] Next, the calculation unit 110 calculates the arrival time t to the object based on the relative speed ΔV and the distance D calculated in step S201 (step S202).

[0048] Next, the image generating unit 112 determines whether the arrival time t calculated in step S202 is greater than a predetermined first threshold th1 (for example, 3 seconds) (step S203).

[0049] In step S203, if it is determined that the arrival time t is greater than the first threshold th1 (step S203: Yes), the environmental information acquisition unit 104 acquires relative position information of the object (step S204). Then, the image generation unit 112 generates a potential risk notification image (step S205).

[0050] Furthermore, the image display unit 114 uses the head-up display 120 (optical system 230) to display the potential risk notification image generated in step S205 at a position on the front windshield of the vehicle that corresponds to the relative position information acquired in step S204 (i.e., a position overlapping with the target person) (step S206). After that, the in-vehicle display device 100 ends the series of processes shown in FIG. 7.

[0051] On the other hand, if it is determined in step S203 that the arrival time t is not greater than the predetermined first threshold th1 (step S203: No), the image generation unit 112 generates an apparent risk notification image (step S207). Then, the image display unit 114 displays the apparent risk notification image generated in step S207 at a predetermined position on the front window of the vehicle using the head-up display 120 (optical system 230) (step S208). After that, the in-vehicle display device 100 ends the series of processes shown in FIG. 7.

[0052] (Example of an image showing actual risk) Figures 8 and 9 are diagrams showing an example of a potential risk notification image displayed by the in-vehicle display device 100 according to the first embodiment of the present invention. Figures 8 and 9 show the view ahead of the vehicle as seen by the driver of the vehicle through the front window of the vehicle.

[0053] In the examples shown in Figures 8 and 9, since the arrival time t until the vehicle reaches the person 10 is smaller than a predetermined first threshold th1 (e.g., 3 seconds), an apparent risk notification image 300 or an apparent risk notification image 400 is displayed on the front window of the vehicle.

[0054] 8, since the distance D from the vehicle to the person 10 is short, an apparent risk notification image 300, which uses only a character string to alert the person 10, is displayed on the front window of the vehicle above the vehicle speed display image 302. The apparent risk notification image 300 is an image that only contains the character string "BRAKE!", which indicates the action that the driver should take.

[0055] 9, since the distance D from the vehicle to the person 10 is closer, an apparent risk notification image 400, which uses a character string and a graphic to alert the person 10, is displayed on the front window of the vehicle above the vehicle speed display image 402. The apparent risk notification image 400 is an image having the character string "BRAKE!", which indicates the action the driver should take, and a graphic that decorates the periphery of the character string with the color red, which signifies "warning."

[0056] In this way, when the arrival time t until the vehicle reaches the person 10 is less than a predetermined first threshold th1 (e.g., 3 seconds), the in-vehicle display device 100 according to the first embodiment can display the apparent risk notification image 300, 400 using only a character string or a character string and a figure on the front window of the vehicle to severely alert the person 10 using the head-up display 120 (optical system 230). This allows the in-vehicle display device 100 according to the first embodiment to allow the driver to accurately and quickly understand the avoidance action instruction content for the apparent risk. Therefore, the in-vehicle display device 100 according to the first embodiment can display a more appropriate alert to the driver of the vehicle.

[0057] Furthermore, when the arrival time t required for the vehicle to reach the person 10 is shorter than a predetermined first threshold th1, the in-vehicle display device 100 according to the first embodiment can display multiple apparent risk notification images in stages according to the distance D from the vehicle to the person 10. This allows the in-vehicle display device 100 according to the first embodiment to more effectively allow the driver to recognize the presence of an apparent risk.

[0058] However, without being limited to this, the in-vehicle display device 100 may display a single potential risk notification image regardless of the distance D from the vehicle to the person 10 when the arrival time t for the vehicle to reach the person 10 is smaller than a predetermined first threshold th1.

[0059] Furthermore, the present risk notification images 300, 400 may have animation effects (for example, blinking, brightness change, color conversion, shape change, etc.). This allows the in-vehicle display device 100 according to the first embodiment to more effectively allow the driver to recognize the presence of a present risk.

[0060] In addition, the apparent risk notification images 300, 400 may have a string representing the type of object (e.g., "Watch out for people!") in addition to, or instead of, a string representing the action the driver should take (e.g., "BRAKE!").

[0061] (Example of a potential risk notification image) Fig. 10 is a diagram showing an example of a potential risk notification image displayed by the in-vehicle display device 100 according to the first embodiment of the present invention. Like Fig. 8 and Fig. 9, Fig. 10 shows the view ahead of the vehicle as seen by the driver of the vehicle through the front window of the vehicle.

[0062] 10, the arrival time t until the vehicle reaches person 10 is greater than a predetermined first threshold th1 (e.g., 3 seconds), so a potential risk notification image 500 calling the attention of person 10 is displayed on the front window of the vehicle at a position overlapping person 10 as seen by the driver. Potential risk notification image 500 is an image using a ring-shaped figure that decorates the periphery of person 10 with yellow, which signifies "caution."

[0063] In this way, when the arrival time t for the vehicle to reach the person 10 is greater than a predetermined first threshold th1 (e.g., 3 seconds), the in-vehicle display device 100 according to the first embodiment can display a potential risk notification image 500 that lightly alerts the person 10 at a position overlapping with the person 10 on the front window of the vehicle using the head-up display 120 (optical system 230). This allows the in-vehicle display device 100 according to the first embodiment to notify the driver of a potential risk without bothering the driver. Therefore, the in-vehicle display device 100 according to the first embodiment can display a more appropriate alert for the driver of the vehicle.

[0064] The potential risk notification image 500 may have animation effects (for example, blinking, brightness change, color change, shape change, etc.). This allows the in-vehicle display device 100 according to the first embodiment to more effectively allow the driver to recognize the presence of a potential risk.

[0065] Second Embodiment Next, a second embodiment will be described with reference to Fig. 11. The second embodiment differs from the first embodiment in the procedure of processing by the in-vehicle display device 100.

[0066] (Processing procedure by the in-vehicle display device 100) FIG. 11 is a flowchart showing the procedure of processing by the in-vehicle display device 100 according to the second embodiment of the present invention.

[0067] First, the environmental information acquisition unit 104 acquires, as environmental information, the relative speed ΔV between the vehicle and the hazardous object, and the distance D between the vehicle and the hazardous object (step S601).

[0068] Next, the calculation unit 110 calculates the arrival time t to the object based on the relative speed ΔV and the distance D calculated in step S601 (step S602).

[0069] Next, the image generating unit 112 determines whether the arrival time t calculated in step S602 is greater than a predetermined second threshold th2 (e.g., 5 seconds) (step S603). Note that the predetermined second threshold th2 is a value greater than the predetermined first threshold th1.

[0070] In step S603, if it is determined that the arrival time t is greater than the predetermined second threshold th2 (step S603: Yes), the in-vehicle display device 100 ends the series of processes shown in FIG.

[0071] On the other hand, if it is determined in step S603 that the arrival time t is not greater than the predetermined second threshold th2 (step S603: No), the image generation unit 112 determines whether the arrival time t calculated in step S602 is greater than a predetermined first threshold th1 (e.g., 3 seconds) (step S604).

[0072] In step S604, if it is determined that the arrival time t is greater than the first threshold th1 (step S604: Yes), the environmental information acquisition unit 104 acquires relative position information of the object (step S605). Then, the image generation unit 112 generates a potential risk notification image (step S606).

[0073] Furthermore, the image display unit 114 uses the head-up display 120 (optical system 230) to display the potential risk notification image generated in step S606 at a position on the front windshield of the vehicle that corresponds to the relative position information acquired in step S605 (i.e., a position overlapping with the target person) (step S607). After that, the in-vehicle display device 100 ends the series of processes shown in FIG.

[0074] On the other hand, if it is determined in step S604 that the arrival time t is not greater than the predetermined first threshold th1 (step S604: No), the image generation unit 112 generates an apparent risk notification image (step S608). Then, the image display unit 114 displays the apparent risk notification image generated in step S608 at a predetermined position on the front window of the vehicle using the head-up display 120 (optical system 230) (step S609). After that, the in-vehicle display device 100 ends the series of processes shown in FIG. 11.

[0075] In this way, the in-vehicle display device 100 according to the second embodiment does not display either the potential risk notification image or the actual risk notification image when the arrival time t is greater than a predetermined second threshold th2 (e.g., 5 seconds). This allows the in-vehicle display device 100 according to the second embodiment to suppress frequent display of the potential risk notification image and the actual risk notification image, which is bothersome to the driver.

[0076] Third Embodiment Next, a third embodiment will be described with reference to Fig. 12. Fig. 12 is a diagram showing a functional configuration of an in-vehicle display device 100A according to a third embodiment of the present invention. The in-vehicle display device 100A shown in Fig. 12 differs from the in-vehicle display device 100 according to the first embodiment in that it further includes a driver information acquisition unit 106.

[0077] The driver information acquisition unit 106 acquires information on the mental and physical state of the driver (hereinafter, referred to as "mental and physical condition information"). For example, the driver information acquisition unit 106 acquires, as mental and physical condition information, electrocardiogram information detected by an electrocardiogram sensor, heart rate information detected by a heart rate sensor, blood pressure information detected by a blood pressure sensor, body temperature information detected by a body temperature sensor, pulse information detected by a pulse sensor, respiration information detected by a respiration sensor, sweat information detected by a sweat sensor, blink information detected by a blink sensor, pupil information detected by a pupil sensor, brain wave information detected by an brain wave sensor, muscle information detected by a muscle sensor, and the like.

[0078] For example, the in-vehicle display device 100A may display the mental and physical state information acquired by the driver information acquisition unit 106 on the front window of the vehicle using the image display unit 114. Also, for example, the in-vehicle display device 100A may dynamically change the processing logic according to the mental and physical state information acquired by the driver information acquisition unit 106. For example, when the in-vehicle display device 100A determines that the driver is in an awake state based on the mental and physical state information acquired by the driver information acquisition unit 106, the in-vehicle display device 100A may suppress the animation effect of the potential risk notification image and the actual risk notification image to suppress annoyance to the driver.

[0079] Although the preferred embodiments of the present invention have been described in detail above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention described in the claims. [Explanation of symbols]

[0080] 100,100A in-vehicle display device 102 Vehicle information acquisition unit 104 Environmental Information Acquisition Department 106 Driver Information Acquisition Unit 110 Calculation section 112 Image Generation Unit 114 Image display unit 120 Head-up display 300 Actual Risk Notification Images 400 Actual Risk Notification Images 500 Potential Risk Notification Images [Prior art documents] [Patent documents]

[0081] [Patent Document 1] JP 2001-023094 A

Claims

1. An in-vehicle display device mounted in a vehicle, A calculation unit that calculates a distance from the vehicle to an object; an image generating unit that generates a first image for calling attention to the object by using only a character string or a character string and a graphic when the distance calculated by the calculation unit is smaller than a predetermined first threshold, and generates a second image for calling attention to the object by using only a graphic when the distance calculated by the calculation unit is greater than the first threshold; a display unit that displays the first image or the second image generated by the image generation unit using a display device; Equipped with the display device is a head-up display that displays the first image or the second image generated by the image generation unit in front of a driver of the vehicle, The display unit is When the second image is generated by the image generating unit, the second image is displayed at a position overlapping with the object as seen from the driver.

1. An in-vehicle display device comprising:

2. The graphics have animation effects 2. The in-vehicle display device according to claim 1 .

3. The distance calculated by the calculation unit is a predetermined second threshold value that is greater than the first threshold value. If the difference is greater than the threshold, neither the first image nor the second image is displayed.

3. The in-vehicle display device according to claim 1, wherein the display device is a display unit that displays an image on a display screen.

4. The character string represents a type of the object or an action that the driver of the vehicle should take. The in-vehicle display device according to any one of claims 1 to 3.

5. A program for an in-vehicle display device mounted in a vehicle, Computer, A calculation unit that calculates a distance from the vehicle to an object; If the distance calculated by the calculation unit is smaller than a predetermined first threshold, a first image is generated to call attention to the object by using only a character string or a character string and a graphic; an image generating unit that generates a second image for calling attention to the object by using only a graphic when the distance calculated by the calculating unit is greater than the first threshold value; and a display unit that displays the first image or the second image generated by the image generation unit using a display device; Functioning as a the display device is a head-up display that displays the first image or the second image generated by the image generation unit in front of a driver of the vehicle, The display unit is When the second image is generated by the image generating unit, the second image is displayed at a position overlapping with the object as seen from the driver. program.

Citation Information

Patent Citations

  • Semi-automatic driving system

    JP2001023094A

  • Information providing device, information providing method, and control program for providing information

    JP2016109645A

  • Display control device, display, and display control method

    JP2017035972A

  • Display control apparatus

    JP2019188843A