Vehicle display device
The vehicle display device enhances marker image visibility by adjusting their position based on vehicle and road features, addressing issues of misrecognition and overlap.
Patent Information
- Application Number
- JP2022136080
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-08-29
- Publication Date
- 2024-11-06
- Estimated Expiration
- 2042-08-29
AI Technical Summary
Marker images in vehicle display devices are difficult to see and may be misrecognized when displayed on objects other than vehicles or road markings, leading to reduced visibility.
A vehicle display device that includes a control unit to adjust the position of marker images based on the relative position and trajectory of preceding vehicles, using virtual straight lines and steering angles to ensure the marker images are displayed at optimal positions relative to the vehicle and road features.
Improves the visibility of marker images by preventing overlap with other vehicles or road markings, ensuring they are clearly visible to the driver.
Smart Images

Figure 0007578386000001 
Figure 0007578386000002 
Figure 0007578386000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a display device for a vehicle. [Background technology]
[0002] Conventionally, there is an augmented reality head-up display device (AR-HUD) that displays a display image such as a marker image by following the target object such as a preceding vehicle and superimposing it. Patent Document 1 discloses a vehicle display device that, when the preceding vehicle deviates outside one of the vehicle width direction side ends of a display area, continues to display a marker image in the peripheral portion of the vehicle width direction side end on the deviated side, and additionally displays a mark indicating the position of the preceding vehicle outside the display range. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Patent No. 6536855 Summary of the Invention [Problem to be solved by the invention]
[0004] In a vehicle display device, when a marker image displayed in correspondence with an object such as a preceding vehicle overlaps with an object (such as a vehicle) other than the object or with colored lines on the road (center line, shoulder strip, and lane boundary line), the marker image is not only difficult to see but may also be misrecognized. Therefore, it is desired to improve the visibility of the marker image in the vehicle display device.
[0005] An object of the present invention is to provide a display device for a vehicle that can improve the visibility of a marker image. [Means for solving the problem]
[0006] The vehicle display device of the present invention includes a display device that is mounted on a vehicle and displays an image on a front windshield of the vehicle by superimposing it on an actual scene in front of the vehicle, a control unit that controls the display device, and a position information acquisition unit that acquires a position of a leading vehicle that the vehicle is following. The control unit calculates a first virtual straight line connecting the position of the leading vehicle acquired by the position information acquisition unit and a position of the vehicle. When the control unit determines that the first virtual straight line is along the straight-ahead direction of the vehicle, the control unit displays a marker image at a position below the leading vehicle as viewed from a viewpoint position of the vehicle. When the control unit determines that the first virtual straight line is inclined with respect to the straight-ahead direction, the control unit performs display movement control to display the marker image by shifting it from the position below the leading vehicle in a direction opposite to a tilt direction of the first virtual straight line with respect to the straight-ahead direction. In the display movement control, an amount by which the marker image is shifted from the position below the leading vehicle is determined based on a tilt of the first virtual straight line with respect to the straight-ahead direction. Effect of the Invention
[0007] Advantageous Effects of Invention According to the vehicle display device of the present invention, an effect is achieved in that the visibility of a marker image can be improved. [Brief description of the drawings]
[0008] [Figure 1] FIG. 1 is a diagram showing a display device for a vehicle according to an embodiment. [Diagram 2] FIG. 2 is a schematic diagram showing an example of a marker image displayed by the vehicle display device according to the embodiment. [Diagram 3] FIG. 3 is a schematic diagram showing an example of a marker image displayed by the vehicle display device according to the embodiment. [Figure 4] FIG. 4 is a schematic diagram showing an example of a marker image displayed by the vehicle display device according to the embodiment. [Diagram 5] FIG. 5 is a schematic diagram showing an example of a marker image displayed by the vehicle display device according to the embodiment. [Figure 6]FIG. 6 is a schematic diagram showing an example of a marker image displayed by the vehicle display device according to the embodiment. [Figure 7] FIG. 7 is a schematic diagram showing an example of a marker image displayed by the vehicle display device according to the embodiment. [Figure 8] FIG. 8 is a schematic diagram showing an example of a marker image displayed by the vehicle display device according to the embodiment. [Figure 9] FIG. 9 is a flowchart illustrating a method for displaying a marker image by the vehicle display device according to the embodiment. [Figure 10] FIG. 10 is a diagram showing an example of a marker image displayed by the vehicle display device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] Hereinafter, a vehicle display device according to an embodiment of the present invention will be described in detail with reference to the drawings. Note that the present invention is not limited to the embodiment. In addition, the components in the following embodiments include those that a person skilled in the art can easily imagine or that are substantially the same.
[0010] [Embodiment] An embodiment will be described with reference to Fig. 1 to Fig. 10. The embodiment relates to a vehicle display device. Fig. 1 is a diagram showing a vehicle display device according to an embodiment, Fig. 2 is a schematic diagram showing a display example of a marker image by the vehicle display device according to an embodiment, Fig. 3 is a schematic diagram showing a display example of a marker image by the vehicle display device according to an embodiment, Fig. 4 is a schematic diagram showing a display example of a marker image by the vehicle display device according to an embodiment, Fig. 5 is a schematic diagram showing a display example of a marker image by the vehicle display device according to an embodiment, Fig. 6 is a schematic diagram showing a display example of a marker image by the vehicle display device according to an embodiment, Fig. 7 is a schematic diagram showing a display example of a marker image by the vehicle display device according to an embodiment, Fig. 8 is a schematic diagram showing a display example of a marker image by the vehicle display device according to an embodiment, and Fig. 9 is a flow chart showing a method of displaying a marker image by the vehicle display device according to an embodiment.
[0011] The vehicle display device 1 according to the embodiment is an augmented reality head-up display device (AR-HUD) mounted on a vehicle 100 such as an automobile. The vehicle display device 1 projects display light of an image toward the windshield. The windshield is a reflecting portion located in front of the driver's seat in the vehicle 100. The windshield has, for example, semi-transparency, and reflects the display light incident from the vehicle display device 1 toward the eye point EP of the vehicle 100. The driver of the vehicle 100 recognizes the image reflected by the windshield as a virtual image. The driver recognizes the virtual image as if it exists in front of the windshield.
[0012] In this specification, unless otherwise specified, the "front-rear direction" refers to the front-rear direction of the vehicle 100 in which the vehicle display device 1 is mounted. In addition, unless otherwise specified, the "vehicle width direction" refers to the vehicle width direction of the vehicle 100, and the "up-down direction" refers to the vehicle up-down direction of the vehicle 100.
[0013] As shown in FIG. 1, a display device 1 for a vehicle according to the embodiment includes a display unit 11, a control unit 12, an external information acquisition unit 13, and a host vehicle information acquisition unit .
[0014] The display device 11 performs AR (augmented reality) display by superimposing a virtual image on the scenery in the forward field of view of the vehicle 100 based on information from the control unit 12, which will be described later.
[0015] The display 11 has a liquid crystal display unit, a backlight, and a mirror (not shown). The liquid crystal display unit is a liquid crystal display device such as a TFT-LCD (Thin Film Transistor-Liquid Crystal Display), and displays any image, for example, a color image. The backlight irradiates light from the rear side of the liquid crystal display unit, and projects the image displayed on the liquid crystal display unit toward the mirror. The mirror reflects the image projected from the liquid crystal display unit toward the windshield. The image projected from the mirror is reflected by the windshield toward the viewpoint position EP of the vehicle. The image reflected by the windshield is formed as a virtual image at a position forward of the vehicle 100 from the windshield when viewed by the driver.
[0016] Here, the viewpoint position EP is typically assumed in advance to be located within a so-called eye range in the vehicle 100 to which the vehicular display device 1 is applied. Here, the eye range is the "driver's eye range of an automobile" and corresponds to a region in which the driver's viewpoint, which is determined in advance for each vehicle, is located. The eye range typically represents a statistical distribution of the driver's eye position in the vehicle 100, and corresponds to a region that includes a predetermined proportion (e.g., 95%) of the driver's eye positions when the driver is sitting in the driver's seat. Here, the viewpoint position EP is assumed to be based on the driver of the vehicle 100.
[0017] The control unit 12 controls the display device 11 to display a marker image MI that emphasizes the presence of display objects such as the preceding vehicle 200 (see Figs. 2 to 7), another vehicle 300 (see Fig. 7) other than the preceding vehicle 200, and an oncoming vehicle 400 (see Fig. 8). Here, the other vehicle 300 is a vehicle traveling in the same direction in a lane other than the lane in which the vehicle 100 and the preceding vehicle 200 are traveling. The oncoming vehicle 400 is a vehicle traveling in the oncoming lane.
[0018] In the embodiment, the external information acquisition unit 13 includes a position information acquisition unit 13a, a driving trajectory acquisition unit 13b, and a road shape detection unit 13c. The external information acquisition unit 13 in the embodiment is configured by an electronic control unit (ECU) of an advanced driver assistance system (ADAS), an electronic control unit (ECU) of a navigation device, and peripheral devices (auxiliaries) mounted on the vehicle 100 and capable of acquiring information outside the vehicle 100.
[0019] In the embodiment, the vehicle 100 is equipped with a front camera 31 and an on-board sensor 32. The position information acquisition unit 13a, the travel trajectory acquisition unit 13b, and the road shape detection unit 13c are configured to be able to communicate with the front camera 31 and the on-board sensor 32. In addition, the travel trajectory acquisition unit 13b and the road shape detection unit 13c are configured to acquire navigation information 33.
[0020] The front camera 31 is mounted at a position where it can capture an image of the scenery ahead of the vehicle 100. For example, it is disposed on the roof or the rearview mirror inside the vehicle 100. The front camera 31 continuously captures images of the scenery ahead of the vehicle 100, and acquires images or videos of the scenery ahead of the vehicle 100. The vehicle camera 31 sequentially outputs the captured images or videos to the position information acquisition unit 13a.
[0021] The on-vehicle sensor 32 detects the preceding vehicle 200 and the other vehicle 300. For example, a LiDAR (Laser Imaging Detection and Ranging) or a radar sensor is used as the on-vehicle sensor 32. The on-vehicle sensor 32 can detect, for example, the relative position and relative speed of the preceding vehicle 200 with respect to the vehicle 100. The on-vehicle sensor 32 can also detect the size and shape of the preceding vehicle 200. Furthermore, the on-vehicle sensor 32 can also detect, for example, the relative position and relative speed of the other vehicle 300 and the oncoming vehicle 400 with respect to the vehicle 100. Furthermore, the on-vehicle sensor 32 can also detect, for example, the size and shape of the other vehicle 300 and the oncoming vehicle 400.
[0022] The navigation information 33 includes, for example, information on the shape of the road on which the vehicle 100 is traveling and information on the traveling conditions of the preceding vehicle 200, the other vehicle 300, and the oncoming vehicle 400. For example, the navigation information 33 includes three-dimensional map information and two-dimensional map information. The navigation information 33 may also include information on the positions and shapes of colored lines (center lines, side strips, and lane boundary lines) CL on the road.
[0023] The host vehicle information acquisition unit 14 acquires information about the vehicle 100. The vehicle 100 is equipped with instruments 41 such as a steering wheel steering angle sensor, a speedometer, an angular acceleration meter, and an accelerometer. The host vehicle information acquisition unit 14 is configured to be able to communicate with these instruments 41, and acquires information about the steering wheel steering angle, speed, angular acceleration, and acceleration of the vehicle 100. In the embodiment, the host vehicle information acquisition unit 14 receives information about the steering wheel steering angle of the vehicle 100 detected by the steering wheel steering angle sensor.
[0024] The control unit 12 includes a power switch 12a, a System-on-a-Chip (SoC) 12b, non-volatile memories such as a ROM 12c and a RAM 12d, a communication I / F 12e, and an external I / F 12f.
[0025] The power switch 12a is connected to a power source Bn of the vehicle 100, and turns the power of the display device 1 for vehicles on and off.
[0026] The SoC 12b includes a central processing unit (CPU), a graphics processing unit (GPU), a chipset, etc. The SoC 12b is connected to the display 11, the meters 21 of the vehicle 100, the ROM 12c, the RAM 12d, the communication I / F 12e, and the external I / F 12f. The SoC 12b performs various calculation processes such as calculations for performing AR display.
[0027] The ROM 12c is an internal storage of the control unit 12, and stores data necessary for the control unit 12 to control the display 11. The ROM 12c also stores data newly acquired by the control unit 12. For example, the ROM 12c may store an AR display data set for performing AR display. The RAM 12d is a memory of the control unit 12, and the RAM 12d temporarily stores data retrieved from the ROM 12c, data acquired from the external information acquisition unit 13 and the vehicle information acquisition unit 14, and the like, and is used for arithmetic processing in the SoC 12b.
[0028] The communication I / F 12e connects the SoC 12b and the external information acquisition unit 13. The SoC 12b acquires information about the outside of the vehicle 100 from the external information acquisition unit 13 via the communication I / F 12e.
[0029] The external I / F 12f connects the SoC 12b and the host vehicle information acquisition unit 14. The SoC 12b acquires information about the vehicle 100 from the host vehicle information acquisition unit 14 via the external I / F 12f.
[0030] In the embodiment, the control unit 12 controls the display 11 to display the marker image MI as an AR display image. The marker image MI displayed as the AR display image is displayed so as to correspond to and follow the movement of the preceding vehicle 200 or the like that is the display target. As shown in Figs. 2 and 3, the marker image MI in the embodiment is displayed in the shape of a bar extending along the vehicle width direction.
[0031] The marker image MI is displayed at a position below the leading vehicle 200. When the driver of the vehicle 100 views the marker image MI displayed at a position below the leading vehicle 200 from the viewpoint position EP, the driver perceives the marker image MI at a position shifted from the actual display position MO due to an illusion. Specifically, the marker image MI is perceived as being shifted from the actual display position MO to the rear side of the leading vehicle 200. As a result, the marker image MI is perceived as if it is following behind the leading vehicle 200.
[0032] If the distance between vehicle 100 and preceding vehicle 200 in the forward / backward direction is L1, the amount of deviation of marker image MI from actual display position MO due to the illusion is L2, the height from the ground to the viewpoint position EP of vehicle 100 is h, the height of preceding vehicle 200 from the ground is D, and the distance in the vertical direction between preceding vehicle 200 and actual display position MO of the marker image is d, then the amount of deviation L2 of marker image MI from actual display position MO due to the illusion is expressed by the following formula (1). L2 = d × L1 ÷ (h + d) (1)
[0033] The deviation amount L2 of the marker image MI may be calculated by multiplying the relative speed between the vehicle 100 and the preceding vehicle 200 by a coefficient determined in advance according to the delay time (seconds) of the vehicle 100. Here, the delay time (seconds) of the vehicle 100 is the elapsed time until the vehicle 100 reaches a position where the preceding vehicle 200 has passed.
[0034] Moreover, the shift amount L2 of the marker image MI may be a constant that is determined in advance according to the size and shape of the preceding vehicle 200. This constant is set in consideration of the size, shape, etc. of the preceding vehicle 200 so that the marker image MI is appropriately visually recognized by the preceding vehicle 200.
[0035] In the embodiment, the SoC 12b acquires the position information of the preceding vehicle 200 detected by the position information acquisition unit 13a via the communication I / F. The position information acquisition unit 13a in the embodiment corresponds to an electronic control unit (ECU) of an advanced driver assistance system (ADAS). Note that, if the position information of the preceding vehicle 200 can be acquired by a navigation device, the position information acquisition unit 13a may correspond to the electronic control unit (ECU) of the navigation device. Also, if the position information of the preceding vehicle 200 can be acquired by some auxiliary device, the position information acquisition unit 13a may correspond to the auxiliary device.
[0036] The position information acquisition unit 13a of the embodiment acquires the position of the preceding vehicle 200 traveling ahead of the vehicle 100 by the forward camera 31 and the in-vehicle sensor 32. Furthermore, when there are other vehicles 300 other than the preceding vehicle 200 and oncoming vehicles 400 ahead of the vehicle 100, the position information acquisition unit 13a can also acquire the positions of these vehicles. The control unit 12 calculates, by the SoC 12b, a first virtual straight line VL1 (see FIGS. 4 to 7) connecting the position of the preceding vehicle 200 acquired by the position information acquisition unit 13a and the position of the vehicle 100.
[0037] The control unit 12 uses the SoC 12b to compare the straight-line direction X1 of the vehicle 100 with the first virtual straight line VL1, and determines whether the first virtual straight line VL1 is aligned with the straight-line direction X1 of the vehicle 100. As shown in FIG. 4, when the vehicle 100 and the preceding vehicle 200 that the vehicle 100 is following are traveling on a straight lane, the first virtual straight line VL1 is aligned with the straight-line direction X1 of the vehicle 100. When the control unit 12 determines that the first virtual straight line VL1 is aligned with the straight-line direction X1 of the vehicle 100, the control unit 12 controls the display 11 to display the marker image MI at a position below the preceding vehicle 200 as viewed from the viewpoint position EP of the vehicle 100, as shown in FIGS. 2 and 4. At this time, the marker display MI is displayed below the preceding vehicle 200 so that the center of the preceding vehicle 200 in the vehicle width direction and the center of the marker image MI in the vehicle width direction overlap with each other.
[0038] On the other hand, as shown in FIG. 5, when the preceding vehicle 200 is traveling on a curved portion of the lane and the vehicle 100 is traveling on a straight portion of the lane, the first virtual straight line VL1 is inclined with respect to the straight-line direction X1 of the vehicle 100. When the control unit 12 determines that the first virtual straight line VL1 is inclined with respect to the straight-line direction X1, the control unit 12 performs display movement control to display the marker image MI shifted from a position below the preceding vehicle 200 in a direction opposite to the inclination direction of the first virtual straight line VL1 with respect to the straight-line direction X1. Here, the amount of shifting of the marker image MI from the position below the preceding vehicle 200 is represented by an angle AS that is an angle formed between the first virtual straight line VL1 and a second virtual straight line VL2 that connects the center of the front of the vehicle 100 in the vehicle width direction and the center of the marker image MI. Then, an angle A2 that is an angle formed between the straight-line direction X1 and the second virtual straight line VL2 is represented by A2=A1-AS.
[0039] In the display movement control, the marker image MI is displayed shifted a predetermined amount from a position below the preceding vehicle 200, thereby preventing the marker image MI from being displayed overlapping with the colored line CL and another vehicle 300 traveling in a different lane when viewed from the viewpoint position EP of the vehicle 100.
[0040] 6 and 7, when the vehicle 100 and the preceding vehicle 200 are both traveling in a curved portion of the travel lane, the amount by which the marker image MI is shifted may be corrected by the steering angle of the steering wheel. In this case, in the display movement control, the amount AS by which the marker image MI is shifted from a position below the preceding vehicle 200 is determined based on the inclination of the first virtual straight line VL1 with respect to the straight-ahead direction X1 and the steering angle of the steering wheel of the vehicle 100.
[0041] In the display movement control, the shift amount AS is expressed by the following formula (2), where A1 is the angle between the straight-ahead direction X1 and the first virtual straight line VL1, and θ is the steering angle of the steering wheel. Note that the steering angle of the steering wheel is positive when it coincides with the inclination direction of the first virtual straight line VL1 with respect to the straight-ahead direction X1. AS = A1 ÷ 2 + θ (2)
[0042] The control unit 12 performs display movement control by displaying the marker image MI so that the second virtual straight line VL2 is shifted by a shift amount AS relative to the first virtual straight line VL1 in the opposite direction to the inclination direction of the first virtual straight line VL1 relative to the straight-ahead direction X1.
[0043] Note that, when the steering angle θ of the steering wheel is equal to or smaller than a predetermined threshold, the marker image MI may be displayed without being shifted. The predetermined threshold is, for example, a steering angle of the steering wheel that is small enough that it is considered that there is no problem in displaying the marker image MI in the same way as when the vehicle 100 is traveling straight.
[0044] In addition, in the display movement control, the amount AS by which the marker image MI is shifted from a position below the leading vehicle 200 may be determined based only on the inclination of the first virtual straight line VL1 with respect to the straight-ahead direction X1, regardless of the shape of the travel lane of the vehicle 100. In this case, the amount AR by which the marker image MI is shifted is, for example, half the angle A1 formed between the straight-ahead direction X1 and the first virtual straight line VL1.
[0045] Furthermore, in the display movement control, the amount AS by which the marker image MI is shifted from a position below the leading vehicle 200 may be determined based on the inclination of the first virtual straight line VL1 with respect to the straight-ahead direction X1 and the distance between the vehicle 100 and the leading vehicle 200. In this case, the amount AS by which the marker image MI is shifted is expressed by the following formula (3), where L1 is the distance between the vehicle 100 and the leading vehicle 200, L2 is the amount of shift of the marker image MI from the actual display position MO due to an illusion, and A1 is the angle formed by the first virtual straight line VL1 with respect to the straight-ahead direction X1. AS = (A1 × L2) ÷ L1 (3)
[0046] Furthermore, in the display movement control, the amount AS by which the marker image MI is shifted from a position below the leading vehicle 200 may be corrected according to the speed of the vehicle 100. In this case, the amount AS by which the marker image MI is shifted from a position below the leading vehicle 200 in the display movement control is determined based on the inclination of the first virtual straight line VL1 with respect to the straight-ahead direction X1 and the speed of the vehicle 100.
[0047] For example, the amount AS by which the marker image MI is shifted is, for example, AS=A1÷2 when the speed of the vehicle 100 is 100 km / h or more, and AS=A1÷(3×2) when the speed of the vehicle 100 is less than 100 km / h.
[0048] 8, the control unit 12 may display a marker image MI for an oncoming vehicle 400 traveling in an oncoming lane. When the speed difference between the vehicle 100 and a vehicle ahead of the vehicle 100 is greater than the speed of the vehicle 100, the control unit 12 determines that the vehicle is the oncoming vehicle 400, and displays the marker image MI without shifting it from a position below the oncoming vehicle 400.
[0049] The traveling locus acquisition unit 13b acquires a traveling locus T1 of the preceding vehicle 200. In the embodiment, the traveling locus acquisition unit 13b corresponds to an electronic control unit (ECU) of an advanced driver assistance system (ADAS). The traveling locus acquisition unit 13b may correspond to an electronic control unit (ECU) of a navigation device. In addition, when the traveling locus of the preceding vehicle 200 can be acquired by some auxiliary device, the traveling locus acquisition unit 13b may correspond to the auxiliary device.
[0050] For example, the traveling trajectory acquisition unit 13b acquires the traveling trajectory T1 of the preceding vehicle 200 from an image or a video acquired from the front camera 31. The traveling trajectory acquisition unit 13b may acquire the traveling trajectory T1 of the preceding vehicle 200 based on information from the in-vehicle sensor 32. In addition, when the traveling trajectory acquisition unit 13b corresponds to an electronic control unit (ECU) of a navigation device, the traveling trajectory of the preceding vehicle 200 may be acquired from the navigation information 33.
[0051] When the control unit 12 can acquire the travel trajectory T1 of the preceding vehicle 200 by the travel trajectory acquisition unit 13b, the control unit 12 performs travel trajectory reference control for displaying the marker image MI so that the center of the marker image MI overlaps with the center of the travel trajectory T1 instead of the display movement control (see Figs. 6 and 7). As a result of the travel trajectory reference control, it is possible to prevent the marker image MI from being displayed so as to overlap with another vehicle 300 (or an oncoming vehicle 400) or a colored line CL.
[0052] For example, when the control unit 12 determines that the first virtual straight line VL1 is inclined with respect to the straight-line direction X1 and the control unit 12 is able to acquire the driving trajectory T1 of the preceding vehicle 200 by the driving trajectory acquisition unit 13b, the control unit 12 performs driving trajectory reference control, instead of display movement control, to display the center of the marker image MI in the vehicle width direction so as to overlap with the center of the driving trajectory T1.
[0053] Then, when the control unit 12 determines that the first virtual straight line VL1 is inclined with respect to the straight-line direction X1 and the control unit 12 is unable to acquire the driving trajectory T1 of the preceding vehicle 200 using the driving trajectory acquisition unit 13b, the control unit 12 performs display movement control.
[0054] The road shape detection unit 13c detects the shape of a road on which vehicles such as the vehicle 100 and the preceding vehicle 200 travel. The road shape detection unit 13c in the embodiment corresponds to an electronic control unit (ECU) of a navigation device. The travel trajectory acquisition unit 13b may correspond to an electronic control unit (ECU) of an advanced driver assistance system (ADAS). In addition, when the road shape can be acquired by some auxiliary device, the road shape detection unit 13c may correspond to the auxiliary device.
[0055] For example, the road shape detection unit 13c detects the road shape from the navigation information 33. When the road shape detection unit 13c corresponds to an electronic control unit (ECU) of an advanced driver assistance system (ADAS), the road shape detection unit 13c detects the road shape from an image or a video acquired from the forward camera 31.
[0056] In the vehicle display device 1 according to the embodiment, when the control unit 12 determines that the first virtual straight line VL1 is inclined with respect to the straight-line direction X1 and the control unit 12 is able to acquire the shape of the driving lane of the preceding vehicle 200 by the road shape detection unit 13c, the control unit 12 performs road shape-based control to display the marker image MI in the center of the driving lane based on the detected shape of the driving lane, instead of the display movement control and the driving trajectory-based control.
[0057] Then, when the control unit 12 determines that the first virtual straight line VL1 is inclined with respect to the straight-ahead direction X1 and the control unit 12 is unable to acquire the shape of the driving lane of the preceding vehicle 200 using the road shape detection unit 13c, the control unit 12 performs display movement control or driving trajectory reference control.
[0058] The road shape detection unit 13c may detect, as the road shape, at least one of a pair of colored lines CL sandwiching the driving lane of the preceding vehicle 200. When the road shape detection unit 13c corresponds to an electronic control unit (ECU) of a navigation device, it detects at least one of the pair of colored lines CL from the navigation information 33. When the road shape detection unit 13c corresponds to an electronic control unit (ECU) of an advanced driver assistance system (ADAS), the road shape detection unit 13c detects at least one of the pair of colored lines CL from an image or video acquired from the forward camera 31.
[0059] In the road shape reference control, the control unit 12 displays the marker image MI in the center of the driving lane based on the position of the colored line CL detected by the road shape detection unit 13c. In addition, when only one of a pair of colored lines CL that sandwich the driving lane of the preceding vehicle 200 can be detected, the control unit 12 may display the marker image MI at a predetermined distance from the detected colored line CL. For example, the control unit 12 may display the marker image MI near the center of the lane by displaying the marker image MI at a distance of 0.75 m inward from the detected colored line CL.
[0060] Next, an example of a display control method for the mark image MI of the vehicle display device 1 according to the embodiment will be described with reference to FIG.
[0061] 9, in step ST1, the control unit 12 judges whether the drawing start flag of the display image is OFF or not. If the result of this judgment is that the drawing start flag is ON, the drawing of the display image is continued and the process returns to step ST1. If the drawing start flag is OFF, the process proceeds to step ST2.
[0062] In step ST2, the control unit 12 determines whether or not the data set for AR display has been acquired (received). If the result of this determination is that the data set for AR display has not been acquired (received), the process returns to step ST1, whereas if the data set for AR display has been acquired (received), the process proceeds to step ST3.
[0063] In step ST3, the control unit 12 determines whether or not there is a preceding vehicle 200 that has requested AR display, such as the preceding vehicle 200. If the result of this determination is that there is no preceding vehicle 200 that has requested AR display, the process returns to step ST1, whereas if there is a preceding vehicle 200 that has requested AR display, the process proceeds to step ST4.
[0064] In step ST4, the control unit 12 determines whether the preceding vehicle 200 is in the AR displayable area. If the result of this determination is that the preceding vehicle 200 is not in the AR displayable area, the process proceeds to step ST5, whereas if the preceding vehicle 200 is in the AR displayable area, the process proceeds to step ST6. Here, the AR displayable area is a display area in the vehicle 100 where an AR display image such as a marker image MI can be displayed by the vehicular display device 1.
[0065] In step ST5, the control unit 12 turns on a drawing start flag, draws a display image different from the marker image MI, and displays it on the display 11. In step ST5, the control unit 12 displays, for example, an ambient display other than AR display or a normal marker image other than AR display as the display image. Then, the process returns to step ST1.
[0066] In step ST6, the control unit 12 stores the relative position between the leading vehicle 200 and the vehicle 100 (host vehicle) based on the information acquired from the external information acquisition unit 13. Then, after that, the process proceeds to step ST7.
[0067] In step ST7, the control unit 12 determines whether the position of the preceding vehicle 200 is in front of the vehicle 100. In the embodiment, the control unit 12 compares the straight-ahead direction X1 of the vehicle 100 with the first virtual straight line VL1 and determines whether the first virtual straight line VL1 is along the straight-ahead direction X1 of the vehicle 100, thereby determining whether the position of the preceding vehicle 200 is in front of the vehicle 100. If the result of the determination in step ST7 is that the position of the preceding vehicle 200 is in front of the vehicle 100 (if the first virtual straight line VL1 is along the straight-ahead direction X1 of the vehicle 100), the process proceeds to step ST8, whereas if the position of the preceding vehicle 200 is not in front of the vehicle 100 (if the first virtual straight line VL1 is inclined with respect to the straight-ahead direction X1 of the vehicle 100), the process proceeds to step S9.
[0068] In step ST8, the control unit 12 calculates the position where the marker image MI is to be displayed based on the distance between the leading vehicle 200 and the vehicle 100 and the size and shape of the leading vehicle 200, turns on the drawing start flag, and starts displaying the mark image MI. Then, the process returns to step ST1.
[0069] In step ST9, the control unit 12 calculates a position for displaying the marker image MI based on the distance between the leading vehicle 200 and the vehicle 100 and the size, shape, etc. of the leading vehicle 200. Then, the process proceeds to step ST10.
[0070] In step ST10, the control unit 12 determines whether or not the road shape detection unit 13c has detected the shape of the right side of the driving lane of the preceding vehicle 200. For example, the control unit 12 determines whether or not a colored line CL existing on the right side of the driving lane of the preceding vehicle 200 has been detected as the shape of the right side of the driving lane of the preceding vehicle 200. If the result of this determination is that the shape of the right side of the driving lane of the preceding vehicle 200 has been detected, the process proceeds to step ST11, whereas if the shape of the right side of the driving lane of the preceding vehicle 200 has not been detected, the process proceeds to step ST12.
[0071] In step ST11, the control unit 12 determines whether or not the road shape detection unit 13c has detected the shape of the left side of the driving lane of the preceding vehicle 200. For example, the control unit 12 determines whether or not a colored line CL existing on the left side of the driving lane of the preceding vehicle 200 has been detected as the shape of the left side of the driving lane of the preceding vehicle 200. If the result of this determination is that the shape of the left side of the driving lane of the preceding vehicle 200 has not been detected, the process proceeds to step ST13, whereas if the shape of the left side of the driving lane of the preceding vehicle 200 has been detected, the process proceeds to step ST14.
[0072] In step ST13, the display position of the marker image MI is calculated based only on the shape of the right side of the driving lane of the preceding vehicle 200, the drawing start flag is turned ON, and road shape reference control is performed. Then, the process returns to step ST1.
[0073] In step ST14, the display position of the marker image MI is calculated based on the left and right shapes of the driving lane of the preceding vehicle 200, the drawing start flag is turned ON, and road shape reference control is performed. Then, the process returns to step ST1.
[0074] In step ST12, similarly to step ST11, the control unit 12 determines whether or not the road shape detection unit 13c has detected the shape of the left side of the driving lane of the preceding vehicle 200. If the result of this determination is that the shape of the left side of the driving lane of the preceding vehicle 200 has not been detected, the process proceeds to step ST15, whereas if the shape of the left side of the driving lane of the preceding vehicle 200 has been detected, the process proceeds to step ST16.
[0075] In step ST15, the display position of the marker image MI is calculated based only on the shape of the left side of the driving lane, the drawing start flag is turned ON, and road shape reference control is performed. Then, the process returns to step ST1.
[0076] In step ST16, the control unit 12 determines whether or not the travel locus acquisition unit 13b has acquired the travel locus T1 of the preceding vehicle 200. If the result of this determination is that the travel locus T1 of the preceding vehicle 200 has been acquired, the process proceeds to step ST17, whereas if the travel locus T1 of the preceding vehicle 200 has not been acquired, the process proceeds to step ST18.
[0077] In step ST17, the control unit 12 calculates the position of the marker image MI based on the travel path T1 of the leading vehicle 200, turns on the drawing start flag, and performs travel path reference control, and then returns to step ST1.
[0078] In step ST18, the control unit 12 determines whether or not the vehicle 100 is traveling straight from the steering angle of the steering wheel of the vehicle 100 acquired by the host vehicle information acquisition unit 14. In the embodiment, the control unit 12 determines that the vehicle 100 is traveling straight when the steering angle of the steering wheel of the vehicle 100 is 0 degrees or an angle equal to or less than a predetermined threshold value. If the result of this determination is that the vehicle 100 is traveling straight, the process proceeds to step ST19, whereas if the steering angle of the steering wheel of the vehicle 100 indicates that the vehicle 100 is not traveling straight, the process proceeds to step ST20.
[0079] In step ST19, the control unit 12 performs display movement control based on the inclination of the first virtual straight line VL1 with respect to the straight-line direction X1. In the display movement control in step ST19, the amount AR by which the marker image MI is shifted from a position below the leading vehicle 200 is determined based on the inclination of the first virtual straight line VL1 with respect to the straight-line direction X1. For example, the amount AR by which the marker image MI is shifted is half the angle formed by the first virtual straight line VL1 and the straight-line direction X1. Then, the process returns to step ST1.
[0080] In step ST20, the control unit 12 performs display movement control based on the steering angle of the steering wheel of the vehicle 100 and the inclination of the first virtual straight line VL1 with respect to the straight ahead direction X1, and then returns to step ST1.
[0081] In the above description, the vehicle display device 1 is provided with the control unit 12 capable of executing all of the display movement control, the travel trajectory-based control, and the road shape-based control, but is not limited thereto. For example, the control unit 12 may be capable of executing only the display movement control and the travel trajectory-based control among the display movement control, the travel trajectory-based control, and the road shape-based control. Also, the control unit 12 may be capable of executing only the display movement control and the road shape-based control among the display movement control, the travel trajectory-based control, and the road shape-based control.
[0082] As described above, the vehicular display device 1 according to the embodiment includes the display device 11 that is mounted on the vehicle 100 and displays an image on the front windshield of the vehicle 100 by superimposing it on an actual scene ahead of the vehicle 100, the control unit 12 that controls the display device 11, and the position information acquisition unit 13a that acquires the position of the preceding vehicle 200 that the vehicle 100 is following. The control unit 12 calculates a first virtual straight line VL1 that connects the position of the preceding vehicle 200 acquired by the position information acquisition unit 13a and the position of the vehicle 100, and determines that the first virtual straight line VL1 is aligned along the straight-ahead direction X1 of the vehicle 100. If this is the case, the control unit 12 displays the marker image MI at a position below the preceding vehicle 200 as viewed from the viewpoint position EP of the vehicle 100, and if the control unit 12 determines that the first virtual straight line VL1 is inclined with respect to the straight-line direction X1, the control unit 12 performs display movement control to display the marker image MI shifted from the position below the preceding vehicle 200 in the opposite direction to the inclination direction of the first virtual straight line VL1 with respect to the straight-line direction X1, and in the display movement control, the amount by which the marker image MI is shifted from the position below the preceding vehicle 200 is determined based on the inclination of the first virtual straight line VL1 with respect to the straight-line direction X1.
[0083] With the above-described configuration, the vehicle display device 1 according to the embodiment can prevent the marker image MI from overlapping with other vehicles 300, oncoming vehicles 400, colored lines CL, etc., even when the road shape or the driving trajectory T1 of the preceding vehicle cannot be detected, thereby improving the visibility of the marker image MI.
[0084] In addition, the vehicle display device 1 according to the embodiment further includes a host vehicle information acquisition unit 14 that acquires the steering angle of the steering wheel of the vehicle 100, and in the display movement control, the amount by which the marker image MI is shifted from a position below the preceding vehicle 200 is determined based on the inclination of the first virtual straight line VL1 with respect to the straight-line direction X1 and the steering angle of the steering wheel of the vehicle 100. In the display movement control, if the angle between the straight-line direction X1 and the first virtual straight line VL1 is A1, the steering angle of the steering wheel of the vehicle 100 is θ, and the amount by which the marker image MI is shifted from a position below the preceding vehicle 200 is the angle AS between the first virtual straight line VL1 and a second virtual straight line VL2 connecting the center of the marker image MI and the vehicle 100, the amount by which the marker image MI is shifted from a position below the preceding vehicle 200 is expressed as AS=A1÷2+θ.
[0085] With the above configuration, the vehicle display device 1 according to the embodiment can shift the display position of the marker image MI to a more appropriate position by considering not only the positional relationship between the vehicle 100 and the leading vehicle 200 but also the steering angle of the steering wheel. Therefore, it is possible to prevent the marker image MI from overlapping with the other vehicle 300 (or the oncoming vehicle 400) or the colored line CL, and it is possible to improve the visibility of the marker image MI.
[0086] In addition, the vehicle display device 1 according to the embodiment further includes a driving trajectory acquisition unit 13b that acquires a driving trajectory T1 of the preceding vehicle 200. When the control unit 12 determines that the first virtual straight line VL1 is inclined with respect to the straight-line direction X1 and the control unit 12 is able to acquire the driving trajectory T1 of the preceding vehicle 200 by the driving trajectory acquisition unit 13b, the control unit 12 performs driving trajectory reference control, instead of display movement control, for displaying the center of the marker image MI so as to overlap with the center of the driving trajectory T1. When the control unit 12 determines that the first virtual straight line VL1 is inclined with respect to the straight-line direction X1 and the control unit 12 is unable to acquire the driving trajectory T1 of the preceding vehicle 200 by the driving trajectory acquisition unit 13b, the control unit 12 performs display movement control.
[0087] With the above-described configuration, the vehicle display device 1 according to the embodiment displays the marker image MI based on the driving trajectory T1 of the preceding vehicle 200, thereby preventing the marker image MI from overlapping with another vehicle 300 (or an oncoming vehicle 400) or a colored line CL, and displaying the marker image MI to more naturally follow the preceding vehicle 200, thereby improving the visibility of the marker image.
[0088] In addition, the vehicle display device 1 according to the embodiment further includes a road shape detection unit 13c that detects the road shape. When the control unit 12 determines that the first virtual straight line VL1 is inclined with respect to the straight-line direction X1 and the control unit 12 is able to acquire the shape of the driving lane of the preceding vehicle 200 by the road shape detection unit 13c, the control unit 12 performs road shape reference control to display the marker image MI in the center of the driving lane based on the detected shape of the driving lane instead of display movement control. When the control unit 12 determines that the first virtual straight line VL1 is inclined with respect to the straight-line direction X1 and the control unit 12 is unable to acquire the shape of the driving lane of the preceding vehicle 200 by the road shape detection unit 13c, the control unit 12 performs display movement control.
[0089] With the above-described configuration, the vehicle display device 1 according to the embodiment can display the marker image MI based on the road shape, thereby enabling the marker image MI to be displayed in a more appropriate position relative to the driving lane, thereby improving the visibility of the marker image MI.
[0090] In addition, the vehicle display device 1 according to the embodiment further includes a road shape detection unit 13c that detects a road shape. When the control unit 12 determines that the first virtual straight line VL1 is inclined with respect to the straight-line direction X1 and the control unit 12 can acquire the shape of the driving lane of the preceding vehicle 200 by the road shape detection unit 13c, the control unit 12 performs road shape-based control to display the marker image MI in the center of the driving lane based on the detected shape of the driving lane, instead of the display movement control and the driving trajectory-based control. When the control unit 12 determines that the first virtual straight line VL1 is inclined with respect to the straight-line direction X1, When the control unit 12 is unable to acquire the shape of the driving lane of the preceding vehicle 200 by the road shape detection unit 13c but is able to acquire the driving trajectory T1 of the preceding vehicle 200 by the driving trajectory acquisition unit 13b, the control unit 12 performs driving trajectory reference control, and when the control unit 12 determines that the first virtual straight line VL1 is inclined with respect to the straight-line direction X1 but is unable to acquire the shape of the driving lane of the preceding vehicle 200 by the road shape detection unit 13c and is also unable to acquire the driving trajectory T1 of the preceding vehicle 200 by the driving trajectory acquisition unit 13b, the control unit 12 performs display movement control.
[0091] Similarly, in the above configuration, the vehicle display device 1 according to the embodiment can display the marker image MI based on the road shape, thereby enabling the marker image MI to be displayed in a more appropriate position relative to the driving lane, thereby improving the visibility of the marker image MI.
[0092] In addition, in the vehicle display device 1 of the embodiment, the road shape detection unit 13c detects at least one of a pair of colored lines CL that sandwich the driving lane of the preceding vehicle 200 as the road shape, and in road shape based control, the control unit 12 displays the marker image MI in the center of the driving lane based on the position of the colored line CL detected by the road shape detection unit 13c.
[0093] With the above configuration, the vehicle display device 1 according to the embodiment can display the marker image MI based on the colored line CL, thereby enabling the marker image MI to be displayed at a more appropriate position relative to the colored line ML, thereby improving the visibility of the marker image.
[0094] [Variations] In the above embodiment, the marker image MI is described as being displayed in the shape of a bar extending along the vehicle width direction, but is not limited to this.
[0095] Fig. 10 is a diagram showing an example of a marker image displayed by a vehicle display device according to a modified example. For example, as shown in Fig. 10, the marker image may be a concave marker image MIa having a bar shape extending along the vehicle width direction and having turners at both ends, an elliptical marker image MIb having a longitudinal direction in the vehicle width direction, or an arc-shaped marker image MIc that opens forward.
[0096] The contents disclosed in the above-described embodiments and modifications can be implemented in appropriate combinations.
[0097] [Reference example] As a reference example, the control unit 12 may be capable of executing at least one of the driving trajectory-based control and the road shape-based control among the display movement control, the driving trajectory-based control, and the road shape-based control. In other words, the control unit 12 may be capable of executing the driving trajectory-based control and the road shape-based control in combination among the display movement control, the driving trajectory-based control, and the road shape-based control, or may be capable of executing each of them alone.
[0098] Of the display movement control, driving trajectory reference control, and road shape reference control, a vehicle display device 1 that can execute only the driving trajectory reference control may continue displaying the mark image MI without shifting its position when the preceding vehicle 200 is not positioned in front of the vehicle 100 and the driving trajectory acquisition unit 13b is unable to acquire the driving trajectory T1.
[0099] In addition, a vehicle display device 1 that can execute only the road shape reference control among the display movement control, driving trajectory reference control, and road shape reference control may continue to display the mark image MI without shifting the position of the mark image MI when the preceding vehicle 200 is not positioned in front of the vehicle 100 and the road shape of the driving lane cannot be acquired by the road shape detection unit 13c.
[0100] Furthermore, the vehicle display device 1 that can execute only the road shape reference control and the road shape reference control among the display movement control, the driving trajectory reference control, and the road shape reference control may continue to display the mark image MI without shifting the position of the mark image MI when the preceding vehicle 200 is not positioned in front of the vehicle 100, the driving trajectory acquisition unit 13b cannot acquire the driving trajectory T1, and the road shape of the driving lane cannot be acquired by the road shape detection unit 13c. [Explanation of symbols]
[0101] 1: Vehicle display device 11: Display 12: Control unit 12a: Power switch 12b: SoC 12c: ROM 12d: RAM 12e: Communication I / F 12f: External I / F 13: External information acquisition unit 13a: Position information acquisition unit 13b: Travel trajectory acquisition unit 13c: Road shape detection unit 14: Vehicle information acquisition unit 21: Meters 31: Front camera 32: Vehicle sensors 33: Navigation information 100:Vehicle 200: Leading vehicle 300: Other vehicles 400: Oncoming vehicle Bn:Power supply MI, MIa-MIc: Marker images VL1: First virtual line VL2: Second virtual line Steps ST1 to ST20
Claims
1. a display device mounted on a vehicle and configured to display an image on a front windshield of the vehicle, the image being superimposed on an actual scene ahead of the vehicle; a control unit that controls the display; a position information acquisition unit that acquires the position of a preceding vehicle that the vehicle is following; Equipped with the control unit calculates a first virtual line connecting the position of the leading vehicle acquired by the position information acquisition unit and the position of the vehicle; When the control unit determines that the first virtual straight line is along the straight-ahead direction of the vehicle, the control unit displays a marker image at a position below the leading vehicle as viewed from a viewpoint position of the vehicle, when it is determined by the control unit that the first virtual straight line is inclined with respect to the straight-ahead direction, the control unit performs display movement control to shift the marker image from the position below the leading vehicle in a direction opposite to the inclination direction of the first virtual straight line with respect to the straight-ahead direction, and In the display movement control, the amount by which the marker image is shifted from the position below the leading vehicle is determined based on the inclination of the first virtual straight line with respect to the straight-ahead direction. A vehicle display device characterized by:
2. a vehicle information acquisition unit that acquires a steering angle of the steering wheel of the vehicle; in the display movement control, an amount by which the marker image is shifted from the position below the leading vehicle is determined based on an inclination of the first virtual line with respect to the straight-ahead traveling direction and a steering angle of the steering wheel of the vehicle; In the display movement control, when an angle formed between the straight-ahead direction and the first virtual line is A1, a steering angle of the steering wheel of the vehicle is θ, and an amount by which the marker image is shifted from the position below the leading vehicle is an angle AS formed between a second virtual line connecting the center of the marker image and the vehicle and the first virtual line, the amount by which the marker image is shifted from the position below the leading vehicle is expressed as AS = A1 ÷ 2 + θ 2. The vehicle display device according to claim 1, wherein:
3. a travel locus acquisition unit that acquires a travel locus of the preceding vehicle; When the control unit determines that the first virtual straight line is inclined with respect to the straight-ahead direction and the control unit can acquire the traveling trajectory of the preceding vehicle by the traveling trajectory acquisition unit, the control unit performs traveling trajectory reference control, instead of the display movement control, to display the marker image so that a center of the marker image overlaps a center of the traveling trajectory, When the control unit determines that the first virtual straight line is inclined with respect to the straight traveling direction and the control unit is unable to acquire the traveling trajectory of the preceding vehicle by the traveling trajectory acquisition unit, the control unit performs the display movement control.
3. The vehicle display device according to claim 1, wherein:
4. Further comprising a road shape detection unit that detects a road shape, When the control unit determines that the first virtual straight line is inclined with respect to the straight-ahead direction and when the control unit can acquire the shape of the driving lane of the preceding vehicle by the road shape detection unit, the control unit performs road shape reference control to display the marker image in the center of the driving lane based on the detected shape of the driving lane, instead of the display movement control; When the control unit determines that the first virtual straight line is inclined with respect to the straight traveling direction and the control unit is unable to acquire the shape of the driving lane of the leading vehicle by the road shape detection unit, the control unit performs the display movement control.
3. The vehicle display device according to claim 1, wherein:
5. Further comprising a road shape detection unit that detects a road shape, When the control unit determines that the first virtual straight line is inclined with respect to the straight-ahead direction and when the control unit can acquire the shape of the driving lane of the preceding vehicle by the road shape detection unit, the control unit performs road shape-based control to display the marker image in the center of the driving lane based on the detected shape of the driving lane, instead of the display movement control and the driving trajectory-based control, When the control unit determines that the first virtual straight line is inclined with respect to the straight traveling direction, and when the control unit cannot acquire the shape of the driving lane of the preceding vehicle by the road shape detection unit but can acquire the driving trajectory of the preceding vehicle by the driving trajectory acquisition unit, the control unit performs the driving trajectory reference control, When the control unit determines that the first virtual straight line is inclined with respect to the straight traveling direction, and when the control unit cannot acquire the shape of the driving lane of the preceding vehicle by the road shape detection unit and cannot acquire the driving trajectory of the preceding vehicle by the driving trajectory acquisition unit, the control unit performs the display movement control.
4. The vehicle display device according to claim 3, wherein:
6. the road shape detection unit detects, as the road shape, at least one of a pair of colored lines sandwiching the driving lane of the leading vehicle; In the road shape reference control, the control unit displays the marker image in the center of the driving lane based on the position of the colored line detected by the road shape detection unit.
5. The vehicle display device according to claim 4, wherein:
7. the road shape detection unit detects, as the road shape, at least one of a pair of colored lines sandwiching the driving lane of the leading vehicle; In the road shape reference control, the control unit displays the marker image in the center of the driving lane based on the position of the colored line detected by the road shape detection unit.
6. The vehicle display device according to claim 5, wherein:
Citation Information
Patent Citations
Vehicular display device
JP2005067514A
Vehicular display apparatus
JP2016002779A
Head-up display device
JP2017030600A
Display control device and display control program
JP2021024556A
Vehicle display device and vehicle display method
JP6536855B2
