Display control device

Abstract

To provide a display control device capable of enabling a driver to intuitively recognize that a preceding vehicle is located outside a display region.SOLUTION: A display ECU 10: detects a following target vehicle ahead of an own vehicle from an image captured by a camera 22; projects a marker image onto a screen display frame of an AR-HUD 12 to indicate the following target vehicle either adjacent to or superimposed on the following target vehicle. The display ECU also controls the AR-HUD 12 so that the marker image takes on a first shape representing a maximum display when the entire following target vehicle is within the screen display frame or the marker image takes on a second shape that is deformed and positioned in contact with the edge of the screen display frame corresponding to the location of the following target vehicle outside the screen display frame when the following target vehicle moves out of the screen display frame.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a display control device for an AR - HUD (Augmented Reality Head - Up Display).

Background Art

[0002] An AR - HUD that displays information such as a marker image in accordance with a preceding vehicle has come to be used on the windshield of a vehicle. However, since the AR - HUD displays information only in a limited area of the windshield, there has been a problem that when the preceding vehicle goes out of the display area, information such as the marker image is no longer displayed.

[0003] Patent Document 1 describes an invention that enables a driver to easily recognize that control following the preceding vehicle is operating even when the position of the preceding vehicle is outside the side of the display area.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the invention described in Patent Document 1, when the position of the preceding vehicle is outside the side of the display area, the design of the marker image is changed and continuously displayed in the screen display frame which is the peripheral part of the display area. However, it may be difficult to determine whether the change in the design of the marker image is due to the fact that the position of the preceding vehicle is outside the side of the display area or due to other factors.

[0006] The present invention has been made in consideration of the above facts, and an object thereof is to obtain a display control device that can enable a driver to intuitively recognize that a preceding vehicle is outside the range of a display area.

Means for Solving the Problems

[0007] To solve the above problems, the display control device according to claim 1 includes a control unit that controls an information display unit that projects and displays information within a screen display frame that is a predetermined range of a vehicle's windshield, and an acquisition unit that acquires an image of the front of the vehicle captured by an imaging unit. The control unit detects a following target vehicle that precedes the vehicle from the image acquired by the acquisition unit, and projects a marker image for recognizing the following target vehicle located within the screen display frame within the screen display frame either in the vicinity of the following target vehicle or superimposed on the following target vehicle. When the entire following target vehicle enters the screen display frame, the marker image exhibits a first shape that is the maximum display. When the following target vehicle deviates from the screen display frame, the control unit controls the information display unit such that the marker image exhibits a second shape that deforms in a state of being in contact with the screen display frame according to the position of the following target vehicle existing outside the screen display frame.

[0008] According to the display control device described in claim 1, when the following target vehicle, which is a preceding vehicle, deviates from the screen display frame, by deforming the marker image according to the position of the following target vehicle existing outside the screen display frame, the driver can be intuitively made aware that the preceding vehicle is outside the range of the screen display frame, which is the display area.

[0009] In the display control device according to claim 2, the second shape is deformed so as to become shorter in the vehicle width direction of the following target vehicle from the end in contact with the screen display frame while maintaining the shape of the end existing within the screen display frame.

[0010] According to the display control device described in claim 2, by deforming the marker image so as to become shorter in the vehicle width direction of the following target vehicle from the end in contact with the screen display frame, the continuity of the design between the first shape and the second shape is ensured, so that the driver can be intuitively made aware that the preceding vehicle has deviated from within the display area to outside the display area.

[0011] When the display control device according to claim 3 is deformed, an animation expression is presented such that the ends of the marker image in contact with the screen display frame are cut off.

[0012] According to the display control device described in claim 3, the driver can intuitively recognize that the preceding vehicle is outside the range of the display area through the animation display.

[0013] When the marker image deforms, the screen display frame according to claim 4 has its four corners highlighted.

[0014] According to the display control device described in claim 4, the driver can intuitively recognize that the preceding vehicle is outside the range of the display area through the highlighting of the screen display frame.

[0015] When the vehicle to be tracked enters the screen display frame, the control unit according to claim 5 controls the information display unit to expand the marker image of the second shape in the vehicle width direction of the vehicle to be tracked and return it to the first shape.

[0016] According to the display control device described in claim 5, by returning the marker image from the second shape to the first shape, the driver is made to recognize that the preceding vehicle has entered the screen display frame.

Advantages of the Invention

[0017] The present invention has the effect of enabling the driver to intuitively recognize that the preceding vehicle is outside the range of the display area.

Brief Description of the Drawings

[0018]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Mode for Carrying Out the Invention

[0019] Hereinafter, an example of this embodiment will be described in detail with reference to the drawings. FIG. 1 is a schematic diagram showing an example of the AR-HUD 12 in this embodiment. The AR-HUD 12 is provided at a position corresponding to the driver's viewpoint on the windshield 50, separately from the instrument panel 40 provided near the steering wheel 42. As shown in FIG. 1, in the AR-HUD 12, the area inside a predetermined screen display frame 14 is a display area for displaying information such as a marker image. The screen display frame 14 is provided in a state that is generally invisible to the driver.

[0020] FIG. 2 is a block diagram showing an example of the configuration of the display control device 100 according to this embodiment. The display control device 100 according to this embodiment includes a display ECU (Electronic Control Unit) 10 that generates data such as a marker image indicating a preceding vehicle based on information detected by various sensors, and an AR-HUD 12 that projects and displays information such as a marker image based on the data generated by the display ECU 10 on the windshield 50 of the vehicle.

[0021] The various sensors include a camera 22 that acquires an image in front of the vehicle, an obstacle sensor 34 that detects obstacles and the like existing around the vehicle, a vehicle speed sensor 36 that detects the speed of the vehicle, and a steering angle sensor 38 that detects the steering angle of the vehicle.

[0022] The camera 22 acquires an image in front of the vehicle. The video analysis ECU 32 analyzes the image in front of the vehicle acquired by the camera 22 and detects a preceding vehicle as a following target vehicle. As an example, the video analysis ECU 32 uses a machine-learned model constructed by machine learning using a mathematical model such as a CNN (Convolutional Neural Network) with image data whose vehicle type is specified in advance as teacher data to detect a vehicle in the image.

[0023] The obstacle sensor 34 is, for example, a millimeter-wave radar, a LIDAR (Light Detection and Ranging), and a sonar. The millimeter-wave radar emits millimeter waves in front of and on the front side of the vehicle, receives the radio waves reflected from the target object, and measures the distance to the obstacle and the relative speed between the host vehicle and the obstacle based on the propagation time and the frequency difference caused by the Doppler effect. The LIDAR, as an example, detects obstacles and the like from the scattered light of the pulsed laser irradiated around the vehicle. The sonar, as an example, detects obstacles and the like by using the difference in the reflectivity of ultrasonic waves irradiated around the vehicle.

[0024] Each of the video analysis ECU 32 and the display ECU 10 includes a CPU (Central Processing Unit) which is an arithmetic processing device and a storage device, and executes predetermined arithmetic processing based on a program stored in the storage device. Each of the video analysis ECU 32 and the display ECU 10 may be integrally configured. Also, each of the display ECU 10 and the AR-HUD 12 may be integrally configured.

[0025] In this embodiment, the traveling direction of the vehicle is estimated from the detection result of the steering angle sensor 38. However, in addition to the steering angle sensor 38, a gyro sensor may be provided, and the traveling direction of the vehicle may be detected by the gyro sensor.

[0026] Figure 3 is a flowchart showing an example of the processing of the display control device 100 according to the present embodiment. The processing shown in Figure 3 starts when the vehicle power is in the ACC (Accessory) on or IG (Ignition) on state.

[0027] In step S100, the video analysis ECU 32 detects a preceding vehicle, which is a following target vehicle with a marker image attached within the screen display frame 14, from the image data acquired by the camera 22. The detection of the following target vehicle may be executed by the display ECU 10 based on the image processing result of the video analysis ECU 32 and the detection result of the obstacle sensor 34 in addition to the video analysis ECU 32.

[0028] In step S102, the display ECU 10 starts displaying the marker image. As shown in FIGS. 4 to 6, the marker image is displayed, for example, near the following target vehicle or superimposed on the following target vehicle.

[0029] In step S104, it is determined whether the position of the following target vehicle is within the screen display frame 14. If the position of the following target vehicle is within the screen display frame 14 in step S104, the procedure proceeds to step S106, and if the position of the following target vehicle is not within the screen display frame 14, the procedure proceeds to step S108.

[0030] In step S106, the display of the marker image is continued as it is. And in step S108, as will be described later, the marker image is deformed to adjust the display.

[0031] In step S110, it is determined whether the vehicle power has been turned off. If the vehicle power has been turned off in step S110, the process ends, and if the vehicle power has not been turned off, the procedure proceeds to step S104.

[0032] FIG. 4 is an explanatory diagram showing an example of deformation of the marker image. FIG. 4(A) shows a state where the target vehicle 60 existing within the screen display frame 14 is about to deviate from the screen display frame 14. When the target vehicle 60 exists within the screen display frame 14, the marker image 70A assumes a first shape that is displayed in a strip shape with the maximum size, for example, directly below the target vehicle 60. When the position of the target vehicle 60 changes so as to deviate from the screen display frame 14, the marker image 70B moves following the change in the position of the target vehicle 60 and assumes a second shape that is deformed so as to be compressed short in the vehicle width direction (hereinafter abbreviated as "vehicle width direction") from the end in contact with the screen display frame 14. Since the second shape is a state in which the first shape is shortened, the design continuity between the second shape and the first shape is ensured. Such design continuity is the same for other aspects of the marker image described later.

[0033] FIG. 4(B) is an explanatory diagram showing an example of a state where the target vehicle 60 is about to deviate from the screen display frame 14. The marker image 70C, which is in the second shape, changes its display position following the target vehicle 60 that is about to deviate from the screen display frame 14, and is deformed so that the marker image 70C in contact with the screen display frame 14 is compressed short in the vehicle width direction. However, the shape of the end of the marker image 70C within the screen display frame 14 is maintained. As will be described later, in this embodiment, there are various aspects of the marker image, but the point that the shape of the end of the marker image within the screen display frame 14 is maintained is common.

[0034] FIG. 4(C) shows a case where the marker image 72A is retained on the screen display frame 14 when the target vehicle 60 deviates from the screen display frame 14. When the target vehicle 60 deviates from the screen display frame 14 as shown by the position of the marker image 72B, it is easier for the driver to recognize the presence of the target vehicle 60 by displaying it as the marker image 72A rather than as the marker image 72B.

[0035] Figure 4(D) shows a state where the target vehicle 60 existing within the screen display frame 14 is about to deviate from the screen display frame 14. When the target vehicle 60 exists within the screen display frame 14, the marker image 74A is displayed in a strip shape, for example, directly below the target vehicle 60. When the position of the target vehicle 60 changes such that it deviates from the screen display frame 14, the marker image 74B moves following the change in the position of the target vehicle 60. When the target vehicle 60 deviates from the screen display frame 14, the marker image 74B exhibits a second shape that deforms so as to be compressed in the vehicle width direction according to the position of the target vehicle 60 whose end is in contact with the screen display frame 14 and is about to deviate from the screen display frame 14.

[0036] Figure 4(E) is an explanatory diagram showing an example of a state where the target vehicle 60 has completely deviated from the screen display frame 14. The marker image 74C is compressed from the marker image 70C that has contacted the screen display frame 14. When the target vehicle 60 has completely deviated from the screen display frame 14, the marker image 74C is compressed to the minimum size in the second shape and is displayed at the end of the screen display frame 14.

[0037] Figure 4(F) is an explanatory diagram showing another aspect where the marker image 76 contacts the screen display frame 14 and its end is compressed due to the target vehicle 60 deviating from the screen display frame 14. The marker image 76 exhibits a second shape that deforms so as to be compressed in the vehicle width direction according to the position of the target vehicle 60 that is about to deviate from the screen display frame 14. When being compressed, by animating a fragmentary image of the marker image 76, an expression is created such that the end of the marker image 76 contacts and is cut by the screen display frame 14.

[0038] FIG. 4(G) is an explanatory diagram showing another aspect in which the marker image 76 contacts the screen display frame 14 and its end is compressed due to the target vehicle 60 deviating from the screen display frame 14. In FIG. 4(G), when the marker image 76 assumes a second shape that contacts the screen display frame 14 and is deformed so as to be compressed short in the vehicle width direction, a fragmented image is animatedly displayed, and for example, the four corners of the screen display frame 14 are highlighted 78 in a highly visible color tone such as yellow. Such highlighting 78 allows the driver to recognize that the target vehicle 60 is about to deviate from the screen display frame 14 or has completely deviated. The highlighting 78 of the four corners of the screen display frame 14 may also be performed in cases other than when a fragmented image is animatedly displayed, for example, in the cases shown in FIGS. 4(B) to 4(E), and further in the cases shown in FIGS. 5 and 6 described later.

[0039] FIG. 5(A) is an explanatory diagram when the target vehicle 60 has completely deviated from the screen display frame 14 and the marker image 80 is compressed to the minimum size in the second shape. The compressed marker image 80 is displayed at the position on the screen display frame 14 closest to the position where the target vehicle 60 exists.

[0040] FIG. 5(B) is an explanatory diagram showing a state in which the marker image 80 of the second shape compressed on the screen display frame 14 moves according to the position of the target vehicle 60 existing outside the screen display frame 14. By moving the compressed marker image 80 according to the change in the position of the target vehicle 60, the driver is made aware of the presence of the target vehicle 60.

[0041] FIG. 5(C) is an explanatory diagram showing an example when the target vehicle 60 enters the screen display frame 14. As shown in FIG. 5(C), as the target vehicle 60 enters the screen display frame 14, the marker image 82 expands in the vehicle width direction from the compressed state and moves according to the position of the target vehicle 60 within the screen display frame 14.

[0042] Fig. 6 shows another embodiment of the marker image. Fig. 6(A) shows marker images 84A and 84B in the form of parallelogram-shaped figures that are intermittently connected. The marker image 84A, which is a first shape, moves in response to a change in the position of the vehicle to be followed 60, and when the position of the vehicle to be followed 60 moves outside the screen display frame 14, the marker image 84B, which is a second shape, is compressed in a state of contact with the screen display frame 14.

[0043] 6B shows a state in which the vehicle to be followed 60 has completely deviated from the screen display frame 14, and the marker image 84C has been compressed to the minimum size as the second shape. The marker image 84C compressed to the minimum size has a small parallelogram shape.

[0044] 6(C) shows arrow-shaped marker images 86A and 86B. The marker image 86A, which is a first shape, moves in response to a change in the position of the vehicle to be followed 60, and when the position of the vehicle to be followed 60 moves outside the screen display frame 14, the marker image 86B, which is a second shape, is compressed in a state of contact with the screen display frame 14.

[0045] 6(D) shows a state in which the vehicle to be followed 60 has completely deviated from the screen display frame 14, and the marker image 86C has been compressed to the minimum size as the second shape. The marker image 86C compressed to the minimum size has a diamond shape in which the left and right protrusions of an arrow join together.

[0046] 6(E) shows marker images 88A, 88B in the form of rectangular parallelepiped figures that are intermittently connected together. The marker image 88A, which is the first shape, moves in response to a change in the position of the vehicle to be followed 60, and when the position of the vehicle to be followed 60 moves outside the screen display frame 14, the marker image 88B is compressed in a state of contact with the screen display frame 14.

[0047] 6(F) shows a state in which the vehicle to be followed 60 has completely deviated from the screen display frame 14, and the marker image 88C has been compressed to the minimum size as the second shape. The marker image 88C compressed to the minimum size has a small rectangular parallelepiped shape.

[0048] FIG. 6(G) shows marker images 90A and 90B having a parallelogram shape. The marker image 90A having the first shape moves according to the change in the position of the vehicle 60 to be tracked. When the position of the vehicle 60 to be tracked moves outside the screen display frame 14, the marker image 90B is compressed in a state of being in contact with the screen display frame 14.

[0049] FIG. 6(H) shows a state in which the vehicle 60 to be tracked has completely deviated from the screen display frame 14 and the marker image 84C has been compressed to the minimum size as the second shape. The marker image 90C compressed to the minimum size has a small parallelogram shape.

[0050] As described above, the display control device according to the present embodiment deforms the marker image according to the screen display frame 14 and the position of the vehicle 60 to be tracked, which is the preceding vehicle. Specifically, when the preceding vehicle deviates from the screen display frame 14, by deforming the marker image according to the position of the vehicle 60 to be tracked existing outside the screen display frame 14, it is possible to make the driver intuitively recognize that the preceding vehicle is outside the range of the display area.

[0051] Note that the information display unit in the claims corresponds to the AR-HUD 12 in the detailed description of the invention in the specification, the imaging unit in the claims corresponds to the camera 22 in the detailed description of the invention in the specification, and the control unit in the claims corresponds to the display ECU 10 in the detailed description of the invention in the specification, respectively.

Explanation of Reference Numerals

[0052] 10 Display ECU 12 AR-HUD 14 Screen display frame 22 Camera 32 Video analysis ECU 50 Windshield 60 Vehicle to be tracked Marker images of 70A, 70B, 70C, 72A, 72B, 74A, 74B, 74C, 76, 80, 82, 84A, 84B, 84C, 86A, 86B, 86C, 88A, 88B, 88C, 90A, 90B, 90C 78 Highlight 100 Display control device

Claims

1. A control unit that controls an information display unit that projects and displays information within a screen display frame that is a predetermined range of a vehicle windshield, and an acquisition unit that acquires an image of the front of the vehicle captured by an imaging unit, wherein the control unit detects a following target vehicle that precedes the vehicle from the image acquired by the acquisition unit, and projects a marker image that causes the following target vehicle located within the screen display frame to be recognized, within the screen display frame in either a display near the following target vehicle or a display superimposed on the following target vehicle, and when the entire following target vehicle is within the screen display frame, the marker image exhibits a first shape that is the maximum display, and when the following target vehicle deviates from the screen display frame, the marker image exhibits a second shape that deforms in a state of being in contact with the screen display frame according to the position of the following target vehicle existing outside the screen display frame, and controls the information display unit.

2. The display control device according to claim 1, wherein the second shape is deformed so as to become shorter in the vehicle width direction of the following target vehicle from an end portion in contact with the screen display frame while maintaining the shape of the end portion existing within the screen display frame.

3. The display control device according to claim 2, wherein an animation expression is presented such that an end portion of the marker image in contact with the screen display frame is cut during the deformation.

4. The display control device according to claim 3, wherein when the marker image is deformed, the four corners of the screen display frame are highlighted.

5. The display control device according to any one of claims 1 to 4, wherein the control unit controls the information display unit so that when the following target vehicle enters the screen display frame, the marker image of the second shape is expanded in the vehicle width direction of the following target vehicle and restored to the first shape.

Images