Vehicular display device
The vehicle display device addresses the challenge of displaying virtual images with depth by projecting light to create a depth gradient and using vanishing point-based images, resulting in enhanced three-dimensional information for drivers.
Patent Information
- Application Number
- JP2023207947
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-12-08
- Publication Date
- 2025-06-19
AI Technical Summary
Existing vehicle display devices struggle to effectively display virtual images with a sense of depth, which is essential for providing three-dimensional information to drivers.
The vehicle display device projects display light onto a reflection surface in front of the driver, creating a virtual image where the upper part appears farther away than the lower part, and incorporates predetermined images that express depth based on a vanishing point.
This configuration allows for the display of virtual images with a clear sense of depth, enhancing the driver's perception of three-dimensional information.
Smart Images

Figure 2025092209000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a vehicle display device.
Background Art
[0002] Conventionally, there is a device that displays a virtual image. Patent Document 1 discloses a vehicle display device including a first display that emits first display light and a second display that emits second display light, and projecting the first display light and the second display light onto a windshield to display a virtual image.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] In a vehicle display device, it is desirable to be able to display a virtual image with a sense of depth. If a virtual image with a sense of depth can be displayed, it becomes possible to provide three-dimensional information to the driver.
[0005] An object of the present invention is to provide a vehicle display device capable of displaying a virtual image with a sense of depth.
Means for Solving the Problems
[0006] The vehicle display device of the present invention includes a display device configured to project display light of an image onto a reflection surface in front of a driver in a vehicle to display a virtual image for the driver, and the upper part of the virtual image is configured to appear farther from the driver than the lower part of the virtual image, and a control unit configured to control the display device, wherein the virtual image displayed by the display device includes a predetermined image in which depth based on a vanishing point is expressed.
Effects of the Invention
[0007] The vehicle display device according to the present invention includes a display device configured such that the upper part of the virtual image appears farther from the driver than the lower part of the virtual image. The virtual image displayed by the display device includes a predetermined image in which the depth based on the vanishing point is expressed. According to the vehicle display device of the present invention, in the virtual image in which the upper part appears farther from the driver than the lower part, by including a predetermined image in which the depth based on the vanishing point is expressed, there is an effect that a virtual image with a sense of depth can be displayed.
Brief Description of the Drawings
[0008]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Figure 18
Figure 19
Figure 20
Figure 21
Figure 22
Figure 23
Figure 24
Figure 25
Figure 26
Figure 27
Figure 28
Figure 29
Figure 30
Figure 31
DETAILED DESCRIPTION OF THE INVENTION
[0009] Hereinafter, a vehicle display device according to an embodiment of the present invention will be described in detail with reference to the drawings. Note that the present invention is not limited by this embodiment. Also, the constituent elements in the following embodiments include those that can be easily assumed by those skilled in the art or those that are substantially the same.
[0010] [Embodiment] Embodiments will be described with reference to FIGS. 1 to 31. This embodiment relates to a vehicle display device. FIG. 1 is a view of a vehicle equipped with the vehicle display device of the embodiment, FIG. 2 is a configuration diagram of the vehicle display device according to the embodiment, FIG. 3 is a view of a virtual image according to the embodiment, FIG. 4 is a view showing the scenery in front of the vehicle and the virtual image, FIGS. 5 and 6 are views showing the virtual image when the vehicle is reversing in the embodiment, FIGS. 7 and 8 are views showing the virtual image when the vehicle is moving forward in the embodiment, FIG. 9 is a view showing the scenery in front of the vehicle and the virtual image, and FIGS. 10 to 17 are views showing the virtual image of route guidance in the embodiment.
[0011] FIG. 18 is a view showing the scenery in front of the vehicle and the virtual image, FIG. 19 is a view showing the virtual image when turning left in the embodiment, FIG. 20 is a view showing the virtual image before the start of ACC control in the embodiment, FIGS. 21 to 23 are views showing the virtual image during ACC control in the embodiment, FIG. 24 is a view showing the scenery in front of the vehicle and the virtual image, FIGS. 25 to 27 are views showing the virtual image during ACC control in the embodiment, FIG. 28 is a view showing the virtual image during charging in the embodiment, FIG. 29 is a view showing the virtual image when charging is completed in the embodiment, and FIGS. 30 and 31 are views showing an example of the display device.
[0012] As shown in FIG. 1, the vehicle display device 1 is a device that displays a virtual image Vi for the driver 200. As shown in FIG. 2, the vehicle display device 1 displays the virtual image Vi for the driver 200 by projecting display light Lt of an image onto the reflection surface 110a in front of the driver 200 in the vehicle 100. The reflection surface 110a in this embodiment is the inner surface of the windshield 110 on the vehicle interior side. The reflection surface 110a may be coated for reflection.
[0013] As will be described later, the vehicle display device 1 of the present embodiment displays an inclined virtual image Vi. As shown in FIG. 1, the vehicle display device 1 is configured such that the upper part Vu of the virtual image Vi appears farther from the driver 200 than the lower part Vd of the virtual image Vi.
[0014] As shown in FIG. 2, the vehicle display device 1 includes a housing 2, a display device 3, and a control unit 10. The housing 2 is disposed below the windshield 110 of the vehicle 100. The housing 2 is accommodated, for example, below the dashboard 120. The display device 3 and the control unit 10 are accommodated in the housing 2.
[0015] The display device 3 includes an image display unit 4, a first mirror 5, and a second mirror 6. The image display unit 4 includes, for example, a liquid crystal display device such as a TFT-LCD (Thin Film Transistor-Liquid Crystal Display). The image display unit 4 has a display surface 4a for displaying an image. The display light Lt of the image is emitted from the display surface 4a. The image display unit 4 has, for example, a backlight unit disposed on the back side with respect to the display surface 4a. In this case, the display light Lt is generated by the light of the backlight unit.
[0016] The first mirror 5 reflects the display light Lt output from the image display unit 4 toward the second mirror 6. The first mirror 5 has a reflecting surface 5r for reflecting light. The illustrated shape of the reflecting surface 5r is a convex aspherical surface. The shape of the reflecting surface 5r is a shape for correcting the distortion of the image generated in the second mirror 6 and the windshield 110.
[0017] The second mirror 6 reflects the display light Lt incident from the side of the first mirror 5 toward the windshield 110. The housing 2 has a transparent cover 2a. The cover 2a faces the opening of the dashboard 120. The display light Lt passes through the cover 2a from the side of the second mirror 6 toward the side of the windshield 110. The reflecting surface 110a of the windshield 110 reflects the display light Lt toward the eye point EP of the vehicle 100. The driver 200 visually recognizes the virtual image Vi by the display light Lt. The position of the virtual image Vi as seen from the driver 200 is in front of the windshield 110 in the vehicle longitudinal direction X.
[0018] The second mirror 6 of the present embodiment is configured to display a virtual image Vi inclined with respect to the driver 200. The second mirror 6 has a concave reflecting surface 6r. The shape of the reflecting surface 6r is an aspherical curved shape and is a shape that enlarges an image. The reflecting surface 6r has a first end 6u and a second end 6d in the image vertical direction.
[0019] The first end 6u is an end corresponding to the upper part Vu of the virtual image Vi. That is, the first end 6u reflects the light among the display light Lt that is visually recognized as the upper part Vu of the virtual image Vi. The second end 6d is an end corresponding to the lower part Vd of the virtual image Vi. That is, the second end 6d reflects the light among the display light Lt that is visually recognized as the lower part Vd of the virtual image Vi.
[0020] The shape of the reflecting surface 6r is set such that the magnification of the first end 6u is higher than the magnification of the second end 6d. Also, the shape of the reflecting surface 6r is set such that the magnification increases from the second end 6d toward the first end 6u. When the magnification on the reflecting surface 6r is high, the position of the virtual image Vi as seen from the driver 200 becomes distant. Therefore, the display device 3 of the present embodiment can display an inclined virtual image Vi as shown in FIG. 1 with respect to the driver 200.
[0021] The virtual image Vi has an image vertical direction Gv when viewed from the driver 200. The virtual image Vi has an upper part Vu and a lower part Vd in the image vertical direction Gv. In the virtual image Vi displayed by the display device 3 of the present embodiment, the upper part Vu appears farther from the driver 200 than the lower part Vd. That is, when viewed from the driver 200, the upper part Vu of the virtual image Vi is located in front in the vehicle longitudinal direction X with respect to the lower part Vd. The distance from the position where the upper part Vu of the virtual image Vi is imaged to the eye point EP is longer than the distance from the position where the lower part Vd of the virtual image Vi is imaged to the eye point EP. The shape of the virtual image Vi viewed from the vehicle width direction is substantially linear. That is, the display device 3 is configured such that the distance from the eye of the driver 200 to the virtual image Vi gradually increases as it goes from the lower part Vd to the upper part Vu of the virtual image Vi.
[0022] The inclined virtual image Vi as described above can give the driver 200 a sense of perspective. The convergence angle of the driver 200 when viewing the upper part Vu of the virtual image Vi is different from the convergence angle of the driver 200 when viewing the lower part Vd, so that the driver 200 experiences a sense of depth of the virtual image Vi.
[0023] The inclination angle θ of the virtual image Vi with respect to the vehicle longitudinal direction X may be, for example, 5 degrees, 15 degrees, or any angle between 5 degrees and 15 degrees. The inclination angle θ may be an angle of 45 degrees or less. The distance Lu from the eye of the driver 200 to the position where the upper part Vu of the virtual image Vi is imaged may be, for example, 6 m. The distance Ld from the eye of the driver 200 to the position where the lower part Vd of the virtual image Vi is imaged may be, for example, 4 m. The distance Lu may be 1.5 times the value of the distance Ld.
[0024] The control unit 10 shown in FIG. 2 controls the display device 3. More specifically, the control unit 10 commands the image display unit 4 to display an image on the display surface 4a. The control unit 10 may generate the image to be displayed and output this image to the image display unit 4. The control unit 10 controls the image display unit 4 based on, for example, a program stored in a memory or the like of the display device 3.
[0025] The control unit 10 acquires various types of information regarding the vehicle 100 from a vehicle ECU or the like that controls the vehicle 100. The information acquired by the control unit 10 includes, for example, the traveling speed of the vehicle 100, the shift position of the vehicle 100, route guidance information by a navigation system, the position information of the vehicle 100, information regarding the battery of the vehicle 100, and information regarding driving control such as ACC (Adaptive Cruise Control).
[0026] As described below, the virtual image Vi displayed by the vehicle display device 1 of the present embodiment includes a predetermined image in which depth is expressed. Thereby, the vehicle display device 1 of the present embodiment can display the virtual image Vi with a sense of perspective and depth to the driver 200.
[0027] FIG. 3 shows an example of the displayed virtual image Vi. The shape of the image displayed on the display surface 4a of the image display unit 4 is, for example, the same as the shape of the virtual image Vi shown in FIG. 3. Note that the image displayed on the display surface 4a may be an image obtained by performing warping processing on the image to be displayed as the virtual image Vi. The warping processing is, for example, correction processing according to the shape of the windshield 110, the shape of the second mirror 6, or the like.
[0028] The virtual image Vi in FIG. 3 includes an aerial view image 20 of the vehicle, a speed image 21, and a line image 30. The aerial view image 20 is an image simulating the vehicle and is an image of the vehicle viewed from above from the rear. The shape of the aerial view image 20 may be based on the shape of the vehicle 100. The speed image 21 is an image of characters indicating the traveling speed of the vehicle 100. The line image 30 is an image representing the boundary of the lane in which the vehicle 100 travels. The line image 30 in FIG. 3 is an image of a line extending toward a predetermined vanishing point Vp. The illustrated virtual image Vi includes two line images 30. The two line images 30 are arranged on the left and right with respect to the aerial view image 20.
[0029] In the virtual image Vi of the present embodiment, the vanishing point Vp is set outside the image. The illustrated vanishing point Vp is located above the virtual image Vi as viewed from the driver 200. That is, the line image 30 of the present embodiment extends toward the vanishing point Vp located above the image vertical direction Gv. The position of the vanishing point Vp in the image horizontal direction Gh is, for example, at the center. Note that the position of the vanishing point Vp is not limited to the illustrated position. For example, the vanishing point Vp may be set inside the virtual image Vi.
[0030] The bird's-eye view image 20 and the line image 30 are predetermined images in which the depth based on the vanishing point Vp is expressed. The depth feeling of the virtual image Vi is produced by the line image 30 extending toward the vanishing point Vp. The width of the line image 30 becomes narrower as it goes toward the vanishing point Vp. Thereby, the depth feeling is expressed. Also, the luminance of the line image 30 becomes lower as it goes toward the vanishing point Vp. Thereby, the depth feeling is expressed.
[0031] The speed image 21 is displayed at a position that does not overlap with either the bird's-eye view image 20 or the line image 30. In other words, the speed image 21 is displayed independently of the other display elements in the virtual image Vi. In this case, to the driver 200, the speed image 21 appears to be displayed on a vertical plane along the vehicle vertical direction Z. Therefore, the vehicle display device 1 of the present embodiment can ensure the visibility of the speed image 21 while tilting the virtual image Vi.
[0032] FIGS. 4 to 6 show the virtual image Vi displayed when the vehicle 100 starts to reverse. The virtual image Vi of the present embodiment is displayed superimposed on the scenery Sc in front of the vehicle 100. The illustrated virtual image Vi is displayed so as to overlap the road surface in front of the vehicle 100. In this case, the display device 3 projects an image on the lower part of the windshield 110.
[0033] As shown in FIG. 5, when the vehicle 100 reverses, the virtual image Vi includes a position image 31 and a plurality of dot images 40 in addition to the bird's-eye view image 20, the speed image 21, and the line image 30. The position image 31 is an image indicating the shift position of the vehicle 100. The position image 31 in FIG. 5 is an image indicating that the shift position is a reverse position, and is an image of the letter R.
[0034] When a shift change to a shift position for reversing the vehicle 100 is made, the control unit 10 starts an animation described with reference to FIGS. 5 and 6. The dot image 40 shown in FIG. 5 is an image indicating a light emitter. The dot image 40 is displayed, for example, in the same color as the position image 31. The color of the dot image 40 is, for example, amber.
[0035] The control unit 10 executes an animation for moving the plurality of dot images 40. In FIG. 6, the moving direction of the dot image 40 in the reverse animation is indicated by a dashed arrow. When the vehicle 100 reverses, the dot image 40 moves toward the vanishing point Vp along the depth direction based on the vanishing point Vp. That is, the plurality of dot images 40 move so as to converge on the vanishing point Vp. The plurality of dot images 40 moving toward the vanishing point Vp represent the state in which the vehicle 100 reverses. The driver 200 can intuitively know that the vehicle 100 driven by the driver 200 is in a reverse shift position by the moving dot images 40. The animation of the dot image 40 can prevent the vehicle 100 from starting in the wrong direction.
[0036] The luminance of the dot image 40 becomes lower as it approaches the vanishing point Vp. Also, the size of the dot image 40 becomes smaller as it approaches the vanishing point Vp. Such a change in the dot image 40 produces a sense of perspective in the virtual image Vi. The dot image 40 is a predetermined image in which the depth based on the vanishing point Vp is represented.
[0037] The control unit 10 ends the display of the dot image 40 according to a predetermined end condition. The end condition is, for example, a shift change from the reverse shift position to another shift position. The end condition may be that a predetermined time has elapsed since the vehicle 100 started to reverse, or that the reverse speed of the vehicle 100 has reached a predetermined speed. When ending the display of the dot image 40, the control unit 10 may also end the display of the position image 31. The virtual image Vi after the display of the dot image 40 ends is, for example, the virtual image Vi in FIG. 3.
[0038] FIG. 7 shows the virtual image Vi displayed when the vehicle 100 starts to move forward. The virtual image Vi includes a position image 31 and a plurality of dot images 41 in addition to the bird's-eye view image 20, the speed image 21, and the line image 30. The position image 31 in FIG. 7 is an image indicating that the shift position is a forward position, and is an image of the letter D.
[0039] When a shift change to a shift position for moving the vehicle 100 forward is made, the control unit 10 starts an animation described with reference to FIGS. 7 and 8. The dot image 41 shown in FIG. 7 is an image indicating a light emitter. The dot image 41 is displayed, for example, in the same color as the position image 31. The color of the dot image 41 during forward movement is different from the color of the dot image 40 during reverse movement. The color of the dot image 41 during forward movement is, for example, white.
[0040] The control unit 10 executes an animation that moves a plurality of dot images 41. In FIG. 8, the moving directions of the dot images 41 in the forward animation are indicated by dashed arrows. When the vehicle 100 moves forward, the dot images 41 move away from the vanishing point Vp along the depth direction based on the vanishing point Vp. That is, the plurality of dot images 41 move so as to spread from the vanishing point Vp. The plurality of dot images 41 that spread from the vanishing point Vp represent the state of the vehicle 100 moving forward. The driver 200 can intuitively know that the vehicle 100 driven by the driver 200 is in the forward shift position by the moving dot images 41. The animation of the dot images 41 can prevent the vehicle 100 from starting in the wrong direction.
[0041] The brightness of the dot images 41 becomes higher as they move away from the vanishing point Vp. Also, the size of the dot images 41 becomes larger as they move away from the vanishing point Vp. Such changes in the dot images 41 produce a sense of perspective in the virtual image Vi. The dot image 41 is a predetermined image in which the depth based on the vanishing point Vp is represented.
[0042] The control unit 10 terminates the display of the dot images 41 according to a predetermined end condition. The end condition is, for example, a shift change from the forward shift position to a shift position different from the forward position. The end condition may be that a predetermined time has elapsed since the vehicle 100 started moving forward, or that the forward speed of the vehicle 100 has reached a predetermined speed. When terminating the display of the dot images 41, the control unit 10 may also terminate the display of the position image 31. The virtual image Vi after the display of the dot images 41 ends is, for example, the virtual image Vi in FIG. 3.
[0043] Figures 9 and 10 show a virtual image Vi of route guidance. The virtual image Vi of route guidance is displayed superimposed on the scenery Sc in front of the vehicle 100. As shown in FIG. 10, the virtual image Vi of route guidance includes an aerial view image 20, a speed image 21, a line image 30, and at least one guidance image 50. The virtual image Vi in FIG. 10 includes three guidance images 50 that are displayed partially superimposed. The guidance image 50 is a predetermined image in which the depth based on the vanishing point Vp is expressed.
[0044] The guidance image 50 in FIG. 10 has a first image 51, a second image 52, and a third image 53. Each guidance image 50 is an image that guides the traveling direction at a forward branch point. The guidance image 50 in FIG. 10 is an image that guides the route so that the driver 200 turns left at the third branch point from the current position.
[0045] The three guidance images 50 are arranged side by side along a line toward the vanishing point Vp. For example, a virtual line L1 connecting the upper left corners of the plurality of guidance images 50 extends toward the vanishing point Vp. Therefore, the plurality of guidance images 50 can give a sense of depth to the virtual image Vi.
[0046] The illustrated guidance images 50 are arranged side by side along the left line image 30. The first image 51 is arranged at the most forward position along the line image 30 among the three guidance images 50. The third image 53 is arranged at the most rearward position along the line image 30 among the three guidance images 50. The three guidance images 50 are arranged at equal intervals along the line image 30, for example. In the line image 30, the portion overlapping the guidance image 50 is hidden by the guidance image 50.
[0047] The first image 51 is an image that guides the traveling direction of the vehicle 100 at the first branch point. The first image 51 in FIG. 10 has an arrow mark indicating straight-ahead travel. The second image 52 is an image that guides the traveling direction of the vehicle 100 at the second branch point. The second image 52 in FIG. 10 has an arrow mark indicating straight-ahead travel. The third image 53 is an image that guides the traveling direction of the vehicle 100 at the third branch point. The third image 53 in FIG. 10 has an arrow mark indicating a left turn.
[0048] One guidance image 50 is superimposed on a part of another guidance image 50 so as not to hide the traveling direction indicated by the other guidance image 50. For example, the second image 52 is superimposed on the third image 53 in such a manner that the left-turn arrow of the third image 53 can be visually recognized. The first image 51 is superimposed on the second image 52 in such a manner that the straight-ahead arrow of the second image 52 can be visually recognized. Accordingly, the plurality of guidance images 50 can give a sense of depth while fulfilling the function of route guidance.
[0049] In addition, a shadow by another guidance image 50 is displayed on the guidance image 50. For example, the second image 52 has a shadow 52s by the first image 51. The shadow 52s imitates a shadow generated by light irradiated from behind in the vehicle longitudinal direction X with respect to the first image 51. The shadow 52s has a substantially L shape so as to wrap around the edge of the first image 51. Similarly, the third image 53 has a shadow 53s by the second image 52.
[0050] Among the plurality of guidance images 50, the guidance image 50 displayed closest to the front is larger than the other guidance images 50. Among the plurality of guidance images 50, the guidance image 50 displayed on the rearmost side is smaller than the other guidance images 50. Further, when three or more guidance images 50 are displayed, the guidance images 50 become smaller as they go from the front side toward the vanishing point Vp on the rear side.
[0051] Among the plurality of guidance images 50, the guidance image 50 displayed closest to the front is displayed with higher brightness than the other guidance images 50. Among the plurality of guidance images 50, the guidance image 50 displayed farthest to the back is displayed with lower brightness than the other guidance images 50. Further, when three or more guidance images 50 are displayed, the guidance image 50 becomes higher in brightness as it moves away from the vanishing point Vp from the back side to the front side.
[0052] By overlapping and displaying a plurality of guidance images 50 and by the guidance images 50 having shadows 52s, 53s, to the driver 200, the guidance images 50 appear to be displayed on a vertical plane along the vehicle vertical direction Z. In other words, to the driver 200, the guidance images 50 appear like a sign board standing on the road surface.
[0053] When starting to display the guidance image 50, the control unit 10 may cause the plurality of guidance images 50 to appear in order. In this case, the control unit 10 may cause the first image 51 to first appear in the virtual image Vi and the third image 53 to last appear in the virtual image Vi.
[0054] The control unit 10 changes the virtual image Vi according to the current position of the vehicle 100. FIG. 11 shows the virtual image Vi when the vehicle 100 approaches the first branch point. The first branch point is an intersection. In this case, the virtual image Vi includes a line image 32 indicating the intersecting roads. The intersection point Cr1 where the line images 30, 32 intersect corresponds to the first branch point. The control unit 10 moves the line image 32 downward in the image vertical direction Gv as the vehicle 100 moves forward.
[0055] FIG. 12 shows the virtual image Vi when the vehicle 100 passes through the first branch point. The line image 32 of the intersecting roads is displayed on the side of the bird's-eye view image 20. The first image 51 is displayed until the vehicle 100 passes the first branch point.
[0056] FIG. 13 shows a virtual image Vi after the vehicle 100 has passed through the first branch point. When the control unit 10 passes through the first branch point, it ends the display of the first image 51. At this time, the first image 51 slides out to the lower end of the virtual image Vi while moving along, for example, the line image 30. At this time, the first image 51 may fade out.
[0057] When the display of the first image 51 ends, as shown in FIG. 13, a second image 52 and a third image 53 are displayed as the guidance image 50. The second image 52 is displayed overlapping the third image 53. The second image 52 in FIG. 13 is displayed, for example, at the same position and the same size as the first image 51 in FIG. 10. The third image 53 in FIG. 13 is displayed, for example, at the same position and the same size as the second image 52 in FIG. 10. The second image 52 is displayed with higher brightness than the third image 53.
[0058] The control unit 10 changes the virtual image Vi according to the current position of the vehicle 100. For example, when the vehicle 100 approaches the second branch point, a line image similar to the line image 32 in FIG. 11 is displayed.
[0059] When the vehicle 100 passes through the second branch point, the control unit 10 ends the display of the second image 52. At this time, the second image 52 slides out to the lower end of the virtual image Vi while moving along, for example, the line image 30. At this time, the second image 52 may fade out.
[0060] When the display of the second image 52 ends, as shown in FIG. 14, only the third image 53 is displayed as the guidance image 50. The third image 53 is displayed overlapping the line image 30. A shadow 30s by the third image 53 is displayed on the line image 30.
[0061] Figures 15 and 16 show the virtual image Vi when the vehicle 100 approaches the third branch point. The third branch point is an intersection where the vehicle 100 should turn left. When approaching a branch point where a left or right turn is to be made, the control unit 10 causes the line images 30 and 32 viewed from a high altitude to be displayed. At this time, the control unit 10 raises the position of the eyes in the bird's-eye view as the vehicle 100 approaches the branch point.
[0062] Figure 16 shows the virtual image Vi when approaching the branch point even closer than in Figure 15. The position of the eyes in the bird's-eye view of Figure 16 is higher than the position of the eyes in the bird's-eye view of Figure 15. The driver 200 can easily confirm the road shape of the forward branch point from the line images 30 and 32 viewed from a high position.
[0063] In Figure 16, instead of the third image 53, an arrow image 54 is displayed. The arrow image 54 has a shape along the traveling direction at the branch point. The arrow image 54 has a portion 54a along the line image 30 of the currently traveling road and a portion 54b along the line image 32 of the road after the left turn. The driver 200 can grasp the shape of the branch point in advance from the line images 30 and 32 and the arrow image 54. The arrow image 54 is a predetermined image in which the depth based on the vanishing point Vp is represented. For example, the width of the portion 54a becomes narrower as it goes toward the vanishing point Vp.
[0064] Figure 17 shows the virtual image Vi when reaching just before the branch point. The position of the eyes in the bird's-eye view of Figure 17 is, for example, the same as the position of the eyes in the bird's-eye view of Figure 14. That is, before the vehicle 100 reaches the branch point, the control unit 10 lowers the position of the eyes in the bird's-eye view from the raised position to the original position. When the vehicle 100 reaches just before the branch point, the traveling direction is guided by the arrow image 54.
[0065] The arrow image 54 extends upward on the image from the bird's-eye view image 20 toward the vanishing point Vp, and the tip is bent toward the direction in which it should proceed. When the vehicle 100 moves forward, the line image 32 approaches the bird's-eye view image 20. In other words, as the vehicle 100 approaches the branch point, the line image 32 moves downward on the image. In response to the movement of the line image 32, the arrow image 54 becomes shorter.
[0066] As shown in FIG. 18, the shapes of the line images 30 and 32 at this time are the same as the actual shape of the road 300 that the driver 200 is looking at. Therefore, the driver 200 can easily identify the branch point where the road 300 should turn. Also, as seen from the driver 200, the upper part Vu of the virtual image Vi appears farther away from the lower part Vd. The inclined virtual image Vi like this is likely to be felt as being displayed along the road surface of the actual road 300. Therefore, the vehicle display device 1 of the present embodiment can produce a natural sense of depth in the virtual image Vi.
[0067] FIG. 19 shows the virtual image Vi when the vehicle 100 is turning left at the branch point. The control unit 10 rotates the line images 30 and 32 in response to the change in the direction of the vehicle 100. The control unit 10 determines the position and angle of the line images 30 and 32 based on, for example, the detection result of the yaw rate sensor of the vehicle 100.
[0068] The control unit 10 changes the arrow image 54 in accordance with the progress of the left turn. More specifically, the arrow image 54 becomes shorter as the left turn progresses. The control unit 10 shortens the portion 54b along the line image 32 in the arrow image 54. When the left turn is completed, the control unit 10 ends the display of the arrow image 54.
[0069] Next, the virtual image Vi when ACC (Adaptive Cruise Control) control is performed in the vehicle 100 will be described. FIG. 20 shows the virtual image Vi before the ACC control is started. The vehicle 100 is traveling on a highway. The virtual image Vi in FIG. 20 has a bird's-eye view image 20, a speed image 21, and a line image 30.
[0070] FIG. 21 shows a virtual image Vi when the ACC control is started. The virtual image Vi in FIG. 21 has an aerial view image 20, a speed image 21, a line image 33, a set value image 22, and a plurality of graphic images 60.
[0071] The set value image 22 is a set value of the traveling speed in the ACC control. In the following description, the set value of the traveling speed in the ACC control is simply referred to as the set speed. The set speed is set by, for example, the driver 200. The set speed in FIG. 21 is 120 [km / h]. The set value image 22 is displayed in a color different from that of the speed image 21. The color of the speed image 21 is, for example, white. The color of the set value image 22 is, for example, green. The set value image 22 is arranged above the speed image 21 in the image vertical direction Gv. The set value image 22 is displayed in smaller characters than the speed image 21.
[0072] The color of the line image 33 when the ACC control is being executed is different from the color of the line image 30 when the ACC control is not being executed. The color of the line image 30 before the start of the ACC control is, for example, white. The color of the line image 33 during the execution of the ACC control is, for example, light blue or blue. By displaying the line image 33 in a color different from before, the driver 200 recognizes that the vehicle has shifted to the ACC control.
[0073] The graphic image 60 is an image that three-dimensionally represents changes in the inter-vehicle distance and the like in the ACC control. The shape of the graphic image 60 in the present embodiment is a rectangle. The graphic image 60 in FIG. 21 has a first image 61, a second image 62, and a third image 63. The three graphic images 60 are displayed partially overlapping. The relative positions of the three graphic images 60 change according to the target value of the inter-vehicle distance and the like.
[0074] The three graphic images 60 are arranged side by side along a line extending toward the vanishing point Vp. The graphic images 60 are arranged on the back side closer to the vanishing point Vp with respect to the bird's-eye view image 20. The first image 61 is arranged at the frontmost position among the three graphic images 60. The third image 63 is arranged at the rearmost position among the three graphic images 60. The three graphic images 60 are arranged at equal intervals, for example, along the depth direction based on the vanishing point Vp.
[0075] One graphic image 60 is superimposed on a part of another graphic image 60. For example, the second image 62 is superimposed on the lower part of the third image 63. The first image 61 is superimposed on the lower part of the second image 62. The plurality of graphic images 60 superimposed on each other can give the driver 200 a sense of depth. The graphic image 60 is a predetermined image in which the depth based on the vanishing point Vp is expressed.
[0076] Among the plurality of graphic images 60, the graphic image 60 displayed at the frontmost is larger than the other graphic images 60. Among the plurality of graphic images 60, the graphic image 60 displayed at the rearmost is smaller than the other graphic images 60. Also, when three or more graphic images 60 are displayed, the graphic images 60 become smaller as they go from the front side toward the vanishing point Vp on the back side.
[0077] Among the plurality of graphic images 60, the graphic image 60 displayed at the frontmost is displayed with higher luminance than the other graphic images 60. Among the plurality of graphic images 60, the graphic image 60 displayed at the rearmost is displayed with lower luminance than the other graphic images 60. Also, when three or more graphic images 60 are displayed, the graphic images 60 become higher in luminance as they go from the back side to the front side away from the vanishing point Vp. In one graphic image 60, the luminance of the contour line is the highest.
[0078] When the control unit 10 starts displaying the graphic images 60, it may display the plurality of graphic images 60 in order. In this case, the control unit 10 may cause the first image 61 to appear first and the third image 63 to appear last.
[0079] The first image 61 of the present embodiment is displayed such that the bird's-eye view image 20 overlaps a part of the first image 61. That is, a part of the first image 61 is hidden by the bird's-eye view image 20. With such a display, it is easy for the driver 200 to understand that the plurality of graphic images 60 indicate virtual objects or segments in front of the vehicle 100.
[0080] In ACC control, when the preceding vehicle is not detected or when there is a sufficient inter-vehicle distance from the preceding vehicle to the vehicle 100, control is executed to drive the vehicle 100 at the set speed. The target speed in this case is equal to the set speed. The vehicle ECU mounted on the vehicle 100 executes driving control to drive the vehicle 100 at the target speed.
[0081] When the virtual image Vi in FIG. 21 is being displayed, the traveling speed of the vehicle 100 is 100 [km / h]. Therefore, the vehicle ECU executes control to accelerate the vehicle 100 to the set speed of 120 [km / h].
[0082] The relative positions of the plurality of graphic images 60 are determined according to the target value of the inter-vehicle distance and the like. In the following description, the target value of the inter-vehicle distance is simply referred to as the target distance Dt. When no preceding vehicle is detected in front of the vehicle 100 or when the inter-vehicle distance from the vehicle 100 to the preceding vehicle is sufficiently large, the interval between the graphic images 60 is set to the initial interval. FIG. 21 shows the graphic images 60 arranged at the initial interval D1.
[0083] FIG. 22 shows the virtual image Vi during acceleration by ACC control. When the vehicle 100 is accelerating toward the target speed, the control unit 10 displays a plurality of mark images 34 superimposed on the line image 33. The illustrated mark image 34 is a circular or oval image and is displayed in a color different from that of the line image 33. The color of the mark image 34 is, for example, white.
[0084] When the vehicle 100 is accelerating by ACC control, the control unit 10 executes an acceleration animation that moves the mark image 34. In FIG. 23, the direction of movement of the mark image 34 in the acceleration animation is indicated by a dashed arrow. In the acceleration animation, the mark image 34 moves away from the vanishing point Vp along the line image 33. That is, the mark image 34 moves away from the vanishing point Vp along the depth direction based on the vanishing point Vp. The size of the mark image 34 increases as it moves away from the vanishing point Vp. By displaying the acceleration animation, the driver 200 recognizes that the current acceleration of the vehicle 100 is the intended acceleration by ACC control. The mark image 34 is a predetermined image in which the depth based on the vanishing point Vp is represented.
[0085] In the acceleration animation, the control unit 10 increases the moving speed of the mark image 34 as the traveling speed increases. By changing the moving speed of the mark image 34 in conjunction with the traveling speed of the vehicle 100, an animation that matches the driver's 200 perception is obtained.
[0086] When the traveling speed of the vehicle 100 reaches the target speed, the vehicle ECU ends the acceleration and shifts to the control of constant-speed driving. When the acceleration of the vehicle 100 ends, the control unit 10 ends the acceleration animation. As a result, the display of the mark image 34 ends.
[0087] FIGS. 24 and 25 show the virtual image Vi when the vehicle 100 is trying to catch up with the preceding vehicle 400. At this time, the inter-vehicle distance Ds from the vehicle 100 to the preceding vehicle 400 is larger than the target distance Dt.
[0088] As shown in FIG. 25, the virtual image Vi when the vehicle 100 is trying to catch up with the preceding vehicle 400 includes the vehicle image 65. The vehicle image 65 is an image showing the preceding vehicle 400 and is displayed closer to the vanishing point Vp than the graphic image 60. The position of the vehicle image 65 changes according to the detected inter-vehicle distance Ds. As the inter-vehicle distance Ds becomes shorter, the position of the vehicle image 65 approaches the bird's-eye view image 20.
[0089] When the control unit 10 starts displaying the vehicle image 65, it changes the relative position of the graphic image 60. More specifically, the control unit 10 changes the position of the graphic image 60 so as to widen the interval between the two graphic images 60. The interval between the graphic images 60 in FIG. 25 is the second interval D2. The second interval D2 is larger than the initial interval D1. The control unit 10 moves the second image 62 and the third image 63 toward the vanishing point Vp, thereby displaying the three graphic images 60 at the second interval D2.
[0090] FIG. 26 shows a virtual image Vi when the inter-vehicle distance Ds has decreased to a value close to the target distance Dt. When the inter-vehicle distance Ds approaches the target distance Dt, the third image 63 overlaps the vehicle image 65. As a result, the driver 200 can intuitively recognize that the vehicle 100 has approached the preceding vehicle 400. In other words, the driver 200 can recognize that the vehicle 100 has shifted to the following mode with respect to the preceding vehicle 400 by the ACC control. The vehicle ECU executes deceleration control so that the inter-vehicle distance Ds does not fall below the target distance Dt.
[0091] The virtual image Vi in FIG. 26 is a virtual image Vi during deceleration by the ACC control. When the vehicle 100 is decelerating by the ACC control, the control unit 10 displays a plurality of mark images 34 superimposed on the line image 33. The mark image 34 during deceleration has, for example, the same shape and color as the mark image 34 during acceleration.
[0092] When the vehicle 100 is decelerating by the ACC control, the control unit 10 executes a deceleration animation for moving the mark image 34. The direction of movement of the mark image 34 in the deceleration animation is the direction shown in FIG. 23. That is, the mark image 34 moves along the line image 33 so as to move away from the vanishing point Vp. Here, the speed of movement of the mark image 34 in the deceleration animation is slower than the speed of movement of the mark image 34 in the acceleration animation.
[0093] When the deceleration animation is executed, the driver 200 recognizes that the current deceleration of the vehicle 100 is the intended deceleration by the ACC control. In the deceleration animation, the control unit 10 decreases the moving speed of the mark image 34 as the traveling speed decreases. By changing the moving speed of the mark image 34 in conjunction with the traveling speed of the vehicle 100, an animation that matches the driver's perception is obtained.
[0094] The target value of the inter-vehicle distance changes according to the target speed in the ACC control. When the vehicle 100 decelerates due to approaching the preceding vehicle 400, the target distance Dt also decreases. FIG. 27 shows a virtual image Vi when the vehicle 100 further decelerates with respect to FIG. 26. In FIG. 27, the vehicle image 65 approaches the bird's-eye view image 20 with respect to FIG. 26, and the interval of the graphic images 60 becomes narrower. Due to such a change in the graphic images 60, an effect is produced as if a plurality of graphic images 60 are maintaining the space between vehicles as a buffer material.
[0095] The change in the interval of the graphic images 60 may be fast at the start of deceleration and slow at the end of deceleration. In this case, it can be made to appear as if a plurality of graphic images 60 are being compressed by the approaching vehicle image 65 to generate a repulsive force.
[0096] When the deceleration by the ACC control ends, the control unit 10 ends the deceleration animation. As a result, the display of the mark image 34 ends. The driver 200 recognizes that the vehicle has shifted to a constant-speed driving in accordance with the preceding vehicle 400 by the disappearance of the mark image 34.
[0097] Note that the scene where the graphic images 60 are displayed is not limited to during the execution of the ACC control. For example, when the control unit 10 performs automatic braking control for collision avoidance, the control unit 10 may display a virtual image Vi including a plurality of graphic images 60. When the driver 200 is operating the vehicle 100, the control unit 10 may display a virtual image Vi including a plurality of graphic images 60 in order to prompt the driver to ensure a sufficient inter-vehicle distance from the preceding vehicle 400.
[0098] FIG. 28 shows a virtual image Vi displayed during charging of the vehicle 100. The vehicle 100 is parked at a charging station or the like, and a charging connector is connected to the vehicle 100. The virtual image Vi during charging has a bar graph image 70 and a percentage image 23. The bar graph image 70 is an image of a three-dimensional figure showing the state of charge of the battery of the vehicle 100. The illustrated shape of the bar graph image 70 is an arc shape. The control unit 10 extends the bar graph image 70 as the remaining charge amount of the battery increases. The bar graph image 70 is an example of a predetermined image and is an image presented in a bird's-eye view based on the vanishing point Vp.
[0099] The percentage image 23 is an image of characters showing the state of charge of the battery. The percentage image 23 is arranged in an area surrounded by the bar graph image 70 so as not to overlap with the bar graph image 70. With such an arrangement, to the driver 200, the percentage image 23 appears to be displayed on a vertical plane along the vehicle vertical direction Z.
[0100] FIG. 29 shows the virtual image Vi when charging is completed. When charging of the battery is completed, the control unit 10 causes a notification image 24 to be displayed. The notification image 24 is an image of characters notifying the driver 200 that charging has been completed. The notification image 24 is arranged on the side of the vanishing point Vp with respect to the bar graph image 70. Therefore, the notification image 24 is displayed farther away from the driver 200 than the percentage image 23. The three-dimensional bar graph image 70 and the two character images with different positions in the depth direction produce a sense of depth of the virtual image Vi.
[0101] As described above, the vehicle display device 1 of the present embodiment includes a display device 3 and a control unit 10 that controls the display device 3. The display device 3 displays a virtual image Vi for the driver 200 by projecting display light Lt of an image onto a reflection surface 110a in front of the driver 200 in the vehicle 100. The display device 3 is configured such that the upper part Vu of the virtual image Vi appears farther from the driver 200 than the lower part Vd of the virtual image Vi. The virtual image Vi displayed by the display device 3 includes a predetermined image in which the depth based on the vanishing point Vp is expressed. The vehicle display device 1 of the present embodiment can display a virtual image Vi with a sense of depth by combining the virtual image Vi in which the upper part Vu appears farther from the driver 200 than the lower part Vd and the predetermined image.
[0102] The predetermined image may be, for example, a plurality of dot images 40 that move toward the vanishing point Vp along the depth direction based on the vanishing point Vp, or a plurality of dot images 41 or a plurality of mark images 34 that move away from the vanishing point Vp along the depth direction.
[0103] The sizes of the plurality of dots moving toward the vanishing point Vp become smaller as they approach the vanishing point Vp. For example, the size of the dot image 40 becomes smaller as it approaches the vanishing point Vp. The sizes of the plurality of dots moving away from the vanishing point Vp become larger as they move away from the vanishing point Vp. For example, the sizes of the dot image 41 and the mark image 34 become larger as they move away from the vanishing point Vp. Such a change in the size of the dots increases the sense of depth of the virtual image Vi.
[0104] When the vehicle 100 starts moving forward, the control unit 10 of the present embodiment causes the display device 3 to display a plurality of dot images 41 that move away from the vanishing point Vp as the predetermined image. The moving dot image 41 represents that the shift position of the vehicle 100 is in the forward position.
[0105] When a shift change to a shift position for moving the vehicle 100 forward is made, the control unit 10 of the present embodiment starts an animation of a plurality of point images 41 moving away from the vanishing point Vp. By starting the animation in response to the shift change, a mis-start of the vehicle 100 in the wrong direction is suppressed.
[0106] When the vehicle 100 starts to reverse, the control unit 10 of the present embodiment causes the display device 3 to display a plurality of point images 40 moving toward the vanishing point Vp as a predetermined image. The moving point images 40 represent that the shift position of the vehicle 100 is a position for reverse.
[0107] When a shift change to a shift position for moving the vehicle 100 backward is made, the control unit 10 of the present embodiment starts an animation of a plurality of point images 40 moving toward the vanishing point Vp. By starting the animation in response to the shift change, a mis-start of the vehicle 100 in the wrong direction is suppressed.
[0108] The predetermined image of the present embodiment includes an aerial view image 20 of the vehicle and a line image 30. The predetermined image may include an aerial view image 20 and a line image 33. The line images 30, 33 are images showing the boundaries of the lanes on which the vehicle 100 travels and extend toward the vanishing point Vp. The aerial view image 20 and the line images 30, 33 give a sense of depth to the virtual image Vi.
[0109] Note that the means for displaying the virtual image Vi obliquely is not limited to the magnification of the second mirror 6. For example, as shown in FIG. 30, it is also possible to tilt the virtual image Vi depending on the posture of the image display unit 4. In the image display unit 4 shown in FIG. 30, the display surface 4a is tilted with respect to the optical axis of the display light Lt from the display surface 4a toward the first mirror 5. More specifically, the display surface 4a is tilted such that the optical path length of the display light Lt toward the first end portion 6u of the second mirror 6 is longer than the optical path length of the display light Lt toward the second end portion 6d. Therefore, the virtual image Vi is tilted with respect to the vehicle vertical direction Z such that the upper part Vu of the virtual image Vi appears farther from the driver 200 than the lower part Vd of the virtual image Vi.
[0110] The display device 3 can also tilt the virtual image Vi by both the tilted display surface 4a and the second mirror 6. The display device 3 may have a mechanism for adjusting the degree of tilt of the display surface 4a. FIG. 31 shows a rotatable image display unit 4. The image display unit 4 in FIG. 31 is rotatable about a rotation axis 4b. The central axis of the rotation axis 4b is a straight line passing through the central portion of the display surface 4a. The display device 3 has a motor 11 for rotating the image display unit 4. The control unit 10 controls the motor 11 to set the angle of the display surface 4a to a target angle. With such a configuration, the tilt angle of the virtual image Vi can be changed.
[0111] [Modification of the Embodiment] The configuration for tilting the virtual image Vi is not limited to the configuration exemplified in the embodiment. The number of display guide images 50 and the number of display graphic images 60 in the virtual image Vi are not limited to the exemplified numbers. The content displayed on the guide image 50 is not limited to the arrow for route guidance. The guide image 50 may include character information.
[0112] The shape of the graphic image 60 is not limited to a rectangle. The shape of the graphic image 60 may be circular, oval, or other shapes. The display position of the virtual image Vi is not limited to the position exemplified in the embodiment. For example, the virtual image Vi may be displayed superimposed on an object of attention in front of the vehicle 100. The object of attention may be, for example, another vehicle such as a preceding vehicle 400 or a pedestrian, or other objects. The reflecting surface that reflects the display light Lt toward the driver 200 is not limited to the surface of the windshield 110. The reflecting surface may be, for example, the reflecting surface of a combiner or the surface of other reflecting members.
[0113] The contents disclosed in the above embodiment and modification can be executed in appropriate combination.
Description of Reference Numerals
[0114] 1: Vehicle display device 2: Housing, 3: Display device, 4: Image display section, 4a: Display surface 5: First mirror 6: Second mirror, 6r: Reflective surface, 6u: First end, 6d: Second end 10: Control section 20: Bird's-eye view image, 21: Speed image, 22: Set value image 30, 33: Line image, 31: Position image, 32: Line image 34: Mark image 40: Dot image, 41: Dot image 50: Guidance image, 51: First image, 52: Second image, 53: Third image 54: Arrow image 60: Graphic image, 61: First image, 62: Second image, 63: Third image 65: Vehicle image 70: Bar graph image 100: Vehicle, 110: Windshield, 110a: Reflective surface 120: Dashboard 200: Driver 300: Road 400: Leading vehicle Ds: Inter-vehicle distance, Dt: Target distance EP: Eye point Gh: Horizontal direction of image, Gv: Vertical direction of image L1: Virtual line Lt: Display light Sc: Scenery Vi: Virtual image, Vd: Lower part, Vu: Upper part Vp: Vanishing point X: Vehicle longitudinal direction, Z: Vehicle vertical direction
Claims
1. A display device configured to project display light of an image onto a reflection surface in front of a driver in a vehicle to display a virtual image for the driver, and configured such that the upper part of the virtual image appears farther from the driver than the lower part of the virtual image; A control unit that controls the display device; comprising: The virtual image displayed by the display device includes a predetermined image in which depth based on a vanishing point is expressed. A vehicle display device characterized by the above.
2. The predetermined image is an image of a plurality of points moving toward the vanishing point along the depth direction based on the vanishing point, or an image of a plurality of points moving away from the virtual image along the depth direction. The vehicle display device according to claim 1.
3. The sizes of the plurality of points moving toward the vanishing point become smaller as they approach the vanishing point, and the sizes of the plurality of points moving away from the vanishing point become larger as they move away from the vanishing point. The vehicle display device according to claim 2.
4. When the vehicle starts to move forward, the control unit causes the display device to display an image of a plurality of points moving away from the vanishing point as the predetermined image. The vehicle display device according to claim 2.
5. When a shift change is made to a shift position for moving the vehicle forward, the control unit starts an animation of an image of a plurality of points moving away from the vanishing point. The vehicle display device according to claim 4.
6. When the vehicle starts to move backward, the control unit causes the display device to display an image of a plurality of points moving toward the vanishing point as the predetermined image. The vehicle display device according to claim 2.
7. When a shift change to a shift position for reversing the vehicle is made, the control unit starts an animation of images of a plurality of points moving toward the vanishing point. The vehicle display device according to claim 6.
8. The predetermined image includes an aerial view image of the vehicle and an image showing a boundary of a lane on which the vehicle travels, and an image of a line extending toward the vanishing point. The vehicle display device according to claim 1.
Citation Information
Patent Citations
Vehicle display device
JP2023056063A