Vehicle display device, display method, and program

The vehicle display system addresses annoyance and visibility issues by dynamically adjusting destination display based on proximity, ensuring seamless transition from display to foreground awareness as the vehicle approaches the destination.

JP7845444B2Active Publication Date: 2026-04-14TOYOTA JIDOSHA KK
View PDF 5 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
TOYOTA JIDOSHA KK
Filing Date
2024-12-04
Publication Date
2026-04-14

AI Technical Summary

Technical Problem

Existing vehicle display systems may cause annoyance and reduced visibility by constantly displaying destination icons, especially when the vehicle is near the destination, affecting the occupant's perception of the foreground.

Method used

A vehicle display system that adjusts the display of destination information based on the vehicle's proximity to the destination, using first and second images that adapt in size and focus to minimize foreground obstruction and enhance visibility.

Benefits of technology

The system allows intuitive and unobtrusive display of destination information, shifting focus from the display to the foreground as the vehicle approaches the destination, maintaining visibility and reducing annoyance.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007845444000001
    Figure 0007845444000001
  • Figure 0007845444000002
    Figure 0007845444000002
  • Figure 0007845444000003
    Figure 0007845444000003
Patent Text Reader

Abstract

To display information on a destination point in consideration of a positional relation between a vehicle and the destination point.SOLUTION: A vehicle display device 10 displays a prescribed image in a display area 26 which indicates a front view of a vehicle 12. The vehicle display device 10 acquires positional information for the vehicle 12 and positional information for a destination point, and determines whether the destination point is being displayed in the display area 26. When the determination results in negative, a first image indicating a direction of the destination point is displayed in the display area 26. When the determination results in affirmative, a second image indicating an area where the destination point is located is displayed in an out-of-focus manner such that the destination point overlaps with the area where the destination point is located. After that, when a distance L from the vehicle 12 to the destination point is a second threshold value or more, the size of the second image on the display area 26 is made gradually smaller as the vehicle 12 approaches the destination point. When the distance L is smaller than the second threshold value, the second image is displayed in the display area 26 so that the size of the second image in the display area 26 becomes gradually larger as the vehicle approaches the destination point.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a vehicle display device, a display method, and a program.

Background Art

[0002] Patent Document 1 below discloses a vehicle display device (head-up display device) that projects an image onto a combiner disposed between an occupant in a vehicle interior and a front window and displays the direction of a destination of the vehicle. In this vehicle display device, an image of a direction information display ring projected onto the combiner overlaps with the foreground that the occupant visually recognizes through the front window. Then, the direction of the destination with respect to the vehicle is displayed based on the position of a destination icon that moves above the direction display ring.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, if an icon indicating the direction of the destination is constantly displayed at the center of the display area as in Patent Document 1 above, depending on the positional relationship between the vehicle and the destination, there is a possibility that the occupant may feel annoyed. For example, when the vehicle is traveling near the destination and the occupant visually checks the display area to confirm the destination from the foreground, the visibility of the foreground may be reduced by the icon indicating the direction of the destination, and the occupant may feel annoyed.

[0005] The present disclosure has been made in view of the above points, and an object thereof is to provide a vehicle display device, a display method, and a program that can display information regarding a destination point in consideration of the positional relationship between the vehicle and the destination point.

Means for Solving the Problems

[0006] A vehicle display device according to the first embodiment is a vehicle display device that displays a predetermined image in a display area showing the foreground of a vehicle, comprising: a location information acquisition unit that acquires location information of the vehicle and location information of a destination point; a determination means that determines whether the destination point is displayed in the display area showing the foreground of the vehicle; a display control unit that, if the determination means determines that the destination point is not displayed in the display area showing the foreground of the vehicle, displays a first image indicating the direction of the destination point in the display area; if the determination means determines that the destination point is displayed in the display area showing the foreground of the vehicle, displays a second image indicating the area where the destination point is located in an out-of-focus manner so as to overlap the area where the destination point is located; and, if the distance from the vehicle to the destination point is greater than or equal to a second threshold, displays the second image in the display area such that the size of the second image in the display area gradually decreases as the vehicle approaches the destination point; and, if the distance from the vehicle to the destination point is less than the second threshold, displays the second image in the display area such that the size of the second image in the display area gradually increases as the vehicle approaches the destination point.

[0007] In the first embodiment, the vehicle display device displays a predetermined image in a display area showing the foreground of the vehicle. The location information acquisition unit acquires the location information of the vehicle and the location information of the destination point, and the determination means determines whether the destination point is displayed in the display area showing the foreground of the vehicle. If it is determined that the destination point is not displayed in the display area, a first image indicating the direction of the destination point is displayed in the display area. This makes it possible to inform the occupants of the direction of the destination point, taking into account the positional relationship between the vehicle and the destination point.

[0008] Furthermore, in the first embodiment, when the display control unit determines that a destination point is displayed in the display area, it displays a second image indicating the area where the destination point is located in an out-of-focus manner so as to overlap the area where the destination point is located. Then, if the distance from the vehicle to the destination point is greater than or equal to a second threshold, the display control unit displays the second image in the display area in such a way that its size gradually decreases as the vehicle approaches the destination point. This allows, for example, when the vehicle is relatively far from the destination point, the presence of the destination point in the foreground is extremely small, so by deliberately displaying the second image larger, the occupant can recognize the area where the destination point is located while remaining aware of the foreground. Then, by gradually decreasing the size of the second image as the vehicle approaches the destination point, the area where the destination point is located is reduced, and the display manner is changed so that the occupant's awareness naturally shifts to the destination point in the foreground. In this way, as the vehicle approaches the destination point, the occupant's recognition of the destination point can be naturally shifted from the second image to the destination point in the foreground.

[0009] Furthermore, in the first embodiment, when the distance from the vehicle to the destination point is less than the second threshold, the display control unit displays the second image in the display area such that the size of the second image in the display area gradually increases as the vehicle approaches the destination point. As a result, for example, when the destination point is visible from the display area, the display of the second image is enlarged to match the gradually approaching destination point. Therefore, it is possible to give the occupant a visual effect in which the second image appears to become one with the destination point and approach the vehicle, thereby allowing them to intuitively recognize the degree to which they have reached the destination point.

[0010] In the second embodiment, in the first embodiment, when the determination means determines whether the destination point is displayed in the display area showing the foreground, it determines whether the distance from the vehicle to the destination point is greater than or equal to a first threshold greater than the second threshold, and if it determines that the distance from the vehicle to the destination point is greater than or equal to the first threshold, it does not determine that the destination point is displayed in the display area showing the foreground of the vehicle.

[0011] According to the second embodiment, when the determination means determines whether the destination point is displayed in the display area showing the foreground, it determines whether the distance from the vehicle to the destination point is greater than or equal to a first threshold, and if it determines that the distance from the vehicle to the destination point is greater than or equal to the first threshold, it does not determine that the destination point is displayed in the display area showing the foreground of the vehicle. For this reason, the vehicle display device displays a first image indicating the direction of the destination point in the display area. That is, when the distance from the vehicle to the destination point is sufficiently far and it is difficult to see the destination point from the display area, the direction of the destination point can be displayed. As a result, the destination point included in the foreground of the vehicle and the first image do not coexist in the display area, so that information about the destination point can be displayed without causing inconvenience to the occupants.

[0012] In the third aspect, in the first aspect, when the determination means determines whether the destination point is displayed in the display area showing the foreground, it determines whether the position of the destination point is a position that is not displayed in the display area due to being obstructed by surrounding objects, and if it determines that the position of the destination point is a position that is not displayed in the display area due to being obstructed by surrounding objects, it does not determine that the destination point is displayed in the display area showing the foreground of the vehicle.

[0013] According to the third embodiment, if the location of the destination point is not visible in the display area due to being obscured by surrounding objects, a first image indicating the direction of the destination point is displayed in the display area. That is, if the destination point is not visible from the display area due to being obscured by surrounding buildings, the direction of the destination point can be displayed. As a result, the destination point included in the foreground of the vehicle and the first image do not coexist in the display area, so information about the destination point can be displayed without causing inconvenience to the occupants.

[0014] A fourth aspect is that, in the first aspect, the display control unit, when the distance from the vehicle to the destination point is greater than or equal to a second threshold, displays the second image in the display area such that it gradually comes into focus from an out-of-focus aspect as the vehicle approaches the destination point.

[0015] According to the fourth aspect, the second image displayed in the display area is displayed in a way that gradually brings it into focus from an out-of-focus state as the vehicle approaches the destination. For example, if the destination is far from the vehicle and the presence of the destination in the foreground is very small, the outline of the second image is displayed ambiguously to indicate the area where the destination is located to the occupants. Subsequently, as the vehicle approaches the destination, the display mode of the second image is gradually changed to a state that brings it into focus, so that the outline of the second image becomes clearer and the position of the destination is clearly indicated. In this way, by displaying the second image in a way that allows the destination to be gradually clearly recognized from a position before the destination, the occupants can recognize their progress toward the destination without feeling any inconvenience.

[0016] The fifth embodiment is that, in any of the first to fourth embodiments, the display area is a projection surface projected by a head-up display device in front of the vehicle in the driver's seat, and the display control unit causes the second image to be displayed at a position corresponding to the destination point in the foreground of the vehicle visible through the display area.

[0017] According to the fifth embodiment, the display area showing the vehicle's foreground is a projection surface projected by a head-up display device in front of the driver's seat, and a second image showing the vehicle's destination is displayed at a position corresponding to the destination in the vehicle's foreground as seen through the display area. In this way, the vehicle display device displays the second image superimposed on the foreground from the driver's seat, allowing the occupant in the driver's seat to recognize the destination without significantly moving their gaze.

[0018] The sixth aspect of the display method is a display method for displaying a predetermined image in a display area showing the foreground of a vehicle, the method being used to obtain location information of the vehicle and location information of a destination point, determine whether the destination point is displayed in the display area showing the foreground of the vehicle, if the determination does not determine whether the destination point is displayed in the display area showing the foreground of the vehicle, display a first image indicating the direction of the destination point in the display area, if it is determined that the destination point is displayed in the display area showing the foreground of the vehicle, display a second image indicating the area where the destination point is located in an out-of-focus manner so as it overlaps with the area where the destination point is located, and then, if the distance from the vehicle to the destination point is greater than or equal to a second threshold, display the second image in the display area such that its size gradually decreases as the vehicle approaches the destination point, and if the distance from the vehicle to the destination point is less than the second threshold, display the second image in the display area such that its size gradually increases as the vehicle approaches the destination point. Display the image.

[0019] According to the sixth aspect, similar to the first aspect, if the destination point is not displayed in the display area, information regarding the destination point can be displayed considering the positional relationship between the vehicle and the destination point. If the destination point is displayed in the display area and the vehicle is relatively far from the destination point, the occupant can recognize the area where the destination point is located while remaining aware of the foreground. As the vehicle approaches the destination point, the occupant's recognition of the destination point can be naturally shifted from the second image to the destination point in the foreground. If the destination point is displayed in the display area and the vehicle is relatively close to the destination point, the degree to which the destination point has been reached can be intuitively recognized.

[0020] The program according to the seventh embodiment is a program that displays a predetermined image in a display area showing the foreground of a vehicle, and causes a computer to acquire location information of the vehicle and location information of a destination point, determine whether the destination point is displayed in the display area showing the foreground of the vehicle, and if the determination does not determine that the destination point is displayed in the display area showing the foreground of the vehicle, it displays a first image showing the direction of the destination point in the display area, and if it is determined that the destination point is displayed in the display area showing the foreground of the vehicle, it displays a second image showing the area where the destination point is located in an out-of-focus manner so as to overlap the area where the destination point is located, and if the distance from the vehicle to the destination point is greater than or equal to a second threshold, it displays the second image in the display area such that the size of the second image on the display area gradually decreases as the vehicle approaches the destination point, and if the distance from the vehicle to the destination point is less than the second threshold, it displays the second image in the display area such that the size of the second image on the display area gradually increases as the vehicle approaches the destination point.

[0021] According to the seventh aspect, similar to the first aspect, if the destination point is not displayed in the display area, information regarding the destination point can be displayed considering the positional relationship between the vehicle and the destination point. If the destination point is displayed in the display area and the vehicle is relatively far from the destination point, the occupant can recognize the area where the destination point is located while remaining aware of the foreground. As the vehicle approaches the destination point, the occupant's recognition of the destination point can be naturally shifted from the second image to the destination point in the foreground. If the destination point is displayed in the display area and the vehicle is relatively close to the destination point, the degree to which the destination point has been reached can be intuitively recognized. [Effects of the Invention]

[0022] According to the present disclosure, when the destination point is not displayed in the display area, information regarding the destination point can be displayed in consideration of the positional relationship between the vehicle and the destination point. When the destination point is displayed in the display area and the vehicle is relatively far from the destination point, the area where the destination point exists can be recognized while the occupant is conscious of the foreground, and as the vehicle approaches the destination point, the occupant's recognition of the destination point can be naturally shifted from the second image to the destination point in the foreground. When the destination point is displayed in the display area and the vehicle is relatively close to the destination point, the degree of approach to the destination point can be intuitively recognized.

Brief Description of the Drawings

[0023] [Figure 1] It is a schematic view of the front part of the vehicle interior in a vehicle to which the vehicle display device according to the present embodiment is applied, as viewed from the rear side of the vehicle. [Figure 2] It is a block diagram showing the hardware configuration of the vehicle display device according to the present embodiment. [Figure 3] It is a block diagram showing the functional configuration of the vehicle display device according to the present embodiment. [Figure 4] It is a flowchart showing an example of the flow of display processing in the present embodiment. [Figure 5] It is a diagram showing an example of the positional relationship between the vehicle and the destination point. [Figure 6] It is a diagram showing an example of the display method of the first image when the distance from the vehicle to the destination point is equal to or greater than the distance L1. [Figure 7] It is a diagram showing an example of the positional relationship between the vehicle and the destination point. [Figure 8] It is a diagram showing an example of the display method of the second image that changes as the distance from the vehicle to the destination point approaches, when the distance from the vehicle to the destination point is less than the distance L1 and equal to or greater than the distance L2. [Figure 9] It is a diagram showing an example of the display method of the second image that changes as the distance between the vehicle and the destination point approaches, when the distance from the vehicle to the destination point is less than the distance L2. [Figure 10] This is a schematic diagram showing a modified vehicle display device according to this embodiment. [Modes for carrying out the invention]

[0024] A vehicle 12 to which the vehicle display device 10 according to this embodiment is applied will be described with reference to the drawings. In this embodiment, the vehicle 12 is configured to allow switching between automatic driving and manual driving. Automatic driving refers to a driving mode in which some or all of the operations such as acceleration, braking, turn signals, and steering are performed automatically. Manual driving refers to a driving mode in which the driver performs all driving operations (acceleration, braking, turn signals, steering, etc.). As shown in Figure 1, an instrument panel 14 is provided at the front of the passenger compartment in the vehicle 12.

[0025] The instrument panel 14 extends in the vehicle width direction, and the steering wheel 16 is provided on the right side of the instrument panel 14. In other words, in this embodiment, as an example, it is a right-hand drive vehicle with the steering wheel 16 on the right side, and the driver's seat is set on the right side of the vehicle.

[0026] A windshield glass 18 is provided at the front end of the instrument panel 14. The windshield glass 18 is located on the front side of the vehicle from the driver's seat and extends in the vertical and horizontal directions of the vehicle, separating the interior of the vehicle from the exterior.

[0027] The right-side end of the windshield glass 18 is fixed to the right-side front pillar 20 of the vehicle. The front pillar 20 extends in the vertical direction of the vehicle, and the windshield glass 18 is fixed to the inner end of the front pillar 20 in the vehicle width direction. The front end of the front side glass 22 is fixed to the outer end of the front pillar 20 in the vehicle width direction. The left-side end of the windshield glass 18 is fixed to the left-side front pillar of the vehicle (not shown).

[0028] Here, the instrument panel 14 is provided with a first display unit 24 having a display area for a predetermined image. The first display unit 24 is a meter display located on the right side of the instrument panel 14 in the vehicle width direction, in front of the driver's seat. The meter display is part of a meter display device (not shown) connected to various meter devices mounted on the vehicle 12. The first display unit 24 is positioned so that it is within the driver's field of vision when the driver is looking forward at the vehicle.

[0029] The instrument panel 14 is provided with a second display unit 25 having a display area for a predetermined image. The second display unit 25 consists of a display located in the center of the instrument panel 14 in the vehicle width direction, on the vehicle front side of the driver's seat.

[0030] The windshield glass 18 is provided with a third display section 26 having a display area for a predetermined image. The third display section 26 is set on the upper side of the vehicle above the first display section 24 and is composed of a projection surface projected by a head-up display device 44 (see Figure 2). Specifically, the head-up display device 44 is set on the vehicle-front side of the instrument panel 14, and the head-up display device 44 is configured to project an image onto the third display section 26 of the windshield glass 18. In other words, the third display section 26 is composed of the windshield glass 18 which serves as the projection surface for the head-up display device 44.

[0031] (Hardware configuration of the vehicle display device 10) The vehicle 12 is equipped with an ECU (Electronic Control Unit) 28 as a control unit. Figure 2 is a block diagram showing the hardware configuration of the vehicle display device 10. As shown in Figure 2, the ECU 28 of the vehicle display device 10 is composed of a CPU (Central Processing Unit: processor) 30, ROM (Read Only Memory) 32, RAM (Random Access Memory) 34, storage 36, communication interface 38, and input / output interface 40. Each component is connected to the others so as to be able to communicate with each other via a bus 42.

[0032] The CPU 30 is a central processing unit that executes various programs and controls various components. Specifically, the CPU 30 reads programs from the ROM 32 or storage 36 and executes them using the RAM 34 as a working area. The CPU 30 controls each of the above components and performs various calculations according to the programs recorded in the ROM 32 or storage 36.

[0033] ROM32 stores various programs and data. RAM34 temporarily stores programs or data as a working area. Storage36 is composed of an HDD (Hard Disk Drive) or SSD (Solid State Drive) and stores various programs, including the operating system, and various data. In this embodiment, ROM32 or storage36 stores programs for display processing, and various data.

[0034] The communication interface 38 is an interface for the vehicle display device 10 to communicate with servers and other devices (not shown), and standards such as Ethernet®, LTE, FDDI, and Wi-Fi® can be used.

[0035] The input / output interface 40 is connected to a head-up display device 44 that projects predetermined images onto the first display unit 24, the second display unit 25, and the third display unit 26, and an actuator 46. The actuator 46 includes a steering actuator, an accelerator actuator, and a brake actuator. The steering actuator steers the vehicle 12. The accelerator actuator accelerates the vehicle 12. The brake actuator decelerates the vehicle 12 by controlling the brakes. The input / output interface 40 is also connected to a camera (not shown) that photographs the area around the vehicle 12, sensors for automatic driving of the vehicle 12, and a GPS device.

[0036] (Functional configuration of the vehicle display device 10) The vehicle display device 10 implements various functions using the above-mentioned hardware resources. The functional configuration implemented by the vehicle display device 10 will be explained with reference to Figure 3.

[0037] As shown in Figure 3, the vehicle display device 10 is configured as follows: a communication unit 50, an acquisition unit 51, a driving plan setting unit 52, an automatic driving control unit 54, a location information acquisition unit 56, a determination unit 58, an image generation unit 60, and a display unit 62. Each functional configuration is realized by the CPU 30 reading and executing a program stored in the ROM 32 or storage 36.

[0038] The communication unit 50 transmits and receives data with external servers and other devices via the communication interface 38. For example, it transmits and receives data such as map data and traffic conditions stored on the server. The communication unit 50 may also be configured to perform vehicle-to-vehicle communication with surrounding vehicles.

[0039] The acquisition unit 51 acquires information about the driving environment of the vehicle 12 as surrounding information from an external sensor (not shown) via the input / output interface 40. The external sensor comprises at least one of the following: a camera that images a predetermined range around the vehicle 12, a millimeter-wave radar that transmits search waves to the predetermined range, and a lidar (Light Detection and Ranging / Laser Imaging Detection and Ranging) that scans the predetermined range. The "surrounding information" includes, as an example, the shape and width of the lane in which the vehicle 12 is traveling, information about other vehicles and obstacles traveling near the vehicle 12, and environmental information such as the weather and darkness around the vehicle.

[0040] The operation plan setting unit 52 sets the operation plan for the vehicle 12. Specifically, when the destination point is entered by the crew, the operation plan from the current location to the destination point is set.

[0041] The automatic driving control unit 54 controls the switching between manual and automatic driving of the vehicle 12. Furthermore, when the driving mode of the vehicle 12 is switched to automatic driving, the automatic driving control unit 54 makes the vehicle 12 drive automatically according to a set operating plan, taking into account the vehicle's location information and the surrounding environment information. Specifically, it makes the vehicle 12 drive automatically by controlling the actuator 46.

[0042] The location information acquisition unit 56 acquires the location information of the vehicle 12 and the location information of the destination point set in the operation plan. Specifically, for example, it acquires the location information of the vehicle 12 using a GPS device. It also acquires the location information of the destination point of the vehicle 12 and map information of the area around the destination point by referring to map data.

[0043] The determination unit 58, acting as a determination means, has the function of determining whether the relationship between the vehicle's position and the destination's position satisfies predetermined conditions related to visual observation, based on the position information acquired by the position information acquisition unit 56. The predetermined conditions are, for example, those that, considering the distance from the vehicle 12 to the destination or the surrounding environment of the destination, determine that it is difficult for the occupant to visually confirm the destination through the third display unit 26 (windshield glass 18).

[0044] In this embodiment, the determination unit 58 determines whether the distance L from the vehicle 12 to the destination point is greater than or equal to distance L1 (for example, L1 = 200 m). That is, if the distance from the vehicle to the destination point is greater than or equal to distance L1, it is determined that it is difficult for the occupant to see the destination point through the third display unit 26, and the condition is met. In Figure 5, as an example, a destination point that is greater than or equal to distance L1 from the vehicle 12 is indicated by the symbol "G1".

[0045] Furthermore, in this embodiment, the determination unit 58 considers the surrounding environment of the destination point and determines whether the location of the destination point is visible through the third display unit 26. That is, even if the distance L from the vehicle 12 to the destination point is less than L1, if the destination point is not visible from the vehicle 12 due to being obstructed by surrounding buildings, etc., the determination unit 58 determines that it is difficult for the occupant to see the destination point through the third display unit 26 and determines that the condition is met. As an example, Figure 5 shows a destination point that is not visible from the vehicle 12 due to being obstructed by surrounding buildings B1 to B3, indicated by the symbol "G2".

[0046] The image generation unit 60 generates images for display on the third display unit 26, which is the projection surface of the head-up display device 44. The images generated by the image generation unit 60 include, for example, a meter display (not shown) indicating the vehicle's speed, and various images intended to assist manual and automated driving.

[0047] In this embodiment, the image generation unit 60 generates a first image 70 showing the direction of the destination point relative to the vehicle 12 when the determination unit 58 determines that the conditions are met. The image generation unit 60 also generates a second image 80 showing the destination point when the determination unit 58 determines that the conditions are not met.

[0048] The display unit 62, acting as a display control unit, displays the image generated by the image generation unit 60 in the display area of ​​the third display unit 26. The display unit 62 displays the first image 70 on the third display unit 26 if the determination unit 58 determines that the conditions are met. The display unit 62 deletes the first image 70 from the third display unit 26 and displays the second image 80 if the determination unit 58 determines that the conditions are not met. Furthermore, the display unit 62 deletes the second image 80 from the third display unit 26 when the vehicle 12 arrives at the destination.

[0049] In this embodiment, the display unit 62 displays the first image 70 and the second image 80 in the display area of ​​the third display unit 26 so as to blend with the foreground of the vehicle 12 as seen through the third display unit 26 (windshield glass 18).

[0050] As shown in Figure 6, the first image 70 is displayed at the edge of the display area of ​​the third display unit 26, taking into consideration the visibility to the front of the driver's seat, as an example. The first image 70 includes a flag-shaped destination icon 70A indicating the destination point and an arrow-shaped direction icon 70B pointing to the destination icon 70A. Looking at Figure 6, it can be seen that the direction icon 70B points in the direction of the destination icon 70A, which is positioned diagonally to the left and in front of the vehicle 12, so it can be seen that the destination point is located diagonally to the left and in front of the vehicle 12.

[0051] As shown in Figures 8 and 9, the second image 80 is displayed, for example, at a position corresponding to the destination point in the foreground that the driver's seat occupant can see through the third display unit 26. Therefore, to the driver's seat occupant, the second image 80 appears to be displayed overlapping with the destination point visible through the windshield glass 18. The second image 80 is composed of an image of a flag, for example. The second image 80 is displayed in a manner in which the focus and size of the image differ depending on the distance L from the vehicle 12 to the destination point. The detailed display method of the second image 80 will be described later.

[0052] (action) Next, the operation of this embodiment will be described.

[0053] (Display processing) An example of a display process that displays either the first image 70 or the second image 80 based on the position of the vehicle 12 and the position of the destination point will be explained using the flowchart shown in Figure 4. This display process is performed by the CPU 30 reading the display program from the ROM 32 or storage 36, loading it into the RAM 34, and executing it.

[0054] As shown in Figure 4, the CPU 30 determines in step S100 whether a destination has been set. The destination may be entered directly into the vehicle 12 by the occupant, or it may be entered indirectly via a mobile terminal or the like.

[0055] If the CPU 30 determines in step S100 that a destination has been set, it proceeds to the processing in step S101. If the CPU 30 determines in step S100 that no destination has been set, it repeats the processing in step S100.

[0056] In step S101, the CPU 30 sets the operation plan for the vehicle 12. Specifically, the CPU 30 sets the operation plan from the current location to the destination using the functions of the operation plan setting unit 52. When setting the operation plan, information on traffic conditions and accidents may be acquired and reflected. In addition, the operation plan may be set to maximize autonomous driving in accordance with the requests of the occupants that have been entered in advance.

[0057] In step S102, the CPU 30 determines, based on the function of the determination unit 58, whether the distance L from the vehicle 12 to the destination point is greater than or equal to distance L1. Here, as an example, distance L1 is set to 200m, so in step S102, the CPU 30 determines whether the distance L from the vehicle 12 to the destination point is 200m or greater. If the distance L to the destination point is 200m or greater, the CPU 30 proceeds to the process in step S103; if the distance L to the destination point is less than 200m, the CPU 30 proceeds to the process in step S104. Note that distance L1 corresponds to the "first threshold" in this invention.

[0058] In step S103, the CPU 30 displays a first image 70 on the third display unit 26, which indicates the direction of the destination point. For example, if the destination point G1 in Figure 5 is set as the destination point of the vehicle 12, the CPU 30 generates and displays a first image 70 indicating the direction of the destination point G1, since the destination point G1 is more than 200m away from the vehicle 12. As shown in Figure 6, the first image 70 consists of a flag-shaped destination icon 70A and an arrow-shaped direction icon 70B pointing to the destination icon 70A, and is displayed at the edge of the third display unit 26. In Figure 6, the direction icon 70B pointing diagonally forward to the left indicates that the destination point G1 is located diagonally forward to the left of the vehicle 12. After displaying the first image 70 in step S103, the CPU 30 returns to step S102 and repeats the process.

[0059] In step S104, the CPU 30 determines, based on the function of the determination unit 58, whether or not the destination point is shown in the display area of ​​the third display unit 26. Specifically, since the occupant views the foreground of the vehicle 12 through the third display unit 26 (windshield glass 18), the CPU 30 refers to the map data of the destination point and determines whether or not the destination point is visible through the windshield glass 18. If the CPU 30 determines that the destination point is not visible, it proceeds to the process in step S105; if it determines that the destination point is visible, it proceeds to the process in step S106.

[0060] In step S105, the CPU 30 displays a first image 70 on the third display unit 26 that shows the direction of the destination point. For example, if the destination point G2 in Figure 5 is set as the destination point of the vehicle 12, the destination point G2 is obscured by the surrounding buildings B1 to B3 and cannot be seen from the vehicle 12. Therefore, the CPU 30 generates and displays a first image 70 that shows the direction of the destination point G2. Since the destination point G2 is located diagonally to the left and in front of the vehicle 12, the direction icon 70B is displayed pointing diagonally to the left and in front, similar to the first image 70 shown in Figure 6.

[0061] In step S106, the CPU 30 displays the second image 80 at a position corresponding to the destination point visible through the third display unit 26. That is, the CPU 30 indicates the position of the destination point visible through the third display unit 26 when the distance L from the vehicle 12 to the destination point is less than 200m using the second image 80.

[0062] As shown in Figures 8 and 9, the second image 80 is displayed so as to overlap with the destination point of the real image seen by the occupant when the occupant views the foreground through the third display unit 26 (windshield glass 18). As shown in Figure 8, if the distance L from the vehicle 12 to the destination point is L2 (=100m) or more, the second image 80 is displayed as a rectangular planar figure in an out-of-focus manner. Note that an out-of-focus manner means that the outline of the image is blurred and ambiguously shown, and is not limited to projecting an out-of-focus image onto the third display unit 26, but also includes generating and displaying an image in which the outline of the figure is ambiguously represented. As shown in Figure 8(A), the third display unit 26 displays the second image 80 in an ambiguous state, superimposed on the destination point G3 located in front of the vehicle 12. In this state, the second image 80 indicates to the occupant the area where the destination point G3 is located.

[0063] In step S107, the CPU 30 determines whether the distance L to the destination point is less than the distance L2, based on the position information of the vehicle 12 and the destination point. Here, as an example, the distance L2 is set to 100m. In step S107, the CPU 30 determines whether the distance L from the vehicle 12 to the destination point is less than 100m. Then, if the distance L to the destination point is 100m or more, the CPU 30 proceeds to the process in step S108, and if the distance L to the destination point is less than 100m, it proceeds to the process in step S109. Note that the distance L2 corresponds to the "second threshold" in this invention.

[0064] In step S108, the CPU 30 displays the second image 80 in such a way that its size gradually decreases as the distance L from the vehicle 12 to the destination point decreases. This can be achieved, for example, by changing the image so that the focus of the second image 80 gradually improves as the distance L from the vehicle 12 to the destination point decreases.

[0065] In other words, when the focus of the second image 80 is shifted to a state where its outline is almost indistinguishable, the area occupied by the second image 80 in the display area increases, and at the same time, its transparency increases. In this state, the second image is displayed so as to overlap an area of ​​a certain size within the foreground visible to the occupant, but because it is a highly transparent image, it does not reduce the occupant's visibility of the foreground. Then, as the focus of the second image 80 is gradually adjusted, the area occupied by the second image 80 in the display area decreases as its outline becomes clearer. At this time, the transparency of the second image 80 also gradually decreases, so it can maintain its presence as an image that indicates a specific point in the foreground.

[0066] As an example, Figures 8(A) to 8(C) show the changes in the second image 80 when the vehicle 12 gradually approaches the destination point G3 from a position where the distance L is less than 200m to a position where it is 100m. As shown in Figure 8(A), at a position where the distance L from the vehicle 12 to the destination point G3 is nearly 200m, the presence of the destination point G3 in the foreground is extremely small and barely visible. However, since the second image is displayed superimposed on the destination point G3 on the third display unit 26, the occupants can see that the destination point G3 is located in the area to the left front of the driving lane. Then, as shown in Figures 8(B) and 8(C), as the vehicle 12 approaches the destination point G3, the outline and colors of the vaguely displayed second image 80 gradually become clearer, changing to a form that clearly indicates the position of the destination point G3.

[0067] After the CPU 30 finishes processing in step S108, it repeats the processing in step S107.

[0068] Next, in step S109, the CPU 30 displays the second image 80 so that its size gradually increases as the distance L from the vehicle 12 to the destination approaches. At this time, the second image 80 is displayed as a clear image resembling a flag.

[0069] That is, as shown in Figure 9, if the distance L from the vehicle 12 to the destination point G3 is less than 100m, the vicinity of the destination point G3 can be clearly seen through the third display unit 26. Therefore, by enlarging the second image 80 in accordance with the destination point G3 gradually approaching within the display area of ​​the third display unit 26, a visual effect can be given to the occupant that makes the second image 80 appear to become one with the destination point G3 and approach the vehicle 12.

[0070] After completing the processing in step S109, the CPU 30 proceeds to the processing in step S110. In step S110, the CPU 30 determines whether or not the vehicle 12 has arrived at the destination. If the CPU 30 determines that the vehicle has arrived at the destination based on the vehicle's position information, it deletes the second image from the display area of ​​the third display unit 26 and terminates the display process. On the other hand, if the CPU 30 determines that the vehicle has not arrived at the destination, it repeats the processing in step S109.

[0071] As described above, in the vehicle display device 10 according to this embodiment, a predetermined image is displayed in the display area of ​​the third display unit 26 that shows the foreground of the vehicle 12. The vehicle display device 10 acquires the position information of the vehicle 12 and the position information of the destination point, and determines whether the relationship between the position of the vehicle 12 and the position of the destination point satisfies predetermined conditions related to visual observation. If it is determined that the predetermined conditions are met, a first image 70 indicating the direction of the destination point is displayed in the display area. This makes it possible to inform the occupants of the direction of the destination point, taking into account the relationship between the position of the vehicle 12 and the position of the destination point.

[0072] Specifically, when the distance L from the vehicle 12 to the destination point is L1 (=200m) or greater, the first image 70 indicating the direction of the destination point is displayed in the display area. This means that, for example, when the distance from the vehicle to the destination point is sufficiently far and it is difficult to see the destination point on the third display unit 26, the direction of the destination point is displayed on the third display unit 26.

[0073] Furthermore, in this embodiment, if the location of the destination point is not shown in the foreground within the display area, a first image 70 indicating the direction of the destination point is displayed in the display area. This ensures that, for example, if the destination point is obscured by surrounding buildings and cannot be seen from the display area, the direction of the destination point is displayed on the third display unit 26.

[0074] Thus, in the vehicle display device 10 according to this embodiment, the first image 70 is displayed when it is anticipated that it will be difficult to see the destination point from the display area of ​​the third display unit 26. Therefore, the destination point included in the foreground of the vehicle 12 and the first image 70 are not mixed in the display area. Accordingly, information regarding the destination point can be displayed without causing inconvenience to the occupants.

[0075] On the other hand, in this embodiment, if the positional relationship between the vehicle 12 and the destination point does not satisfy predetermined conditions, a second image 80 indicating the destination point is displayed at a position corresponding to the destination point in the foreground of the vehicle 12. This makes it possible to inform the occupants of the location of the destination point while taking into account the positional relationship between the vehicle and the destination point.

[0076] Specifically, the second image 80 is displayed when the distance L between the vehicle 12 and the destination is less than distance L1 (=200m), and the destination can be seen via the third display unit 26.

[0077] In this case, as shown in Figure 8, the second image 80 is displayed in an out-of-focus manner when the distance L from the vehicle 12 to the destination point is greater than or equal to distance L2 (=100m). That is, in positions where the presence of the destination point in the foreground is extremely small, the outline of the second image 80 is displayed ambiguously to indicate the area where the destination point is located to the occupants. As a result, the occupants can recognize the area where the destination point is located in the foreground of the vehicle early on, and thus prepare for arrival at the destination point.

[0078] Furthermore, as the distance L from the vehicle 12 to the destination decreases, the second image 80 gradually changes from being out of focus to being in focus. As a result, as the vehicle approaches the destination, the outline of the second image 80 becomes clearer and changes to a state that clearly indicates the location of the destination. In this way, by displaying the second image in a state that allows the destination to be gradually recognized from a position before the destination, the occupants can recognize their progress toward the destination without feeling any inconvenience.

[0079] Furthermore, as the focus of the second image 80 gradually changes, the second image 80 is displayed in such a way that it gradually shrinks as the distance L from the vehicle 12 to the destination point approaches. That is, when the distance L from the vehicle 12 to the destination point is relatively far, the presence of the destination point in the foreground is extremely small, so by deliberately displaying the second image 80 larger, the occupant can recognize the area where the destination point is located while remaining aware of the foreground. Then, as the vehicle 12 approaches the destination point, the second image 80 is gradually made smaller, shrinking the area where the destination point is located and changing the display manner so that the occupant's awareness naturally shifts to the destination point in the foreground. In this way, as the vehicle 12 approaches the destination point, the occupant's recognition of the destination point can be naturally shifted from the second image to the destination point in the foreground.

[0080] Furthermore, in this embodiment, when the distance from the vehicle 12 to the destination is less than distance L2 (=100m), the second image 80 is displayed so that it gradually increases in size as the distance from the vehicle to the destination approaches. That is, at a distance where the destination can be seen from the third display unit 26, the display of the second image 80 is enlarged to match the gradually approaching destination. This gives the occupant a visual effect that the second image 80 becomes one with the destination and approaches the vehicle 12, allowing them to intuitively recognize the degree to which they have reached the destination.

[0081] Furthermore, in this embodiment, the display area of ​​the third display unit 26 is the projection surface projected by the head-up display device 44 in front of the driver's seat. In addition, the second image 80 indicating the vehicle's destination is displayed at a position corresponding to the destination in the foreground of the vehicle visible through the display area. In this way, the vehicle display device 10 displays the second image 80 superimposed on the foreground from the driver's seat, allowing the driver to recognize the destination without significantly moving their gaze.

[0082] [supplementary explanation] In the above embodiment, the case in which the display area showing the foreground of the vehicle is composed of the projection surface of the head-up display device 44 has been described, but the present invention is not limited thereto. As in the modified vehicle display device 100 shown in Figure 10, the first image 70 or the second image 80 may be displayed in the display area of ​​the second display unit 25, which is a display provided on the instrument panel 14. In the second display unit 25 shown in Figure 10, a map image N showing the current position of the vehicle 12 is displayed at the bottom of the display area, and a foreground image F showing the foreground of the vehicle is displayed at the top of the display area. The foreground image F is composed of, for example, an image acquired from a camera (not shown) that photographs the front of the vehicle 12, or an animated foreground image. With the above configuration, regardless of the seating position of the occupant in the vehicle, an occupant who views the second display unit 25 can recognize information regarding the destination of the vehicle 12.

[0083] Similarly, in the instrument panel 14, the first image 70 or the second image 80 may be displayed in the display area of ​​the first display unit 24, which is a meter display located in front of the driver's seat. Since the first display unit 24 is located in front of the driver's seat, the occupant in the driver's seat can view the first display unit 24 with little or no movement of their gaze from the front of the vehicle and recognize information regarding the destination of the vehicle 12.

[0084] Furthermore, the display modes of the first image 70 and the second image 80 described in the above embodiment are examples and can be modified as appropriate without departing from the spirit of the present invention.

[0085] Furthermore, the display processing in the above embodiment is configured such that the first image 70 and the second image 80 are displayed in the display area of ​​the third display unit 26 when the vehicle is driving in automatic mode, but it is not limited to this configuration. For example, the configuration may be such that the first image 70 and the second image 80 are displayed in the display area of ​​the third display unit 26 when the vehicle is driving in manual mode to a set destination.

[0086] Furthermore, in the above implementation, the "predetermined conditions for visual inspection" for determining whether or not to display the first image in the display area may be when it is determined, based on surrounding information regarding the environment near the vehicle, that the occupant cannot see the destination from the display area. That is, if the surrounding environment of the vehicle's current location is bad weather such as dense fog or strong winds and rain, or if it is a dark road with few streetlights, it is determined that the occupant cannot see the destination from the display area, and the first image 70 is displayed in the display area.

[0087] In the above embodiment, if we consider the problem that the invention aims to solve as "to provide a vehicle display device, display method, and program that enable occupants to recognize the presence of a destination point early without feeling any inconvenience," then the problem can be solved with the following configuration: "A vehicle display device that displays a predetermined image in a display area showing the foreground of a vehicle, comprising: a location information acquisition unit that acquires location information of the vehicle and location information of a destination point; and a display unit that displays an image (second image) showing the destination point at a position corresponding to the destination point in the foreground of the vehicle shown in the display area, wherein the display unit displays the image in a way that is out of focus when the distance from the vehicle to the destination point is greater than or equal to a predetermined threshold (distance L2)."

[0088] In other words, if the distance from the vehicle to the destination point is greater than a predetermined threshold, and the presence of the destination point in the foreground of the vehicle is extremely small, it is difficult to intuitively recognize information regarding the distance from the vehicle to the destination point even if it is displayed in text or other form. However, with the above configuration, when the distance from the vehicle to the destination point is greater than a predetermined threshold, the second image is displayed in an out-of-focus manner. As a result, the display area is overlaid with the second image, which has an ambiguous outline, at the position corresponding to the destination point, thereby indicating the area where the destination point is located. This allows the occupant to recognize the area where the destination point is located while maintaining their attention on the scenery in front of the vehicle, thus enabling them to recognize the presence of the destination point early without feeling any annoyance.

[0089] Furthermore, if the display processing in the above embodiment is to implement only the invention with the above configuration, steps S102 to S105 can be deleted from the flowchart of the display processing shown in Figure 4.

[0090] In addition, the display processing that the CPU reads and executes in the above embodiment may be executed by various processors other than the CPU. Examples of such processors include PLDs (Programmable Logic Devices) such as FPGAs (Field-Programmable Gate Arrays) whose circuit configuration can be changed after manufacturing, and dedicated electrical circuits that are processors with circuit configurations specifically designed to execute specific processing, such as ASICs (Application Specific Integrated Circuits). Furthermore, the display processing may be executed by one of these various processors, or by a combination of two or more processors of the same or different types (for example, multiple FPGAs, and a combination of a CPU and an FPGA). More specifically, the hardware structure of these various processors is an electrical circuit that combines circuit elements such as semiconductor elements. Furthermore, while the above embodiments describe a configuration in which the display processing and lane change display processing programs are pre-stored (installed) in ROM or storage, the system is not limited to this. The programs may be provided in the form of recordings on recording media such as CD-ROM (Compact Disc Read Only Memory), DVD-ROM (Digital Versatile Disk Read Only Memory), and USB (Universal Serial Bus) memory. Alternatively, the programs may be provided in the form of downloads from external devices via a network. [Explanation of Symbols]

[0091] 10 Vehicle display devices 12 vehicles 24 First display section (display area) 25 Second display section (display area) 26 Third display section (display area, projection surface) 44. Head-up display device 56 Location information acquisition section 58 Judgment section 62 Display section 70 Image 1 80 Second image L1 Distance (First Threshold) L2 distance (second threshold)

Claims

1. A vehicle display device that displays a predetermined image in a display area showing the foreground of a vehicle, A location information acquisition unit that acquires the location information of the vehicle and the location information of the destination point, A determination means for determining whether the destination point is displayed in the display area showing the foreground of the vehicle, If the determination means determines that the destination point is not displayed in the display area showing the foreground of the vehicle, a first image indicating the direction of the destination point is displayed in the display area. If the determination means determines that the destination point is displayed in the display area showing the foreground of the vehicle, a second image indicating the area where the destination point is located is displayed in an out-of-focus manner so as to overlap with the area where the destination point is located. If the distance from the vehicle to the destination point is greater than or equal to a second threshold, the display control unit displays the second image in the display area so as the vehicle approaches the destination point, and if the distance from the vehicle to the destination point is less than the second threshold, the display control unit displays the second image in the display area so as the vehicle approaches the destination point. A vehicle display device equipped with [a specific feature / feature].

2. The determination means, when determining whether the destination point is displayed in the display area showing the foreground, determines whether the distance from the vehicle to the destination point is greater than or equal to a first threshold greater than the second threshold, and if it is determined that the distance from the vehicle to the destination point is greater than or equal to the first threshold, it does not determine that the destination point is displayed in the display area showing the foreground of the vehicle. The vehicle display device according to claim 1.

3. When determining whether the destination point is displayed in the display area showing the foreground, the determination means determines whether the location of the destination point is such that it is not displayed in the display area due to being obstructed by surrounding objects, and if it determines that the location of the destination point is such that it is not displayed in the display area due to being obstructed by surrounding objects, it does not determine that the destination point is displayed in the display area showing the foreground of the vehicle. The vehicle display device according to claim 1.

4. The vehicle display device according to claim 1, wherein the display control unit, when the distance from the vehicle to the destination point is greater than or equal to a second threshold, displays the second image in the display area such that it gradually comes into focus from an out-of-focus state as the vehicle approaches the destination point.

5. The aforementioned display area is a projection surface projected by a head-up display device in front of the driver's seat of the vehicle. The vehicle display device according to any one of claims 1 to 4, wherein the display control unit displays the second image at a position corresponding to the destination point in the foreground of the vehicle visible through the display area.

6. A display method for displaying a predetermined image in a display area showing the front view of a vehicle, The vehicle's location information and the destination location information are obtained. Determine whether the destination point is displayed in the display area showing the foreground of the vehicle. If the determination does not determine that the destination point is displayed in the display area showing the foreground of the vehicle, a first image indicating the direction of the destination point is displayed in the display area. If the determination determines that the destination point is displayed in the display area showing the foreground of the vehicle, a second image indicating the area where the destination point is located is displayed in an out-of-focus manner so as to overlap with the area where the destination point is located. If the distance from the vehicle to the destination point is greater than or equal to a second threshold, the second image is displayed in the display area such that its size gradually decreases as the vehicle approaches the destination point. If the distance from the vehicle to the destination point is less than the second threshold, the second image is displayed in the display area such that its size gradually increases as the vehicle approaches the destination point. Display method.

7. A program that displays a predetermined image in a display area showing the front view of a vehicle, On the computer, The vehicle's location information and the destination location information are obtained. Determine whether the destination point is displayed in the display area showing the foreground of the vehicle. If the determination does not determine that the destination point is displayed in the display area showing the foreground of the vehicle, a first image indicating the direction of the destination point is displayed in the display area. If the determination determines that the destination point is displayed in the display area showing the foreground of the vehicle, a second image indicating the area where the destination point is located is displayed in an out-of-focus manner so as to overlap with the area where the destination point is located. If the distance from the vehicle to the destination point is greater than or equal to a second threshold, the second image is displayed in the display area such that its size gradually decreases as the vehicle approaches the destination point. If the distance from the vehicle to the destination point is less than the second threshold, the second image is displayed in the display area such that its size gradually increases as the vehicle approaches the destination point. A program that performs an action.

Citation Information

Patent Citations

  • Display device

    JP2019206262A

  • Map display system and map display program

    JP2019215600A

  • Display control device, and display control program

    JP2020196295A

  • Superimposed image display apparatus and computer program

    JP2021076415A

  • Head-up display, control method, and display device

    WO2013046425A1