Vehicle display device, display method, and storage medium

By adopting image display technology with different display methods in the vehicle display device according to the positional relationship between the vehicle and the destination, the problem of occupants being reduced due to the visibility of the foreground is solved, and clear destination recognition and intuitive arrival perception are achieved under different distances and occlusions.

CN115465096BActive Publication Date: 2025-08-08TOYOTA JIDOSHA KK
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202210629172.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2021-06-10
Filing Date
2022-06-06
Publication Date
2025-08-08
Estimated Expiration
2042-06-06

AI Technical Summary

Technical Problem

When the relationship between the vehicle and the destination is changed, the existing vehicle display device may easily cause occupants to feel troubled by the reduction of the visibility of the foreground, especially when the distance is close or when the foreground is blocked, it is difficult to accurately identify the destination position.

Method used

The vehicle display device displays images on the projection surface in front of the driving position. According to the positional relationship between the vehicle and the destination, different image display methods are adopted, such as displaying a blurred second image at a distance, and gradually displaying the second image at a close distance, and overlapping the second image in the foreground to reduce line of sight movement.

Benefits of technology

It effectively reduces the visual troubles of occupants, improves the destination recognition ability at different distances and occlusions, provides intuitive sense of arrival, and ensures that the visibility of the foreground is not affected.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115465096B_ABST
    Figure CN115465096B_ABST
Patent Text Reader

Abstract

The present invention relates to a display device, a display method and a storage medium for a vehicle, wherein the display device for a vehicle displays a specified image in a display area showing the foreground of the vehicle, and comprises: a memory; and a processor connected to the memory, wherein the processor obtains position information of the vehicle and position information of a destination point, and when the relationship between the position of the vehicle and the position of the destination point satisfies specified conditions related to visual observation, the processor displays a first image indicating the orientation of the destination point in the display area.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a display device, a display method, and a storage medium for a vehicle. Background Art

[0002] International Publication No. 2013 / 046425 discloses a vehicle display device (head-up display) that projects an image onto a combiner positioned between a passenger and the front window within a vehicle cabin to display the direction of the vehicle's destination. In this vehicle display device, the image projected onto a direction information display ring on the combiner overlaps with the foreground visually recognized by the passenger through the front window. Furthermore, the direction of the destination relative to the vehicle is displayed based on the position of a destination icon that moves on the direction information display ring.

[0003] However, if an icon indicating the direction of the destination is always displayed in the center of the display area as in the technique disclosed in International Publication No. 2013 / 046425, there is a possibility that the occupants may feel annoyed depending on the positional relationship between the vehicle and the destination.

[0004] For example, when a vehicle is traveling near a destination and a passenger visually observes the display area to confirm the destination from the foreground, the visibility of the foreground is reduced by the icon indicating the direction of the destination, which may cause the passenger to feel annoyed. Summary of the Invention

[0005] The present disclosure has been made in view of the above-mentioned points, and an object thereof is to provide a vehicle display device, a display method, and a storage medium capable of displaying information related to a destination point in consideration of the positional relationship between the vehicle and the destination point.

[0006] The vehicle display device involved in the first embodiment of the present invention displays a specified image in a display area showing the foreground of the vehicle, and comprises: a position information acquisition unit for acquiring the position information of the vehicle and the position information of the destination point; and a display unit for displaying a first image indicating the orientation of the destination point in the above-mentioned display area when the relationship between the position of the vehicle and the position of the destination point satisfies specified conditions related to visual observation.

[0007] According to a first embodiment, a vehicle display device displays a predetermined image in a display area representing the foreground of the vehicle. The vehicle display device obtains vehicle position information and destination position information, and when the relationship between the vehicle's position and the destination's position satisfies predetermined conditions related to visual observation, displays a first image indicating the direction of the destination in the display area. This allows the direction of the destination to be communicated to passengers, taking into account the positional relationship between the vehicle and the destination.

[0008] A vehicle display device according to a second aspect of the present disclosure is implemented based on the configuration described in the first aspect, wherein the predetermined condition is a condition that the distance from the vehicle to the destination point is greater than or equal to a first threshold value.

[0009] According to the second embodiment, when the distance from the vehicle to the destination is greater than or equal to a first threshold, a first image indicating the direction of the destination is displayed in the display area. Specifically, the direction of the destination can be displayed even when the distance from the vehicle to the destination is sufficiently great that the destination is difficult to visually identify from the display area. This prevents the destination, which is included in the foreground of the vehicle, from intermingling with the first image in the display area, allowing information related to the destination to be displayed without causing any discomfort to the occupants.

[0010] A vehicle display device according to a third aspect of the present disclosure is implemented based on the configuration described in the first aspect, wherein the predetermined condition is a condition that the location of the destination point is a location within the display area where a foreground is not displayed.

[0011] According to the third aspect, when the destination is located in a position not shown in the foreground of the display area, the display area displays a first image indicating the direction to the destination. This allows the direction to be displayed even when the destination is obscured by surrounding buildings and cannot be visually identified from the display area. This prevents the destination, which is included in the foreground of the vehicle, from intermingling with the first image in the display area, allowing information related to the destination to be displayed without causing any discomfort to the occupants.

[0012] The vehicle display device involved in the fourth embodiment of the present invention is completed on the basis of the structure described in any one of the first to third embodiments. When the above-mentioned conditions are not met, the above-mentioned display unit displays a second image representing the destination point at a position corresponding to the destination point in the foreground of the vehicle displayed in the above-mentioned display area.

[0013] According to the fourth aspect, if the positional relationship between the vehicle and the destination does not satisfy a predetermined condition, a second image representing the destination is displayed at a position corresponding to the destination point in the foreground of the vehicle. This allows the position of the destination to be communicated to the occupant while taking into account the positional relationship between the vehicle and the destination.

[0014] The vehicle display device involved in the fifth embodiment of the present disclosure is completed based on the structure described in the fourth embodiment, and the above-mentioned display unit displays the above-mentioned second image on the above-mentioned display area in a manner that gradually changes from an out-of-focus state to a focused state as the distance from the vehicle to the destination point becomes closer.

[0015] According to the fifth embodiment, the second image displayed in the display area is displayed so that it gradually shifts from an out-of-focus state to a focused state as the distance from the vehicle to the destination decreases. Thus, for example, when the distance from the vehicle to the destination is far and the destination point is minimal in the foreground, the area where the destination point is located is indicated to the occupant by blurring the outline of the second image. Then, as the distance from the vehicle to the destination decreases, the display of the second image gradually shifts to a focused state, whereby the outline of the second image gradually becomes clearer, clearly indicating the location of the destination point. Thus, by displaying the second image in a manner that gradually makes the destination point more clearly visible from a position close to the destination point, the occupant can readily discern the degree of arrival at the destination point.

[0016] The vehicle display device involved in the sixth embodiment of the present invention is completed on the basis of the structure described in the fourth embodiment. When the distance from the vehicle to the destination is less than the above-mentioned first threshold value and is greater than the second threshold value which is smaller than the above-mentioned first threshold value, the above-mentioned display unit displays the above-mentioned second image in the above-mentioned display area in a manner such that the size of the above-mentioned second image gradually decreases as the distance from the vehicle to the destination point becomes closer.

[0017] According to the sixth aspect, when the distance from the vehicle to the destination is less than a first threshold and greater than a second threshold that is smaller than the first threshold, the second image displayed in the display area is gradually reduced in size as the distance from the vehicle to the destination decreases. Thus, for example, when the distance from the vehicle to the destination is relatively long, the destination point in the foreground is minimal. By intentionally displaying the second image larger, the occupant can recognize the area where the destination point is located while remaining aware of the foreground. Furthermore, by gradually reducing the size of the second image as the vehicle approaches the destination, the display configuration changes so that the area where the destination point is located shrinks, allowing the occupant's awareness to naturally shift to the destination point in the foreground. This allows the occupant's awareness of the destination point to naturally shift from the second image to the destination point in the foreground as the vehicle approaches the destination.

[0018] The vehicle display device involved in the seventh embodiment of the present invention is completed on the basis of the structure described in the sixth embodiment. When the distance from the vehicle to the destination is less than the above-mentioned second threshold value, the above-mentioned display unit displays the above-mentioned second image in the above-mentioned display area in a manner such that the size of the above-mentioned second image gradually increases as the distance from the vehicle to the destination point becomes closer.

[0019] According to the seventh aspect, when the distance from the vehicle to the destination is less than the second threshold, the second image displayed in the display area is gradually enlarged as the distance from the vehicle to the destination decreases. Thus, for example, when the distance to the destination can be visually confirmed from the display area, the second image is enlarged as the destination approaches. This creates a visual effect for the occupant, as if the second image is becoming one with the destination and approaching the vehicle, allowing them to intuitively recognize the degree of arrival at the destination.

[0020] The vehicle display device involved in the 8th embodiment of the present invention is completed on the basis of the structure described in any one of the 4th to 7th embodiments, and the above-mentioned display area is a projection surface projected by the head-up display device in front of the vehicle at the driver's seat, and the above-mentioned display unit displays the above-mentioned second image at a position corresponding to the destination point in the foreground of the vehicle visually confirmed through the above-mentioned display area.

[0021] According to the eighth aspect, the display area representing the vehicle's foreground is a projection surface projected by the head-up display device in front of the vehicle from the driver's seat, and the second image representing the vehicle's destination is displayed at a position corresponding to the destination in the foreground of the vehicle visually recognized through the display area. Thus, since the second image is displayed on the vehicle display device superimposed on the foreground as viewed from the driver's seat, the driver's seat occupant can recognize the destination without significantly shifting their line of sight.

[0022] The display method involved in the 9th embodiment of the present disclosure causes a display area showing the foreground of a vehicle to display a prescribed image, wherein the position information of the vehicle and the position information of the destination point are obtained, and when the relationship between the position of the vehicle and the position of the destination point satisfies prescribed conditions related to visual observation, the above-mentioned display area is caused to display a first image representing the orientation of the destination point.

[0023] According to the display method according to the ninth aspect, as described above, information related to the destination point can be displayed while taking into account the positional relationship between the vehicle and the destination point.

[0024] The program involved in the 10th method of the present disclosure causes the display area showing the foreground of the vehicle to display a prescribed image, and causes the computer to perform the following processing: obtaining the position information of the vehicle and the position information of the destination point, and when the relationship between the position of the vehicle and the position of the destination point satisfies the prescribed conditions related to visual observation, causing the above-mentioned display area to display the first image representing the orientation of the destination point.

[0025] According to the program according to the tenth aspect, as described above, information related to the destination can be displayed in consideration of the positional relationship between the vehicle and the destination.

[0026] According to the present disclosure, it is possible to display information related to a destination point in consideration of the positional relationship between the vehicle and the destination point. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] An exemplary embodiment of the present invention is described in detail based on the following figure, in which:

[0028] Figure 1 This is a schematic diagram showing the front portion of a vehicle cabin to which the vehicle display device according to the present embodiment is applied, as viewed from the rear side of the vehicle.

[0029] Figure 2 This is a block diagram showing the hardware configuration of the vehicle display device according to the present embodiment.

[0030] Figure 3 This is a block diagram showing the functional configuration of the vehicle display device according to the present embodiment.

[0031] Figure 4 This is a flowchart showing an example of the flow of display processing in this embodiment.

[0032] Figure 5 FIG. 1 is a diagram showing an example of the positional relationship between a vehicle and a destination point.

[0033] Figure 6 This is a diagram showing an example of a display method of the first image when the distance from the vehicle to the destination point is equal to or greater than the distance L1.

[0034] Figure 7 FIG. 1 is a diagram showing an example of the positional relationship between a vehicle and a destination point.

[0035] Figure 8A This diagram shows an example of a display method of the second image that changes as the distance from the vehicle to the destination decreases when the distance from the vehicle to the destination is less than the distance L1 and equal to or greater than the distance L2.

[0036] Figure 8B This diagram shows an example of a display method of the second image that changes as the distance from the vehicle to the destination decreases when the distance from the vehicle to the destination is less than the distance L1 and equal to or greater than the distance L2.

[0037] Figure 8C This diagram shows an example of a display method of the second image that changes as the distance from the vehicle to the destination decreases when the distance from the vehicle to the destination is less than the distance L1 and equal to or greater than the distance L2.

[0038] Figure 9AThis is a diagram showing an example of a display method of the second image that changes as the distance between the vehicle and the destination point decreases when the distance from the vehicle to the destination point is less than the distance L2.

[0039] Figure 9B This is a diagram showing an example of a display method of the second image that changes as the distance between the vehicle and the destination point decreases when the distance from the vehicle to the destination point is less than the distance L2.

[0040] Figure 9C This is a diagram showing an example of a display method of the second image that changes as the distance between the vehicle and the destination point decreases when the distance from the vehicle to the destination point is less than the distance L2.

[0041] Figure 10 This is a schematic diagram showing a vehicle display device according to a modified example of the present embodiment. DETAILED DESCRIPTION

[0042] With reference to the accompanying drawings, a vehicle 12 to which the vehicle display device 10 according to the embodiment is applied will be described. As an example, the vehicle 12 according to the present embodiment is configured to be able to switch between automatic driving and manual driving. Automatic driving is a mode of driving a vehicle in which a part or all of the operations of the accelerator, brake, turn indicator, steering wheel, etc. are performed automatically. In addition, manual driving is a mode of driving a vehicle in which the driver performs all driving operations (operations of the accelerator, brake, turn indicator, steering wheel, etc.). As Figure 1 As shown, an instrument panel 14 is provided at the front portion of the interior of the vehicle 12 .

[0043] The instrument panel 14 extends in the vehicle width direction, and a steering wheel 16 is provided on the right side of the instrument panel 14. That is, in this embodiment, as an example, a right-hand drive vehicle is provided with the steering wheel 16 on the right side, and the driver's seat is set on the right side of the vehicle.

[0044] A windshield 18 is provided at the front end of the instrument panel 14. The windshield 18 is arranged on the vehicle front side of the driver's seat, extends in the vehicle vertical direction and the vehicle width direction, and divides the vehicle interior from the vehicle exterior.

[0045] The right-side end of the windshield 18 is fixed to a front pillar 20 on the right side of the vehicle. The front pillar 20 extends in the vertical direction of the vehicle, and the windshield 18 is fixed to the inner end of the front pillar 20 in the vehicle width direction. Furthermore, the front end of the front side glass 22 is fixed to the outer end of the front pillar 20 in the vehicle width direction. Furthermore, the left-side end of the windshield 18 is fixed to a front pillar on the left side of the vehicle (not shown).

[0046] The instrument panel 14 is provided with a first display unit 24 having a display area for a predetermined image. The first display unit 24 comprises an instrument display, which is located on the right side of the instrument panel 14 in the vehicle width direction, in front of the driver's seat. The instrument display forms part of an instrument display device (not shown) connected to various instrument devices installed in the vehicle 12. The first display unit 24 is located in a position where it is visible to the driver when the driver is looking toward the front of the vehicle.

[0047] The instrument panel 14 is provided with a second display unit 25 having a display area for displaying a predetermined image. The second display unit 25 is composed of a display provided at the center of the instrument panel 14 in the vehicle width direction on the vehicle front side of the driver's seat.

[0048] The third display unit 26 having a display area of a predetermined image is provided on the front windshield 18. The third display unit 26 is set on the upper side of the vehicle of the first display unit 24 and is controlled by the head-up display device 44 (see Figure 2 ) is formed by projecting a projection surface. Specifically, a head-up display device 44 is provided on the vehicle front side relative to the instrument panel 14, and an image is projected from the head-up display device 44 onto the third display unit 26 of the windshield 18. In other words, the third display unit 26 is formed by the windshield 18, which serves as the projection surface of the head-up display device 44.

[0049] (Hardware Configuration of Vehicle Display Device 10)

[0050] The vehicle 12 is provided with an ECU (Electronic Control Unit) 28 as a control unit. Figure 2 1 is a block diagram showing the hardware configuration of the vehicle display device 10. Figure 2 As shown, the ECU 28 of the vehicle display device 10 includes a CPU (Central Processing Unit) 30, a ROM (Read Only Memory) 32, a RAM (Random Access Memory) 34, a storage 36, a communication interface 38, and an input / output interface 40. These components are interconnected via a bus 42 so as to be communicable with each other. The CPU 30 is an example of a processor, and the RAM 34 is an example of a memory.

[0051] The CPU 30 is a central processing unit that executes various programs and controls various components. Specifically, the CPU 30 reads programs from the ROM 32 or storage 36 and executes them using the RAM 34 as a work area. The CPU 30 controls the various components described above and performs various calculations based on the programs stored in the ROM 32 or storage 36.

[0052] ROM 32 stores various programs and data. RAM 34 serves as a work area for temporary storage of programs and data. Storage 36, comprised of an HDD (Hard Disk Drive) or SSD (Solid State Drive), stores various programs and data, including the operating system. In this embodiment, ROM 32 or storage 36 stores programs and data for display processing.

[0053] The communication interface 38 is an interface for the vehicle display device 10 to communicate with a server (not shown) and other devices, and can use standards such as Ethernet (registered trademark), LTE, FDDI, and Wi-Fi (registered trademark).

[0054] Connected to the input / output interface 40 are a head-up display device 44 that projects predetermined images on the first display unit 24, the second display unit 25, and the third display unit 26, and an actuator 46. The actuator 46 includes a steering actuator, an acceleration actuator, and a brake actuator. The steering actuator steers the vehicle 12. The acceleration actuator accelerates the vehicle 12. The brake actuator decelerates the vehicle 12 by controlling the brakes. Furthermore, connected to the input / output interface 40 are a camera (not shown) that captures images of the surroundings of the vehicle 12, sensors for autonomously driving the vehicle 12, a GPS device, and the like.

[0055] (Functional Structure of Vehicle Display Device 10)

[0056] The vehicle display device 10 realizes various functions using the aforementioned hardware resources. Figure 3 The functional configuration implemented by the vehicle display device 10 will be described.

[0057] like Figure 3 As shown, the vehicle display device 10 includes a communication unit 50, an acquisition unit 51, an operation plan setting unit 52, an automatic driving control unit 54, a position information acquisition unit 56, a determination unit 58, an image generation unit 60, and a display unit 62 as functional components. Each functional component is implemented by the CPU 30 reading and executing a program stored in the ROM 32 or the memory 36.

[0058] The communication unit 50 transmits and receives data to and from external servers and other devices via the communication interface 38. For example, the communication unit 50 transmits and receives map data and traffic conditions data stored on the server. Furthermore, the communication unit 50 may be configured to perform inter-vehicle communication with surrounding vehicles.

[0059] The acquisition unit 51 acquires the driving environment of the vehicle 12 as peripheral information from an external sensor (not shown) via the input / output interface 40. The external sensor may include at least one of a camera that captures a predetermined range of images around the vehicle 12, a millimeter-wave radar that transmits detection waves within a predetermined range, and an optical radar (Light Detection and Ranging / Laser Imaging Detection and Ranging) that scans a predetermined range. For example, "peripheral information" includes information related to the shape and width of the lane in which the vehicle 12 is traveling, other vehicles traveling near the vehicle 12, obstacles, and other environmental information such as the weather and brightness levels surrounding the vehicle.

[0060] The operation plan setting unit 52 sets an operation plan for the vehicle 12. Specifically, the operation plan from the current location to the destination is set by the passenger inputting the destination.

[0061] The automatic driving control unit 54 controls the switching between manual and automatic driving of the vehicle 12. Furthermore, when the driving mode of the vehicle 12 is switched to automatic driving, the automatic driving control unit 54 takes into account the position information and environmental information surrounding the vehicle 12 and causes the vehicle 12 to automatically drive according to a pre-set operation plan. Specifically, the automatic driving control unit 54 controls the actuator 46 to cause the vehicle 12 to travel automatically.

[0062] The position information acquisition unit 56 acquires the position information of the vehicle 12 and the position information of the destination set in the operation plan. Specifically, the position information of the vehicle 12 is acquired using, for example, a GPS device. Furthermore, the position information of the destination of the vehicle 12 and map information of the surrounding area of the destination are acquired by referring to map data.

[0063] The determination unit 58 has a function of determining whether the relationship between the vehicle's position and the destination's position satisfies a predetermined condition related to visual observation based on the position information acquired by the position information acquisition unit 56. The predetermined condition is, for example, a condition that determines that it is difficult for the occupant to visually confirm the destination through the third display unit 26 (windshield 18) in consideration of the distance from the vehicle 12 to the destination or the surrounding environment of the destination.

[0064] In this embodiment, the determination unit 58 determines whether the distance L from the vehicle 12 to the destination is greater than or equal to the distance L1 (e.g., L1 = 200 m). That is, if the distance from the vehicle to the destination is greater than or equal to the distance L1, it is determined that it is difficult for the occupant to visually confirm the destination through the third display unit 26, and the condition is determined to be satisfied. As an example, Figure 5 In FIG. 1 , a destination point separated from the vehicle 12 by a distance L1 or more is indicated by reference symbol “ G1 ”.

[0065] In addition, in this embodiment, the determination unit 58 determines whether the location of the destination point is located at a position that can be visually confirmed by the third display unit 26, taking into account the surrounding environment of the destination point. That is, even if the distance L from the vehicle 12 to the destination point is less than L1, if the destination point cannot be seen from the vehicle 12 due to obstruction by surrounding buildings, etc., it is determined that it is difficult for the occupant to visually confirm the destination point through the third display unit 26, and the condition is determined to be satisfied. As an example, Figure 5 In the figure, reference symbol “ G2 ” indicates a destination point that is blocked by surrounding buildings B1 to B3 and cannot be seen from the vehicle 12 .

[0066] The image generator 60 generates images for display on the third display unit 26, which is the projection surface of the head-up display device 44. The images generated by the image generator 60 include, for example, an instrument display (not shown) indicating the speed of the vehicle 12 and various images for assisting manual and automatic driving.

[0067] In this embodiment, when the determination unit 58 determines that the conditions are satisfied, the image generation unit 60 generates a first image 70 representing the direction of the destination point relative to the vehicle 12. If the determination unit 58 determines that the conditions are not satisfied, the image generation unit 60 generates a second image 80 representing the destination point.

[0068] The display unit 62 displays the image generated by the image generation unit 60 in the display area of the third display unit 26. If the determination unit 58 determines that the condition is satisfied, the display unit 62 displays the first image 70 on the third display unit 26. If the determination unit 58 determines that the condition is not satisfied, the display unit 62 deletes the first image 70 from the third display unit 26 and displays the second image 80. Furthermore, if the vehicle 12 arrives at the destination, the display unit 62 deletes the second image 80 from the third display unit 26.

[0069] The display unit 62 of the present embodiment displays the first image 70 and the second image 80 in the display area of the third display unit 26 so as to merge with the foreground of the vehicle 12 visible through the third display unit 26 (the windshield 18 ).

[0070] like Figure 6 As shown, as an example, the first image 70 is displayed at the end of the display area of the third display unit 26 in consideration of the visibility in front of the driver's seat. The first image 70 includes a destination icon 70A that is a flag indicating the destination point and an arrow-shaped direction icon 70B that indicates the destination icon 70A. Figure 6Since the direction icon 70B indicates the direction of the destination icon 70A disposed diagonally in front of the left, it is known that the destination point is located diagonally in front of the left relative to the vehicle 12 .

[0071] like Figures 8A to 8C as well as Figures 9A to 9C As shown, as an example, the second image 80 is displayed at a location corresponding to the destination point in the foreground that is visually recognized by the driver's seat passenger through the third display unit 26. Therefore, as viewed from the driver's seat, the second image 80 is displayed so as to overlap with the destination point visible through the windshield 18. As an example, the second image 80 is composed of an image of a flag. The second image 80 is displayed so that its focus and size vary depending on the distance L from the vehicle 12 to the destination point. The detailed method for displaying the second image 80 will be described later.

[0072] (effect)

[0073] Next, the operation of this embodiment will be described.

[0074] (Display Processing)

[0075] use Figure 4 The flowchart illustrates an example of display processing for displaying the first image 70 or the second image 80 based on the position of the vehicle 12 and the position of the destination point. This display processing is performed by CPU 30 reading a display program from ROM 32 or storage 36 , expanding it in RAM 34 , and executing it.

[0076] like Figure 4 As shown, the CPU 30 determines whether a destination has been set in step S100. The destination may be directly input to the vehicle 12 by the occupant, or may be indirectly input to the vehicle 12 via a mobile terminal or the like.

[0077] If it is determined in step S100 that the destination has been set, the CPU 30 proceeds to the process of step S101. If it is determined in step S100 that the destination has not been set, the CPU 30 repeats the process of step S100.

[0078] In step S101, the CPU 30 sets a driving plan for the vehicle 12. Specifically, the CPU 30 uses the driving plan setting unit 52 to set a driving plan from the current location to the destination. Information related to traffic conditions and accidents can be acquired and reflected during the driving plan setting. Furthermore, the driving plan can be set to a more automated driving mode based on the passenger's pre-entered preferences.

[0079] In step S102, the CPU 30 uses the function of the determination unit 58 to determine whether the distance L from the vehicle 12 to the destination is greater than or equal to distance L1. As an example, since distance L1 is set to 200 meters, the CPU 30 determines in step S102 whether the distance L from the vehicle 12 to the destination is greater than or equal to 200 meters. If the distance L to the destination is greater than or equal to 200 meters, the CPU 30 proceeds to step S103. If the distance L to the destination is less than or equal to 200 meters, the CPU 30 proceeds to step S104. Distance L1 corresponds to the "first threshold" in the present invention.

[0080] In step S103, the CPU 30 causes the third display unit 26 to display the first image 70 indicating the direction of the destination point. Figure 5 If the destination point G1 is set as the destination point of the vehicle 12, then since the destination point G1 is separated from the vehicle 12 by more than 200 m, the CPU 30 generates and displays the first image 70 indicating the direction of the destination point G1. Figure 6 As shown, the first image 70 is composed of a flag destination icon 70A and an arrow-shaped direction icon 70B indicating the destination icon 70A, and is displayed at the end of the third display unit 26. Figure 6 , the direction icon 70B indicating the obliquely left front direction indicates that the destination point G1 exists in the obliquely left front direction of the vehicle 12. After displaying the first image 70 in step S103, the CPU 30 returns to step S102 and repeats the process.

[0081] In step S104, the CPU 30 determines, based on the function of the determination unit 58, whether the destination is indicated in the display area of the third display unit 26. Specifically, since the occupant visually confirms the foreground of the vehicle 12 through the third display unit 26 (windshield 18), the CPU 30 refers to the map data of the destination to determine whether the destination is visually confirmed through the windshield 18. If the CPU 30 determines that the destination is not visually confirmed, the process proceeds to step S105. If the CPU 30 determines that the destination is visually confirmed, the process proceeds to step S106.

[0082] In step S105, the CPU 30 causes the third display unit 26 to display the first image 70 indicating the direction of the destination point. Figure 5 If the destination point G2 is set as the destination point of the vehicle 12, the destination point G2 is blocked by the surrounding buildings B1 to B3 and cannot be visually confirmed from the vehicle 12. Therefore, the CPU 30 generates and displays the first image 70 indicating the direction of the destination point G2. Since the destination point G2 is located in the oblique left front direction of the vehicle 12, it is Figure 6 Similarly, in the first image 70 shown, the direction icon 70B is displayed so as to indicate the obliquely left front direction.

[0083] In step S106, the CPU 30 displays the second image 80 at a position corresponding to the destination point visible on the third display unit 26. That is, the CPU 30 displays the position of the destination point visible on the third display unit 26, where the distance L from the vehicle 12 to the destination point is less than 200 m, using the second image 80.

[0084] like Figures 8A to 8C as well as Figures 9A to 9C As shown, when the occupant visually recognizes the foreground through the third display unit 26 (front windshield 18), the second image 80 is displayed so as to overlap with the destination point of the real image visually recognized by the occupant. Figure 8A As shown, when the distance L from the vehicle 12 to the destination is greater than the distance L2 (=100m), the second image 80 is displayed as a rectangular plane figure in an out-of-focus form. The out-of-focus form refers to a state where the outline of the image is unclear and blurred, and is not limited to projecting an out-of-focus image onto the third display unit 26. It also includes the case where an image with a blurred outline of the figure is generated and displayed. Figure 8A As shown, the second image 80 with a blurred outline is displayed on the third display unit 26 so as to overlap the destination point G3 located in front of the vehicle 12. In this state, the second image 80 shows the area where the destination point G3 is located to the occupant.

[0085] In step S107, the CPU 30 determines whether the distance L to the destination is less than the distance L2 based on the position information of the vehicle 12 and the destination. Here, as an example, the distance L2 is set to 100 meters. In step S107, the CPU 30 determines whether the distance L from the vehicle 12 to the destination is less than 100 meters. If the distance L to the destination is greater than 100 meters, the CPU 30 proceeds to step S108. If the distance L to the destination is less than 100 meters, the CPU 30 proceeds to step S109. The distance L2 corresponds to the "second threshold value" in the present invention.

[0086] In step S108, the CPU 30 displays the second image 80 so that the size gradually decreases as the distance L from the vehicle 12 to the destination decreases. As an example, this can be achieved by changing the image so that the second image 80 gradually comes into focus as the distance L from the vehicle 12 to the destination decreases.

[0087] Specifically, if the second image 80 is defocused to a state where its outline is barely discernible, the area occupied by the second image 80 in the display area increases, and its transparency increases. In this state, although the second image is displayed overlapping a certain area of the foreground visible to the occupant, the highly transparent image does not reduce the occupant's visibility of the foreground. Furthermore, if the second image 80 is gradually brought into focus, the area occupied by the second image 80 in the display area decreases as its outline becomes clearer. At this point, since the transparency of the second image 80 also gradually decreases, its presence as an image depicting a specific point in the foreground is maintained.

[0088] As an example, Figures 8A to 8C FIG. 8 shows a change in the second image 80 when the vehicle 12 gradually approaches a position where the distance L to the destination point G3 is less than 200 m to a position where the vehicle 12 is 100 m away. Figure 8A As shown in FIG. 1 , at a distance L of approximately 200 m from the vehicle 12 to the destination point G3, the destination point G3 in the foreground is extremely small and can barely be visually recognized. However, since the second image is displayed on the third display unit 26 in an overlapping manner with the destination point G3, the occupant knows that the destination point G3 exists in the left front area of the driving lane. Figure 8B as well as Figure 8C As shown, as the vehicle 12 approaches the destination point G3 , the outline and color of the dimly displayed second image 80 gradually become clearer, and the image changes to a form that clearly shows the position of the destination point G3 .

[0089] After completing the process of step S108 , the CPU 30 repeats the process of step S107 .

[0090] Next, in step S109, the CPU 30 displays the second image 80 so that the size thereof gradually increases as the distance L from the vehicle 12 to the destination point decreases. At this time, the second image 80 is displayed as a clear image imitating a flag.

[0091] That is, Figures 9A to 9C As shown, if the distance L from the vehicle 12 to the destination point G3 is less than 100 m, the vicinity of the destination point G3 can be clearly visually confirmed via the third display unit 26. Therefore, by gradually enlarging the second image 80 within the display area of the third display unit 26 as the destination point G3 gradually approaches, the occupant can be given a visual effect that the second image 80 is integrated with the destination point G3 and is approaching the vehicle 12.

[0092] After completing step S109, the CPU 30 proceeds to step S110. In step S110, the CPU 30 determines whether the vehicle 12 has arrived at the destination. If the vehicle 12 has arrived at the destination based on the vehicle's position information, the CPU 30 deletes the second image from the display area of the third display unit 26 and ends the display process. On the other hand, if the vehicle 12 has not arrived at the destination, the CPU 30 repeats step S109.

[0093] As described above, the vehicle display device 10 according to this embodiment displays a predetermined image in the display area of the third display unit 26, which displays the foreground of the vehicle 12. The vehicle display device 10 obtains the position information of the vehicle 12 and the position information of the destination point, and determines whether the relationship between the position of the vehicle 12 and the location of the destination point satisfies the predetermined conditions related to visual observation. If the predetermined conditions are satisfied, the display area displays the first image 70 indicating the direction of the destination point. This allows the direction of the destination point to be communicated to the occupants, taking into account the relationship between the position of the vehicle 12 and the location of the destination point.

[0094] Specifically, when the distance L from the vehicle 12 to the destination is greater than or equal to distance L1 (=200 m), the display area displays a first image 70 indicating the direction of the destination. Thus, for example, when the distance from the vehicle to the destination is sufficiently great that the destination is difficult to visually confirm on the third display unit 26, the direction of the destination is displayed on the third display unit 26.

[0095] Furthermore, in this embodiment, when the destination point is located in a position not shown in the foreground of the display area, a first image 70 indicating the direction of the destination point is displayed in the display area. Thus, for example, when the destination point cannot be visually recognized from the display area due to obstruction by surrounding buildings, the direction of the destination point is displayed on the third display unit 26.

[0096] As described above, in the vehicle display device 10 according to this embodiment, the first image 70 is displayed in a situation where it is assumed that the destination point is difficult to visually confirm from the display area of the third display unit 26. Therefore, the destination point included in the foreground of the vehicle 12 and the first image 70 are not mixed in the display area. Therefore, information related to the destination point can be displayed without causing trouble to the occupants.

[0097] On the other hand, in this embodiment, when the positional relationship between the vehicle 12 and the destination does not satisfy a predetermined condition, a second image 80 representing the destination is displayed at a position corresponding to the destination in the foreground of the vehicle 12. This allows the position of the destination to be communicated to the occupant while taking into account the positional relationship between the vehicle and the destination.

[0098] Specifically, when the distance L between the vehicle 12 and the destination point is less than the distance L1 (=200 m) and the destination point can be visually confirmed via the third display unit 26 , the second image 80 is displayed.

[0099] At this time, if Figure 8A As shown, when the distance L between vehicle 12 and the destination exceeds distance L2 (=100 meters), second image 80 is displayed out of focus. Specifically, by blurring the outline of second image 80 at a location in the foreground where the destination is minimal, the area where the destination is located is presented to the occupant. As a result, the occupant can quickly identify the area where the destination is located in the foreground of the vehicle, allowing them to prepare for arrival at the destination.

[0100] In addition, if Figures 8B to 8C As shown, second image 80 changes from an out-of-focus state to a focused state as the distance L from vehicle 12 to the destination decreases. Consequently, as the vehicle approaches the destination, the outline of second image 80 gradually sharpens, clearly showing the location of the destination. By displaying the second image in a manner that gradually makes the destination more clearly visible from a position close to the destination, the occupant can easily identify the degree of arrival at the destination.

[0101] Furthermore, as the second image 80 gradually changes focus, it is displayed so that it gradually becomes smaller as the distance L from the vehicle 12 to the destination decreases. Specifically, when the distance L from the vehicle 12 to the destination is relatively long, the destination point in the foreground is minimal. Therefore, by intentionally displaying the second image 80 larger, the occupant can recognize the area where the destination point is located while remaining aware of the foreground. Furthermore, by gradually reducing the size of the second image 80 as the vehicle 12 approaches the destination, the display configuration changes so that the area where the destination point is located is reduced, allowing the occupant's awareness to naturally shift to the destination point in the foreground. This allows the occupant's awareness of the destination point to naturally shift from the second image to the destination point in the foreground as the vehicle 12 approaches the destination.

[0102] Furthermore, in this embodiment, when the distance from vehicle 12 to the destination is less than distance L2 (=100m), second image 80 is displayed so that it gradually increases in size as the distance from the vehicle to the destination decreases. Specifically, while the distance to the destination can be visually confirmed on third display unit 26, the second image 80 is displayed in increasing size as the destination approaches. This creates a visual effect for the occupant, as if second image 80 is becoming one with the destination and approaching vehicle 12, allowing them to intuitively recognize the degree of arrival at the destination.

[0103] Furthermore, in this embodiment, the display area of the third display unit 26 is the projection surface projected by the head-up display device 44 in front of the vehicle from the driver's seat. Furthermore, a second image 80 representing the vehicle's destination is displayed at a position corresponding to the destination in the foreground of the vehicle visible through the display area. Thus, since the second image 80 is displayed on the vehicle display device 10 superimposed on the foreground as viewed from the driver's seat, the driver's seat occupant can recognize the destination without significantly shifting their line of sight.

[0104] [Supplementary explanation]

[0105] In the above embodiment, the case where the display area showing the foreground of the vehicle is composed of the projection surface of the head-up display device 44 is described, but the present invention is not limited to this. Figure 10 As in the vehicle display device 100 according to the modified example shown, the first image 70 or the second image 80 is displayed on the display area of the second display unit 25 which is a display provided on the instrument panel 14. Figure 10 The second display unit 25 shown in the figure displays a map image N indicating the current position of the vehicle 12 in the lower portion of the display area, and a foreground image F showing the foreground of the vehicle in the upper portion of the display area. The foreground image F may be composed of, for example, an image captured by a camera (not shown) that captures the front of the vehicle 12, or an animated foreground image. With this configuration, regardless of the passenger's seated position within the vehicle cabin, any passenger who visually checks the second display unit 25 can recognize information related to the vehicle 12's destination.

[0106] Similarly, the first image 70 or the second image 80 may be displayed in the instrument panel 14 in the display area of the first display unit 24, which is an instrument display located in front of the vehicle at the driver's seat. Since the first display unit 24 is located in front of the vehicle at the driver's seat, the driver's seat occupant can visually check the first display unit 24 without having to look away from the foreground of the vehicle, and can recognize information related to the destination of the vehicle 12.

[0107] The display forms of the first image 70 and the second image 80 described in the above embodiment are merely examples and can be appropriately changed without departing from the spirit of the present invention.

[0108] Furthermore, while the display processing in the above embodiment is configured to display the first image 70 and the second image 80 in the display area of the third display unit 26 when the vehicle is traveling in automatic driving, the present invention is not limited thereto. For example, the first image 70 and the second image 80 may be displayed in the display area of the third display unit 26 when the vehicle is traveling in manual driving to a set destination.

[0109] Furthermore, in the above-described embodiment, the "predetermined condition related to visual observation" for determining whether to display the first image in the display area may also be a determination that the occupant cannot visually confirm the destination from the display area based on surrounding information related to the vehicle's immediate surroundings. Specifically, if the surrounding environment of the vehicle's current location is inclement weather such as dense fog or a storm, or if the vehicle is on a nighttime road with few streetlights, the occupant may be determined to be unable to visually confirm the destination from the display area, and the first image 70 may be displayed in the display area.

[0110] In addition, in the above embodiment, if the problem that the invention is intended to solve is understood as "providing a vehicle display device, a display method, and a program that enable passengers to recognize the existence of a destination point early without feeling annoyed", the problem can be solved by the following structure: "A vehicle display device that displays a specified image in a display area showing the foreground of the vehicle, comprising: a position information acquisition unit that acquires the position information of the vehicle and the position information of the destination point; and a display unit that displays an image (a second image) representing the destination point at a position corresponding to the destination point in the foreground of the vehicle shown in the above display area, and when the distance from the vehicle to the destination point is greater than a specified threshold value (distance L2), the above display unit displays the above image in a defocused form."

[0111] Specifically, if the distance between the vehicle and the destination exceeds a predetermined threshold and the destination is minimally visible in the foreground of the vehicle, it is difficult to visually recognize the distance even if displayed using text or other information. However, according to the above configuration, when the distance between the vehicle and the destination is greater than the predetermined threshold, the second image is displayed out of focus. Thus, the area where the destination is located is indicated in the display area by superimposing the second image with a blurred outline at the position corresponding to the destination. This allows the occupant to recognize the area where the destination is located while maintaining their focus on the scenery ahead of the vehicle, allowing them to recognize the destination early without feeling annoyed.

[0112] In the display processing of the above embodiment, when performing processing of the invention in which only the above configuration is implemented, Figure 4 The flowchart of the display process described above may be executed by omitting steps S102 to S105 .

[0113] In addition, the display processing executed by the CPU reading the software (program) in the above-mentioned embodiment can also be executed by various processors other than the CPU. As the processor in this case, FPGA (Field-Programmable Gate Array) and other processors with PLD (Programmable Logic Device) and ASIC (Application Specific Integrated Circuit) that can change the circuit structure after manufacturing, which are designed as dedicated circuit structures for executing specific processing, that is, dedicated circuits, etc. can be exemplified. In addition, the display processing can be executed by one of these various processors, or by a combination of two or more processors of the same or different types (for example, multiple FPGAs, and a combination of a CPU and an FPGA, etc.). In addition, the hardware structure of these various processors is more specifically a circuit that combines circuit elements such as semiconductor elements.

[0114] In addition, in the above-described embodiments, the display processing and lane change display processing programs are described as being pre-stored (installed) in a ROM or memory, but the present invention is not limited thereto. The programs may also be provided by recording them on a recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disk Read Only Memory), or a USB (Universal Serial Bus) memory device. Alternatively, the programs may be downloaded from an external device via a network.

Claims

1. A vehicle display device that displays a predetermined image in a display area showing a foreground of a vehicle, wherein: have: a position information acquiring unit for acquiring the position information of the vehicle and the position information of the destination point; a determination unit for determining whether the distance from the vehicle to the destination is greater than or equal to a first threshold, and if it is determined that the distance from the vehicle to the destination is not greater than or equal to the first threshold, determining whether the destination is displayed in a display area showing a foreground of the vehicle; as well as The display control unit displays a first image indicating the direction of the destination point in the display area when the determination unit determines that the destination point is not displayed in the display area showing the foreground of the vehicle. When it is determined that the destination point is displayed in a display area showing the foreground of the vehicle, a second image representing the area where the destination point exists is displayed in a defocused form so as to overlap with the area where the destination point exists, and then, when the distance from the vehicle to the destination point is greater than a second threshold value that is smaller than the first threshold value, the second image on the display area is displayed in the display area so that the size of the second image on the display area gradually decreases as the vehicle approaches the destination point, and when the distance from the vehicle to the destination point is less than the second threshold value, the second image on the display area is displayed in the display area so that the size of the second image on the display area gradually increases as the vehicle approaches the destination point.

2. The vehicle display device according to claim 1, wherein When determining whether the destination point is displayed in the display area showing the foreground, the determination unit determines whether the location of the destination point is not displayed in the display area due to being blocked by surrounding objects. If it is determined that the location of the destination point is not displayed in the display area due to being blocked by surrounding objects, the destination point is not determined to be displayed in the display area showing the foreground of the vehicle.

3. The vehicle display device according to claim 1, wherein When the distance from the vehicle to the destination is equal to or greater than the second threshold, the display control unit displays the second image in the display area so that the second image gradually comes into focus from an out-of-focus state as the vehicle approaches the destination.

4. The vehicle display device according to any one of claims 1 to 3, wherein: The display area is a projection surface projected by the head-up display device in front of the vehicle at the driver's seat. The display control unit displays the second image at a position corresponding to the destination point in the foreground of the vehicle visually recognized through the display area.

5. A display method for causing a display area showing a foreground of a vehicle to display a predetermined image, wherein: Obtaining the location information of the vehicle and the location information of the destination; determining whether a distance from the vehicle to the destination is greater than or equal to a first threshold, and if it is determined that the distance from the vehicle to the destination is not greater than or equal to the first threshold, determining whether the destination is displayed in a display area showing a foreground of the vehicle; When the determination does not determine that the destination point is displayed in the display area showing the foreground of the vehicle, the display area displays a first image indicating the direction of the destination point. When the determination determines that the destination point is displayed in the display area showing the foreground of the vehicle, the display area displays a second image indicating the area where the destination point exists in a defocused manner so as to overlap with the area where the destination point exists. Then, when the distance from the vehicle to the destination point is greater than or equal to a second threshold value that is smaller than the first threshold value, the display area displays the second image in such a manner that the size of the image gradually decreases as the vehicle approaches the destination point. When the distance from the vehicle to the destination point is less than the second threshold value, the display area displays the second image in such a manner that the size of the image gradually increases as the vehicle approaches the destination point.

6. A non-transitory storage medium storing a program for causing a display area showing a foreground of a vehicle to display a predetermined image, wherein: The program is used to cause a computer to execute the following processing: Obtaining the location information of the vehicle and the location information of the destination; determining whether a distance from the vehicle to the destination is greater than or equal to a first threshold, and if it is determined that the distance from the vehicle to the destination is not greater than or equal to the first threshold, determining whether the destination is displayed in a display area showing a foreground of the vehicle; as well as When the determination does not determine that the destination point is displayed in the display area showing the foreground of the vehicle, the display area displays a first image indicating the direction of the destination point. When the determination determines that the destination point is displayed in the display area showing the foreground of the vehicle, the display area displays a second image indicating the area where the destination point exists in a defocused manner so as to overlap with the area where the destination point exists. Then, when the distance from the vehicle to the destination point is greater than or equal to a second threshold value that is smaller than the first threshold value, the display area displays the second image in such a manner that the size of the image gradually decreases as the vehicle approaches the destination point. When the distance from the vehicle to the destination point is less than the second threshold value, the display area displays the second image in such a manner that the size of the image gradually increases as the vehicle approaches the destination point.

Citation Information

Patent Citations

  • Head-up display, control method, and display device

    WO2013046425A1

  • Display device

    JP2019206262A

  • Display control device, and display control program

    JP2020196295A

  • Superimposed image display apparatus and computer program

    JP2021076415A