Vehicle display device, display processing method, and program

Abstract

To provide a vehicle display device, a vehicle, a display processing method, and a program which enable an occupant to understand in advance a possibility that a plan scheduled to be implemented is switched.SOLUTION: A vehicle display device includes: display sections 24 and 26 provided in a cabin and including, within display areas 24A and 26A, specific display areas 24B and 26B where a plurality of plans P1 to P3 scheduled to be implemented in a vehicle is displayed while being arranged in an order of scheduled implementation; and a control section (28) for allowing, within the specific display areas 24B and 26B, display of the first plan P1 which is one plan of the plurality of plans, and in addition to the first plan P1, an alternative plan P5 having a possibility of being implemented instead of the first plan P1.SELECTED DRAWING: Figure 6

Description

Technical Field

[0001] The present invention relates to a vehicle display device, a display processing method, and a program.

Background Art

[0002] Patent Document 1 discloses a vehicle display device that displays operations (such as lane changes, lane merges, and lane divergences) planned to be performed by a vehicle on a route for guiding the vehicle to a destination on a display or a head-up display device. For the display of this operation, the distance to the planned execution position of the operation, the type of operation (such as lane change, lane merge, lane divergence, etc.), and the type of automatic driving or manual driving are displayed.

[0003] Further, in this display device, a plurality of operations are arranged and displayed from the bottom to the top in order of the proximity of the planned execution position (distance) of the operation. The bottommost operation that has ended is deleted, and a new operation is additionally displayed at the top.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In the vehicle display device described in Patent Document 1 above, even if an operation by automatic driving control is displayed as the most recent operation, there may be a case where the operation cannot be performed automatically due to road conditions or the like. In such a case, the vehicle display device will display an operation by manual driving instead of the operation by automatic driving control.

[0006] In this case, on the screen of the display device, since only the notation of automatic driving control is changed to the notation of manual driving without changing the notation of the type of operation, there is a possibility that the passenger may not be able to grasp the change in the display.

[0007] In other words, there was a risk that the driver might not be able to grasp the situation where the driver had to perform the above operation (driving operation) manually.

[0008] That is, there is room for improvement in enabling the driver to grasp that the plan scheduled to be executed has been changed on the vehicle display device. In this regard, it is desirable that the driver can grasp in advance the possibility that the plan scheduled to be executed will be switched.

[0009] In view of the above facts, an object of the present invention is to provide a vehicle display device, a display processing method, and a program that enable a driver to grasp in advance the possibility that a plan scheduled to be executed will be switched.

Means for Solving the Problems

[0010] A vehicle display device according to a first aspect includes a display unit provided in a vehicle interior and having a specific display area in which a plurality of plans scheduled to be executed by the vehicle are arranged and displayed in the order of execution schedule, and a control unit that causes the first plan, which is one of the plurality of plans, and an alternative plan that may be executed in place of the first plan to be displayed in the specific display area.

[0011] In this vehicle display device, the display unit is provided in the vehicle interior. In the specific display area within the display area of the display unit, a plurality of plans scheduled to be executed by the vehicle are arranged and displayed in the order of execution schedule. The control unit causes the first plan, which is one of the plurality of plans, and an alternative plan that may be executed in place of the first plan to be displayed in the specific display area.

[0012] Therefore, just by looking at the specific display area of the display unit, the passenger can grasp that there is a possibility that an alternative plan will be implemented instead of the first plan scheduled to be implemented. As a result, even if the first plan scheduled to be implemented is changed to an alternative plan, the passenger can grasp the possibility of the plan change in advance, so the passenger can grasp the change of the plan. That is, it is possible to prevent or suppress the passenger from being unable to grasp the change of the plan.

[0013] The vehicle display device according to the second aspect is the vehicle display device according to the first aspect, wherein the control unit displays the first plan, a second plan scheduled to be implemented next to the first plan, and the alternative plan within the specific display area.

[0014] In this vehicle display device, the control unit displays the first plan, a second plan scheduled to be implemented next to the first plan, and the alternative plan within the specific display area. As a result, just by looking at the specific display area of the display unit, the passenger can grasp not only the first plan and the alternative plan but also the second plan scheduled to be implemented next to the first plan.

[0015] A display processing method according to a third aspect is a display processing method in which a plurality of plans scheduled to be implemented in a vehicle are arranged and displayed in the order of implementation in a specific display area of a display area provided in a vehicle interior and having the display area, and in the specific display area, a first plan which is one of the plurality of plans and an alternative plan which may be implemented in place of the first plan in addition to the first plan are displayed.

[0016] According to this display processing method, the same operational effects as those of the first aspect are achieved.

[0017] A display processing method according to a fourth aspect is the display processing method according to the third aspect, wherein the step is to display the first plan, a second plan scheduled to be implemented next to the first plan, and the alternative plan within the specific display area.

[0018] According to this display processing method, the same operational effects as those in the second aspect are achieved.

[0019] The program according to the fifth aspect is a program that causes a computer to perform a process including a step of causing a display unit provided in a vehicle interior and having a display area to display a plurality of plans scheduled to be implemented by the vehicle in the order of implementation schedule in a specific display area of the display area, and in the specific display area, displaying a first plan that is one of the plurality of plans and an alternative plan that may be implemented in place of the first plan in addition to the first plan.

[0020] According to this program, the same operational effects as those in the first aspect are achieved.

[0021] The program according to the sixth aspect is, in the display processing method according to the fifth aspect, the step of displaying, in the specific display area, the first plan, a second plan scheduled to be implemented next to the first plan, and the alternative plan.

[0022] According to this program, the same operational effects as those in the second aspect are achieved.

Effects of the Invention

[0023] As described above, according to the first, third, and fifth aspects, the occupant can grasp in advance the possibility that the plan scheduled to be implemented will be switched.

[0024] According to the second, fourth, and sixth aspects, the occupant can also grasp the second plan scheduled to be implemented next to the first plan in addition to the first plan and the alternative plan.

Brief Description of the Drawings

[0025]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Mode for Carrying Out the Invention

[0026] A vehicle 12 to which a vehicle display device 10 according to an embodiment is applied will be described with reference to the drawings. Note that, as an example, the vehicle 12 of the present embodiment is configured to be able to switch between automatic driving and manual driving. As shown in FIG. 1, an instrument panel 14 is provided at the front part of the vehicle interior in the vehicle 12.

[0027] The instrument panel 14 extends in the vehicle width direction, and a steering wheel 16 is provided on the right side of the vehicle of this instrument panel 14. That is, in this embodiment, as an example, it is a right-hand drive vehicle with the steering wheel 16 provided on the right side, and the driver's seat is set on the right side of the vehicle.

[0028] A windshield glass 18 is provided at the front end of the instrument panel 14. The windshield glass 18 extends in the vehicle vertical direction and the vehicle width direction to partition the inside of the passenger compartment and the outside of the passenger compartment.

[0029] The right end of the windshield glass 18 in the vehicle width direction is fixed to the front pillar 20 on the right side of the vehicle. The front pillar 20 extends in the vehicle vertical direction, and the windshield glass 18 is fixed to the inner end of the front pillar 20 in the vehicle width direction. Further, the front end of the front side glass 22 is fixed to the outer end of the front pillar 20 in the vehicle width direction. Note that the left end of the windshield glass 18 in the vehicle width direction is fixed to a front pillar on the left side of the vehicle (not shown).

[0030] Here, a first display unit 24 is provided on the instrument panel 14. The first display unit 24 is provided in front of the driver's seat in the vehicle on the instrument panel 14, and is provided at a position that comes into the field of view when the driver looks forward.

[0031] A second display unit 26 is provided on the windshield glass 18. The second display unit 26 is set above the vehicle of the first display unit 24, and is constituted by a projection surface projected by a head-up display device 44 (see FIG. 2). Specifically, the head-up display device 44 is provided on the front side of the vehicle rather than the instrument panel 14, and an image is projected from this head-up display device 44 to the second display unit 26 of the windshield glass 18.

[0032] (Hardware Configuration of Vehicle Display Device 10)

[0033] The vehicle 12 is provided with an ECU (Electronic Control Unit) 28 as a control unit. FIG. 2 is a block diagram showing the hardware configuration of the vehicle display device 10. As shown in this FIG. 2, the ECU 28 of the vehicle display device 10 includes a CPU (Central Processing Unit: processor) 30, a ROM (Read Only Memory) 32, a RAM (Random Access Memory) 34, a storage 36, a communication interface 38, and an input / output interface 40. Each component is communicably connected to each other via a bus 42.

[0034] The CPU 30 is a central arithmetic processing unit that executes various programs and controls each part. That is, the CPU 30 reads a program from the ROM 32 or the storage 36 and executes the program using the RAM 34 as a work area. The CPU 30 performs control of the above components and various arithmetic processes according to the program recorded in the ROM 32 or the storage 36.

[0035] The ROM 32 stores various programs and various data. The RAM 34 temporarily stores a program or data as a work area. The storage 36 is composed of an HDD (Hard Disk Drive) or an SSD (Solid State Drive) and stores various programs including an operating system and various data. In the present embodiment, a program for performing display processing and various data are stored in the ROM 32 or the storage 36.

[0036] The communication interface 38 is an interface for the vehicle display device 10 to communicate with a server (not shown) and other devices. For example, standards such as Ethernet (registered trademark), LTE, FDDI, Wi-Fi (registered trademark), etc. are used.

[0037] The input / output interface 40 is connected to a head-up display device 44 that projects images onto the first display unit 24 and the second display unit 26, and an actuator 46. The actuator 46 includes a steering actuator, an accelerator actuator, and a brake actuator. The steering actuator is for steering the vehicle 12. The accelerator actuator is for accelerating the vehicle 12. Also, the brake actuator decelerates the vehicle 12 by controlling the brakes. Note that sensors (not shown) for automatically driving the vehicle 12, a GPS device, etc. are connected to the input / output interface 40.

[0038] (Functional Configuration of Vehicle Display Device 10)

[0039] The vehicle display device 10 realizes various functions using the above hardware resources. The functional configuration realized by the vehicle display device 10 will be described with reference to FIG. 3.

[0040] As shown in FIG. 3, the vehicle display device 10 includes, as functional components, a communication unit 50, a travel plan setting unit 52, an automatic driving control unit 54, a detection unit 55, a first display instruction unit 56, a second display instruction unit 58, and an emphasis display unit 60. Note that each functional component is realized by the CPU 30 reading and executing a program stored in the ROM 32 or the storage 36.

[0041] The communication unit 50 transmits and receives data to and from an external server and other devices via the communication interface 38. For example, it transmits and receives data such as map data and traffic conditions stored in the server. Also, the communication unit 50 may be configured to perform vehicle-to-vehicle communication with surrounding vehicles.

[0042] The travel plan setting unit 52 sets the travel plan of the vehicle 12. Specifically, when a destination is input by the occupant, the travel plan from the current location to the destination is set.

[0043] The automatic driving control unit 54 automatically drives the vehicle 12 along the set operation plan while considering the position information and the environmental information around the vehicle 12. Specifically, the vehicle 12 is automatically driven by controlling the actuator 46.

[0044] The detection unit 55 detects the current location of the vehicle 12 from sensors and the GPS device, etc., and also detects drive signals for the actuator 46, etc. It detects whether the operation of the plan has started when the vehicle passes the planned implementation position, etc.

[0045] The first display instruction unit 56 causes the first display unit 24 to display the plan of the vehicle 12 based on the operation plan set by the operation plan setting unit 52. The function of this first display instruction unit 56 will be described with reference to FIGS. 4(B), 5(B), and 6(B).

[0046] As shown in FIG. 4(B), at the upper part of the display area 24A of the first display unit 24, the set speed VA during cruise control and the current vehicle speed VB of the vehicle 12 are displayed. The set speed VA and the vehicle speed VB are displayed on the left side in the vehicle width direction of the display area 24A of the first display unit 24. The set speed VA is displayed smaller in the lower row, and here it is set to 120 km / h as an example. Also, the current vehicle speed VB is displayed in the upper row and is shown as 58 km / h. Therefore, the vehicle 12 is set to travel at a speed up to 120 km / h while maintaining a certain distance from the vehicle ahead.

[0047] On the left side of the display area 24A of the first display unit 24, an image V1 simulating the host vehicle, and images V2 and V3 simulating surrounding vehicles are displayed on the road image R. When looking at the image V1, it can be seen that the host vehicle is traveling in the middle lane among the three driving lanes of the road image R. Also, the images V2 and V3 are respectively displayed based on information detected by sensors (not shown) mounted on the vehicle 12. And by looking at the images V2 and V3, it can be seen that vehicles are traveling diagonally in front of the host vehicle on the right and in front of the host vehicle. Note that the position of the host vehicle can be detected by a GPS device mounted on the vehicle 12. Also, as sensors for detecting surrounding vehicles, sensors such as a stereo camera, an ultrasonic sensor, a millimeter-wave radar, and a lidar are used in combination. In addition to this, it may be configured to be able to grasp the position of the host vehicle and the positions of surrounding vehicles by performing vehicle-to-vehicle communication with surrounding vehicles.

[0048] On the right side of the display area 24A of the first display unit 24, a specific display area 24B in which the plan of the vehicle 12 is displayed by the first display instruction unit 56 is set, and a plurality of plans scheduled to be executed are displayed in the specific display area 24B. In the present embodiment, as an example, three plans, namely the first plan P1, the second plan P2, and the third plan P3, are displayed in order from the bottom. Also, for each plan, three pieces of information, namely the distance from the current position to the planned execution position of the operation, the planned travel route, and the type of driving, are displayed. Here, the type of driving refers to the type of whether the operation is performed manually by the driver or is performed by autonomous driving. Also, in the present embodiment, as an example, only the three latest plans are displayed and subsequent plans are not displayed, but it is not limited to this. For example, four or more plans may be displayed on the first display unit 24. Also, the number (however, a plurality) of plans to be displayed on the first display unit 24 may be arbitrarily set.

[0049] Hereinafter, the first plan P1, the second plan P2, and the third plan P3 will be specifically described.

[0050] As shown in FIG. 4(B), on the left of the first plan P1, "100m" is displayed, indicating that the operation will be carried out approximately 100m ahead from the current position. Also, in the middle of the first plan P1, a lane change from the left lane to the right lane is shown in a schematic diagram, and the planned driving route can be understood from this schematic diagram. Furthermore, on the right side of the first plan P1, "ASSIST" is displayed, indicating that the operation is carried out (performed) by automatic driving (driving support control).

[0051] Note that the first plan P1 is displayed slightly enlarged compared to the second plan P2 and the third plan P3 described later. Also, the first plan P1 corresponds to the "top plan".

[0052] On the other hand, the second plan P2 is displayed above the first plan P1. On the left of the second plan P2, "500m" is displayed, indicating that the operation will be carried out (performed) approximately 500m ahead from the current position. Also, in the middle of the second plan P2, a route for merging from the right side road to the main line is shown in a schematic diagram, and the planned driving route can be understood from this schematic diagram. Furthermore, on the right side of the second plan P2, "ASSIST" is displayed, indicating that the operation is carried out (performed) by automatic driving (driving support control).

[0053] The third plan P3 is displayed above the second plan P2. On the left of the third plan P3, "800m" is displayed, indicating that the operation will be carried out (performed) approximately 800m ahead from the current position. Also, in the middle of the third plan P3, a lane change from the left lane to the right lane is shown in a schematic diagram, and the planned driving route can be understood from this schematic diagram. Furthermore, on the right side of the third plan P3, "ASSIST" is displayed, indicating that the operation is carried out by automatic driving (driving support control).

[0054] Note that the third plan P1 corresponds to the "last plan".

[0055] Note that the first plan P1 to the third plan P3 are all operations performed by automatic driving. In the case of operations performed by manual driving, "MANUAL" is displayed on the right side of each plan instead of "ASSIST".

[0056] FIG. 5(B) shows an image of the first display unit 24 in a state where the vehicle 12 has traveled about 100 m from the state of FIG. 4(B). As shown in this FIG. 5(B), the display on the left of the first plan P1 has been changed to "0 m", and the display on the left of the second plan P2 has been changed to "400 m". Also, the display on the left of the third plan P3 has been changed to "700 m".

[0057] The other display contents are the same as those in FIG. 4(B).

[0058] FIG. 10(B) shows a state where the first plan P1 has been deleted from the state of FIG. 5(B), the second plan P2 and the third plan P3 have each been moved one step downward, and the fourth plan P4, which is the next plan to be implemented, is displayed above the third plan P3.

[0059] On the left of the fourth plan P4, "1.5 km" is displayed, indicating that it is an operation (to be performed) about 1.5 km ahead from the current position. Also, in the middle of the fourth plan P4, a route for merging from the right side road to the main line is displayed as a schematic diagram, and the planned driving route can be understood from this schematic diagram. Furthermore, on the right side of the fourth plan P4, "ASSIST" is displayed, indicating that it is an operation (to be performed) by automatic driving (driving support control).

[0060] The other display contents are the same as those in FIG. 5(B).

[0061] FIG. 6(B) is a diagram showing a state where a fifth plan P5, which may replace the first plan P1, is displayed between the first plan P1 and the second plan P2 when the detection unit 55 detects that the operation of the first plan P has not started at the planned implementation position of the first plan P1, which is the position of FIG. 5(B).

[0062] In Fig. 6(B), the fifth plan P5 is displayed on top of the first plan P1. To the left of the fourth plan, it is displayed as "50m", indicating an operation that may be performed (implemented) approximately 50m ahead from the current position. Also, in the middle of the fifth plan P5, a lane change from the left lane to the right lane is displayed as a schematic diagram, and the planned driving route can be understood from this schematic diagram. Furthermore, to the right of the fifth plan P5, it is displayed as "MANUAL", indicating an operation performed by manual driving.

[0063] Also, different from other plans (the first plan P1, the second plan P2), the fifth plan P5 is displayed in a grayed-out display (light gray) in a specific display area. In Fig. 6(B), this is shown by the dashed outer frame of the fifth plan P5. This indicates that it is not a plan scheduled for implementation at this stage (it may become a plan scheduled for implementation), and it shows that it is an alternative plan to the first plan P1 located below the fifth plan P5.

[0064] Other display contents are the same as in Fig. 5(B).

[0065] Fig. 7(B) shows an image of the first display unit 24 in a state where the vehicle 12 has traveled approximately 50m from the state of Fig. 6(B).

[0066] As shown in Fig. 7(B), in the specific display area 24B, the first plan P1 has been erased from the state of Fig. 6(B). Both the fifth plan P5 and the second plan P2 have moved downward, and at the same time, the third plan P3, which was erased due to the addition of the fifth plan P5 at the topmost position, has been restored and displayed.

[0067] Also, the fifth plan P5, which was in gray display, is displayed in the same way as other plans (the second plan P2, the third plan P3).

[0068] The left displays of the fifth plan P5, the second plan P2, and the third plan P3 have been changed to "0m", "350m", and "650m" respectively.

[0069] That is, since the operation of the first plan P1 could not be started even after passing through the planned implementation position of the first plan P1, the fifth plan P5 of manual operation, which is an alternative plan, was implemented.

[0070] In addition, if the first plan P1 can be implemented after passing through the planned implementation position, it returns to the state of FIG. 5(B).

[0071] Other display contents are the same as those in FIG. 6(B).

[0072] Next, the second display instruction unit 58 will be described.

[0073] As shown in FIG. 3, the vehicle display device 10 includes a second display instruction unit 58 as a functional configuration. The second display instruction unit 58 is configured to display, on the second display unit 26, the two plans with the earliest planned implementation among the plans displayed on the first display unit 24 by the first display instruction unit 56.

[0074] When the highlighting unit 60 displays a plurality of plans in the specific display areas 24B and 26B of the first display unit 24 and the second display unit 26 respectively, it has a function of highlighting (enlarging the display) the plan with the earliest planned implementation (hereinafter referred to as the "top plan") more than other plans.

[0075] Due to the function of the highlighting unit 60, in the specific display area 24B of the first display unit 24, as shown in FIG. 4(B), the top plan, the first plan P1 (see FIG. 4(B)), and the fourth plan P2 (see FIG. 7(B)) are enlarged slightly more than other plans. For example, the enlargement is about 110%.

[0076] On the other hand, when the highlighting unit 60 displays a plurality of plans on the second display unit 26, it highlights the most recent plan more than other plans and displays it on the second display unit 26.

[0077] The functions of the second display instruction unit 58 and the highlighting unit 60 will be described with reference to FIGS. 4(A) to 7(A) and FIG. 10(A). Note that, for the video displayed on the second display unit 26 that is substantially the same as the video displayed on the first display unit 24, the same reference numerals are given, and detailed descriptions thereof are omitted. Also, for the video displayed on the second display unit 26 that is substantially the same as that of the first display unit 24, the content synchronized with the display of the first display unit 24 is displayed.

[0078] As shown in FIG. 4(A), at the lower part of the display area 26A of the second display unit 26, the set speed VA during cruise control and the current vehicle speed VB of the vehicle 12 are displayed. The set speed VA and the vehicle speed VB are displayed on the left side in the vehicle width direction of the display area 26A of the second display unit 26. The set speed VA is displayed on the right side, and here, as an example, it is set to 120 km / h. Also, the current vehicle speed is displayed on the left side, and it is displayed as 58 km / h. Therefore, the vehicle 12 is set to travel at a speed up to 120 km / h while maintaining a certain distance from the vehicle ahead. Note that the display of the set speed and the vehicle speed is synchronized with the content of the first display unit 24.

[0079] On the right side of the display area 26A of the second display unit 26, a specific display area 26B is set where the plan of the vehicle 12 is displayed by the second display instruction unit 58, and a plurality of plans scheduled to be executed (the latest first plan P1 and the second plan P2 scheduled to be executed next) are displayed within the specific display area 26B. The latest plan, the first plan P1, is displayed below. As shown in FIG. 4(A), this first plan P1 is displayed in an enlarged manner compared to other plans (the second plan P2), and the distance of 100 m to the first plan P1 is described below, and a schematic diagram of a lane change from the left lane to the right lane is shown above the distance of 100 m, and "ASSIST" indicating that it is an automatic driving is displayed on the right side of the schematic diagram.

[0080] Also, in the display area 26A of the second display unit 26, the second plan P2 is displayed above the first plan P1.

[0081] Figure 5(A) is a diagram showing the state at the position where the vehicle 12 has traveled 100 m from Figure 4(A).

[0082] Figure 10(A) shows a state where the first plan P1 has been erased from the state of Figure 5(A), the second plan P2 has been moved downward, and the third plan P3 scheduled to be executed next for the second plan P2 is displayed above the second plan P2.

[0083] Other display contents are substantially the same as those in Figure 5(A).

[0084] Figure 6(A) is a diagram showing a state where the fifth plan P5 is inserted above the first plan P1 after the second plan P2 has been erased from the display area 26A of the second display unit 26 in Figure 5(A).

[0085] Figure 7(A) is a diagram showing the state at the position where the vehicle 12 has traveled 50 m from the state of Figure 6(A). In this figure, the first plan P1 could not be executed at the execution setting position and could not be executed even though an attempt was made to execute it later. Therefore, the first plan P1 was determined to be unexecutable, and the fifth plan P5 was set as the plan to be executed.

[0086] For this reason, the fifth plan P5, which was in a grayed-out display, was changed to the same display state as the other plan (the second plan P2).

[0087] (Operation)

[0088] Next, the operation of this embodiment will be described.

[0089] (Display process)

[0090] An example of the display process for displaying the plan of the vehicle 12 based on the operation plan will be described using the flowcharts shown in FIGS. 8 and 9. This display process is implemented by the CPU 30 reading the display program from the ROM 32 or the storage 36 and expanding it in the RAM 34 for execution.

[0091] As shown in FIG. 8, the CPU 30 determines whether a destination is set in step S102. The destination may be directly input to the vehicle 12 by the occupant, or may be indirectly input via a mobile terminal or the like.

[0092] If the CPU 30 determines in step S102 that a destination is set, it proceeds to the process of step S104. Also, if the CPU 30 determines in step S102 that a destination is not set, it ends the display process.

[0093] The CPU 30 sets an operation plan for the vehicle 12 in step S104. Specifically, the CPU 30 sets an operation plan from the current location to the destination by the function of the operation plan setting unit 52. When setting the operation plan, information on traffic conditions and accidents may be acquired and reflected. Also, the operation plan may be set so that the automatic driving increases according to the previously input requirements of the occupant.

[0094] The CPU 30 causes the first display unit 24 and the second display unit 26 to display a plan in step S106. Specifically, the CPU 30 causes the first display unit 24 and the second display unit 26 to display the plan of the vehicle 12 by the functions of the first display instruction unit 56 and the second display instruction unit 58 based on the operation plan.

[0095] Here, as an example, as shown in FIG. 4(B), the CPU 30 displays three plans, i.e., a first plan P1, a second plan P2, and a third plan P3, in a specific display area 24B set on the right side of the display area 24A of the first display unit 24. Similarly, as shown in FIG. 4(A), the CPU 30 displays three plans, i.e., a first plan P1 and a second plan P2, in a specific display area 26B set on the right side of the display area 26A of the second display unit 26.

[0096] At this time, as shown in FIG. 4(B) by the function of the highlighting unit 60, the CPU 30 enlarges and displays the display of the first plan P1, which is the top plan, slightly more than the displays of other plans (the second plan P2 and the third plan P3) in the specific display area 24B of the first display unit 24.

[0097] Similarly, as shown in FIG. 4(A) by the function of the highlighting unit 60, the CPU 30 enlarges and displays the display of the first plan P1, which is the top plan, more than the display of other plans (the second plan P2) in the specific display area 26B of the second display unit 26.

[0098] In step S108, the CPU 30 determines, by the function of the detection unit 55, whether the vehicle 12 has reached the planned execution position of the operation of the top plan (the first plan P1). For example, by the function of the communication unit 50 or the like, the current position of the vehicle 12 is confirmed, and it is determined whether the vehicle 12 has reached the planned execution position of the operation.

[0099] If an affirmative determination is made in step 108, the process proceeds to step S110. On the other hand, if a negative determination is made in step S108, the system waits until an affirmative determination is made.

[0100] In step S110, the CPU 30 determines, by the function of the detection unit 55, whether the operation of the top plan (the first plan P1) has started. Among the plans P1 to P3 displayed on the first display unit 24 shown in FIG. 4(B), it is determined from a drive signal or the like for the actuator 46 whether the operation (lane change control (driving support control)) of the first plan P1, which is the top plan, has started. For example, in the case of a lane change, it is determined that the lane change control (driving support control) as the first plan P1 has started by detecting the blinking drive signal of the direction indicator with the detection unit 55.

[0101] If an affirmative determination is made in step S110, the process proceeds to step S112, and if a negative determination is made, the process proceeds to step S114.

[0102] In step S112, the CPU 30 updates the display of the plans in the specific display areas 24B and 26B of the first display unit 24 and the second display unit 26 according to the functions of the first display instruction unit 56 and the second display instruction unit 58.

[0103] Specifically, as shown in FIG. 10(B), in the specific display area 24B, the display of the first plan P1, which is the top action plan, is made to disappear from the state shown in FIG. 5(B), the second plan P2 and the third plan P3 are each moved downward by one step, and the fourth plan P4, which is scheduled to be executed next after the third plan P3, is newly displayed at the top.

[0104] Also, as shown in FIG. 10(A), in the specific display area 26B, the display of the first plan P1, which is the top action plan, is made to disappear from the state shown in FIG. 5(A), the second plan P2 is moved downward and enlarged, and the third plan P3 is newly displayed above the second plan P2.

[0105] Hereinafter, the same display control is referred to as "update of plan display", and detailed description thereof is omitted.

[0106] Thus, when the display of the plans of the first display unit 24 and the second display unit 26 is updated in step S112, the process returns to step S108.

[0107] On the other hand, in step S114 of FIG. 9, the CPU 30 creates an alternative plan that may be executed in place of the first plan P1, which is the top plan, according to the function of the operation plan setting unit 52. The fifth plan P5, which is the alternative plan, is similar to the first plan P1 but differs in the following points.

[0108] That is, the execution scheduled position of the fifth plan P5 is 50 m farther than that of the first plan P1. Also, the first plan P1 is an automatic driving (refer to FIGS. 6(A) and (B), "ASSIST" notation), while the fourth plan P4 is a manual driving (refer to FIGS. 6(A) and (B), "MANUAL" notation).

[0109] Next, in step S116, the CPU 30 uses the functions of the first display instruction unit 56 and the second display instruction unit 58 to display the fifth plan P5 in the specific display areas 24B and 26B of the first display unit 24 and the second display unit 26 (by inserting it).

[0110] Specifically, as shown in FIG. 6(B), in the specific display area 24B of the first display unit 24, the third plan P3 is erased from the state of FIG. 5(B), the second plan P2 is moved upward, and the fifth plan P5 is inserted and displayed between the first plan P1 and the second plan P2. At this time, the fifth plan P5 is displayed in a grayed-out display (light gray).

[0111] Similarly, as shown in FIG. 6(A), in the specific display area 26B of the second display unit 26, the second plan P2 is erased from the state of FIG. 5(A), and the fifth plan P5 is displayed above the first plan P1. At this time, the fifth plan P5 is displayed in a grayed-out display (light gray).

[0112] By thus displaying the fifth plan P5 in a grayed-out manner, it is shown that although the fifth plan P5 is not a plan scheduled for implementation, it has the possibility of being substituted when the first plan P1 becomes unimplementable.

[0113] Also, by displaying the fifth plan P5 directly above the first plan P1, it indicates that it is an alternative plan to the first plan P1.

[0114] Next, in step S118, the CPU 30 determines, using the function of the detection unit 57, whether or not the operation of the top plan (the first plan P1) has started.

[0115] This is to determine whether the operation of the top plan is feasible even when the vehicle 12 passes through the scheduled implementation point of the top plan (for example, the first plan P1) and travels a further predetermined distance (for example, until the display change position described later).

[0116] If an affirmative determination is made in step S118, the process proceeds to step S120; if a negative determination is made, the process proceeds to step S126.

[0117] Subsequently, in steps S120 and S122, the CPU 30, by means of the functions of the first display instruction unit 56 and the second display instruction unit 58, erases the fifth plan P5, which is an alternative plan, from the respective specific display areas 24B and 26B of the first display unit 24 and the second display unit 26, and adds the plan scheduled to be executed next.

[0118] Specifically, as shown in FIG. 5(B), in the specific display area 24B, the display of the fifth plan P5 is erased from the state of FIG. 6(B), the second plan P2 is moved one position downward, and the third plan P3 is displayed above the second plan P2.

[0119] Similarly, as shown in FIG. 5(A), in the specific display area 26B, the display of the fifth plan P5 is erased from the state of FIG. 6(A), and the second plan P2 is displayed above the first plan P1.

[0120] Subsequently, in step S124, the CPU 30, by means of the functions of the first display instruction unit 56 and the second display instruction unit 58, updates the display of the plans in the specific display areas 24B and 26B after a predetermined time has elapsed since the start of the operation of the top plan.

[0121] This is because it is also possible to update the display of the plans simultaneously with the start of the operation of the top plan. However, in that case, the displays of the top plan (the first display plan P1) and the alternative plan (the fifth plan P5) would disappear from the specific display areas 24B and 26B at the same time, which might cause confusion among the passengers.

[0122] When the update of the plan display in step S124 is completed, the process returns to step S108.

[0123] On the other hand, in step S126, the CPU 30 determines whether or not the vehicle 12 has reached the display change position by the function of the detection unit 55. For example, the current position of the vehicle 12 is confirmed by the function of the communication unit 50 or the like, and it is determined whether or not the vehicle 12 has reached the display change position.

[0124] Here, the display change position is a position at which it is determined to abandon the implementation of the top plan and set the alternative plan as the planned plan to be implemented, and a position in front of the planned position of the implementation of the alternative plan is set.

[0125] If a negative determination is made in step S126, the process returns to step 118. This means that it is attempted to start the operation of the top plan until the vehicle 12 reaches the display change position.

[0126] On the other hand, if an affirmative determination is made in step 126, the process proceeds to step S128.

[0127] In steps S128 and S130, the CPU 30 performs a display change to set the alternative plan as the planned plan to be implemented by the functions of the first display instruction unit 56 and the second display instruction unit 58.

[0128] Specifically, as shown in FIG. 7(B), in the specific display area 24B, the display of the first plan P1 is erased from the state of FIG. 6(B), the fifth plan P5 and the second plan P2 are each moved downward by one step, and the third plan P3 is displayed above the second plan P2.

[0129] Similarly, as shown in FIG. 7(A), in the specific display area 26B, the display of the first plan P1 is erased from the state of FIG. 6(A), the fifth plan P5 is moved downward, and the second plan P2 is displayed above the fifth plan P5.

[0130] Note that the states shown in FIGS. 7(A) and 7(B) are the displays at the time when the vehicle 12 reaches the planned position of the fifth plan P5.

[0131] In this way, when the display change of the plan is completed in steps 128 and 130, the process returns to step 108.

[0132] In this way, when there is a possibility that the top plan (for example, the first plan P1) displayed in the specific display areas 24B and 26B of the first display unit 24 and the second display unit 26 may become unexecutable, since an alternative plan (for example, the fifth plan P5) of the top plan is being displayed, the passengers can grasp in advance that there is a possibility that the fifth plan P5 will be implemented instead of the first plan.

[0133] Also, since the alternative plan (for example, the fifth plan P5) is displayed in a color different from other plans (for example, light gray), the passengers can intuitively grasp that it is a plan that may be implemented rather than a plan scheduled to be implemented.

[0134] In particular, since the alternative plan (for example, the fifth plan P5) is grayed out, it is easy for the passengers to intuitively grasp that it is not a plan scheduled to be implemented at the current stage.

[0135] Furthermore, in this embodiment, when the vehicle 12 reaches the scheduled position of the top plan (for example, the first plan P1), if the operation of the top plan has not started, it is determined that the possibility of implementing the operation of the top plan is low, and an alternative plan is displayed.

[0136] That is, instead of displaying the alternative plan after the timing to implement the alternative plan, at a point in time when there is a high possibility that the alternative plan will be implemented (it is determined that the top plan is unexecutable), in other words, from before the scheduled position of the alternative plan, since the passengers can visually recognize the alternative plan, they can grasp the possibility of implementing the alternative plan.

[0137] In addition, since the planned implementation position of the alternative plan is set further away than the planned implementation position of the top plan, even if the operation does not start at the planned implementation point of the top plan, it does not immediately switch to the implementation of the alternative plan. Instead, it is possible to ensure that the operation of the top plan starts until the planned implementation point of the alternative plan.

[0138] Furthermore, since the first display unit 24 is arranged at the upper front of the driver's seat in the instrument panel 14, and the second display unit 26 is arranged in front of the driver's seat on the windshield glass 18. Therefore, the driver can visually recognize the update of the plan displayed in the specific display areas 24B and 26B of the first display unit 24 and the second display unit 26 without much movement of the line of sight. That is, the driver can easily visually recognize the update of the plan.

[0139] Moreover, since the vehicle 12 has such a vehicle display device 10, the passengers can grasp that the top plan may become impossible to implement and the alternative plan may be scheduled for implementation. That is, it is possible to grasp in advance that the alternative plan must be implemented manually instead of automatic driving, and can calmly respond when implementing the alternative plan.

[0140] (Others)

[0141] As described above, the vehicle display device and the display processing method according to the embodiment have been described. However, it goes without saying that the present invention can be implemented in various modes without departing from the gist of the present invention. For example, in the above embodiment, the first display unit 24 is provided in front of the vehicle of the driver's seat in the instrument panel 14, and the second display unit 26 is used as a projection surface projected by the head-up display device 44. However, the present invention is not limited to this. That is, the first display unit may be a center display provided at the center in the vehicle width direction of the instrument panel 14. Further, the second display unit may be provided on the vehicle front side of the steering wheel 16 in the instrument panel 14.

[0142] Also, in the embodiment, the top plan was enlarged and displayed in each specific display area 24B, 26B of the first display unit 24 and the second display unit 26 by the function of the highlighting unit 60, but this is not essential. That is, in each specific display area 24B, 26B of the first display unit 24 and the second display unit 26, a plurality of all plans may be displayed in the same size.

[0143] Furthermore, in the present embodiment, when the vehicle 12 reaches the scheduled implementation position of the first plan P1 and the operation of the first plan P1 is not started, an alternative plan is displayed in the specific display areas 24B, 26B, but the present invention is not limited thereto.

[0144] For example, it may be controlled by time instead of the scheduled implementation position. That is, as long as it defines the scheduled implementation timing of the operation of the first plan P1, it is not limited to the position of the vehicle 12.

[0145] Furthermore, when it is not possible to execute the operation of the top plan (for example, the first plan P1) at a timing earlier than the scheduled implementation timing of the top plan, for example, when traffic jam information, accident information, etc. are detected by the ECU 28 or the like, an alternative plan (for example, the fifth plan P5) may be displayed from before the scheduled implementation timing (scheduled implementation position).

[0146] Furthermore, a configuration in which an alternative plan is always displayed for the top plan in the specific display areas 24B, 26B may also be adopted.

[0147] Note that in the embodiment, a configuration in which an alternative plan is displayed for the top plan is adopted, but the present invention is not limited thereto. For example, an alternative plan may be displayed for the second plan (for example, the second plan P2) next to the top plan. That is, when it is detected from traffic jam information or the like that the merging point is congested, it is also conceivable to display an alternative plan for the second plan (which is not the top plan) that is a merging operation.

[0148] Furthermore, in the embodiment, the alternative plans were shown in a grayed-out manner in the specific display areas 24B and 26B and, when the implementation schedule was finalized, they were displayed in the same way as the other plans, but the invention is not limited to this. When there is an alternative possibility, it is sufficient that the alternative plan is displayed differently (for example, with a different color) from the other plans.

[0149] Also, in the embodiment, when adding an alternative plan to the specific display areas 24B and 26B, in each of the display areas 24A and 26A, after displaying it outside the specific display areas 24B and 26B, it may be moved (fade-in processing) from the outside to the inside of the specific display areas 24B and 26B.

[0150] Similarly, when deleting an alternative plan or the top plan from the specific display areas 24B and 26B, in each of the display areas 24A and 26A, after moving it from the inside to the outside of the specific display areas 24B and 26B, it may be deleted (fade-out processing).

[0151] Furthermore, in the embodiment, the alternative plan also displayed the planned distance to implementation in the same way as the other plans. However, when the alternative plan is shown in a grayed-out manner, there is a possibility that the distance is difficult to see, so a configuration for displaying the planned timing of the alternative plan using a progress bar or the like is also conceivable.

[0152] Furthermore, in the above embodiment, as plans, three types of information, namely, the distance to the operation of the vehicle 12, the planned travel route of the vehicle, and the type of driving, were displayed, but the invention is not limited to this. For example, information such as the speed limit may be displayed, but from the viewpoint of making the display easy to view, it is preferable to display only the above three types of information. Also, the display of the planned travel route is not limited to the schematic diagrams shown in FIGS. 4 to 7, and it may be displayed using other icons or the like.

[0153] Also, in the above embodiment, the second display instruction unit 58 displayed the two most recent plans on the second display unit 26, but the invention is not limited to this. For example, the second display instruction unit 58 may display three or more of the most recent plans on the second display unit 26.

[0154] Furthermore, in the above-described embodiment, a plurality of plans are displayed from bottom to top in the specific display areas 24B and 26B of the first display unit 24 and the second display unit 26 in the order of implementation schedule, but it is not limited to this direction. For example, a plurality of plans may be displayed from top to bottom in the specific display areas 24B and 26B of the first display unit 24 and the second display unit 26 in the order of implementation schedule.

[0155] Furthermore, in the above-described embodiment, a plurality of plans are displayed in the respective display areas 24A and 26A of the first display unit 24 and the second display unit 26, but the second display unit 26 may be configured to display only the most recent top plan.

[0156] Note that the road conditions, plan types, distances, etc. displayed on the screen are described only for the convenience of explanation and may not match the actual road surface conditions.

[0157] Also, in the above-described embodiment, the display process implemented by the CPU 30 by loading software (program) may be implemented by various processors other than the CPU 30. Examples of the processor in this case include PLDs (Programmable Logic Devices) whose circuit configuration can be changed after manufacturing, such as FPGAs (Field-Programmable Gate Arrays), and dedicated electric circuits such as ASICs (Application Specific Integrated Circuits) having a circuit configuration designed specifically to perform specific processing. Also, the display process may be implemented by one of these various processors, or by a combination of two or more processors of the same type or different types (for example, a plurality of FPGAs, and a combination of a CPU and an FPGA, etc.). Also, the hardware structure of these various processors is, more specifically, an electric circuit combining circuit elements such as semiconductor elements.

[0158] Furthermore, in the above embodiment, the configuration is such that various data are stored in the storage 36, but the present invention is not limited to this. For example, a recording medium such as a CD (Compact Disk), a DVD (Digital Versatile Disk), or a USB (Universal Serial Bus) memory may be used as the storage unit. In this case, various programs and data are stored in these recording media.

Explanation of Reference Numerals

[0159] 10 Vehicle display device 12 Vehicle 14 Instrument panel 24 First display unit (display unit) 24A, 26A Display area 24B, 26B Specific display area 26 Second display unit (display unit, projection surface) 28 ECU (control unit) 44 Head-up display device P1 First plan P2 Second plan P3 Third plan P4 Fourth plan P5 Fifth plan (alternative plan)

Claims

1. A display unit is provided in the vehicle cabin and has a specific display area in which a plurality of plans to be carried out in the vehicle are arranged in order of their execution; a control unit that displays, in the specific display area, a first plan that is one of the multiple plans, and an alternative plan that may be implemented in place of the first plan in addition to the first plan; A vehicle display device having the following:

2. The vehicle display device according to claim 1 , wherein the control unit displays the first plan, a second plan to be implemented next to the first plan, and the alternative plan in the specific display area.

3. A display processing method for displaying a plurality of plans to be implemented in a vehicle in a specific display area of ​​a display unit provided in a vehicle cabin and arranged in order of implementation, the display processing method comprising: A display processing method including a step of displaying, within the specific display area, a first plan which is one of the multiple plans, and an alternative plan which may be implemented in place of the first plan in addition to the first plan.

4. 4. The display processing method according to claim 3, wherein said step displays, in said specific display area, said first plan, a second plan to be executed next to said first plan, and said alternative plan.

5. A program for displaying a plurality of plans to be implemented in a vehicle in a specific display area on a display unit provided in a vehicle cabin, the plan being arranged in order of implementation, the program comprising: A step of displaying, in the specific display area, a first plan which is one of the plurality of plans, and an alternative plan which may be implemented in place of the first plan in addition to the first plan. A program for causing a computer to carry out processing including the above.

6. 6. The program according to claim 5, wherein said step displays, in said specific display area, said first plan, a second plan to be executed next to said first plan, and said alternative plan.

Images