Vehicle display device, vehicle display method and storage medium that stores a vehicle display program

Abstract

Vehicle display device (10), comprising: a first display device (24) which is arranged in a vehicle cabin; a second display device (26) which is located in the vehicle cabin and separate from the first display device (24); a memory (36); and a processor (30) connected to the memory (36) and configured to: establishes a timetable for a vehicle, and a plurality of planned actions of the vehicle on the first display device (24) based on the timetable, characterized in that the processor (30) is further configured to in a case where at least one of a distance or time interval to the planned action has reached a prescribed value or less, an upcoming planned action of the majority of planned actions is indicated on the second display device (26), wherein the vehicle is switchable between autonomous driving and manual driving; and In addition to the planned action, the distance to the planned action and a planned route of the vehicle are displayed, indicating whether the planned action is to be carried out manually by a driver or by autonomous driving.

Description

BACKGROUND Technical area

[0001] The present invention relates to a vehicle display device, a vehicle display method and a non-volatile storage medium that stores a vehicle display program. State of the art

[0002] Japanese patent application JP 2018-100867A discloses a display device that finds a route to guide a vehicle to a destination and displays the route on a screen. The display performed by the device disclosed in JP 2018-100867A makes it possible to distinguish between autonomous driving segments, where the vehicle drives autonomously, and manual driving segments, where manual driving is required.

[0003] However, in the display device disclosed in JP 2018 - 100 867 A, a large amount of information is displayed through one display section, so it may take some time for an occupant to recognize a planned action of the vehicle.

[0004] A vehicle display device and a vehicle display method according to the preamble of independent claims are disclosed in US patent 2019 / 0204827A1. A head-up display on which driving information is shown to the driver is also known from JP patent 2019-119262A. SUMMARY

[0005] The object of the present invention is to provide a vehicle display device, a vehicle display method, and a non-volatile storage medium for storing a vehicle display program, enabling an occupant to quickly ascertain a planned action of a vehicle. This object is achieved by the features of the independent claims; advantageous embodiments are the subject of the dependent claims.

[0006] A first aspect is a vehicle display device comprising: a first display device located in a vehicle cabin; a second display device located in the vehicle cabin and separate from the first display device; a memory; and a processor connected to the memory and configured to: establish a route or timetable for a vehicle, display a plurality of planned actions of the vehicle on the first display device based on the timetable, and, in a case where at least one of the distances or time intervals to the planned action has reached a prescribed value or less, display an upcoming planned action of the plurality of planned actions on the second display device.The vehicle can be switched between autonomous driving and manual driving; and with the planned action, in addition to the distance to the planned action and a planned route of the vehicle, it is indicated whether the planned action is to be carried out manually by a driver or by autonomous driving.

[0007] In the first aspect of the vehicle display system, the first display device is located in the vehicle cabin. The second display device is also located in the vehicle cabin, but separate from the first. The vehicle display device establishes the vehicle's schedule and displays the planned actions of the vehicle on the first display device based on the schedule. This allows the occupant to understand the schedule by glancing at the first display device.

[0008] The vehicle's display device also shows the planned action on the second display device if at least one of the distance or time intervals leading up to the action has reached or fallen below the prescribed value. This allows the occupant to check only upcoming planned actions of the vehicle by glancing at the second display device.

[0009] The vehicle display also shows the vehicle's distance from the action and its planned route. It also indicates whether the action is to be performed manually by the driver or autonomously. This allows the occupant to see at a glance whether they need to drive themselves or not. It should be noted that "an action to be performed manually by the driver" is a concept not limited to cases where the system switches to fully manual driving, but also encompasses, more broadly, cases where certain elements of a driving maneuver are performed manually during autonomous driving. This includes, for example, cases where actions relating solely to changing lanes, turning onto another road, and merging are performed manually.

[0010] A second aspect is the vehicle display device of the first aspect, wherein: the first display device is arranged on a dashboard at the front of a vehicle in front of a driver's seat; and the second display device is a head-up display device configured to project onto a projection surface on the top of a vehicle (above) the first display device.

[0011] The second aspect of the vehicle display device shows an upcoming planned action of the vehicle on the projection surface at the top of the vehicle, as displayed by the first display device. This allows the occupant to check the upcoming planned action of the vehicle without significantly changing their gaze while driving.

[0012] A third aspect is the vehicle display device of the first or the second aspect, wherein, in a case where a plurality of planned actions are displayed on the second display device, the earliest of the planned actions is displayed more emphatically than any other of the planned actions.

[0013] With the vehicle display device of the third aspect, the occupant is able to determine the immediately imminent planned action by looking at the emphatically displayed content.

[0014] A fourth aspect is the vehicle display device of one of the first to third aspects, whereby the planned action is deleted by the second display device in a case where a place or time of the planned action has passed.

[0015] In the case of the vehicle display device of the fourth aspect, deleting completed planned actions from the second display device allows the amount of information displayed on the second display device to be limited to the required minimum.

[0016] A fifth aspect is a non-volatile or non-transient storage medium that stores a program executable by a computer to perform processing, the processing comprising: establishing a vehicle's schedule; displaying a plurality of planned actions of the vehicle on a first display device located in a vehicle cabin, based on the schedule; and, in a case where at least one of a distance or time interval to the planned action has reached a prescribed value or less, displaying an upcoming planned action of the plurality of planned actions on a second display device located in the vehicle cabin and separate from the first display device.The vehicle can be switched between autonomous driving and manual driving; and with the planned action, in addition to the distance to the planned action and a planned route of the vehicle, it is indicated whether the planned action is to be carried out manually by a driver or by autonomous driving.

[0017] In the fifth aspect of the program, the vehicle's planned actions are displayed on the first display device based on the set schedule. Of the planned actions shown on the first display device, one for which at least one of the distance or time intervals to the planned action has reached a prescribed value or less is displayed on the second display device. This ensures that only upcoming planned actions of the vehicle are displayed on the second display device. The vehicle's distance from the action and its planned route are also shown. It is also indicated whether the action is to be performed manually by the driver or autonomously. This allows the occupant to see at a glance whether they need to drive themselves or not.It should be noted that "an action to be performed manually by the driver" is a concept not limited to cases where the system switches to fully manual driving, but also, more broadly, encompasses cases where certain elements of a driving process are performed manually during autonomous driving. This includes, for example, cases where actions relating solely to changing lanes, turning onto another road, and merging are carried out manually.

[0018] The vehicle display device of the first aspect allows an occupant to quickly recognize a planned action of the vehicle. Furthermore, the vehicle display device ensures that the occupant is not left in doubt as to whether or not they will have to drive themselves in a vehicle configured to switch between autonomous and manual driving.

[0019] The vehicle display device of the second aspect allows the occupant to easily recognize upcoming planned actions of the vehicle.

[0020] The vehicle display device of the third aspect allows the occupant to intuitively check information about the vehicle's imminent planned action.

[0021] The vehicle display device of the fourth aspect makes it possible to reduce the amount of information displayed on the second display device compared to cases where completed planned actions are not deleted for a certain period of time.

[0022] The fifth aspect of the program allows an occupant to quickly recognize a planned action by the vehicle. Furthermore, it ensures that the occupant is not left in doubt as to whether or not they will have to drive themselves in a vehicle configured to switch between autonomous and manual driving. BRIEF DESCRIPTION OF THE DRAWINGS Fig. Figure 1 is a schematic representation as seen from the rear of a vehicle, showing a front part of the inside of a vehicle cabin, which is equipped with a vehicle display device according to an exemplary embodiment. Fig. Figure 2 is a block diagram showing a hardware configuration of a vehicle display device according to an exemplary embodiment. Fig. Figure 3 is a block diagram showing a functional configuration of a vehicle display device according to an exemplary embodiment. Fig. 4A is a diagram showing an example of a display on a second display device. Fig. 4B is a diagram showing an example of a display on a first display device. Fig. 5A is a diagram showing an example of a display on a second display device after traveling 500 m from the state in Fig. 4A is shown. Fig. 5B is a diagram showing an example of a reading on a first display device after traveling 500 m from the state in Fig. 4B shows. Fig. 6A is a diagram showing an example of a display on a second display device after traveling 600 m from the state in Fig. 5A is shown. Fig. 6B is a diagram showing an example of a reading on a first display device after traveling 600 m from the state in Fig. 5B shows. Fig. Figure 7 is a flowchart showing an example of the process flow of a display processing operation in an exemplary embodiment. DESCRIPTION OF EXECUTION FORMS

[0023] With reference to the drawings, an explanation follows of a vehicle 12 equipped with a vehicle display device 10 according to an exemplary embodiment. It should be noted that the vehicle 12 of the present exemplary embodiment is configured, for example, to be able to switch between autonomous driving and manual driving. As shown in Fig. As shown in Figure 1, a dashboard 14 is arranged on a front section of the inside of a cabin of the vehicle 12.

[0024] The dashboard 14 extends in the direction of the vehicle's width. A steering wheel 16 is arranged on the right side of the dashboard 14. In the present exemplary embodiment, the vehicle is, for example, a right-hand drive vehicle in which the steering wheel 16 is arranged on the right side and a driver's seat is arranged on the right side of the vehicle.

[0025] The windshield 18 is located at a front end section of the dashboard 14. The windshield 18 extends along the vertical direction of the vehicle and the vehicle width direction, thus separating the interior of the cabin from the exterior of the cabin.

[0026] The right end section of the windshield 18 is attached to a front pillar 20 on the right side of the vehicle. The front pillar 20 extends along the vertical direction of the vehicle, and the windshield 18 is attached to an end section of the front pillar 20 that is inward in the direction of the vehicle's width. A front end section of a front side window 22 is attached to an end section of the front pillar 20 that is outward in the direction of the vehicle's width. Note that the left end section of the windshield 18 is attached to a front pillar on the left side of the vehicle.

[0027] A first display device 24 is arranged on the dashboard 14. The first display device 24 is attached to the dashboard 14 such that it is located at the front of the vehicle in front of the driver's seat and is arranged at a point that falls within the driver's field of vision when the driver is looking towards the front of the vehicle.

[0028] A projection surface, onto which a second display device 26 projects, is arranged on the windshield 18. The second display device 26 is mounted on the upper surface of the vehicle (above) the first display device 24 and is supported by a head-up display device 44 (see Fig. 2) formed, which is projected onto the projection surface. More precisely, the head-up display device 44 is positioned further towards the front of the vehicle than the dashboard 14, and an image from the head-up display device 44 is projected onto the windshield 18. Hardware configuration of the vehicle display device 10

[0029] An electronic control unit (ECU) 28, which serves as a control section, is provided for the vehicle 12. Fig. Figure 2 is a block diagram showing a hardware configuration of the vehicle display device 10. As shown in Fig. As shown in Figure 2, the ECU 28 of the vehicle display device 10 is configured to include a central processing unit (CPU: processor) 30, a read-only memory (ROM) 32, a random access memory (RAM) 34, a memory 36, a communication interface 38, and an input / output interface 40. The respective configurations are interconnected so that they can communicate with each other via a bus 42.

[0030] The CPU 30 is a central processing unit that executes various programs and controls different sections. Specifically, the CPU 30 reads a program from ROM 32 or memory 36 and executes the program using RAM 34 as its working area. The CPU 30 controls the aforementioned configurations and performs various calculations based on the program stored in ROM 32 or memory 36.

[0031] ROM 32 contains various programs and data. RAM 34 serves as a workspace for the temporary storage of programs and data. Memory 36 is formed by a hard disk drive (HDD) or a solid-state drive (SSD) and contains various programs, including an operating system, as well as various data. In the present exemplary embodiment, a program, various data, and the like are held in ROM 32 or memory 36 for display processing.

[0032] The communication interface 38 is an interface that enables the vehicle display device 10 to communicate with a server and other devices, and uses a protocol such as LTE, FDDI or Wi-Fi (registered trademark).

[0033] The first display device 24, the head-up display device 44, which projects images onto the second display device 26, and actuators 46 are connected to the input / output interface 40. The actuators 46 are configured to include a steering actuator, an accelerator pedal actuator, and a brake actuator. The steering actuator performs the steering of the vehicle 12. The accelerator pedal actuator performs the acceleration of the vehicle 12. The brake actuator controls the brakes to decelerate the vehicle 12. It should be noted that various sensors, a GPS device, and the like, which are used during the autonomous driving of the vehicle 12, are also connected to the input / output interface 40. Functional configuration of the vehicle display device 10

[0034] The vehicle display device 10 implements various functions using the hardware resources described above. The following is an explanation of the functional configurations implemented by the vehicle display device 10 with reference to... Fig. 3.

[0035] As in Fig. As shown in Figure 3, the vehicle display device 10 is configured to include, as a functional configuration, a communication section 50, a timetable setting section 52, an autonomous driving control section 54, a first display instruction section 56, a second display instruction section 58, and a reprint display section 60. The respective functional configurations are implemented by the CPU 30 reading and executing a program stored in ROM 32 or memory 36.

[0036] Communication section 50 exchanges data with an external server and other devices via communication interface 38. Examples of the exchanged data include map data and traffic conditions stored on the server. Communication section 50 can be configured to perform vehicle-to-vehicle communication with vehicles in the vicinity.

[0037] Timetable setting section 52 defines a route or timetable for vehicle 12. More precisely, when a passenger enters a destination, timetable setting section 52 sets a route or timetable from the current location to the destination.

[0038] The autonomous driving control section 54 instructs the vehicle 12 to drive autonomously according to the set timetable, taking into account position and environmental information about the vehicle 12's surroundings. More precisely, the autonomous driving control section 54 controls the actuators 46 so that the vehicle 12 drives autonomously.

[0039] The first display instruction section 56 shows planned actions of vehicle 12 on the first display device 24 based on the timetable defined by the timetable setting section 52. An explanation of the functionality of the first display instruction section 56 follows with reference to Fig. 4B, Fig. 5B and Fig. 6B.

[0040] As in Fig. As shown in Figure 4B, a speed set via a speed controller or cruise control and the current speed of the vehicle 12 are displayed in an upper part of a display area of ​​the first display device 24. The set speed and the current vehicle speed are displayed in a central part of a display area of ​​the first display device 24, in the direction of the vehicle's width. The set speed is displayed in a smaller font on a lower line and is set to 120 km / h as an example. The current vehicle speed is displayed on an upper line and is shown as 58 km / h. The vehicle 12 is set to travel at a speed of up to 120 km / h while maintaining a constant distance to the vehicle ahead.

[0041] An image V1, depicting the vehicle with the device installed within it, as well as images V2 and V3, depicting peripheral vehicles, are displayed in a central part of the display area of ​​the first display device 24. Viewing image V1, it can be seen that the vehicle with the device installed within it is traveling in the middle lane of a three-lane roadway. Images V2 and V3 are each displayed based on information acquired by various sensors mounted on the vehicle 12. Images V2 and V3 show that the vehicles are traveling on the slanted front right side of the vehicle with the device installed within it and in front of the vehicle with the device installed within it. It should be noted that the position of the vehicle with the device installed within it can be determined by the GPS device built into the vehicle 12. A combination of sensors, such as...A stereo camera, an ultrasonic sensor, a millimeter-wave radar, and a laser radar are used as sensors to detect peripheral vehicles. Alternatively, the position of the vehicle with the device installed within it, and the positions of vehicles in the vicinity, can be determined through vehicle-to-vehicle communication with other vehicles in the area.

[0042] Planned actions of the vehicle 12 are displayed in a right-hand end portion of the display area of ​​the first display device 24 by the first display instruction section 56. In the present exemplary embodiment, a first planned action P1, a second planned action P2, and a third planned action P3 are displayed in a sequence from bottom to top. For each of the planned actions, three pieces of information are displayed: a distance from the current position to the position of the planned action, a planned route, and a driving category. The driving category refers to whether the action is to be performed manually by the driver or by autonomous driving. In the present exemplary embodiment, the setting is chosen, for example, to display only three upcoming planned actions, and subsequent planned actions are not displayed. However, there is no other restriction.For example, four or more planned actions can be displayed on the first display device 24. Alternatively, the number of planned actions displayed on the first display device 24 can be freely adjustable.

[0043] Detailed explanations of the first planned action P1, the second planned action P2, and the third planned action P3 follow. On the left side of the first planned action P1, "1.4 km" is displayed to indicate that this action will be performed approximately 1400 m ahead of the current position. In the center of the first planned action P1, a graphic representation of a route is displayed, showing a path that transitions from a side road to a main road on the right, allowing the planned route to be determined from the graphic representation. On the right side of the first planned action P1, "AUTO" is displayed to indicate that this action will be performed by autonomous driving.

[0044] The second planned action, P2, is displayed above the first planned action, P1. On the left side of the second planned action, P2, "2.0 km" is displayed to indicate that this action will be performed approximately 2000 m before the current position. In the center of the second planned action, P2, a graphic representation of a lane change from a left to a right lane is displayed, allowing the planned route to be determined from the graphic. On the right side of the second planned action, P2, "MANUAL" is displayed to indicate that this action will be performed manually. Specifically, a temporary handover from autonomous driving to manual driving will take place before 2000 m have been traveled. It should be noted that in this exemplary embodiment, the occupant only performs the lane change and switches back to autonomous driving afterward.

[0045] The third planned action, P3, is displayed above the second planned action, P2. On the left side of the third planned action, P3, "2.6 km" is displayed to indicate that this action will be performed approximately 2600 m ahead of the current position. In the center of the third planned action, P3, a graphic representation of a lane change from a left to a right lane is displayed, allowing the planned route to be determined. On the right side of the third planned action, P3, "AUTO" is displayed to indicate that this action will be performed autonomously.

[0046] Fig. Figure 5B shows an image displayed on the first display device 24 in a state where the vehicle 12 is approximately 500 m from the state in Fig. has covered 4B. As in Fig. As shown in diagram 5B, the display on the left in the first planned action P1 has changed to "0.9 km", and the display on the left in the second planned action P2 has changed to "1.5 km". The display on the left in the third planned action P3 has changed to "2.1 km". Other display content is the same as in diagram 5B. Fig. 4B.

[0047] Fig. Figure 6B shows an image displayed on the first display device 24 in a state in which the vehicle 12 is approximately 600 m from the state in Fig. 5B covered. As in Fig. As shown in Figure 6B, the display on the left in the first planned action P1 has changed to "0.3 km", and the display on the left in the second planned action P2 has changed to "0.9 km". The display on the left in the third planned action P3 has changed to "1.5 km". Other display content is the same as in Figure 6B. Fig. 5B. It should be noted that in the present exemplary embodiment, the distance display for each planned action is set to change in increments of 0.1 km as the vehicle 12 approaches the planned action.

[0048] As in Fig. As shown in Figure 3, the functional configuration of the vehicle display device 10 includes the second display instruction section 58. Of the planned actions shown on the first display device 24 by the first display instruction section 56, the second display instruction section 58 shows on the second display device 26 one planned action for which at least one of the distances or time intervals leading up to the action has reached or fallen below a prescribed value. In cases where there is no planned action for which at least one of the distances or time intervals leading up to the action has reached or fallen below a prescribed value, the second display instruction section 58 shows on the second display device 26 the immediately imminent planned action from among those shown on the first display device 24 by the first display instruction section 56.It should be noted that in the present exemplary embodiment, the second display instruction section 58 indicates a planned action on the second display device 26 in cases where the distance to the planned action is within 1000 m.

[0049] In cases where the distance to a planned action is within 1000 m, the reprint indicator section 60 highlights (emphasizes) the display of this planned action on the second display device 26. In cases where several planned actions are displayed on the second display device 26, the reprint indicator section 60 highlights the display of the nearest planned action over the other planned actions on the second display device 26. An explanation of the functionality of the second display instruction section 58 and the reprint indicator section 60 follows, with reference to Fig. 4A, Fig. 5A and Fig. 6A.

[0050] As in Fig. As shown in Figure 4A, the speed set via the cruise control and the current speed of the vehicle 12 are displayed in a lower part of a display area of ​​the second display device 26. The set speed and the current vehicle speed are displayed in a central part of the display area of ​​the second display device 26 in the direction of the vehicle's width. The set speed is displayed on the right in a smaller font and is shown as 120 km / h for example. The current vehicle speed is displayed on the left and is shown as 58 km / h. The vehicle 12 is set to travel at a speed of up to 120 km / h while maintaining a constant distance to the vehicle in front.It should be noted that the display of the set speed and the current vehicle speed are synchronized with the contents of the first display device 24.

[0051] The first planned action P1 of vehicle 12 is indicated in a right-hand end section of the display area of ​​the second display device 26 by the second display instruction section 58. It should be noted that, as in Fig. 4B is shown because the distance to the immediately imminent planned action is greater than 1000 m, the second display instruction section 58 displays the first planned action P1, which is the immediately imminent planned action, on the second display device 26.

[0052] In the illustration of Fig. 5A, the distance to the first planned action P1, indicated by the second display instruction section 58, has become 900 m. In cases where the distance to the planned action is within 1000 m, as in this case, the first planned action P1 is indicated more emphatically, highlighted, or emphasized by the reinforcement display section 60.

[0053] In Fig. 6A, the distance to the second planned action P2 has become 900 m. In cases where, as in this case, several planned actions are within 1000 m of each other, the second display instruction section 58 shows both the first planned action P1 and the second planned action P2 on the second display device 26. Furthermore, the emphasis display section 60 shows the first planned action P1, which is imminent, more emphatically, or with greater emphasis. More precisely, the first planned action P1 is displayed larger than the second planned action P2.

[0054] It should be noted that if the vehicle travels 12,300 m or more from the state in Fig. 6 has traveled to pass the location of the first planned action P1, the first planned action P1 is deleted by the first display device 24 and the second display device 26. How it works

[0055] The following is an explanation of how the present exemplary embodiment works. Display processing

[0056] The following is an explanation of an example of display processing for displaying the planned actions of vehicle 12 based on a timetable, with reference to the one in Fig. The flowchart shown is 7. The display processing is carried out by the CPU 30 reading a display program from the ROM 32 or the memory 36 and extending and executing the display program in RAM 34.

[0057] As in Fig. As shown in Figure 7, the CPU 30 determines in step S102 whether a destination has been set or not. The destination can be entered directly into the vehicle 12 by an occupant, or indirectly via a portable device or similar.

[0058] In cases where CPU 30 determines that the destination was set in step S102, processing continues with step S104. In cases where CPU 30 determines that no destination was set in step S102, display processing is terminated.

[0059] In step S104, CPU 30 defines a route or timetable for vehicle 12. More precisely, CPU 30 uses the functionality of timetable setting section 52 to define a route or timetable from the current location to the destination. Information about traffic conditions, accidents, and the like can be collected and taken into account when defining the timetable. Furthermore, the timetable can be configured to incorporate a high degree of autonomous driving according to the pre-defined preferences of an occupant.

[0060] In step S106, the CPU 30 displays planned actions on the first display device 24. More precisely, the CPU 30 uses the functionality of the first display instruction section 56 to display planned actions of the vehicle 12 on the first display device 24 based on the timetable. As in Fig. As shown in 4B as an example, the CPU 30 displays three planned actions, namely the first planned action P1, the second planned action P2 and the third planned action P3, in the right end part of the display area of ​​the first display device 24.

[0061] As in Fig. As shown in Figure 7, CPU 30 determines in step S108 whether there is no planned action within a specified distance L. For example, distance L is set to 1000 m, and thus CPU 30 determines in step S108 whether there is no planned action within 1000 m. If there is no planned action within 1000 m, CPU 30 continues with the processing of step S110. If there is a planned action within 1000 m, CPU 30 continues with the processing of step S112.

[0062] In step S110, CPU 30 executes the standard display of only the immediately upcoming planned action on the second display device 26. More precisely, CPU 30 uses the functionality of the second display instruction section 58 to display on the second display device 26 only the immediately upcoming planned action from among the planned actions displayed on the first display device 24. It should be noted that the standard display mentioned here is a display format that is not a highlighted display and refers to a state such as the one described in Fig. 4A refers to the first planned action P1, which is displayed using the standard display on the second display device 26.

[0063] In cases where there is a planned action within 1000 m, CPU 30 proceeds to processing step S112. In step S112, CPU 30 determines whether there are multiple planned actions within 1000 m. If there are multiple planned actions within 1000 m from those displayed on the first display device 24, CPU 30 proceeds to processing step S116. If there is only one planned action within 1000 m, CPU 30 proceeds to processing step S114.

[0064] In cases where there is only one planned action within 1000 m, the CPU 30 emphatically displays this planned action on the second display device 26 in step S114. More precisely, as shown in Fig. Figure 5A shows the functionality of the second display instruction section 58 and the reprint display section 60 to increase the display of the first planned action P1 on the second display device 26.

[0065] In cases where there are multiple planned actions within 1000 m, the CPU 30 in step S116 emphatically displays the immediately upcoming planned action and performs the standard display of the other planned actions. More precisely, the CPU 30 uses, as in Fig. Figure 6A illustrates the functionality of the second display instruction section 58 and the reprint display section 60 to enlarge the display of the first planned action P1 on the second display device 26. The CPU 30 also executes the standard display of the second planned action P2 above the first planned action P1 on the second display device 26. The second planned action P2 is thus displayed at a smaller size than the first planned action P1.

[0066] As in Fig. As shown in Figure 7, after the corresponding step S110, step S114, or step S116, CPU 30 proceeds to processing step S118. In step S118, CPU 30 determines whether or not vehicle 12 has passed the location of the corresponding planned action. More precisely, based on a relationship between the position of the vehicle with the device installed in it, as identified by the GPS device, and the position of the planned action, as defined in the map data based on the timetable, CPU 30 determines whether vehicle 12 has passed the location of the relevant planned action. If it is determined that vehicle 12 has passed the location of the planned action, CPU 30 proceeds to processing step S120. If it is determined in step S118 that vehicle 12 has not passed the location of the planned action, i.e.,In cases where it is determined that the location of the planned action has not yet been reached, CPU 30 returns to processing step S108.

[0067] In step S120, CPU 30 deletes the corresponding planned action from the first display device 24 and the second display device 26 and terminates the display processing. More precisely, when the location of the planned action has been passed, CPU 30 deletes the display of the planned action on the first display device 24 and the second display device 26. For example, in cases where the vehicle 12 is approximately 400 m or more from the state in Fig. 6A and Fig. Once 6B has been travelled, the display of the first planned action P1 is cleared from the first display device 24 and the second display device 26.

[0068] When this is done, since the first scheduled action P1 has been cleared from the first display device 24, the second scheduled action P2 is displayed below and the third scheduled action P3 is displayed above the second scheduled action P2. The functionality of the first display instruction section 56 is used to display a scheduled action following the third scheduled action P3 above the third scheduled action P3.

[0069] Since the first planned action P1 is cleared from the second display device 26, the second planned action P2 is displayed below. Because the distance to the second planned action P2 is within 1000 m, the functionality of the reprint display section 60 is also used to enlarge the display of the second planned action P2. It should be noted that, because the distance to the third planned action P3 is greater than 1000 m, the third planned action P3 is not displayed on the second display device 26.

[0070] As described above, in the vehicle display device 10 of the present exemplary embodiment, planned actions of the vehicle are displayed on the first display device 24 based on the set timetable. This allows the occupant to recognize the route or timetable by glancing at the first display device 24.

[0071] Furthermore, of the planned actions displayed on the first display device 24, one planned action for which at least one of the distances or time intervals to the action has reached a prescribed value or less (in this case, within 1000 m) is displayed on the second display device 26. This allows the occupant to check imminent planned actions of the vehicle by glancing at the second display device 26. This enables the occupant to quickly identify the planned actions of the vehicle.

[0072] Furthermore, in the present exemplary embodiment, upcoming planned actions of the vehicle 12 are displayed by being projected from the second display device 26 onto the projection surface above the first display device 24 in the vehicle. This allows the occupant to check the upcoming planned actions of the vehicle 12 without significantly altering their gaze while driving. In particular, the occupant is able to easily recognize the upcoming planned actions of the vehicle.

[0073] Furthermore, in the present exemplary embodiment, the occupant is able to recognize the immediately imminent planned action by looking at the prominently displayed, emphasized, or highlighted content. This allows the occupant, in particular, to intuitively verify information about the immediately imminent planned action.

[0074] Furthermore, in the present exemplary embodiment, in addition to displaying the distance of the vehicle 12 from the action and the planned route of the vehicle, it is also indicated for the planned action whether the action is to be carried out manually by the driver or by autonomous driving. This allows the occupant to see at a glance whether they have to drive themselves or not. In the vehicle 12, which is configured to switch between autonomous and manual driving, the occupant is not left in any doubt as to whether they have to drive themselves or not.

[0075] Furthermore, in the present exemplary embodiment, deleting completed planned actions from the second display device 26 allows the amount of information displayed on the second display device 26 to be limited to the necessary minimum. This reduces the amount of information displayed on the second display device 26 compared to cases where completed planned actions are not deleted for a certain period. As a result, the occupant does not need to look at the second display device 26 for extended periods.

[0076] A vehicle display device and a program according to an exemplary embodiment have been described above. However, various modifications can be made within a range that does not deviate from the idea of ​​the present invention. In the exemplary embodiment above, for example, the first display device 24 is mounted on the dashboard 14 such that it is located at the front of the vehicle in front of the driver's seat, and the second display device 26 is formed by the head-up display device 44, which projects onto the projection surface. However, the invention is not limited to this. For example, the first display device can be a central display arranged on a part of the dashboard 14 that is central in the direction of the vehicle's width.A projection surface onto which the second display device projects can be arranged on the dashboard 14 such that it is located at the front of the vehicle (in front of) the steering wheel 16.

[0077] In the exemplary embodiment above, the second display instruction section 58 also performs the display on the second display device 26 in cases where the distance to a planned action is within 1000 m. However, the invention is not limited to this. For example, the second display instruction section 58 can perform the display on the second display device 26 in cases where the distance to a planned action is within 1500 m, or it can perform the display on the second display device 26 in cases where the distance to a planned action is within 500 m. In such cases, the time interval until the planned action can be calculated based on the speed of the vehicle 12 and the distance to the planned action, and this time interval can be displayed on the first display device 24 and the second display device 26.In addition, threshold values ​​can be set for both the distance and the time interval to a planned action, and the second display instruction section 58 can display the planned action on the second display device 26 in cases where either the distance or the time interval has reached or fallen below the corresponding threshold value.

[0078] Furthermore, in the exemplary embodiment above, the emphasis indicator section 60 provides an emphatic or highlighted indication by making the indication larger than normal. However, the invention is not limited to this, and the emphatic indication can be achieved by another method. For example, the emphatic indication can be achieved by changing the color and hue. Alternatively, the emphatic or highlighted indication can be achieved by a method such as flashing or increasing the brightness of a section in which the intended action is indicated.

[0079] Furthermore, in the exemplary embodiment above, three pieces of information are displayed for each planned action: the distance to the action of vehicle 12, the planned route of the vehicle, and the driving category. However, the invention is not limited to this. For example, information such as a speed limit can also be displayed. From the perspective of ease of readability, however, the display is preferably limited to the three pieces of information mentioned above. Moreover, the display of the planned route is not limited to the information shown in the above. Fig. 4A to Fig. The graphic representations shown in 6B are limited, and the display may be done with other symbols or similar.

[0080] Furthermore, in the exemplary embodiment shown above, up to two upcoming planned actions are displayed on the second display device 26 in the second display instruction section 58. However, the invention is not limited to this. For example, the second display instruction section 58 can display three or more upcoming planned actions on the second display device 26.

[0081] It should be noted that the display processing performed by CPU 30 in the exemplary embodiment above, which reads and executes software (a program), can be performed by various other processor types besides CPU 30. These processors include programmable logic devices (PLDs), which allow modification of the circuit configuration after manufacturing, such as a field-programmable gate array (FPGA), and dedicated electrical circuits, where these processors comprise a circuit configuration specifically designed to perform a particular processing task, such as an application-specific integrated circuit (ASIC). The display processing can be performed by any one of these different processor types or by a combination of two or more processors of the same type or different processor types (such as multiple FPGAs or a combination of a CPU and an FPGA).The hardware structure of these different processor types is, more precisely, an electrical circuit that combines circuit elements such as semiconductor elements.

[0082] Furthermore, in the exemplary embodiment shown above, the various data are stored in memory 36. However, the invention is not limited to this. A non-volatile storage medium such as a compact disc (CD), a digital versatile disc (DVD), or a universal serial bus storage device (USB storage) can serve as the storage section. In such cases, the various programs, data, etc., are stored on the non-transient or non-volatile recording medium.

Claims

[1] Vehicle display device (10) comprising: a first display device (24) which is arranged in a vehicle cabin; a second display device (26) which is located in the vehicle cabin and separate from the first display device (24); a memory (36); and a processor (30) connected to the memory (36) and configured to: establishes a timetable for a vehicle, and a plurality of planned actions of the vehicle on the first display device (24) based on the timetable, characterized by , that the processor (30) is further configured to in a case where at least one of a distance or time interval to the planned action has reached a prescribed value or less, an upcoming planned action of the majority of planned actions is indicated on the second display device (26), wherein the vehicle is switchable between autonomous driving and manual driving; and In addition to the planned action, the distance to the planned action and a planned route of the vehicle are displayed, indicating whether the planned action is to be carried out manually by a driver or by autonomous driving. [2] Vehicle display device (10) according to claim 1, wherein: the first display device (24) is arranged on a dashboard (14) at the front of a vehicle, on the driver's seat; and the second display device (26) is a head-up display device configured to project onto a projection surface on the top of the vehicle of the first display device (24). [3] Vehicle display device (10) according to claim 1 or claim 2, wherein in a case where a plurality of planned actions are displayed on the second display device (26), the earliest of the planned actions is displayed more prominently than any other of the planned actions. [4] Vehicle display device (10) according to one of claims 1 to 3, wherein the planned action is deleted by the second display device (26) in a case in which a location or time of the planned action has been passed. [5] Vehicle display procedures comprising: by a processor (30), Establishing a vehicle's timetable; and Displaying a plurality of planned actions of the vehicle on a first display device (24) located in a vehicle cabin, based on the timetable; characterized by in a case where at least one of a distance or time interval to the planned action has reached a prescribed value or less, display of an upcoming planned action or the plurality of planned actions on a second display device (26) which is arranged in the vehicle cabin and separately from the first display device (24), wherein the vehicle is switchable between autonomous driving and manual driving; and In addition to the planned action, the distance to the planned action and a planned route of the vehicle are displayed, indicating whether the planned action is to be carried out manually by a driver or by autonomous driving. [6] Vehicle display method according to claim 5, wherein in a case where a plurality of planned actions are displayed on the second display device (26), the earliest of the planned actions is displayed more prominently than any other of the planned actions. [7] Vehicle display method according to claim 5 or 6, wherein the planned action is deleted by the second display device (26) in a case in which a location or time of the planned action has been passed. [8] Non-volatile storage medium that stores a program which can be executed by a computer to perform processing, wherein the processing includes: Establishing a vehicle's timetable; and Displaying a plurality of planned actions of the vehicle on a first display device (24) located in a vehicle cabin, based on the timetable; characterized by in a case where at least one of a distance or time interval to the planned action has reached a prescribed value or less, display of an upcoming planned action or the plurality of planned actions on a second display device (26) which is arranged in the vehicle cabin and separately from the first display device (24), wherein the vehicle is switchable between autonomous driving and manual driving; and In addition to the planned action, the distance to the planned action and a planned route of the vehicle are displayed, indicating whether the planned action is to be carried out manually by a driver or by autonomous driving. [9] Non-volatile storage medium according to claim 8, wherein in a case where a plurality of planned actions are displayed on the second display device (26), the earliest of the planned actions is displayed more prominently than any other of the planned actions. [10] Non-volatile storage medium of claim 8 or 9, wherein the planned action is deleted by the second display device (26) in a case in which a location or time of the planned action has been passed.

Images