Vehicle display device, vehicle, display processing method, and computer-readable storage medium

Abstract

The present invention provides a display device for a vehicle, a vehicle, a display processing method, and a computer-readable storage medium. The display device for a vehicle includes: a display unit disposed within a vehicle compartment, having a specific display area within a display region for arranging and displaying multiple plans to be implemented by the vehicle in a predetermined implementation order; and a control unit that, within the specific display area, displays, between a first plan (one of multiple plans) and a second plan to be implemented following the first plan, an alternative plan that may replace the first plan.

Description

Technical Field

[0001] This disclosure relates to display devices for vehicles, vehicles, display processing methods, and computer-readable storage media. Background Technology

[0002] Patent document 1 (Japanese Patent Application Publication No. 2021-088222) discloses a display device for vehicles that displays, on a display screen and a head-up display, actions (lane change, lane merging, lane branching, etc.) predetermined by the vehicle along a path guiding the vehicle to its destination. The display of these actions includes the distance to the predetermined location of the action, the type of action (lane change, lane merging, lane branching, etc.), and the type of driving mode (autonomous or manual).

[0003] In addition, in this display device, the display process is performed in the following manner: starting from the action that is closest to the predetermined execution position (distance) of the action, multiple actions are displayed in a row from bottom to top, the bottommost action that has ended is deleted, and a new action is added to the top.

[0004] In the vehicle display device described in the aforementioned patent 1, even if the action based on automatic driving control is displayed as the most recent action, there are situations where the action cannot be performed via automatic driving due to road conditions or other reasons. In such cases, the vehicle display device replaces the action controlled by automatic driving control with the action based on manual driving.

[0005] In this situation, the display screen does not change the label indicating the type of action; instead, it changes the label for automatic driving control to manual driving control. As a result, the occupants may not be able to recognize the change in the display.

[0006] In other words, occupants must perform the above actions (driving operations) manually, but may not be able to control the situation.

[0007] In other words, there is room for improvement in ensuring that occupants are aware of any changes to the planned implementation schedule displayed on the vehicle's display device. It is hoped that occupants will be aware of the possibility of a change in the planned implementation schedule in advance. Summary of the Invention

[0008] The present disclosure takes into account the above facts and aims to provide a vehicle display device, vehicle, display processing method, and computer-readable storage medium that allows occupants to anticipate the possibility of switching to a pre-planned implementation schedule.

[0009] The vehicle display device of the first embodiment includes: a display unit disposed inside the vehicle compartment, having a specific display area in which multiple plans to be implemented by the vehicle are displayed in a predetermined implementation order; and a control unit that, in the specific display area, displays an alternative plan that may replace the first plan and be implemented between a first plan, which is one of the multiple plans, and a second plan that is to be implemented next after the first plan.

[0010] In this vehicle display device, a display unit is installed inside the passenger compartment. Within a specific display area of ​​this display unit, multiple plans scheduled to be implemented by the vehicle are displayed in a predetermined execution order. In this specific display area, the control unit displays an alternative plan that could replace the first plan and be implemented, between a first plan (one of multiple plans) and a second plan (the next scheduled plan to be implemented after the first plan).

[0011] Therefore, by simply observing a specific display area on the display unit, the occupants can grasp the possibility of implementing an alternative plan instead of the planned first plan. As a result, even if the planned first plan is changed to an alternative plan, the occupants are aware of the possibility of this change in advance, thus enabling them to control the plan's alteration. In other words, it prevents or suppresses situations where the occupants cannot control the plan's change.

[0012] For the vehicle display device of the second type, in the vehicle display device of the first type, the first plan is the plan that is initially planned to be implemented among the plurality of plans, that is, the first plan.

[0013] In this vehicle display device, the control unit displays an alternative plan to the earliest plan initially scheduled for implementation among multiple displayed plans. That is, by displaying the alternative plan to the earliest implemented plan, even if the initially scheduled plan changes to the alternative plan, the occupants are aware of the possibility of a change in the earliest plan, thus allowing them to be aware of any potential changes. In other words, it prevents or suppresses situations where the occupants are unable to be aware of changes to the earliest plan.

[0014] In the second type of vehicle display device, when the first plan is based on the action of the vehicle under driver assistance control and the conditions specified for the first plan are met, the control unit displays the same type of manually operated vehicle action as the first plan, i.e., the alternative plan, in the specific display area.

[0015] In this vehicle display device, when the first plan is the vehicle's action based on driver assistance control and the conditions specified for the first plan are met, the control unit adds and displays the same type of vehicle action based on manual operation as the first plan, i.e., a replacement plan, in a specific display area.

[0016] That is, when conditions are met for the actions of the vehicle based on driver assistance control as the first plan, for example, if it is determined that the actions of the vehicle based on driver assistance control are highly unlikely to be achieved, the actions of the vehicle based on manual operation, which are the same as the first plan, i.e., the alternative plan, will be displayed in a specific display area. Thus, the occupant can anticipate the possibility of switching to manual driving if the actions of the vehicle based on the first plan (driver assistance control) become difficult.

[0017] Therefore, if the planned implementation is changed from the first plan to an alternative plan, the change can be reliably managed, and the occupants can calmly perform manual driving.

[0018] For the vehicle display device of the fourth type, in any of the vehicle display devices of the first to third types, the control unit causes the alternative plan to be displayed in a color that is at least different from the first plan.

[0019] In this vehicle display device, in a specific display area, the alternative plan is displayed in a color different from the first plan. Therefore, occupants who have visually confirmed the specific display area of ​​the display unit can intuitively confirm that the alternative plan is not the currently planned plan, but rather a candidate for the first plan. Furthermore, since the alternative plan is displayed following the first plan, occupants can easily identify it as a candidate for the first plan.

[0020] For the vehicle display device of the fifth type, in the vehicle display device of the second or third type, when the control unit adds the above-mentioned alternative plan to the above-mentioned specific display area, it deletes the above-mentioned plan that is last to be implemented among the above-mentioned multiple plans, i.e., the final plan, from the above-mentioned specific display area.

[0021] In this vehicle display device, when the control unit inserts (adds) and displays an alternative plan between the first plan and the second plan arranged and displayed in a specific display area, space for displaying the alternative plan in the specific display area is ensured by deleting the last plan.

[0022] This process maintains a constant number of plans displayed in a specific display area.

[0023] For the vehicle display device of the sixth type, in any of the vehicle display devices of the first to fifth types, the control unit deletes the alternative plan from the specific display area when the operation of the first plan has started.

[0024] In this vehicle display device, the control unit deletes the alternative plan from a specific display area when the operation of the first plan has begun. That is, the start of the operation of the first plan means that the possibility of implementing the alternative plan to replace the first plan has disappeared. Therefore, by deleting the alternative plan, which has no possibility of implementation, from the specific display area, the situation that the possibility of implementing the alternative plan has disappeared can be reliably communicated to the occupants.

[0025] For the vehicle display device of the seventh method, in the third-party vehicle display device, the specified condition for the first plan refers to the situation where the operation of the vehicle related to the first plan has not started at the predetermined time of implementation of the first plan.

[0026] In this vehicle display device, when the operation of the first plan cannot be started at the scheduled implementation time, an alternative plan is displayed in a specific display area. That is, the failure to implement the operation of the first plan at the scheduled implementation time means that there is a high probability that the operation of the first plan cannot be implemented during the period even if the scheduled implementation time is postponed.

[0027] Therefore, by displaying an alternative plan when the first plan fails to commence at its intended execution time, the occupants can grasp the possibility of the alternative plan replacing the intended first plan simply by observing a specific display area on the display unit. As a result, even if the intended first plan is changed to an alternative plan, the occupants can anticipate the possibility of a plan change and thus be aware of the plan's alteration. In other words, it prevents or suppresses situations where the occupants cannot anticipate a plan change.

[0028] For the vehicle display device of the eighth method, in the third-party vehicle display device, the specified condition for the first plan refers to the situation where the operation of the vehicle related to the first plan may not begin at the predetermined time of implementation of the first plan.

[0029] In this vehicle display device, when it is possible that the operation of the first plan cannot be started at the scheduled implementation time of the first plan, an alternative plan is displayed in a specific display area. That is, if there is a high probability that the operation of the first plan cannot be carried out at the scheduled implementation time, there is a high probability that the vehicle operation of the first plan cannot be carried out even if the scheduled implementation time arrives.

[0030] Therefore, when there is a high probability that the planned implementation of the first plan will not commence at its intended time, by displaying an alternative plan, the occupants can grasp the possibility of the alternative plan being implemented instead of the planned first plan simply by observing a specific display area on the display unit. As a result, even if the planned first plan is changed to an alternative plan, the occupants can anticipate the possibility of a plan change, thus allowing them to manage the plan's alteration. In other words, it prevents or suppresses situations where the occupants cannot grasp the plan's change.

[0031] For the vehicle display device of the ninth type, in any of the vehicle display devices of the first to eighth types, the display unit is provided in the instrument panel at the position in front of the driver's seat.

[0032] In this vehicle display device, since the display unit is located in the dashboard in front of the driver's seat, the occupant does not need to move their eyes much while driving, and can confirm the plan according to the predetermined sequence of actions.

[0033] For the vehicle display device of the tenth embodiment, in any of the vehicle display devices of the first to eighth embodiments, the aforementioned display section is a projection surface formed by a head-up display device.

[0034] In this vehicle display device, the display section is a projection surface formed by a head-up display. Multiple plans are displayed on the projection surface above the vehicle in a predetermined sequence. As a result, the occupants while driving can check multiple plans within the vehicle's predetermined execution period without significantly shifting their gaze.

[0035] The vehicle of the eleventh method is equipped with a vehicle display device as described in any of the first to tenth methods.

[0036] Since the vehicle is equipped with a vehicle display device as described in any of the first to tenth methods, it is possible to confirm the possibility of replacing the first plan and proceeding with the planned implementation of the alternative plan simply by visually confirming the alternative plan displayed in a specific display area. Therefore, even if the first plan is switched to the alternative plan, the occupants will not be surprised.

[0037] In the twelfth type of display processing method, in a display unit provided in the carriage and having a display area, multiple plans to be implemented by the vehicle are arranged and displayed in a predetermined implementation order in a specific display area of ​​the display area. The display processing method includes the following step: in the specific display area, between a first plan, which is one of the multiple plans, and a second plan that is to be implemented next to the first plan, an alternative plan that may replace the first plan is displayed.

[0038] According to this display processing method, it can achieve the same effect as the first method.

[0039] A program stored in a computer-readable storage medium of the thirteenth method, in a display unit provided inside the carriage and having a display area, causes multiple plans to be implemented by the vehicle to be displayed in a predetermined implementation order in a specific display area of ​​the display area. The program causes a computer to perform a process including the following steps: within the specific display area, between a first plan, which is one of the multiple plans, and a second plan, which is the next plan to be implemented after the first plan, an alternative plan that may replace the first plan is displayed.

[0040] By having the computer execute the program, the same effect as the first method can be achieved.

[0041] As explained above, with the vehicle display device according to the first to eighth methods, the occupants can anticipate the possibility of switching to a pre-planned implementation.

[0042] According to the vehicle display devices of the ninth and tenth methods, the occupants in the driver's seat can confirm the plans displayed in a predetermined sequence without significantly shifting their gaze.

[0043] According to the vehicle of the eleventh method, the occupants can anticipate the possibility of switching to the planned implementation.

[0044] According to the display processing method of the twelfth method, the occupants can anticipate the possibility of switching to the planned implementation.

[0045] According to the computer-readable storage medium of the thirteenth method, the occupants can anticipate the possibility of switching to a pre-planned implementation. Attached Figure Description

[0046] Figure 1 This is a simplified diagram obtained by viewing the front of the passenger compartment of a vehicle with the vehicle display device implemented from the rear of the vehicle.

[0047] Figure 2 This is a block diagram illustrating the hardware structure of a vehicle display device according to an embodiment.

[0048] Figure 3 This is a block diagram illustrating the functional structure of a vehicle display device according to an embodiment.

[0049] Figure 4 (A) is a diagram showing an example of the display of the second display unit. Figure 4 (B) is a diagram showing an example of the display of the first display unit.

[0050] Figure 5(A) indicates that from Figure 4 The diagram shows an example of the second display unit's display after the state (A) has progressed 100m. Figure 5 (B) indicates that from Figure 4 The diagram shows an example of the display of the first display unit when the state of (B) has progressed 100m.

[0051] Figure 6 (A) indicates that from Figure 5 The diagram showing an example of the second display unit in the state of (A) is inserted to replace the planned state. Figure 6 (B) indicates that from Figure 4 The diagram showing an example of the first display unit in the state of (B) is inserted to replace the planned state.

[0052] Figure 7 (A) indicates that from Figure 6 The second display unit, in the state of (A) having moved forward 50m, is shown in the diagram of the replacement display example after processing. Figure 7 (B) indicates that from Figure 6 The diagram shows the first display unit in the state of (B) having moved forward 50m, replacing the processed display example.

[0053] Figure 8 This is a flowchart illustrating an example of the display processing flow in an implementation method.

[0054] Figure 9 This is a flowchart illustrating an example of the display processing flow in an implementation method.

[0055] Figure 10 (A) represents from Figure 5 The diagram shows an example of a second display unit showing an updated state of (A). Figure 10 (B) indicates from Figure 5 The diagram shows an example of the first display section where the status of (B) has been updated. Detailed Implementation

[0056] The vehicle 12, which incorporates a vehicle display device 10 according to one embodiment, is described below with reference to the accompanying drawings. Furthermore, as an example, the vehicle 12 of this embodiment is configured to switch between automatic and manual driving. Figure 1 As shown, an instrument panel 14 is provided at the front of the passenger compartment in vehicle 12.

[0057] The instrument panel 14 extends along the width of the vehicle, and a steering wheel 16 is provided on the right side of the instrument panel 14. That is, in this embodiment, as an example, it is a right-hand drive vehicle with the steering wheel 16 provided on the right side, and the driver's seat is located on the right side of the vehicle.

[0058] A windshield 18 is provided at the front end of the dashboard 14. The windshield 18 extends along the vertical direction and the width direction of the vehicle to divide the interior and exterior of the passenger compartment.

[0059] The windshield 18 is fixed to the right front pillar 20 of the vehicle. The front pillar 20 extends vertically along the vehicle, and the windshield 18 is fixed to the inner end of the front pillar 20 in the vehicle width direction. Additionally, the front end of the front side glass 22 is fixed to the outer end of the front pillar 20 in the vehicle width direction. Furthermore, the left side of the windshield 18 is fixed to the left front pillar (not shown).

[0060] Here, a first display unit 24 is provided in the instrument panel 14. The first display unit 24 is provided in the part of the instrument panel 14 located in front of the driver's seat, and is positioned so that it enters the driver's field of vision when the driver's gaze is directed forward.

[0061] A second display unit 26 is provided on the windshield 18. The second display unit 26 is located on the upper side of the vehicle where the first display unit 24 is located, and is connected to the head-up display device 44 (see reference). Figure 2 The projection surface is formed by projection. Specifically, the configuration is as follows: a head-up display 44 is provided on the front side of the vehicle, which is closer to the instrument panel 14, and an image is projected from the head-up display 44 onto the second display 26 of the windshield 18.

[0062] (Hardware structure of vehicle display device 10)

[0063] The vehicle 12 is equipped with an ECU (Electronic Control Unit) 28, which serves as a control unit. Figure 2 This is a block diagram showing the hardware structure of the vehicle display device 10. (As shown...) Figure 2 As shown, the ECU28 of the vehicle display device 10 is configured to include a CPU (Central Processing Unit) 30, a ROM (Read Only Memory) 32, a RAM (Random Access Memory) 34, a memory 36, a communication interface 38, and an input / output interface 40. All components are connected to each other via a bus 42 in a manner that enables communication.

[0064] CPU 30 is the central processing unit, which executes various programs or controls various parts. That is, CPU 30 reads programs from ROM 32 or memory 36 and uses RAM 34 as the working area to execute the programs. CPU 30 performs control of the above-mentioned structures and various arithmetic operations according to the programs recorded in ROM 32 or memory 36.

[0065] ROM 32 stores various programs and data. RAM 34 serves as a working area for temporary storage of programs or data. Memory 36 is composed of HDD (Hard Disk Drive) or SSD (Solid State Drive) and stores various programs, including the operating system, and various data. In this embodiment, ROM 32 or memory 36 stores programs for display processing and various data.

[0066] Communication interface 38 is an interface for the vehicle display device 10 to communicate with a server and other devices not shown, such as using standards such as Ethernet (registered trademark), LTE, FDDI, and Wi-Fi (registered trademark).

[0067] The input / output interface 40 is connected to a first display unit 24, a head-up display device 44 that projects images to a second display unit 26, and an actuator 46. The actuator 46 is configured to include a steering actuator, an acceleration actuator, and a braking actuator. The steering actuator controls the steering of the vehicle 12. The acceleration actuator accelerates the vehicle 12. The braking actuator decelerates the vehicle 12 by controlling the brakes. Furthermore, the input / output interface 40 is connected to sensors (not shown) and a GPS device, etc., for enabling the vehicle 12 to drive automatically.

[0068] (Functional structure of vehicle display device 10)

[0069] The vehicle display device 10 uses the aforementioned hardware resources to implement various functions. (Refer to...) Figure 3 This section explains the functional structure of the vehicle display device 10.

[0070] like Figure 3 As shown, the vehicle display device 10, as a functional structure, includes a communication unit 50, an operation plan setting unit 52, an automatic driving control unit 54, a detection unit 55, a first display indicator unit 56, a second display indicator unit 58, and an emphasis display unit 60. Furthermore, each functional structure is implemented by the CPU 30 reading and executing a program stored in the ROM 32 or the memory 36.

[0071] The communication unit 50 transmits and receives data with external servers and other devices via the communication interface 38. For example, it transmits and receives map data and traffic conditions stored on the server. In addition, the communication unit 50 can also be configured to conduct vehicle-to-vehicle communication with surrounding vehicles.

[0072] The operation plan setting unit 52 sets the operation plan for the vehicle 12. Specifically, the operation plan from the current location to the destination is set by having the occupants input the destination.

[0073] The automatic driving control unit 54 considers the location information and the surrounding environment information of the vehicle 12, and drives the vehicle 12 automatically according to the set operating plan. Specifically, the vehicle 12 is driven automatically by controlling the actuator 46.

[0074] The detection unit 55 detects the current location of the vehicle 12 based on sensors and GPS devices, and detects the drive signal to the actuator 46, and detects whether the planned action has started when the vehicle passes the planned predetermined implementation position.

[0075] The first display instruction unit 56 displays the vehicle 12's schedule on the first display unit 24 based on the operation plan set by the operation plan setting unit 52. (See reference...) Figure 4 (B) Figure 5 (B) and Figure 6 (B) in the diagram explains the function of the first display indicator 56.

[0076] like Figure 4 As shown in (B), the upper part of the display area 24A of the first display unit 24 displays the set speed VA for cruise control and the current vehicle speed VB of the vehicle 12. The set speed VA and the vehicle speed VB are displayed on the left side of the display area 24A of the first display unit 24 in the vehicle width direction. The set speed VA is displayed smaller in the lower layer; here, as an example, it is set to 120 km / h. The current vehicle speed VB is displayed in the upper layer as 58 km / h. Therefore, the vehicle 12 is set to travel at a speed of 120 km / h or less while maintaining a constant distance from the vehicle in front.

[0077] On the left side of the display area 24A of the first display unit 24, images V1 simulating the vehicle itself and images V2 and V3 simulating surrounding vehicles are displayed on the road image R. Observing image V1, it can be seen that the vehicle is traveling in the middle lane of the three lanes of the road image R. Furthermore, images V2 and V3 are displayed based on information detected by sensors (not shown) mounted on vehicle 12. Moreover, by observing images V2 and V3, it can be seen that vehicles are traveling diagonally to the right and in front of the vehicle. In addition, the vehicle's position can be detected by a GPS device mounted on vehicle 12. Furthermore, sensors such as stereo cameras, ultrasonic sensors, millimeter-wave radar, and lidar are used in combination as sensors for detecting surrounding vehicles. Furthermore, the vehicle can be configured to achieve both the vehicle's position and the positions of surrounding vehicles through vehicle-to-vehicle communication.

[0078] A specific display area 24B is provided on the right side of the display area 24A of the first display unit 24, which displays the vehicle 12's plans via the first display instruction unit 56. Multiple plans scheduled for implementation are displayed within this specific display area 24B. In this embodiment, as an example, three plans—first plan P1, second plan P2, and third plan P3—are displayed sequentially from bottom to top. Furthermore, each plan displays three pieces of information: the distance from the current position to the predetermined implementation position of the action, the predetermined driving route, and the type of driving. The type of driving mentioned here refers to actions performed manually by the driver or actions performed via automatic driving. In this embodiment, as an example, only the three most recent plans are displayed, and subsequent plans are not displayed, but this is not a limitation. For example, four or more plans may be displayed on the first display unit 24. Additionally, the number (multiple) of plans displayed on the first display unit 24 can be arbitrarily set.

[0079] The following sections will provide a detailed explanation of Plan 1 (P1), Plan 2 (P2), and Plan 3 (P3).

[0080] like Figure 4 As shown in (B), "100m" is displayed to the left of the first plan P1, indicating the action to be performed approximately 100m forward from the current position. Additionally, a lane change from the left lane to the right lane is schematically shown in the center of the first plan P1, indicating the planned driving path. Furthermore, "ASSIST" is displayed to the right of the first plan P1, showing the action performed (implemented) through automatic driving (driver assistance control).

[0081] Furthermore, Plan 1 (P1) is shown in larger size than Plan 2 (P2) and Plan 3 (P3) described later. Additionally, Plan 1 (P1) is equivalent to the "first plan".

[0082] On the other hand, above the first plan P1, a second plan P2 is displayed. To the left of the second plan P2 is displayed "500m," indicating the action to be performed approximately 500m forward from the current position. Furthermore, in the center of the second plan P2, a schematic diagram shows the path for merging from the left-hand side lane into the main lane, illustrating the planned driving route. And to the right of the second plan P2 is displayed "ASSIST," indicating the action to be performed using automatic driving (driver assistance control).

[0083] Above Plan P2 is Plan P3. To the left of Plan P3 is "800m," indicating the action to be performed approximately 800m forward from the current position. Additionally, in the center of Plan P3, a lane change diagram is shown, illustrating the planned driving path from the left lane to the right. To the right of Plan P3 is "ASSIST," indicating the action performed via automated driving (driver assistance control).

[0084] Furthermore, Plan 3 (P3) is equivalent to "Plan 3".

[0085] In addition, all actions in Plan 1 through Plan 3 are performed through autonomous driving. However, in the case of actions performed through manual driving, "ASSIST" is replaced with "MANUAL" on the right side of each plan.

[0086] Figure 5 (B) in the text indicates that in vehicle 12 from Figure 4 The image displayed on the first display unit 24 shows the image after traveling approximately 100m in state (B). Figure 5 As shown in (B), the display to the left of the first plan P1 changes to "0m", and the display to the left of the second plan P2 changes to "400m". In addition, the display to the left of the third plan P3 changes to "700m".

[0087] Other displayed content and Figure 4 (B) is the same.

[0088] exist Figure 10 In (B), from Figure 5 In state (B), the first plan P1 is deleted, and the second plan P2 and the third plan P3 move down layer by layer. Above the third plan P3, the fourth plan P4, which is scheduled to be implemented next to the third plan P3, is displayed.

[0089] On the left side of Plan P4, "1.5km" is displayed, indicating the actions to be performed approximately 1.5km forward from the current position. Additionally, in the center of Plan P4, a schematic diagram shows the path for merging from the right-hand side lane into this lane, indicating the planned driving route. Furthermore, on the right side of Plan P4, "ASSIST" is displayed, indicating actions performed using automated driving (driver assistance control).

[0090] Other displayed content and Figure 5 (B) is the same.

[0091] Figure 6 (B) in the diagram represents the state where the detector 55 detects a substance located at a certain position. Figure 5 If the action of the first plan P has not started at the predetermined implementation position of the first plan P1 at position (B) in the middle, the fifth plan P5, which may replace the first plan P1, will be displayed between the first plan P1 and the second plan P2.

[0092] exist Figure 6 In (B), above Plan 1, Plan 5 is displayed. To the left of Plan 5 is "50m," indicating a possible action to be performed approximately 50m forward from the current position. Furthermore, in the center of Plan 5, a lane change diagram is shown, illustrating a lane change from the left lane to the right, revealing the planned driving path. To the right of Plan 5 is "MANUAL," indicating actions performed via manual driving.

[0093] Furthermore, unlike other plans (P1 and P2), Plan 5 (P5) is displayed in grayscale (light gray) in specific display areas. Figure 6 In (B), it is shown with the dashed outline of the fifth plan P5. This indicates that it is not the plan to be implemented at this stage (but may become the plan to be implemented), and it is the alternative plan to the first plan P1 located below the fifth plan P5.

[0094] Other displayed content and Figure 5 (B) is the same.

[0095] Figure 7 (B) in the text indicates that in vehicle 12 from Figure 6 The image on the first display unit 24 is displayed when the vehicle has traveled approximately 50m in state (B).

[0096] like Figure 7 As shown in (B), in a specific display area 24B, from Figure 6 In state (B), the first plan P1 is deleted, the fifth plan P5 and the second plan P2 are moved downwards, and the third plan P3, which was deleted due to the addition of the fifth plan P5, is restored at the top layer.

[0097] In addition, the fifth plan P5, which was previously displayed in gray, is now displayed as the same as the other plans (the second plan P2 and the third plan P3).

[0098] The left-hand display for Plan 5 (P5), Plan 2 (P2), and Plan 3 (P3) has been changed to “0m”, “350m”, and “650m”, respectively.

[0099] That is, since the operation of the first plan P1 could not be started even if the predetermined implementation position of the first plan P1 was reached, the fifth plan P5, which is implemented as a substitute plan, is to be manually driven.

[0100] Furthermore, if the first plan P1 can be implemented after passing the predetermined implementation location, return to Figure 5 The state of (B) in the middle.

[0101] Other displayed content and Figure 6 (B) is the same.

[0102] Next, the second display indicator unit 58 will be described.

[0103] like Figure 3 As shown, as a functional structure, the vehicle display device 10 includes a second display instruction section 58. The second display instruction section 58 is a structure that displays the two earliest planned implementations of the plan that are displayed on the first display section 24 via the first display instruction section 56 on the second display section 26.

[0104] The emphasis display unit 60 has the function of emphasizing (enlarging) the earliest scheduled plan (hereinafter referred to as "first plan") when displaying multiple plans in specific display areas 24B and 26B of the first display unit 24 and the second display unit 26, respectively.

[0105] By emphasizing the function of the display unit 60, in a specific display area 24B of the first display unit 24, such as Figure 4 As shown in (B), the first plan P1 (refer to) is the earliest plan. Figure 4 (B) in the middle), the fifth plan P5 (refer to) Figure 7 (B) in the plan is shown to be slightly larger than the other plans. For example, it is magnified by 110%.

[0106] On the other hand, when displaying multiple plans on the second display unit 26, the emphasis display unit 60 emphasizes the most recent plan on the second display unit 26 more than the other plans.

[0107] Reference Figure 4 (A) in Figure 7 (A) and Figure 10 (A) in the figure illustrates the function of the second display indicator 58 and emphasizes the function of the display unit 60. Furthermore, since the image displayed on the second display unit 26 is substantially the same as the image displayed on the first display unit 24, the same reference numerals are used, and detailed descriptions are omitted. Additionally, the image displayed on the second display unit 26 is substantially the same as that displayed on the first display unit 24, and displays content synchronized with the display on the first display unit 24.

[0108] like Figure 4As shown in (A), the lower part of the display area 26A of the second display unit 26 displays the cruise control set speed VA and the current vehicle speed VB. The set speed VA and vehicle speed VB are displayed on the left side of the display area 26A of the second display unit 26 in the vehicle width direction. The set speed VA is displayed on the right side; here, as an example, it is set to 120 km / h. The current vehicle speed is displayed on the left side as 58 km / h. Therefore, the vehicle 12 is set to travel at a speed of 120 km / h or less while maintaining a constant distance from the vehicle in front. Furthermore, the display of the set speed and vehicle speed is synchronized with the content of the first display unit 24.

[0109] On the right side of the display area 26A of the second display unit 26, there is a specific display area 26B for displaying the vehicle 12's schedule via the second display indicator unit 58. Multiple schedules scheduled for implementation (the most recent first schedule P1 and the next scheduled second schedule P2) are displayed in the specific display area 26B. The most recent schedule, the first schedule P1, is displayed below. Figure 4 As shown in (A), the first plan P1 is enlarged and compared with other plans (second plan P2). The distance 100m to the first plan P1 is recorded at the bottom. Above the distance 100m, there is a diagram of lane change from the left lane to the right lane. To the right of the diagram, "ASSIST" is displayed, indicating that it is an autonomous driving system.

[0110] In addition, in the display area 26A of the second display unit 26, the second plan P2 is displayed above the first plan P1.

[0111] Figure 5 (A) in the text indicates that vehicle 12 is in the process of... Figure 4 The diagram shows the state of position (A) 100m ahead.

[0112] exist Figure 10 In (A), from Figure 5 In state (A), the first plan P1 is deleted, the second plan P2 moves down, and the third plan P3, which is scheduled to be implemented next to the second plan P2, is displayed above the second plan P2.

[0113] Other displayed content and Figure 5 (A) is roughly the same.

[0114] Figure 6 (A) in the text indicates that in Figure 5 In (A), a diagram showing the state where the second plan P2 is deleted from the display area 26A of the second display unit 26, and the fifth plan P5 is inserted above the first plan P1.

[0115] Figure 7 (A) in the text indicates that vehicle 12 is in the process of... Figure 6 The diagram shows the state at position (A) 50m ahead. In this case, since the first plan P1 failed to be implemented at the designated location, it cannot be implemented thereafter, so it is determined that the first plan P1 failed to be implemented, and the fifth plan P5 becomes the plan to be implemented.

[0116] Therefore, although Plan 5 was previously displayed in gray, it was changed to the same display state as other plans (Plan 2).

[0117] (effect)

[0118] Next, the function of this implementation method will be explained.

[0119] (Display processing)

[0120] use Figure 8 as well as Figure 9 The flowchart shown illustrates an example of the display processing for displaying the schedule of vehicle 12 based on the operating plan. This display processing is implemented by the CPU 30 reading the display program from ROM 32 or memory 36, expanding it in RAM 34, and implementing it.

[0121] like Figure 8 As shown, the CPU 30 determines whether a destination has been set in step S102. The destination can be entered directly by the passenger into vehicle 12, or indirectly via a mobile terminal, etc.

[0122] If the CPU 30 determines that a destination has been set in step S102, the process proceeds to step S104. Conversely, if the CPU 30 determines that no destination has been set in step S102, the display process ends.

[0123] In step S104, CPU 30 sets the operation plan for vehicle 12. Specifically, CPU 30 sets the operation plan from the current location to the destination using the function of the operation plan setting unit 52. When setting the operation plan, information related to traffic conditions and accidents can also be obtained and reflected. In addition, the operation plan can also be set in an automated driving mode based on pre-input passenger requests.

[0124] In step S106, the CPU 30 displays the plan on the first display unit 24 and the second display unit 26. Specifically, based on the operation plan, the CPU 30 displays the plan of the vehicle 12 on the first display unit 24 and the second display unit 26 respectively through the functions of the first display instruction unit 56 and the second display instruction unit 58.

[0125] Here, as an example, such as Figure 4As shown in (B), the CPU 30 displays the first plan P1, the second plan P2, and the third plan P3 in a specific display area 24B located to the right of the display area 24A of the first display unit 24. Similarly, as Figure 4 As shown in (A), the CPU 30 displays the first plan P1 and the second plan P2 in a specific display area 26B located to the right of the display area 26A of the second display unit 26.

[0126] At this time, the CPU 30 emphasizes the functions of the display unit 60, such as... Figure 4 As shown in (B), in a specific display area 24B of the first display unit 24, the display of the first plan P1, which is the first plan, is displayed at a slightly larger size than the displays of the other plans (second plan P2, third plan P3).

[0127] Similarly, the CPU 30 emphasizes the functions of the display unit 60, such as... Figure 4 As shown in (A), in a specific display area 26B of the second display unit 26, the display of the first plan P1, which is the first plan, is displayed in a larger size than the displays of the other plans (second plan P2).

[0128] In step S108, the CPU 30 determines, through the function of the detection unit 55, whether the vehicle 12 has reached the predetermined execution position of the first planned (first plan P1) action. For example, through the function of the communication unit 50, the current position of the vehicle 12 is confirmed, and it is determined whether the vehicle 12 has reached the predetermined execution position of the action.

[0129] If the determination in step 108 is affirmative, proceed to step S110. On the other hand, if the determination in step S108 is negative, wait until the determination is affirmative.

[0130] In step S110, the CPU 30 determines, through the function of the detection unit 55, whether the operation of the first planned (first plan P1) has started. Based on the drive signal to the actuator 46, etc., it determines whether the operation displayed on the... Figure 4 The first display unit 24, shown in (B), displays whether the operation of the first plan P1 (lane change control (driving assistance control)) has started, which is the first plan among the plans P1 to P3. For example, in the case of lane change, the detection unit 55 detects the flashing drive signal of the direction indicator, thereby determining that the lane change control (driving assistance control) as the first plan P1 has started.

[0131] In step S110, if the determination is positive, proceed to step S112; if the determination is negative, proceed to step S114.

[0132] In step S112, the CPU30 updates the planned display of specific display areas 24B and 26B of the first display unit 24 and the second display unit 26 through the functions of the first display instruction unit 56 and the second display instruction unit 58.

[0133] Specifically, such as Figure 10 As shown in (B), in a specific display area 24B, from Figure 5 When state (B) is reached, the first plan P1, which is the first action plan, disappears from the display. The second plan P2 and the third plan P3 move down to their lower positions, and the fourth plan P4, which is the next plan to be implemented after the third plan P3, is newly displayed at the top.

[0134] In addition, such as Figure 10 As shown in (A), in a specific display area 26B, from Figure 5 When state (A) is initiated, the display of the first plan P1, which is the first action plan, disappears, the second plan P2 is lowered and enlarged, and the third plan P3 is newly displayed above the second plan P2.

[0135] Hereinafter, the same display control will be referred to as "Scheduled Display Updates," and detailed descriptions will be omitted.

[0136] Thus, after updating the planned display of the first display unit 24 and the second display unit 26 in step S112, the process returns to step S108.

[0137] On the other hand, CPU30 in Figure 9 In step S114, by operating the function of the planning setting unit 52, an alternative plan is created that may replace the first plan P1, which is the primary plan, and be implemented. The fifth plan P5, which is the alternative plan, is similar to the first plan P1, but has the following differences.

[0138] That is, Plan 5 (P5) is 50m further from the intended implementation location than Plan 1 (P1). Furthermore, Plan 1 (P1) involves autonomous driving (see...). Figure 6 (A), (B), and “ASSIST” markings are present, but Plan 5 P5 is manually driven (see [reference]). Figure 6 (A), (B), and the "MANUAL" marker in the text.

[0139] Next, in step S116, the CPU30 displays the fifth plan P5 in each specific display area 24B and 26B (insertion) of the first display indicator 56 and the second display indicator 58 through the functions of the first display indicator 56 and the second display indicator 58.

[0140] Specifically, such as Figure 6As shown in (B), in a specific display area 24B of the first display unit 24, from Figure 5 In state (B), the third plan P3 is deleted, the second plan P2 is moved upwards, and the fifth plan P5 is inserted and displayed between the first plan P1 and the second plan P2. At this time, the fifth plan P5 is displayed in gray (light gray).

[0141] Similarly, such as Figure 6 As shown in (A), in a specific display area 26B of the second display unit 26, from Figure 5 In state (A), the second plan P2 is deleted, and the fifth plan P5 is displayed above the first plan P1. At this time, the fifth plan P5 is displayed in gray (light gray).

[0142] By displaying Plan P5 in gray, it is indicated that although Plan P5 is not a planned implementation plan, it may replace Plan P1 if Plan P1 cannot be implemented.

[0143] In addition, the fact that Plan P5 is displayed directly above Plan P1 indicates that it is a replacement plan for Plan P1.

[0144] Next, in step S118, the CPU30 determines, through the function of the detection unit 57, whether the action of the first plan (first plan P1) has started.

[0145] This is to determine whether the actions of the first plan can still be performed even if the vehicle 12 passes the predetermined implementation location of the first plan (e.g., the first plan P1) during the period of further travel of a specified distance (e.g., until the change of location is shown later).

[0146] In step S118, if the determination is positive, proceed to step S120; if the determination is negative, proceed to step S126.

[0147] Next, in steps S120 and S122, the CPU30 uses the functions of the first display instruction unit 56 and the second display instruction unit 58 to delete the fifth plan P5 as an alternative plan from each specific display area 24B and 26B of the first display unit 24 and the second display unit 26, and adds the plan to be implemented next.

[0148] Specifically, such as Figure 5 As shown in (B), in a specific display area 24B, from Figure 6 In state (B), the display of the fifth plan P5 is removed, the second plan P2 is moved down one layer, and the third plan P3 is displayed above the second plan P2.

[0149] Similarly, such as Figure 5As shown in (A), in a specific display area 26B, from Figure 6 The state (A) in the diagram removes the display of the fifth plan P5 and displays the second plan P2 above the first plan P1.

[0150] Next, in step S124, the CPU30 updates the planned display in specific display areas 24B and 26B after a predetermined time has elapsed since the start of the first planned action, through the functions of the first display indicator 56 and the second display indicator 58.

[0151] This is because although the plan display can be updated simultaneously with the start of the first planned action, in this case the display of the first plan (first display plan P1) and the alternative plan (fifth plan P5) disappears from the specific display areas 24B and 26B together, which may confuse the occupants.

[0152] In step S124, when the planned display update is completed, return to step S108.

[0153] On the other hand, in step S126, the CPU 30 determines whether the vehicle 12 has reached the displayed change location by using the function of the detection unit 55. For example, the current position of the vehicle 12 is confirmed by the function of the communication unit 50, and then it is determined whether the vehicle 12 has reached the displayed change location.

[0154] Here, the display of the change position refers to the position where the implementation of the initial plan is abandoned and the alternative plan is adopted as the planned implementation plan. This position is set closer to the planned implementation position of the alternative plan.

[0155] In step S126, if the determination is negative, return to step 118. The purpose is to try whether the initially planned action can be started until vehicle 12 reaches the displayed change position.

[0156] On the other hand, in step 126, if the determination is positive, proceed to step S128.

[0157] In steps S128 and S130, the CPU30 performs a display change to replace the plan with the predetermined implementation plan through the functions of the first display instruction unit 56 and the second display instruction unit 58.

[0158] Specifically, such as Figure 7 As shown in (B), in a specific display area 24B, from Figure 6 In state (B), the display of the first plan P1 is removed, the fifth plan P5 moves down layer by layer with the second plan P2, and the third plan P3 is displayed above the second plan P2.

[0159] Similarly, such as Figure 7As shown in (A), in a specific display area 26B, from Figure 6 In state (A), the display of the first plan P1 is removed, the fifth plan P5 is moved down, and the second plan P2 is displayed above the fifth plan P5.

[0160] also, Figure 7 The states shown in (A) and (B) are the times when vehicle 12 arrives at the predetermined implementation position of the fifth plan P5.

[0161] Thus, after the planned display changes are completed in steps 128 and 130, the process returns to step 108.

[0162] In this way, if the initial plan (e.g., the first plan P1) displayed in specific display areas 24B and 26B of the first display unit 24 and the second display unit 26 may not be implemented, an alternative plan (e.g., the fifth plan P5) is displayed, so that the occupants can anticipate the possibility that the first plan may be replaced and the fifth plan P5 may be implemented.

[0163] In addition, since the alternative plans (such as Plan 5 P5) are displayed in a different color (such as light gray) than other plans, the occupants can intuitively understand that it is not a plan that is scheduled to be implemented, but a plan that is likely to be implemented.

[0164] In particular, alternative plans (such as Plan 5 P5) are displayed in gray, so that occupants can easily understand that they are plans that are not scheduled to be implemented at this stage.

[0165] Furthermore, in this embodiment, if the action of the first plan has not started when the vehicle 12 has reached the predetermined implementation position of the first plan (e.g., the first plan P1), it is determined that the possibility of implementing the action of the first plan is low, thus indicating that there is an alternative plan.

[0166] That is, since the alternative plan is not displayed from the moment when it is to be implemented, but rather when the possibility of implementing the alternative plan is high (in other words, it is displayed from a position closer to the intended implementation position of the alternative plan), the occupants can visually confirm the alternative plan to grasp the possibility of its implementation.

[0167] In addition, since the planned implementation location of the alternative plan is set to be farther than the planned implementation location of the original plan, the alternative plan will not be switched to be implemented immediately even if the original plan has not started. This ensures the possibility of starting the original plan before reaching the planned implementation location of the alternative plan.

[0168] Furthermore, since the first display unit 24 is positioned in the dashboard 14 above the driver's seat, and the second display unit 26 is positioned in the windshield 18 above the driver's seat, the driver can visually confirm updates to the schedule displayed in specific display areas 24B and 26B of the first display unit 24 and the second display unit 26 with almost no eye movement. In other words, the driver can easily visually confirm schedule updates.

[0169] Furthermore, since vehicle 12 has such a vehicle display device 10, occupants can anticipate situations where the initial plan cannot be implemented and an alternative plan may be scheduled. That is, they can anticipate situations where automatic driving must be replaced by manual driving to implement an alternative plan, and thus can respond calmly when implementing the alternative plan.

[0170] (other)

[0171] The vehicle display device and display processing method of the above embodiments have been described. Naturally, they can be implemented in various ways without departing from the spirit of the invention. For example, in the above embodiments, the first display unit 24 is provided in the dashboard 14 in front of the driver's seat, and the second display unit 26 is a projection surface formed by projection through the head-up display device 44, but this is not a limitation. That is, the first display unit may also be a central display provided in the center of the dashboard 14 in the vehicle width direction. Alternatively, the second display unit may be provided in the part of the dashboard 14 on the vehicle front side of the steering wheel 16.

[0172] Furthermore, in this embodiment, while there is a priority to enlarge the display in specific display areas 24B and 26B of the first display unit 24 and the second display unit 26 by emphasizing the function of the display unit 60, it is not mandatory. That is, multiple plans can also be displayed at the same size in each specific display area 24B and 26B of the first display unit 24 and the second display unit 26.

[0173] Furthermore, in this embodiment, when the vehicle 12 arrives at the predetermined implementation position of the first plan P1 but the operation of the first plan P1 has not started, an alternative plan is displayed in specific display areas 24B and 26B, but this is not a limitation.

[0174] For example, the predetermined implementation location can be replaced by time-based acute control. That is, if a predetermined implementation time for the action of the first plan P1 is specified, it is not limited to the position of vehicle 12.

[0175] Furthermore, if the possibility of not being able to implement the action of the first plan (e.g., the first plan P1) is detected by the ECU 28 or other means, such as traffic congestion information or accident information, an alternative plan (e.g., the fifth plan P5) can be displayed starting earlier than the scheduled implementation time (scheduled implementation location).

[0176] Furthermore, it can also be configured such that, in specific display areas 24B and 26B, an alternative plan is always displayed relative to the first plan.

[0177] Furthermore, while the implementation is configured to display an alternative plan for the first planned operation, it is not limited to this. For example, an alternative plan may also be displayed for the second plan following the first plan (e.g., second plan P2). That is, if congestion is detected at the merging point based on traffic congestion information, etc., it may be considered to display an alternative plan for the second plan, which is a merging operation (not the first planned operation).

[0178] Furthermore, in the implementation, the alternative plan will be grayed out in specific display areas 24B and 26B. If the planned implementation is determined, it will be displayed the same as other plans, but this is not a limitation. Where there is a possibility of substitution, it is acceptable as long as the alternative plan is displayed differently from other plans (e.g., a different color).

[0179] In addition, in the implementation, when an alternative plan is added to specific display areas 24B and 26B, the specific display areas 24B and 26B displayed in each display area 24A and 26A may be moved from the outside of the specific display areas 24B and 26B to the inside (fade-in process).

[0180] Similarly, when deleting an alternative plan or the first plan from a specific display area 24B or 26B, the deletion can also be performed after moving from the inside to the outside of a specific display area 24B or 26B in each display area 24A or 26A (fade-out process).

[0181] Furthermore, in the implementation method, the alternative plan is also displayed with a predetermined implementation distance in the same way as other plans. However, if the alternative plan is displayed in gray, it may be difficult to visually confirm the distance. Therefore, it is also possible to consider configuring it to display the predetermined implementation time of the alternative plan using a progress bar or the like.

[0182] Furthermore, in the above embodiment, as a plan, three types of information are displayed: the distance up to the movement of vehicle 12, the vehicle's planned travel path, and the type of driving, but this is not a limitation. For example, information such as speed limits may also be displayed, but from the viewpoint of easy viewing, it is preferable to display only the above three types of information. Additionally, the display of the planned travel path is not limited to... Figures 4-7The diagram shown can also be displayed using other icons or similar symbols.

[0183] Furthermore, in the above embodiment, the second display indicator 58 displays the two most recent plans on the second display unit 26, but it is not limited to this. For example, the second display indicator 58 may also display three or more recent plans on the second display unit 26.

[0184] Furthermore, in the above embodiments, multiple plans are displayed from bottom to top in specific display areas 24B and 26B of the first display unit 24 and the second display unit 26 in a predetermined implementation order, but this is not limited to that direction. For example, multiple plans may also be displayed from top to bottom in specific display areas 24B and 26B of the first display unit 24 and the second display unit 26 in a predetermined implementation order.

[0185] Furthermore, in the above embodiment, multiple plans are displayed in each display area 24A and 26A of the first display unit 24 and the second display unit 26, but it is also possible to configure the second display unit 26 to display only the most recent and earliest plan.

[0186] Furthermore, the road conditions, types of routes, distances, etc., shown on the screen are for illustrative purposes only and may not reflect the actual road conditions.

[0187] Furthermore, various processors other than CPU 30 can also implement the display processing performed by CPU 30 reading software (program) in the above-described embodiment. Examples of processors in this case include FPGAs (Field-Programmable Gate Arrays) and PLDs (Programmable Logic Devices) whose circuit structure can be changed after manufacturing, as well as ASICs (Application Specific Integrated Circuits) and other processors with circuit structures specifically designed for implementing specific processes, i.e., dedicated electrical circuits. Furthermore, display processing can be implemented using only one of these various processors, or by combining two or more processors of the same or different types (e.g., multiple FPGAs, and combinations of CPUs and FPGAs). More specifically, the hardware configuration of these various processors is an electrical circuit that incorporates circuit elements such as semiconductor components.

[0188] Furthermore, in the above embodiment, the memory 36 is configured to store various types of data, but it is not limited to this. For example, recording media such as CDs (Compact Disk), DVDs (Digital Versatile Disk), and USB (Universal Serial Bus) memory can also be used as storage units. In this case, various programs and data are stored on these recording media.

Claims

1. A display device for a vehicle, wherein, have: The display unit is located inside the carriage and has a specific display area within the display area for arranging and displaying multiple plans that are scheduled to be implemented by the vehicle in a predetermined implementation order; as well as The control unit displays, within the specified display area, an alternative plan that may replace the first plan and be implemented, between a first plan, which is one of the plurality of plans, and a second plan that is scheduled to be implemented next to the first plan.

2. The vehicle display device according to claim 1, wherein, The first plan is the plan initially scheduled to be implemented among the plurality of plans, i.e., the first plan.

3. The vehicle display device according to claim 1 or 2, wherein, When the first plan is a vehicle action based on driver assistance control and the conditions specified for the first plan are met, the control unit displays the same type of vehicle action based on manual operation as the first plan, i.e., the alternative plan, in the specific display area.

4. The vehicle display device according to claim 1 or 2, wherein, The control unit causes the alternative plan to be displayed in at least a different color than the first plan.

5. The vehicle display device according to claim 1 or 2, wherein, When the control unit adds the alternative plan to the specific display area, it deletes the plan that is last scheduled to be implemented among the multiple plans, i.e., the final plan, from the specific display area.

6. The vehicle display device according to claim 1 or 2, wherein, When the action of the first plan has started, the control unit deletes the alternative plan from the specific display area.

7. The vehicle display device according to claim 3, wherein, The specified condition for the first plan is: at the predetermined time of implementation of the first plan, the action of the vehicles related to the first plan has not yet begun.

8. The vehicle display device according to claim 3, wherein, The specified condition for the first plan is that the movement of vehicles related to the first plan may not begin at the predetermined time of implementation of the first plan.

9. The vehicle display device according to claim 1 or 2, wherein, The display unit is located in the dashboard in front of the driver's seat.

10. The vehicle display device according to claim 1 or 2, wherein, The display section is a projection surface formed by projection from a head-up display device.

11. A vehicle, wherein, The vehicle display device is provided with any one of claims 1 to 10.

12. A display processing method, wherein in a display unit provided inside a vehicle compartment and having a display area, multiple plans to be implemented by the vehicle are arranged and displayed in a predetermined implementation order in a specific display area of ​​the display area, wherein, The display processing method includes the following steps: Within the specific display area, between the first plan, which is one of the plurality of plans, and the second plan, which is the next plan to be implemented after the first plan, an alternative plan that may replace the first plan is displayed.

13. A non-transitory computer storage medium storing a program, wherein a program, in a display unit provided inside a vehicle compartment and having a display area, causes multiple plans to be implemented by the vehicle to be displayed in a predetermined implementation order in a specific display area of ​​the display area, wherein... The non-transitory computer storage medium stores a program for causing a computer to perform a process comprising the steps of displaying an alternative plan that may replace the first plan and be implemented between a first plan, which is one of the plurality of plans, and a second plan that is to be implemented next to the first plan within the specific display area.

Images