Information processing device, information processing method, and information processing program

Abstract

To increase the level of user's interest in training compared with when responses to a user's operation are uniform during user's training of at least one of an automatic driving function and a driving assistance function of a vehicle.SOLUTION: A information processing device comprises a control unit that executes a training mode for training at least one of an automatic driving function and a driving assistance function of a vehicle, and outputs, from an output device, an output content corresponding to the correctness of a user's input operation with respect to a prescribed operation relating to the execution of the automatic driving function or the driving assistance function of vehicle instructed in the training mode.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] Patent Document 1 discloses a driving assistance device that allows efficient practice for driving assistance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2022-159189 Summary of the Invention [Problem to be solved by the invention]

[0004] However, it is assumed that the user who performs the above-described practice is not accustomed to using the driving assistance function, and therefore, during the practice, the user may perform both correct and incorrect operations related to the execution of the driving assistance function.

[0005] Here, Patent Document 1 only shows an example of the output when the user performs the correct operation in the above-mentioned practice, and there is a risk that the user's interest in the practice will decrease because the response to the user's operation is uniform.

[0006] Therefore, the present disclosure aims to provide an information processing device, an information processing method, and an information processing program that can increase a user's interest in practicing at least one of a vehicle's automatic driving function and driving assistance function, compared to when the response to the user's operation is uniform. [Means for solving the problem]

[0007] The information processing device of claim 1 executes a practice mode for practicing at least one of a vehicle's automatic driving function and driving assistance function, and includes a control unit that causes an output device to output output content corresponding to the success or failure of a user's input operation for a specified operation related to the execution of the automatic driving function or the driving assistance function instructed in the practice mode.

[0008] In the information processing device according to claim 1, the control unit executes a practice mode for practicing at least one of the vehicle's automatic driving function and driving assistance function. The control unit then controls the output device to output output content corresponding to the success or failure of a user's input operation for a predetermined operation related to the execution of the automatic driving function or driving assistance function instructed in the practice mode. This allows the information processing device to increase the user's interest in practicing at least one of the vehicle's automatic driving function and driving assistance function, compared to a case where the user's response to the user's operation is uniform. Specifically, in the information processing device, if the user performs a correct input operation for a predetermined operation, the output device outputs output content corresponding to the correct input operation. Furthermore, in the information processing device, if the user performs an incorrect input operation for a predetermined operation, the output device outputs output content corresponding to the incorrect input operation. In this way, the output device outputs output content corresponding to the success or failure of the input operation, allowing the user to recognize the success or failure of their input operation, thereby increasing their interest in practicing.

[0009] The information processing device according to claim 2 is the information processing device according to claim 1, wherein the control unit causes the output device to output progress information indicating the progress of the user's practice in the practice mode currently being executed.

[0010] In the information processing device according to claim 2, the control unit causes the output device to output progress information indicating the progress of the user's practice in the currently running practice mode. As a result, the information processing device allows the user to use the progress information as an indicator for estimating the time when the practice will be completed. Therefore, the information processing device allows the user to estimate the time when the practice will be completed, thereby lowering the psychological hurdle for executing the practice mode.

[0011] The information processing device of claim 3 is in claim 1 or 2, wherein the control unit displays problem information indicating a problem related to the specified operation on a display device serving as the output device in the practice mode, and ends or continues the practice mode depending on whether the user's answer to the problem indicated in the problem information is correct or incorrect.

[0012] In the information processing device according to claim 3, the control unit displays problem information indicating a problem related to a predetermined operation on a display device serving as an output device in the practice mode, and terminates or continues the practice mode depending on whether the user's answer to the problem indicated in the problem information is correct or incorrect. Thus, according to the information processing device, by displaying the problem information on the display device in the practice mode, it is possible to create a sense of tension in the user regarding the practice mode and enhance the user's understanding of the predetermined operation. Furthermore, according to the information processing device, by branching the termination or continuation of the practice mode depending on whether the user's answer to the problem indicated in the problem information is correct or incorrect, it is possible to progress the practice mode in accordance with the user's understanding of the predetermined operation.

[0013] The information processing device of claim 4 is any one of claims 1 to 3, wherein the control unit displays progress information indicating the progress of the user's practice in the automatic driving function and the driving assistance function that can execute the practice mode in a list on a display device serving as the output device.

[0014] In the information processing device according to claim 4, the control unit displays progress information indicating the user's progress in practice in the autonomous driving function and driving assistance function that can execute the practice mode in a list on the display device as an output device. This allows the information processing device to allow the user to grasp the progress of practice in each practice mode.

[0015] The information processing device of claim 5 is any one of claims 1 to 4, wherein the control unit displays progress information indicating the progress of the user's practice of the automatic driving function or the driving assistance function corresponding to the selection icon on each of a plurality of selection icons for selecting the automatic driving function or the driving assistance function that executes the practice mode, which are displayed on the display device as the output device.

[0016] In the information processing device according to claim 5, the control unit displays progress information indicating the user's progress in practicing the automatic driving function or driving assistance function corresponding to each of a plurality of selection icons displayed on the display device as an output device for selecting an automatic driving function or driving assistance function that executes a practice mode. This allows the user to understand the progress of practice in each practice mode before starting the practice mode, and assists the user in selecting a practice mode.

[0017] The information processing device of claim 6 is any one of claims 1 to 5, wherein the control unit displays explanatory information indicating an explanation related to the automatic driving function or the driving assistance function while the practice mode is being executed on a first display device as the output device, and displays a specific image showing the vehicle and the surrounding conditions of the vehicle according to the explanatory information from a perspective of the vehicle while traveling as seen from a virtual viewpoint on a second display device as the output device different from the first display device.

[0018] In the information processing device according to claim 6, the control unit displays explanatory information on a first display device as an output device, which explains the automatic driving function or driving assistance function while the practice mode is being executed. Then, the control unit displays a specific image showing the vehicle and its surroundings according to the explanatory information, from a viewpoint of the traveling vehicle as seen from a virtual viewpoint, on a second display device as an output device different from the first display device. As a result, the information processing device can provide information on the practice mode to the user using two display devices.

[0019] The information processing device according to claim 7 is in claim 6, wherein the control unit changes the specific image displayed on the second display device in accordance with a change in the explanation information displayed on the first display device.

[0020] In the information processing device according to claim 7, the control unit changes the specific image displayed on the second display device in accordance with changes in the explanatory information displayed on the first display device. This allows the information processing device to create a sense of unity between the display contents of the two display devices, thereby increasing the user's interest in the practice.

[0021] The information processing method of claim 8 is a process performed by a computer to execute a practice mode for practicing at least one of a vehicle's automatic driving function and driving assistance function, and to output from an output device output content corresponding to the success or failure of a user's input operation for a specified operation related to the execution of the automatic driving function or the driving assistance function instructed in the practice mode.

[0022] The information processing program of claim 9 causes a computer to execute a practice mode for practicing at least one of a vehicle's automatic driving function and driving assistance function, and to output from an output device output content corresponding to the success or failure of a user's input operation for a specified operation related to the execution of the automatic driving function or the driving assistance function instructed in the practice mode. [Effects of the Invention]

[0023] As described above, with the information processing device, information processing method, and information processing program disclosed herein, when a user practices at least one of a vehicle's automatic driving function and driving assistance function, the user's interest in the practice can be increased compared to when the response to the user's operation is uniform. [Brief explanation of the drawings]

[0024] [Figure 1] 1 is a block diagram showing a schematic configuration of a vehicle. [Figure 2] FIG. 1 is a view of the interior of the vehicle as seen from the driver's seat. [Figure 3] FIG. 2 is an explanatory diagram illustrating a group of operation switches. [Figure 4] FIG. 2 is a block diagram showing a schematic configuration of a control ECU. [Figure 5] FIG. 2 is a block diagram showing an example of a functional configuration of a control ECU. [Figure 6] 10 is a first display example displayed on a multimedia display. [Figure 7] 10 is a second display example displayed on the multimedia display. [Figure 8] 10 is a third example of a display displayed on a multimedia display. [Figure 9] 10 is a fourth example of a display displayed on a multimedia display. [Figure 10] 10 is a fifth display example displayed on the multimedia display. [Figure 11A] 10 is a sixth display example displayed on the multimedia display. [Figure 11B] 10 is a seventh display example displayed on the multimedia display. [Figure 12] 13 is an eighth display example displayed on the multimedia display. [Figure 13] 10 is a flowchart showing the flow of a specification process. [Figure 14] 13 is a ninth display example displayed on a multimedia display. [Figure 15]10 is a first display example displayed on the meter display. [Figure 16] 10 is a tenth display example displayed on the multimedia display. [Figure 17] 10 is a second display example shown on the meter display. [Figure 18] 10 is a third example of a display that is displayed on the meter display. [Figure 19] 10 is a fourth display example shown on the meter display. [Figure 20] 11 is an eleventh display example displayed on a multimedia display. [Figure 21] 10 is a fifth example of a display that is displayed on the meter display. [Figure 22] 12 is a twelfth example of a display displayed on a multimedia display. [Figure 23] 10 is a sixth display example that is displayed on the meter display. [Figure 24] 10 is a seventh display example shown on the meter display. [Figure 25] 13 is a thirteenth display example displayed on a multimedia display. [Figure 26] FIG. 10 is an explanatory diagram showing another example of a specific image. [Figure 27A] FIG. 10 is a first explanatory diagram showing an example of audio output contents according to whether a driver's input operation for a predetermined operation is correct or not. [Figure 27B] FIG. 2 is a second explanatory diagram showing an example of audio output contents according to whether the driver's input operation for a predetermined operation is correct or not. [Figure 27C] FIG. 10 is a third explanatory diagram showing an example of audio output contents according to whether the driver's input operation for a predetermined operation is correct or not. [Figure 27D] FIG. 4 is a fourth explanatory diagram showing an example of audio output contents according to whether the driver's input operation for a predetermined operation is correct or not. [Figure 28] 10A and 10B are explanatory diagrams showing examples of combinations of output contents depending on whether the driver's input operation for a predetermined operation is correct or not. [Figure 29A]14 is a fourteenth display example displayed on a multimedia display. [Figure 29B] 15 is a fifteenth display example displayed on the multimedia display. DETAILED DESCRIPTION OF THE INVENTION

[0025] The vehicle 10 according to this embodiment will be described below. (First embodiment) First, a first embodiment of a vehicle 10 according to the present embodiment will be described.

[0026] FIG. 1 is a block diagram showing a schematic configuration of a vehicle 10. As shown in FIG. 1, a vehicle 10 includes a sensor group 20, an output device 30, various switches 40, and a control ECU (Electrical Control Unit) 50. The sensor group 20, the output device 30, the various switches 40, and the control ECU 50 are connected to each other via an external bus (communication bus) 15. The control ECU 50 is an example of an "information processing device."

[0027] The sensor group 20 includes sensors for detecting the state of the vehicle 10 and the surrounding circumstances, such as a 3D-LiDAR, a millimeter wave sensor, an infrared sensor, a blinker sensor, an accelerator position sensor, a vehicle speed sensor, a steering angle sensor, an angular velocity sensor, a GPS (Global Positioning System) sensor, a gyro sensor, and an acceleration sensor. The sensor group 20 outputs the detection results of each sensor to the control ECU 50.

[0028] The output device 30 includes a display device 32 and a speaker 34 . The display device 32 is provided on the instrument panel 12 (see Figure 2), the center console 14 (see Figure 2), the meter panel 16 (see Figure 2), etc., and displays operation suggestions related to the functions of the vehicle 10 and images explaining the functions.

[0029] The speaker 34 is provided on the instrument panel 12, the center console 14, the meter panel 16, or the like, and outputs sounds such as suggestions for operation related to functions of the vehicle 10 and explanations of the functions.

[0030] The various switches 40 are in-vehicle switches for activating or deactivating functions of the vehicle 10. Specific examples of the various switches 40 will be described later.

[0031] The control ECU 50 is an ADAS (Advanced Driver Assistance System)-ECU that controls the autonomous driving function and driving assistance function of the vehicle 10. As an example, the autonomous driving function is an autonomous driving function of autonomous driving level 3 or higher out of the six autonomous driving levels of the Society of Automotive Engineers (SAE). The driving assistance function includes various driving assistance functions such as ACC (Adaptive Cruise Control) and LTA (Lane Tracing Assist). Note that while FIG. 1 shows only the control ECU 50, the vehicle 10 is provided with a plurality of other ECUs corresponding to various functions of the vehicle 10.

[0032] In the following description, autonomous driving refers to the control ECU 50 performing some or all of the driving operations, such as acceleration, braking, and steering, without the driver of the vehicle 10. In other words, the autonomous driving includes both fully autonomous driving, in which the control ECU 50 performs all of the driving operations, and driving assistance, in which the control ECU 50 performs some of the driving operations. The driver of the vehicle 10 is an example of a "user."

[0033] Fig. 2 is a view of the interior of vehicle 10 as seen from the driver's seat. In Fig. 2, the vehicle width direction of vehicle 10 is indicated by X, the vehicle up-down direction by Y, and the vehicle front-rear direction by Z. In Fig. 2, the right side in the vehicle width direction is indicated by +X, the left side is indicated by -X, the upper side in the vehicle up-down direction is indicated by +Y, the lower side is indicated by -Y, the front side in the vehicle front-rear direction is indicated by +Z, and the rear side is indicated by -Z.

[0034] 2, the vehicle 10 is, for example, a right-hand drive vehicle. Therefore, the vehicle seat 18 on the right side in the drawing is the driver's seat 18A, and the vehicle seat 18 on the left side in the drawing is the passenger seat 18B.

[0035] A steering wheel 70 is disposed in front of the driver's seat 18A. The steering wheel 70 is supported via a steering column (not shown) that supports a wheel pad 72, and is disposed rearward of the instrument panel 12. To the right of the wheel pad 72, an operation switch group 45, which is a collection of multiple in-vehicle switches, is provided as the various switches 40.

[0036] The meter panel 16 is disposed in front of the steering wheel 70. The meter panel 16 is provided with a meter display 32A, which is a liquid crystal display, as the display device 32.

[0037] A center console 14 is disposed between the driver's seat 18A and the passenger's seat 18B. On the upper side of the center console 14, a multimedia display 32B, which is a liquid crystal display, is provided as a display device 32.

[0038] FIG. 3 is an explanatory diagram illustrating the operation switch group 45. As shown in FIG. As shown in FIG. 3, operation switch group 45 is a collection of multiple in-vehicle switches, including operation switch 47A located in the upper left of the figure, operation switch 47B located below operation switch 47A, operation switch 47C located below operation switch 47B, operation switch 47D located to the right of operation switch 47C, operation switch 47E located below operation switch 47D, operation switch 47F located to the right of operation switch 47E, and operation switch 47G located above operation switch 47F.

[0039] Hereinafter, the operation switch 47A may be referred to as the "cruising assist switch 49." The cruising assist switch 49 is an in-vehicle switch that can switch on and off the ACC, which is one of the driving assist functions of the vehicle 10. Note that, among the operation switch group 45, explanations of the operation switches 47B to 47G other than the operation switch 47A (cruising assist switch 49) will be omitted, but the operation switches 47B to 47G also activate or deactivate the functions of the vehicle 10 by operation by the driver.

[0040] FIG. 4 is a block diagram showing a schematic configuration of the control ECU 50. As shown in FIG. 4, the control ECU 50 includes a CPU (Central Processing Unit) 51, a ROM (Read Only Memory) 52, a RAM (Random Access Memory) 53, a storage 54, a communication I / F (Interface) 55, and an input / output I / F 56. The CPU 51, the ROM 52, the RAM 53, the storage 54, the communication I / F 55, and the input / output I / F 56 are connected via an internal bus 57 so as to be able to communicate with each other.

[0041] The CPU 51 is a central processing unit that executes various programs and controls various components. That is, the CPU 51 reads programs from the ROM 52 and executes the programs using the RAM 53 as a work area. In this embodiment, an information processing program 52A is stored in the ROM 52.

[0042] The ROM 52 stores various programs and various data. The RAM 53 serves as a working area for temporarily storing programs or data.

[0043] The storage 54 is a NAND memory configured by an eMMC (embedded multi media card) or a UFS (universal flash storage), etc. The storage 54 and the CPU 51 are connected via an eMMC or UFS interface.

[0044] Furthermore, each component included in the control ECU 50, such as the ROM 52 and the storage 54, is preferably a tamper-resistant medium such as an HSM (Hardware Security Module).

[0045] The communication I / F 55 is an interface for connecting with other ECUs, and uses the Ethernet (registered trademark) communication standard.

[0046] The input / output I / F 56 is an interface for communicating with on-board devices such as the sensor group 20, the output device 30, and various switches 40 mounted on the vehicle 10.

[0047] Next, the functional configuration of the control ECU 50 will be described. FIG. 5 is a block diagram showing an example of the functional configuration of the control ECU 50. As shown in FIG.

[0048] 5, the CPU 51 of the control ECU 50 has, as its functional components, a driving control unit 51A, a practice control unit 51B, and an output control unit 51C. Each functional component is realized by the CPU 51 reading and executing an information processing program 52A stored in the ROM 52. The practice control unit 51B and the output control unit 51C are examples of a "control unit."

[0049] The driving control unit 51A executes the automatic driving function or the driving assistance function instructed by the driver, and controls the automatic driving of the vehicle 10. For example, the driving control unit 51A executes ACC when the driving assistance switch 49 is operated while the vehicle 10 is traveling.

[0050] The practice control unit 51B executes a practice mode for practicing the automatic driving functions and driving assistance functions of the vehicle 10 and controls the progress of the practice mode. Here, the practice control unit 51B starts the practice mode when an instruction to start the practice mode is received while the vehicle 10 is stopped. Furthermore, if any of the switches 40 related to the execution of the automatic driving functions or driving assistance functions is operated while the practice mode is being executed, the practice control unit 51B prohibits the execution of the automatic driving functions or driving assistance functions corresponding to the various switches 40. As a result, for example, even if an instruction to operate the driving assistance switch 49 is given in the practice mode and the driver operates the driving assistance switch 49 in accordance with the instruction, the ACC will not be executed.

[0051] The output control unit 51C controls the output device 30 and causes the output device 30 to output various output contents. For example, the output control unit 51C causes the output device 30 to output output contents corresponding to the success or failure of the driver's input operation in response to a predetermined operation related to the execution of an automatic driving function or a driving assistance function instructed in the practice mode. The output contents related to the practice mode of the first embodiment will be described below with reference to FIGS. 6 to 12. It is assumed that the vehicle 10 is stopped when the output contents related to the practice mode are output.

[0052] Fig. 6 is a first example of a display that is displayed on the multimedia display 32B, which is the output device 30. As an example, Fig. 6 shows a home screen that is displayed on the multimedia display 32B after a predetermined system of the vehicle 10 for executing the practice mode has been activated.

[0053] The home screen shown in Fig. 6 displays a selection section 60 for selecting content to be displayed on the multimedia display 32B. Text information 61 in which various content is displayed in text form is displayed in the selection section 60. In Fig. 6, a cursor 62 is displayed on the words "Practice Mode" in the text information 61. When a predetermined switch 40 is operated in this state, the CPU 51 of the control ECU 50 receives an instruction to start the practice mode and starts the practice mode.

[0054] Fig. 7 is a second display example displayed on the multimedia display 32B. Specifically, Fig. 7 shows the state after the CPU 51 has accepted an instruction to start the practice mode on the home screen shown in Fig. 6. Fig. 7 also shows a selection screen for selecting the automatic driving function or driving assistance function that will execute the practice mode.

[0055] The selection screen shown in Fig. 7 displays a plurality of selection icons 63. Specifically, the selection icons 63 shown in Fig. 7 are a selection icon 63A for practicing function A, a selection icon 63B for practicing function B, and a selection icon 63C for practicing function C in practice mode.

[0056] Furthermore, each of the multiple selection icons 63 displays progress information 64 that indicates the progress of the driver's practice of the automatic driving function or driving assistance function corresponding to the selection icon 63. Specifically, the progress information 64 shown in Fig. 7 is progress information 64A that indicates the progress of practice of function A, progress information 64B that indicates the progress of practice of function B, and progress information 64C that indicates the progress of practice of function C. The progress information 64 is an example of "progress information."

[0057] Here, progress information 64A and progress information 64B are displayed as "Incomplete," indicating that practice of function A and function B has not yet been completed. Progress information 64C is displayed with a star mark and the word "Excellent," indicating that practice of function C has been completed.

[0058] Fig. 8 is a third display example displayed on multimedia display 32B. Specifically, Fig. 8 shows the state after selection icon 63A is selected on the selection screen shown in Fig. 7. The following describes an example in which selection icon 63A is selected and ACC is practiced as function A in practice mode.

[0059] The multimedia display 32B shown in Fig. 8 displays explanatory information 80 that provides an explanation regarding the automatic driving function or driving assistance function, in this case, ACC, that is currently in practice mode. Specifically, the explanatory information 80 shown in Fig. 8 includes text information 81, progress information 82, and table of contents information 83 that are displayed in approximately one-quarter of the display area of the multimedia display 32B from the left, and text information 84 and image information 85 that are displayed in the remaining approximately three-quarters of the display area.

[0060] The text information 81 shows a catchphrase for the ACC when the practice mode is being executed. In Fig. 8, the text information 81 shows the catchphrase "Make highway driving comfortable."

[0061] The progress information 82 indicates the progress of the driver's practice in the currently active practice mode. Here, the progress information 82 is composed of numerical information 82A that indicates the progress of the practice as a progress rate, and graphic information 82B that graphically indicates the progress rate indicated by the numerical information 82A. Here, the graphic information 82B indicates the progress rate with a black area. In the progress information 82 shown in FIG. 8, the progress rate indicated by the numerical information 82A is "0%," and the graphic indicated by the graphic information 82B is "no black area." Thus, FIG. 8 indicates a state in which the driver's practice in the practice mode has not progressed at all. The progress information 82 is an example of "progress information."

[0062] Table of contents information 83 shows a table of contents for ACC practice while the practice mode is being executed. As an example, the table of contents information 83 shown in FIG. 8 shows the practice items "1. Function Overview," "2. Start the System," and the first half of "3. Change Settings." The underlined portion in the table of contents information 83, "1. Function Overview: Follow the Vehicle in Front" in FIG. 8, is the practice item currently being executed. The driver can change the practice items shown in the table of contents information 83 by moving the scroll bar 83A located on the right side of the table of contents information 83 up and down.

[0063] The text information 84 shows an explanation of the exercise being performed. In Fig. 8, the text information 84 shows the explanation "1. Function overview - Follows the vehicle ahead, supports keeping an optimal distance from the vehicle ahead."

[0064] Image information 85 shows an image of the practice item being performed. Here, the image information 85 shown in Fig. 8 is "image information 85A." The image information 85A shows how a host vehicle image 10A showing the vehicle 10 travels while following a forward vehicle image 10B showing a forward vehicle.

[0065] 9 is a fourth example of a display displayed on multimedia display 32B. Specifically, FIG. 9 shows a state where the driver's practice in practice mode has progressed from the screen shown in FIG.

[0066] In the progress information 82 shown in Fig. 9, the progress rate shown in numerical information 82A is "20%," and the graphic shown in graphic information 82B is "the black area is approximately 1 / 5 from the left." Thus, Fig. 9 shows that the driver's practice in practice mode has progressed about 1 / 5 of the way.

[0067] In Fig. 9, completion marks 83B, which are check marks indicating that practice has been completed, are displayed to the right of some of the practice items shown in the table of contents information 83. Specifically, in the table of contents information 83 shown in Fig. 9, three completion marks 83B are displayed, indicating that practice of the practice item "1. Function Overview" has been completed.

[0068] In Figure 9, text information 84 is displayed, which explains the currently executed practice item "2. Start the system - Check safety: After merging onto the main highway, check the safety of your surroundings before starting the system."

[0069] 9 is "image information 85B." This image information 85B shows the view in front of the vehicle 10 that the driver will see through the windshield when actually executing ACC while the vehicle 10 is traveling. By displaying this image information 85B, the driver can imagine a state close to the actual environment, even in the practice mode that is performed while the vehicle 10 is stopped.

[0070] Fig. 10 is a fifth example of a display displayed on multimedia display 32B. Specifically, Fig. 10 shows a state after the driver has progressed in practice in practice mode from the screen shown in Fig. 9.

[0071] In the table of contents information 83 shown in Figure 10, four completion marks 83B are displayed, indicating that in addition to the practice items that were completed in Figure 9, the practice item "2. Start the system and check safety" has also been completed.

[0072] In Figure 10, text information 84 is displayed, which reads "2. Start the system - Operate the start button. Press the driving assistance switch on the right side of the steering wheel," which corresponds to the currently being performed practice item, "2. Start the system. Operate the start button."

[0073] The image information 85 shown in FIG. 10 is "image information 85C." The image information 85C shows an image corresponding to the operation switch group 45 (see FIG. 3) of the vehicle 10. The image information 85C also highlights the switch image 10C indicating the driving assistance switch 49 by surrounding it with a dashed line, thereby instructing the driver to operate the driving assistance switch 49. By displaying the image information 85C, the driver can operate the driving assistance switch 49 in the practice mode without looking at their hands, just like in the real environment.

[0074] Fig. 11A is a sixth display example displayed on multimedia display 32B. Fig. 11A shows the state after the driver has correctly operated the predetermined operation instructed on the screen shown in Fig. 10, specifically, the operation of driving support switch 49.

[0075] 11A, response information 10D indicating a response to a correct operation by the driver is displayed to the right of image information 85C. As an example, response information 10D is composed of the word "Good!" and an image showing a "good pose."

[0076] Fig. 11B is a seventh display example displayed on the multimedia display 32B. Fig. 11B shows a state after the driver has performed an incorrect operation of the driving support switch 49 instructed on the screen shown in Fig. 10.

[0077] 11B, response information 10E indicating a response to the driver's incorrect operation is displayed to the right of image information 85C. As an example, response information 10E is composed of the characters "Bad!" and an image showing a "X mark." Furthermore, image information 85C shown in FIG. 11B displays an arrow image 10F pointing at switch image 10C, indicating that the operation of driving assistance switch 49 is correct.

[0078] Figure 12 is an eighth display example displayed on multimedia display 32B. Specifically, Figure 12 shows the state after the driver has progressed in practice in practice mode from the screen shown in Figure 11A.

[0079] In the progress information 82 shown in Fig. 12, the progress rate shown in numerical information 82A is "80%" and the graphic shown in graphic information 82B is "the black area is about 4 / 5 from the left." Thus, Fig. 12 shows that the driver's practice in practice mode has progressed about 4 / 5.

[0080] The table of contents information 83 shown in Fig. 12 shows the latter half of the practice items, "3. Change Settings," "4. Exit the System," "5. Precautions for Use," and "6. Comprehension Test." In addition, the table of contents information 83 shown in Fig. 12 shows five completion marks 83B, indicating that practice of the practice items up to "5. Precautions for Use" has been completed.

[0081] In Figure 12, the text information 84 displays an explanation corresponding to the currently running practice item, "6. Comprehension Test Q1. Which operation switch do you press to start the system?"

[0082] The image information 85 shown in FIG. 12 is "image information 85D." The image information 85D is an image showing a plurality of various switches 40 including the operation switch group 45. As an example, in FIG. 12, the text information 84 and the image information 85D constitute question information showing a question related to a predetermined operation in the practice mode. Also, in FIG. 12, the multimedia display 32B is an example of a "display device."

[0083] Here, the CPU 51 of the control ECU 50 determines whether the question being asked is correct or incorrect based on the operation of the various switches 40 during execution of the comprehension test. In the example shown in FIG. 12, the CPU 51 determines that the answer to the "Comprehension Test Q1" is correct if the driving assistance switch 49 is operated, and determines that the answer to the "Comprehension Test Q1" is incorrect if any of the various switches 40 other than the driving assistance switch 49 is operated. If the CPU 51 determines that all the comprehension tests are correct, it ends the practice mode. On the other hand, if the CPU 51 determines that some of the comprehension tests are incorrect, it continues the practice mode. Here, the comprehension test includes a plurality of questions predetermined for each practice mode. Furthermore, the questions asked in the comprehension test are composed of part of the content practiced or explained in the practice items leading up to the comprehension test.

[0084] 13 is a flowchart showing the flow of specific processing executed by the control ECU 50 in practice mode. The CPU 51 reads the information processing program 52A from the ROM 52, loads it into the RAM 53, and executes it, thereby performing the specific processing. As an example, the specific processing is executed when the practice mode is started. Note that the following description will be given taking the case of practicing ACC in practice mode as an example.

[0085] 13, the CPU 51 displays explanatory information 80 showing an explanation related to ACC on the multimedia display 32B. For example, the CPU 51 displays explanatory information 80 as shown in FIGS. 8 and 9 on the multimedia display 32B. Then, the CPU 51 proceeds to step S11.

[0086] In step S11, the CPU 51 accepts an input operation by the driver for a predetermined operation related to the execution of ACC instructed in the practice mode. For example, the CPU 51 accepts an input operation by the driver for operating the driving support switch 49 instructed on the screen shown in Fig. 10 as the predetermined operation. Then, the CPU 51 proceeds to step S12.

[0087] In step S12, CPU 51 displays on multimedia display 32B output content corresponding to the success or failure of the driver's input operation received in step S11. For example, CPU 51 displays response information 10D shown in Fig. 11A as the output content if the driver has performed a correct operation, and displays response information 10E shown in Fig. 11B if the driver has performed an incorrect operation. CPU 51 then proceeds to step S13.

[0088] In step S13, the CPU 51 displays problem information indicating a problem related to the above-mentioned predetermined operation on the multimedia display 32B. For example, the CPU 51 uses the character information 84 and image information 85D shown in Fig. 12 as the problem information to display a question asking about the various switches 40 that should be operated when executing ACC on the multimedia display 32B. Then, the CPU 51 proceeds to step S14.

[0089] In step S14, the CPU 51 determines whether or not the comprehension test has been passed. If the CPU 51 determines that the comprehension test has been passed (step S14: YES), the process proceeds to step S15. On the other hand, if the CPU 51 determines that the comprehension test has not been passed (step S14: NO), the process proceeds to step S16. As an example, the CPU 51 determines that the comprehension test has been passed if it determines that all the questions in the comprehension test have been answered correctly.

[0090] In step S15, the CPU 51 ends the practice mode, and then ends the specific processing.

[0091] In step S16, the CPU 51 displays feedback information on the multimedia display 32B, which indicates feedback on the questions on which the driver got the comprehension test wrong. The feedback information includes, for example, images (e.g., switch image 10C) indicating the various switches 40 to be operated, and images (e.g., arrow image 10F) pointing to the images, as shown in FIG. 11B. Then, the CPU 51 returns to step S11.

[0092] As described above, the CPU 51 of the control ECU 50 executes a practice mode for practicing the automatic driving function and the driving assistance function of the vehicle 10. The CPU 51 then displays, on the multimedia display 32B, output content corresponding to the success or failure of the driver's input operation for a predetermined operation related to the execution of the automatic driving function or the driving assistance function instructed in the practice mode. As a result, when the driver practices at least one of the automatic driving function and the driving assistance function, the control ECU 50 can increase the driver's interest in the practice compared to when the driver's response to the operation is uniform. Specifically, when the driver performs a correct input operation for a predetermined operation, the control ECU 50 causes the multimedia display 32B to display output content corresponding to the correct input operation. Furthermore, when the driver performs an incorrect input operation for a predetermined operation, the control ECU 50 causes the multimedia display 32B to display output content corresponding to the incorrect input operation. In this way, by displaying output content corresponding to the success or failure of the input operation on the multimedia display 32B, the driver can recognize the success or failure of his / her input operation, thereby increasing the driver's interest in the practice.

[0093] Furthermore, the CPU 51 of the control ECU 50 displays progress information 82, which indicates the progress of the driver's practice in the currently running practice mode, on the multimedia display 32B. This allows the control ECU 50 to allow the driver to use the progress information 82 as an indicator for estimating the time when practice will be completed. Therefore, the control ECU 50 allows the driver to estimate the time when practice will be completed, thereby lowering the psychological hurdle of executing the practice mode.

[0094] Furthermore, the CPU 51 of the control ECU 50 displays problem information indicating a problem related to a predetermined operation on the multimedia display 32B in the practice mode, and terminates or continues the practice mode depending on whether the driver's answer to the problem indicated in the problem information is correct or incorrect. Thus, by displaying the problem information on the multimedia display 32B in the practice mode, the control ECU 50 can create a sense of tension for the driver regarding the practice mode and enhance the driver's understanding of the predetermined operation. Furthermore, the control ECU 50 determines whether to terminate or continue the practice mode depending on whether the driver's answer to the problem indicated in the problem information is correct or incorrect, thereby allowing the practice mode to proceed in accordance with the driver's understanding of the predetermined operation.

[0095] Furthermore, the CPU 51 of the control ECU 50 causes each of the multiple selection icons 63 displayed on the multimedia display 32B to display progress information 64 indicating the driver's progress in practicing the automatic driving function or driving assistance function corresponding to the selection icon 63. This allows the control ECU 50 to allow the driver to understand the progress of practice in each practice mode before starting the practice mode, thereby assisting the driver in selecting a practice mode.

[0096] (Second embodiment) Next, a second embodiment of the vehicle 10 according to the present invention will be described while omitting or simplifying parts that overlap with the above embodiment.

[0097] Fig. 14 is a ninth display example displayed on the multimedia display 32B. Specifically, Fig. 14 is a list screen showing the progress of the driver's practice in the automatic driving function and driving assistance function that can execute the practice mode.

[0098] 14 displays a list 90 showing the driver's progress in practice in a tabular format. As an example, the list 90 includes a first column 92 showing the automated driving functions or driving assistance functions for which the practice mode can be executed, and a second column 94 showing the driver's progress in practice for each function.

[0099] For example, in the first column 92 shown in FIG. 14, function A, function B, function C, etc. are displayed as automatic driving functions or driving assistance functions for which the practice mode can be executed.

[0100] 14 displays progress information 96 including numerical information 96A indicating the progress of the driver's practice as a progress rate and graphic information 96B graphically indicating the progress rate indicated by the numerical information 96A. Here, the graphic information 96B indicates the progress rate with a black area.

[0101] For example, in the list 90, the progress information 96 corresponding to the row of function A has a progress rate of "80%" shown in numerical information 96A and a graphic shown in graphic information 96B in which "the black area is approximately 4 / 5 from the left." In this way, FIG. 14 shows that the driver's practice in function A has progressed approximately 4 / 5. The progress information 96 is an example of "progress information."

[0102] As described above, the CPU 51 of the control ECU 50, as a function of the output control unit 51C, displays, in a list form, on the multimedia display 32B, progress information 96 that indicates the driver's progress in practice for the automatic driving function and driving assistance function that can execute the practice mode. This allows the control ECU 50 to allow the driver to understand the progress of practice in each practice mode.

[0103] (Third embodiment) Next, a third embodiment of the vehicle 10 according to the present invention will be described while omitting or simplifying parts that overlap with the above-described embodiment.

[0104] The third embodiment differs from the above-described embodiments in that the output contents of the practice mode are displayed on two display devices 32: a meter display 32A and a multimedia display 32B. Specifically, the CPU 51 of the control ECU 50, as a function of the output control unit 51C, causes the meter display 32A to display explanatory information 100 (see FIG. 15, etc.) that provides an explanation regarding the ACC that is executing the practice mode. Furthermore, as a function of the output control unit 51C, the CPU 51 causes the multimedia display 32B to display a specific image 110 (see FIG. 16, etc.) that shows the vehicle 10 and the surrounding conditions of the vehicle 10 according to the explanatory information 100, from a viewpoint in which the traveling vehicle 10 is seen from a virtual viewpoint. The meter display 32A is an example of a "first display device," and the multimedia display 32B is an example of a "second display device."

[0105] The output contents relating to the practice mode of the third embodiment will be described below with reference to Figures 15 to 25. It is assumed that the vehicle 10 is stopped when the output contents relating to the practice mode are output.

[0106] Fig. 15 shows a first display example displayed on the meter display 32A. Specifically, Fig. 15 shows a display example of explanation information 100A that shows a first explanation related to ACC as explanation information 100.

[0107] The explanatory information 100A shown in FIG. 15 includes notification information 101A and image information 102A that is displayed to the right of the notification information 101A.

[0108] Notification information 101A indicates a notification to the driver. For example, notification information 101A uses text and images to notify the driver of the driving operations that the driver should perform in the practice mode and the various switches 40 that the driver should operate to proceed to the next instruction information 100B (see FIG. 17).

[0109] 15 shows an image corresponding to the notification information 101A. The image information 102A includes a vehicle speed image 102B showing the vehicle speed, a brake pedal image 102C showing the brake pedal, and an accelerator pedal image 102D showing the accelerator pedal. Here, the vehicle speed image 102B shows that the current vehicle speed is 47 km / h.

[0110] 16 shows a tenth display example displayed on the multimedia display 32B. Specifically, Fig. 16 shows a display example of a specific image 110A, which is the specific image 110 corresponding to the explanation information 100A shown in Fig. 15.

[0111] The specific image 110A shown in FIG. 16 includes a host vehicle image 111 showing the vehicle 10, and a road image 112 showing the road on which the vehicle 10 is traveling.

[0112] Here, the specific image 110 is an image generated from a virtual viewpoint of the traveling vehicle 10. The virtual viewpoint is set in a three-dimensional virtual space with the position of the host vehicle image 111 as the origin, and is defined by viewpoint coordinates and a viewpoint angle (orientation) in the virtual space. As an example, the virtual viewpoint is a viewpoint seen at a specific viewpoint angle from specific viewpoint coordinates on the rear side in the traveling direction of the host vehicle image 111 showing the traveling vehicle 10. As a function of the output control unit 51C, the CPU 51 of the control ECU 50 generates the specific image 110 by assuming that the surroundings of the traveling vehicle 10 are viewed from the virtual viewpoint in the virtual space, and displays the specific image 110 on the multimedia display 32B. Note that even while the vehicle 10 is traveling, the CPU 51 displays an image showing the vehicle 10 and the surrounding conditions of the vehicle 10 from the viewpoint seen from the same virtual viewpoint as the specific image 110 on the multimedia display 32B.

[0113] Moreover, above the specific image 110 on the multimedia display 32B, text information 120 showing an explanation of the specific image 110 is displayed. In Fig. 16, the text information 120 displayed is "Driving on an expressway" as an explanation of the specific image 110A.

[0114] Fig. 17 shows a second display example displayed on the meter display 32A. Specifically, Fig. 17 shows a display example of explanation information 100B showing a second explanation related to ACC as explanation information 100.

[0115] The explanation information 100B shown in FIG. 17 includes notification information 101B and image information 103A that is displayed to the right of the notification information 101B.

[0116] Notification information 101B indicates a notification to the driver. For example, notification information 101B uses text and images to notify the driver of various switches 40 that should be operated to proceed to the next instruction information 100C (see FIG. 18).

[0117] 17 shows an image corresponding to the notification information 101B. The image information 103A includes a steering wheel image 103B showing the steering wheel 70, a wheel pad image 103C showing the wheel pad 72, a switch image 103D showing the driving assistance switch 49, and a road image 103G showing the road on which the vehicle 10 is traveling. The image information 103A also highlights the switch image 103D by surrounding it with a dashed line, thereby instructing the driver to operate the driving assistance switch 49.

[0118] Fig. 18 shows a third display example displayed on the meter display 32A. Specifically, Fig. 18 shows a display example of explanation information 100C showing a third explanation related to ACC as explanation information 100.

[0119] The explanation information 100C shown in FIG. 18 includes notification information 101C and image information 103A that is displayed to the right of the notification information 101C.

[0120] The notification information 101C indicates a notification to the driver. For example, the notification information 101C uses text and images to notify the driver that the various switches 40 have been operated correctly.

[0121] In image information 103A shown in Fig. 18, the display content of switch image 103D has changed from that of image information 103A shown in Fig. 17. Specifically, the color of switch image 103D shown in Fig. 18 has changed from white to black from that of switch image 103D shown in Fig. 17, indicating that driving assistance switch 49 has been operated.

[0122] 17. In addition, image information 103A shown in Fig. 18 includes response image 103E, which indicates a response to a correct operation by the driver, added to image information 103A shown in Fig. 17. As an example, response image 103E is composed of an image indicating the "picture of driving support switch 49" and the word "Nice."

[0123] Fig. 19 shows a fourth display example displayed on the meter display 32A. Specifically, Fig. 19 shows a display example of explanation information 100D showing a fourth explanation related to ACC as explanation information 100.

[0124] The explanation information 100D shown in FIG. 19 includes notification information 101D and image information 103A that is displayed to the right of the notification information 101D.

[0125] The notification information 101D indicates a notification to the driver. For example, the notification information 101D uses text and images to notify the driver that the ACC has operated correctly in the practice mode.

[0126] 19 shows image information 103A in which, instead of response image 103E from image information 103A shown in Fig. 18, a surrounding image 103F is displayed, which is a hypothetical view of the surroundings of a traveling vehicle 10 from a virtual viewpoint. The surrounding image 103F is an image that shows the vehicle 10 and the surrounding conditions of the vehicle 10, as seen from a virtual viewpoint similar to that of specific image 110 shown in Fig. 16 and the like.

[0127] Fig. 20 shows an eleventh display example displayed on the multimedia display 32B. Specifically, Fig. 20 shows a display example of a specific image 110B, which is a specific image 110 corresponding to the explanation information 100B, 100C, and 100D shown in Figs. 17 to 19.

[0128] The specific image 110B shown in FIG. 20 includes a host vehicle image 111, a road image 112, another vehicle image 113, another vehicle image 114, and a bar image 115.

[0129] The other vehicle image 113 shows another vehicle located ahead in the direction of travel in the same lane as the host vehicle image 111. The other vehicle image 114 shows another vehicle located ahead in the direction of travel in the right lane of the host vehicle image 111.

[0130] The bar image 115 indicates the inter-vehicle distance between the host vehicle image 111 and the other vehicle image 113. In Fig. 20, two rectangular bar images 115 are displayed between the host vehicle image 111 and the other vehicle image 113, thereby indicating that the vehicle 10 is traveling while maintaining the inter-vehicle distance indicated by the two bar images 115 while ACC is being executed.

[0131] In addition, in FIG. 20, the text information 120 displays an explanation about the specific image 110B, stating "Supports maintaining a constant distance between vehicles."

[0132] Fig. 21 shows a fifth display example displayed on the meter display 32A. Specifically, Fig. 21 shows a display example of explanation information 100E showing a fifth explanation related to ACC as explanation information 100.

[0133] The explanation information 100E shown in FIG. 21 includes notification information 101E and image information 102A that is displayed to the right of the notification information 101E.

[0134] Notification information 101E indicates a notification to the driver. For example, notification information 101E uses text and images to notify the driver of the driving operations that the driver should perform in the practice mode and the various switches 40 that the driver should operate to proceed to the next instruction information 100F (see FIG. 23).

[0135] Image information 102A shown in Fig. 21 displays a vehicle speed image 102E that indicates a vehicle speed different from that of vehicle speed image 102B from image information 102A shown in Fig. 15. Here, vehicle speed image 102E indicates that the current vehicle speed is 58 km / h.

[0136] 22 is a twelfth display example displayed on the multimedia display 32B. Specifically, Fig. 22 shows a display example of a specific image 110C, which is the specific image 110 corresponding to the explanation information 100E shown in Fig. 21.

[0137] The specific image 110C shown in FIG. 22 includes a host vehicle image 111, a road image 112, another vehicle image 113, another vehicle image 114, and a bar image 115.

[0138] In the specific image 110C shown in Fig. 22, the inter-vehicle distance between the host vehicle image 111 and the other vehicle image 113 is shorter than in the specific image 110B shown in Fig. 20. This is because the CPU 51 of the control ECU 50, as a function of the output control unit 51C, changes the specific image 110 displayed on the multimedia display 32B in response to a change in the explanation information 100 displayed on the meter display 32A. The examples shown in Fig. 20 and Fig. 22 show a case where the inter-vehicle distance between the host vehicle image 111 and the other vehicle image 113 is shorter based on an increase in vehicle speed before and after the execution of ACC in the practice mode.

[0139] In addition, in FIG. 22, the explanation for the specific image 110C, "Supports maintaining a constant distance between vehicles," is displayed as text information 120.

[0140] Fig. 23 shows a sixth display example displayed on the meter display 32A. Specifically, Fig. 23 shows a display example of explanation information 100F showing a sixth explanation related to ACC as the explanation information 100.

[0141] The explanation information 100F shown in FIG. 23 includes notification information 101F and image information 103A that is displayed to the right of the notification information 101F.

[0142] Notification information 101F indicates a notification to the driver. For example, notification information 101F uses text and images to notify the driver of various switches 40 that should be operated to proceed to the next instruction information 100G (see FIG. 24).

[0143] In the image information 103A shown in Fig. 23, the display content of the road image 103G has been changed from that of the image information 103A shown in Fig. 17. Specifically, in the road image 103G shown in Fig. 23, two bar images 103H indicating the inter-vehicle distance between the vehicle 10 and the vehicle ahead of the vehicle 10 have been added to the road image 103G shown in Fig. 17, based on the fact that ACC has been executed in the practice mode.

[0144] 23 instructs the driver to operate the driving support switch 49 by highlighting the switch image 103D with a dashed line surrounding it.

[0145] Fig. 24 shows a seventh display example displayed on the meter display 32A. Specifically, Fig. 24 shows a display example of explanation information 100G showing a seventh explanation related to ACC as the explanation information 100.

[0146] The explanatory information 100G shown in FIG. 24 includes notification information 101G and image information 103A that is displayed to the right of the notification information 101G.

[0147] The notification information 101G indicates a notification to the driver. For example, the notification information 101G uses text and images to notify the driver that the various switches 40 have been operated correctly.

[0148] In image information 103A shown in FIG. 24, a response image 103E similar to that of image information 103A shown in FIG. 18 is displayed.

[0149] Fig. 25 shows a thirteenth display example displayed on the multimedia display 32B. Specifically, Fig. 25 shows a display example of a specific image 110D, which is a specific image 110 corresponding to the explanation information 100F and 100G shown in Figs. 23 and 24.

[0150] The specific image 110D shown in FIG. 25 includes a subject vehicle image 111, a road image 112, a different vehicle image 113, and a different vehicle image 114.

[0151] In the specific image 110D shown in Fig. 25, the bar image 115 is erased from the specific image 110C shown in Fig. 22. The examples shown in Fig. 22 and Fig. 25 show a case where the bar image 115 is erased based on the end of ACC in the practice mode.

[0152] In addition, in FIG. 25, the text information 120 displayed is "Driving support will end," which is an explanation for the specific image 110D.

[0153] Although the output contents related to the practice mode of the third embodiment have been described above using Figures 15 to 25, output contents other than those shown in the above figures may be output in the practice mode. For example, before the practice mode is started, the home screen shown in Figure 6 and the selection screen shown in Figure 7 described in the first embodiment may be displayed on the multimedia display 32B. Furthermore, although the road image 112 displayed on the multimedia display 32B in the above example is an image showing a straight road on which the vehicle 10 is traveling, it may be an image showing a curved road when the vehicle 10 is traveling on a curved road. Furthermore, the multimedia display 32B may display the specific image 110D shown in Figure 25 for a certain period of time, and then display output contents indicating, using text, an image, or the like, that the practice mode has ended.

[0154] The specific image 110 when ACC is not being executed and when it is being executed in practice mode has been described above using FIGS. 16, 20, 22, and 25. Specifically, as shown in specific image 110A of FIG. 16 and specific image 110D of FIG. 25, when ACC is not being executed in practice mode, the bar image 115 is not displayed between the host vehicle image 111 and the other vehicle image 113, thereby indicating that the vehicle 10 is in a manual driving state. Furthermore, as shown in specific image 110B of FIG. 20 and specific image 110C of FIG. 22, when ACC is being executed in practice mode, the bar image 115 is displayed between the host vehicle image 111 and the other vehicle image 113, thereby indicating that the vehicle 10 is in an automatic driving state. In this way, the CPU 51 of the control ECU 50 changes the display content of the specific image 110 depending on whether the automatic driving function or the driving assistance function is being executed in practice mode. As another example, when a specific automatic driving function that allows hands-off driving in traffic jams is being executed in the practice mode, the CPU 51 causes a specific image 110E shown in FIG. 26 to be displayed on the multimedia display 32B.

[0155] The specific image 110E shown in FIG. 26 includes a subject vehicle image 111, a road image 112, a vehicle image 113, and an inter-vehicle distance image .

[0156] The inter-vehicle distance image 116 uses five circles to indicate the inter-vehicle distance between the host vehicle image 111 and the other vehicle image 113. In Fig. 26, by displaying the inter-vehicle distance image 116 between the host vehicle image 111 and the other vehicle image 113, it is shown that while the specific automatic driving function is being executed, the vehicle 10 automatically drives while maintaining the inter-vehicle distance indicated by the inter-vehicle distance image 116, thereby enabling hands-off driving.

[0157] As described above, the CPU 51 of the control ECU 50 causes the meter display 32A to display explanatory information 100 that provides an explanation related to the automatic driving function or driving assistance function that is currently in practice mode. The CPU 51 then causes the multimedia display 32B to display a specific image 110 that shows the vehicle 10 and the surrounding conditions of the vehicle 10 according to the explanatory information 100, from a perspective in which the traveling vehicle 10 is viewed from a virtual viewpoint. In this way, the control ECU 50 can provide the driver with information related to the practice mode using two display devices 32.

[0158] Furthermore, the CPU 51 of the control ECU 50 changes the specific image 110 displayed on the multimedia display 32B in accordance with changes in the explanatory information 100 displayed on the meter display 32A. This allows the control ECU 50 to create a sense of unity between the display contents of the two display devices 32, thereby increasing the driver's interest in practice.

[0159] (others) The practice mode described in the above embodiment can be executed even when the vehicle 10 is not in a state where it can run, in other words, when power is not being supplied to the power supply circuit for running the vehicle 10, as long as a predetermined system of the vehicle 10 for executing the practice mode is activated. As an example, the predetermined system is automatically activated when the smart key of the vehicle 10 is inside the vehicle. Then, in the vehicle 10, based on the activation of the predetermined system, the steering wheel 70 is unlocked and the various switches 40 become operable. This allows the driver to operate the steering wheel 70, the various switches 40, etc. in the practice mode.

[0160] In the above embodiment, the driver can interrupt and end the practice mode at any time by operating the various predetermined switches 40 while the practice mode is being executed.

[0161] In the above embodiment, the CPU 51 of the control ECU 50 may use the output device 30 to suggest to the driver that the practice mode be executed.

[0162] For example, the CPU 51 may suggest the execution of a practice mode when there is a specific trend in the driving history of the vehicle 10. Specifically, when the specific trend is that the number of times of driving on expressways per unit period is equal to or greater than a predetermined number, the CPU 51 may suggest the execution of a practice mode related to an automatic driving function or a driving assistance function that can be executed when driving on expressways.

[0163] Furthermore, the CPU 51 may suggest the execution of a practice mode when a specific route is included in the navigation route set in the vehicle 10. Specifically, when an expressway is included as the specific route, the CPU 51 may suggest the execution of a practice mode related to an automatic driving function or a driving assistance function that can be executed when traveling on the expressway.

[0164] Furthermore, the CPU 51 may suggest execution of the practice mode when a specific operation is performed on the various switches 40 by the driver while the vehicle 10 is traveling. Specifically, the CPU 51 may suggest execution of the practice mode related to the driving assistance function A when, as the specific operation, the various switches 40 related to the execution of the driving assistance function A are operated in a state in which the driving assistance function B, which is a prerequisite for executing the driving assistance function A, is not being executed.

[0165] In the above embodiment, the CPU 51 of the control ECU 50 may impose a predetermined restriction on the automatic driving functions and driving assistance functions that can be executed while the vehicle 10 is traveling, depending on the progress of the driver's practice in the practice mode. For example, the CPU 51 may allow only automatic driving functions or driving assistance functions for which practice in the practice mode has been completed to be executed while the vehicle 10 is traveling, in other words, in the real environment. Furthermore, when a new automatic driving function or driving assistance function (hereinafter referred to as a "new function") becomes available to be added to the vehicle 10, the CPU 51 may permit downloading of a program for executing the new function only after practice in the practice mode for the new function has been completed.

[0166] In the above embodiment, the CPU 51 of the control ECU 50 may grant a reward to a driver depending on the driver's progress in practice in multiple practice modes. For example, the CPU 51 may enable the addition of new functions to the vehicle 10 of a driver whose progress in practice meets a predetermined standard earlier than the vehicle 10 of a driver whose progress in practice does not meet the predetermined standard. Furthermore, the CPU 51 may prohibit the download of a program for executing new functions to the vehicle 10 of a driver whose progress in practice does not meet the predetermined standard until the predetermined standard is met.

[0167] In the above embodiment, the display device 32 is provided on the instrument panel 12, the center console 14, the meter panel 16, or the like. However, the present invention is not limited to this, and the display device 32 may be a head-up display (HUD). In this case, the CPU 51 of the control ECU 50 may display information related to the practice mode on the head-up display, or may display information related to the practice mode on multiple display devices 32, such as the head-up display, the meter display 32A, and the multimedia display 32B.

[0168] In the above embodiment, the information related to the practice mode is output using the display device 32 of the output device 30. However, this is not limited thereto, and the information related to the practice mode may be output using a plurality of output devices 30, such as the display device 32 and the speaker 34. Furthermore, the information related to the practice mode may be output using an output device 30 (not shown), such as a lamp or a buzzer, in addition to the display device 32 and the speaker 34. In other words, the output device 30 that outputs the information related to the practice mode is not particularly limited. Furthermore, the output content of the information related to the practice mode is not particularly limited, and may be different from the response information 10D in FIG. 11A and the response information 10E in FIG. 11B, for example, as long as it enables the driver to know whether a correct operation or an incorrect operation has been performed.

[0169] 27A to 27D, an example in which information related to the practice mode is output from speaker 34 serving as output device 30 will be described. FIGS. 27A to 27D are diagrams of the interior of vehicle 10 as seen from driver's seat 18A shown in FIG. 2, with the addition of output content from speaker 34 provided in meter panel 16. In FIGS. 27A to 27D, the output content from speaker 34 is shown in text within speech bubble 200.

[0170] First, Fig. 27A shows the output content from the speaker 34 when the driver performs a correct operation in response to a predetermined operation. The words "Correct" are displayed inside the speech bubble 200 shown in Fig. 27A, indicating that the output content from the speaker 34 is a voice saying "Correct." Next, Fig. 27B shows the output content from the speaker 34 when the driver performs an incorrect operation in response to a predetermined operation. The words "Incorrect" are displayed inside the speech bubble 200 shown in Fig. 27B, indicating that the output content from the speaker 34 is a voice saying "Incorrect."

[0171] Note that the output content from the speaker 34 in response to whether the driver's input operation for the predetermined operation is correct or incorrect is not limited to the verbal sounds shown in Figures 27A and 27B, and may be non-verbal sounds. Figure 27C shows the output content from the speaker 34 when the driver performs a correct operation for the predetermined operation. The word "ping pong" is displayed inside the speech bubble 200 shown in Figure 27C, indicating that the output content from the speaker 34 is the non-verbal sound "ping pong." Next, Figure 27D shows the output content from the speaker 34 when the driver performs an incorrect operation for the predetermined operation. The word "beep" is displayed inside the speech bubble 200 shown in Figure 27D, indicating that the output content from the speaker 34 is the non-verbal sound "beep."

[0172] In the above embodiment, as a combination of images indicating a response to a correct operation by the driver and a response to an incorrect operation by the driver, an image indicating a "good pose" in response information 10D shown in FIG. 11A and an image indicating a "cross mark" in response information 10E shown in FIG. 11B are exemplified. However, the combination of images is not limited to this, and various images can be combined. For example, as shown in pattern P1 of FIG. 28, the image indicating a response to a correct operation by the driver may be an image indicating a "check mark," and the image indicating a response to an incorrect operation may be an image indicating a "cross mark." Furthermore, as shown in pattern P2 of FIG. 28, the image indicating a response to a correct operation by the driver may be an image indicating a "circle," and the image indicating a response to an incorrect operation may be an image indicating a "cross mark." In this case, the image indicating a response to a correct operation by the driver may be expressed in a color associated with a correct answer, such as green, and the image indicating a response to an incorrect operation may be expressed in a color associated with an incorrect answer, such as red.

[0173] In the above embodiment, the success or failure of the driver's input operation for the predetermined operation may be indicated to the driver by highlighting the image showing the various switches 40 instructed in the practice mode. Hereinafter, this will be described with reference to Figures 29A and 29B.

[0174] FIG. 29A is a fourteenth display example displayed on the multimedia display 32B. FIG. 29A shows a state after the driver has correctly performed a predetermined operation instructed on the screen shown in FIG. 10, specifically, the operation of the driving assistance switch 49. In FIG. 29A, response information 10G is displayed above the switch image 10C. As an example, the response based on the response information 10G is a sparkling animation using an image showing a "star." In FIG. 29A, the animation based on the response information 10G highlights the switch image 10C, indicating that the driver has performed the correct operation.

[0175] FIG. 29B is a fifteenth display example displayed on the multimedia display 32B. FIG. 29B shows a state after the driver has performed an incorrect operation on the driving assistance switch 49 instructed on the screen shown in FIG. 10. In FIG. 29B, response information 10H is displayed around the switch image 10C. As an example, the response based on the response information 10H is an image showing a "dashed frame" that flashes in a predetermined color (e.g., red). In FIG. 29B, the response information 10H flashes in a predetermined color to highlight the switch image 10C, thereby indicating that the driver has performed an incorrect operation.

[0176] In the above embodiment, the CPU 51 of the control ECU 50 causes the explanatory information 100 to be displayed on the meter display 32A, and the specific image 110 to be displayed on the multimedia display 32B. However, this is not limited thereto, and the CPU 51 may cause the explanatory information 100 to be displayed on the multimedia display 32B, and the specific image 110 to be displayed on the meter display 32A. In other words, the display device 32 on which the explanatory information 100 and the specific image 110 are displayed is not particularly limited.

[0177] In the above embodiment, the practice mode allows for practice of both the automatic driving function and the driving assistance function of the vehicle 10. However, this is not limited to this, and the practice mode may allow for practice of only the automatic driving function or only the driving assistance function.

[0178] In the above embodiment, the control ECU 50 executes the specific processing shown in Fig. 13. However, the present invention is not limited to this, and the specific processing may be executed by the control ECU 50 in cooperation with another ECU.

[0179] In the above embodiment, the specific process executed by the CPU 51 after reading the software (program) may be executed by various processors other than a CPU. Examples of such processors include programmable logic devices (PLDs) (such as field-programmable gate arrays (FPGAs)) whose circuit configuration can be changed after fabrication, and dedicated electrical circuits such as application-specific integrated circuits (ASICs) that are processors with circuit configurations specifically designed to execute specific processes. The specific process may be executed by one of these processors, or by a combination of two or more processors of the same or different types (e.g., multiple FPGAs, or a combination of a CPU and an FPGA). The hardware structure of these processors is, more specifically, an electrical circuit that combines circuit elements such as semiconductor devices.

[0180] In the above embodiment, the information processing program 52A is pre-stored (installed) in the ROM 52, but the present invention is not limited to this. The information processing program 52A may be provided in a form recorded on a recording medium such as a CD-ROM (Compact Disk Read Only Memory), a DVD-ROM (Digital Versatile Disk Read Only Memory), or a USB (Universal Serial Bus) memory. The information processing program 52A may also be downloaded from an external device via a network. [Explanation of symbols]

[0181] 10 vehicles 30 Output Devices 32A Meter display (first display device) 32B Multimedia Display (Second Display Device) 50 Control ECU (information processing unit) 51B Practice control section (control section) 51C Output control section (control section) 63 Selection Icon 64,82,96 Progress Information 100 explanatory information 110 Specific Images

Claims

1. A control unit executes a practice mode for practicing at least one of an automatic driving function and a driving assistance function of a vehicle, and outputs output content from an output device according to whether a user's input operation is correct or not for a predetermined operation related to the execution of the automatic driving function or the driving assistance function instructed in the practice mode. Information processing device.

2. The control unit outputting progress information indicating the progress of the user's practice in the currently running practice mode from the output device; The information processing device according to claim 1 .

3. The control unit displaying problem information indicating a problem related to the predetermined operation on a display device serving as the output device in the practice mode, and ending or continuing the practice mode depending on whether the user's answer to the problem indicated in the problem information is correct or not; The information processing device according to claim 1 .

4. The control unit displaying progress information indicating the progress of the user's practice in the automatic driving function and the driving assistance function that can execute the practice mode in a list on a display device as the output device; The information processing device according to claim 1 .

5. The control unit a display device serving as the output device, for displaying progress information indicating a progress of the user's practice of the automatic driving function or the driving assistance function corresponding to each of a plurality of selection icons for selecting the automatic driving function or the driving assistance function that executes the practice mode; The information processing device according to claim 1 .

6. The control unit displaying, on a first display device as the output device, explanatory information showing an explanation related to the automatic driving function or the driving assistance function while the practice mode is being executed; a second display device serving as the output device different from the first display device, displaying a specific image showing the vehicle and a surrounding situation of the vehicle according to the explanatory information, from a viewpoint of the vehicle being driven as seen from a virtual viewpoint; The information processing device according to claim 1 .

7. The control unit changing the specific image displayed on the second display device in accordance with a change in the explanation information displayed on the first display device; The information processing device according to claim 6 .

8. Executing a practice mode for practicing at least one of an automatic driving function and a driving assistance function of a vehicle, and outputting from an output device output content corresponding to whether a user's input operation is correct or incorrect with respect to a predetermined operation related to the execution of the automatic driving function or the driving assistance function instructed in the practice mode. An information processing method in which processing is performed by a computer.

9. Executing a practice mode for practicing at least one of an automatic driving function and a driving assistance function of a vehicle, and outputting from an output device output content corresponding to whether a user's input operation is correct or incorrect with respect to a predetermined operation related to the execution of the automatic driving function or the driving assistance function instructed in the practice mode. An information processing program that causes a computer to execute a process.

Images