Information processing device, information processing method, and computer program product

Abstract

The present disclosure relates to an information processing device, an information processing method, and a computer program product, and the purpose of the present disclosure is to improve the degree of interest of a user in practice when the user practices at least one of an automatic driving function and a driving assistance function of a vehicle compared to a case in which a response to an operation by the user is similar. An information processing device includes a control unit that executes a practice mode for practicing at least one of an automatic driving function and a driving assistance function of a vehicle, and outputs, from an output device, output content corresponding to whether or not an input operation by a user for a predetermined operation indicated in the practice mode is correct. The predetermined operation is an operation related to execution of the automatic driving function or the driving assistance function.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, an information processing method, and a computer program product. Background Art

[0002] For example, Japanese Unexamined Patent Application Publication No. 2022-159189 discloses a driving assistance apparatus capable of efficiently performing practice for driving assistance.

[0003] It is assumed that the user who performs the above practice is not familiar with the use of the driving assistance function.

[0004] Therefore, in this practice, the user may perform correct operations and incorrect operations related to the execution of the driving assistance function.

[0005] Here, Japanese Unexamined Patent Application Publication No. 2022-159189 only shows an output example when the user performs a correct operation in the above practice. In terms of the response to the user's operation being uniform (one-size-fits-all), the user's interest in this practice may decrease.

[0006] Thus, the present disclosure provides an information processing apparatus, an information processing method, and a computer program product, whereby when the user practices at least one of the automatic driving function and the driving assistance function of a vehicle, the degree of the user's interest in the practice can be increased compared to the case where the response to the user's operation is uniform. Summary of the Invention

[0007] The information processing apparatus according to the first aspect includes a control unit that executes a practice mode for practicing at least one of the automatic driving function and the driving assistance function of a vehicle, and causes an output device to output output content corresponding to whether an input operation of a user for a predetermined operation indicated in the practice mode is correct or incorrect, where the predetermined operation is an operation related to the execution of the automatic driving function or the driving assistance function.

[0008] In the information processing apparatus according to the first aspect, the control unit executes a practice mode for practicing at least one of the autonomous driving function and the driving assistance function of the vehicle. Further, the control unit causes an output content corresponding to whether the input operation of the user for a predetermined operation related to the execution of the autonomous driving function or the driving assistance function indicated in the practice mode is correct or not to be output from the output device. Thus, according to this information processing apparatus, when the user practices at least one of the autonomous driving function and the driving assistance function of the vehicle, the degree of the user's interest in the practice can be increased as compared with the case where the response to the user's operation is the same. Specifically, in this information processing apparatus, when the user performs a correct input operation with respect to a predetermined operation, the output content in the case of performing the correct input operation is output from the output device. Further, in this information processing apparatus, when the user performs an incorrect input operation with respect to a predetermined operation, the output content in the case of performing the incorrect input operation is output from the output device. In this way, by outputting the output content corresponding to whether the input operation is correct or not from the output device, the user can identify whether his / her input operation is correct and can enhance the interest in the practice.

[0009] The information processing apparatus according to the second aspect is, in the first aspect, the control unit causes progress information indicating the progress of the user's practice in the practice mode being executed to be output from the output device.

[0010] In the information processing apparatus according to the second aspect, the control unit causes progress information indicating the progress of the user's practice in the practice mode being executed to be output from the output device. Thus, according to this information processing apparatus, the user can use the progress information as an index when estimating the practice completion time. Therefore, according to this information processing apparatus, the user can estimate the practice completion time, and thus can reduce the psychological barrier when executing the practice mode.

[0011] The information processing apparatus according to the third aspect is, in the first aspect or the second aspect, the control unit causes problem information indicating a problem related to the predetermined operation to be displayed on a display device as the output device in the practice mode, and ends or continues the practice mode according to whether the answer of the user to the problem indicated by the problem information is correct or not.

[0012] In the information processing apparatus according to the third aspect, the control unit causes problem information indicating a problem related to a predetermined operation to be displayed on the display device as an output device in the practice mode, and ends or continues the practice mode according to whether the answer to the problem indicated by the problem information by the user is correct. Thus, according to this information processing apparatus, by causing the display device to display the problem information in the practice mode, a sense of tension of the user for the practice mode can be created, and the understanding degree of the user for the predetermined operation can be improved. In addition, according to this information processing apparatus, by classifying into ending the practice mode and continuing the practice mode according to whether the answer to the problem indicated by the problem information by the user is correct, the practice mode can be advanced according to the understanding degree of the user for the predetermined operation.

[0013] The information processing apparatus according to the fourth aspect is such that, in any one of the first to third aspects, the control unit causes progress information indicating the progress of the user's practice in the autonomous driving function and the driving assistance function in which the practice mode can be executed to be displayed in a list form on the display device as the output device.

[0014] In the information processing apparatus according to the fourth aspect, the control unit causes progress information indicating the progress of the user's practice in the autonomous driving function and the driving assistance function in which the practice mode can be executed to be displayed in a list form on the display device as the output device. Thus, according to this information processing apparatus, the user can grasp the progress of his / her practice in each practice mode.

[0015] The information processing apparatus according to the fifth aspect is such that, in any one of the first to fourth aspects, the control unit causes each of a plurality of selection icons displayed on the display device as the output device and used for selecting the autonomous driving function or the driving assistance function for executing the practice mode to display progress information indicating the progress of the user's practice in the autonomous driving function or the driving assistance function corresponding to the selection icon.

[0016] In the information processing apparatus according to the fifth aspect, the control unit causes each of a plurality of selection icons displayed on the display device as the output device and used for selecting the autonomous driving function or the driving assistance function for executing the practice mode to display progress information indicating the progress of the user's practice in the autonomous driving function or the driving assistance function corresponding to the selection icon. Thus, according to this information processing apparatus, the user can grasp the progress of his / her practice in each practice mode before the start of the practice mode, and the selection of the practice mode can be assisted for the user.

[0017] The information processing apparatus according to the sixth aspect is as follows. In any one of the first to fifth aspects, the control unit causes a first display device serving as the output device to display explanatory information indicating an explanation related to the autonomous driving function or the driving assistance function that is executing the practice mode, and causes a second display device serving as the output device different from the first display device to display a specific image representing the vehicle and the surrounding conditions of the vehicle corresponding to the explanatory information from the viewpoint of observing the moving vehicle from a virtual viewpoint (angle of view).

[0018] In the information processing apparatus according to the sixth aspect, the control unit causes a first display device serving as the output device to display explanatory information indicating an explanation related to the autonomous driving function or the driving assistance function that is executing the practice mode. Further, the control unit causes a second display device serving as the output device different from the first display device to display a specific image representing the vehicle and the surrounding conditions of the vehicle corresponding to the explanatory information from the viewpoint of observing the moving vehicle from a virtual viewpoint. Thus, according to this information processing apparatus, it is possible to provide information related to the practice mode to the user using two display devices.

[0019] The information processing apparatus according to the seventh aspect is as follows. In the sixth aspect, the control unit changes the specific image displayed on the second display device according to a change in the explanatory information displayed on the first display device.

[0020] In the information processing apparatus according to the seventh aspect, the control unit changes the specific image displayed on the second display device according to a change in the explanatory information displayed on the first display device. Thus, according to this information processing apparatus, it is possible to give a sense of unity to the display contents of the two display devices and to increase the degree of interest of the user in the practice.

[0021] The information processing method according to the eighth aspect includes: a computer executing the following processing: executing a practice mode for practicing at least one of an autonomous driving function and a driving assistance function of a vehicle, and outputting output contents corresponding to whether a user input operation for a predetermined operation indicated in the practice mode is correct or not, the predetermined operation being an operation related to the execution of the autonomous driving function or the driving assistance function.

[0022] The information processing program according to the ninth aspect causes a computer to execute the following processing: executing a practice mode for practicing at least one of an autonomous driving function and a driving assistance function of a vehicle, and outputting output contents corresponding to whether a user input operation for a predetermined operation indicated in the practice mode is correct or not, the predetermined operation being an operation related to the execution of the autonomous driving function or the driving assistance function.

[0023] As described above, in the information processing apparatus, information processing method, and information processing program according to the present disclosure, when a user practices at least one of an automatic driving function and a driving assistance function of a vehicle, the degree of interest of the user in the practice can be increased as compared with a case where responses to the operations of the user are the same and uniform. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Exemplary embodiments of the present disclosure will be described in detail based on the following drawings, where:

[0025] Figure 1 is a block diagram showing a schematic configuration of a vehicle.

[0026] Figure 2 is a view obtained by observing the interior of the vehicle from the driver's seat.

[0027] Figure 3 is an explanatory diagram for explaining an operation switch group (group).

[0028] Figure 4 is a block diagram showing a schematic configuration of a control ECU.

[0029] Figure 5 is a block diagram showing an example of a functional structure of a control ECU.

[0030] Figure 6 is a first display example displayed on a multimedia display.

[0031] Figure 7 is a second display example displayed on a multimedia display.

[0032] Figure 8 is a third display example displayed on a multimedia display.

[0033] Figure 9 is a fourth display example displayed on a multimedia display.

[0034] Figure 10 is a fifth display example displayed on a multimedia display.

[0035] Figure 11A is a sixth display example displayed on a multimedia display.

[0036] Figure 11B is a seventh display example displayed on a multimedia display.

[0037] Figure 12 is an eighth display example displayed on a multimedia display.

[0038] Figure 13 is a flowchart showing a process of a specific process.

[0039] Figure 14It is the 9th display example shown on the multimedia display.

[0040] Figure 15 It is the 1st display example shown on the instrument display.

[0041] Figure 16 It is the 10th display example shown on the multimedia display.

[0042] Figure 17 It is the 2nd display example shown on the instrument display.

[0043] Figure 18 It is the 3rd display example shown on the instrument display.

[0044] Figure 19 It is the 4th display example shown on the instrument display.

[0045] Figure 20 It is the 11th display example shown on the multimedia display.

[0046] Figure 21 It is the 5th display example shown on the instrument display.

[0047] Figure 22 It is the 12th display example shown on the multimedia display.

[0048] Figure 23 It is the 6th display example shown on the instrument display.

[0049] Figure 24 It is the 7th display example shown on the instrument display.

[0050] Figure 25 It is the 13th display example shown on the multimedia display.

[0051] Figure 26 It is an explanatory diagram showing other examples of a specific image.

[0052] Figure 27A It is the 1st explanatory diagram showing an example of output content based on voice corresponding to whether a driver's input operation for a predetermined operation is correct or not.

[0053] Figure 27B It is the 2nd explanatory diagram showing an example of output content based on voice corresponding to whether a driver's input operation for a predetermined operation is correct or not.

[0054] Figure 27C It is the 3rd explanatory diagram showing an example of output content based on voice corresponding to whether a driver's input operation for a predetermined operation is correct or not.

[0055] Figure 27DFIG. 4 is an explanatory diagram showing an example of output content corresponding to whether a driver's input operation for a predetermined operation is correct or not based on voice.

[0056] Figure 28 FIG. is an explanatory diagram showing an example of a combination of output content corresponding to whether a driver's input operation for a predetermined operation is correct or not.

[0057] Figure 29A The 14th display example shown on the multimedia display.

[0058] Figure 29B The 15th display example shown on the multimedia display. DETAILED DESCRIPTION

[0059] Hereinafter, the vehicle 10 according to the present embodiment will be described.

[0060] (First Embodiment)

[0061] First, the vehicle 10 according to the first embodiment will be described.

[0062] Figure 1 FIG. is a block diagram showing a schematic configuration of the vehicle 10. As Figure 1 shown, the vehicle 10 includes a sensor group 20, an output device 30, various switches 40, and a control ECU (Electronic Control Unit) 50. The sensor group 20, the output device 30, various switches 40, and the control ECU 50 are connected to each other via an external bus (communication bus) 15. The control ECU 50 is an example of an "information processing device".

[0063] The sensor group 20 includes, for example, a three-dimensional lidar (3D-LiDAR), a millimeter-wave sensor, an infrared sensor, a turn signal indicator sensor, an accelerator position sensor, a vehicle speed sensor, a steering angle sensor, an angular velocity sensor, a GPS (Global Positioning System) sensor, a gyro sensor, and an acceleration sensor, etc., sensors for detecting the state of the vehicle 10 and the surrounding conditions. The sensor group 20 outputs the detection results of each sensor to the control ECU 50.

[0064] The output device 30 includes a display device 32 and a speaker 34. The display device 32 is provided on the instrument panel 12 (refer to Figure 2 ), the center console 14 (refer to Figure 2 ), or the meter panel 16 (refer to Figure 2) etc., display suggestions for actions related to the functions of the vehicle 10 and images related to the explanations of the functions, etc.

[0065] The speaker 34 is provided on the instrument panel 12, the center console 14, or the dashboard 16, etc., and outputs suggestions for actions related to the functions of the vehicle 10 and voices (sounds) related to the explanations of the functions.

[0066] The various switches 40 are in-vehicle switches for operating or stopping the functions of the vehicle 10, etc. Specific examples of the various switches 40 will be described later.

[0067] The control ECU 50 is an ADAS (Advanced Driver Assistance System) - ECU that controls the autonomous driving function and the driving assistance function of the vehicle 10. As an example, this autonomous driving function is an automatic driving function at the autonomous driving level L3 or higher among the 6 levels of autonomous driving of SAE (Society of Automotive Engineers). In addition, this driving assistance function includes various driving assistance functions such as ACC (Adaptive Cruise Control) and LTA (Lane Tracing Assist). In addition, although only the control ECU 50 is shown in Figure 1 there are multiple other ECUs corresponding to the various functions of the vehicle 10 provided in the vehicle 10.

[0068] In addition, in the following description, autonomous driving means that, without relying on the driver of the vehicle 10, a part or all of the driving operations such as acceleration, braking, and steering are performed by the control ECU 50. That is, this autonomous driving includes both full autonomous driving in which all driving operations are performed by the control ECU 50 and driving assistance in which a part of the driving operations is performed by the control ECU 50. The driver of the vehicle 10 is an example of a "user".

[0069] Figure 2 is a view obtained by observing the interior of the vehicle 10 from the driver's seat. In Figure 2 X represents the vehicle width direction of the vehicle 10, Y represents the vehicle up and down direction, and Z represents the vehicle front and rear direction. In addition, in Figure 2 the right side in the vehicle width direction is represented by +X, the left side by -X, the upper side in the vehicle up and down direction by +Y, the lower side by -Y, the front side in the vehicle front and rear direction by +Z, and the rear side by -Z.

[0070] As Figure 2As shown, as an example, the vehicle 10 is a right-hand drive vehicle. Therefore, the vehicle seat 18 on the right side in the figure is set as the driver's seat 18A, and the vehicle seat 18 on the left side in the figure is set as the passenger seat 18B.

[0071] A steering wheel 70 is disposed in front of the driver's seat 18A. The steering wheel 70 is supported via a steering column (not shown) that supports a wheel pad 72, and is disposed behind the instrument panel 12. On the right side of the wheel pad 72, an operation switch group 45 is provided as various switches 40, which is a collection of multiple in-vehicle switches.

[0072] A dashboard 16 is disposed in front of the steering wheel 70. In the dashboard 16, a meter display 32A is provided as a display device 32, which is a liquid crystal display.

[0073] A center console 14 is disposed between the driver's seat 18A and the passenger seat 18B. On the upper side of the center console 14, a multimedia display 32B is provided as a display device 32, which is a liquid crystal display.

[0074] Figure 3 is an explanatory diagram for explaining the operation switch group 45. As Figure 3 shown, the operation switch group 45 is a collection of multiple in-vehicle switches including an operation switch 47A disposed in the upper left in the figure, an operation switch 47B disposed below the operation switch 47A, an operation switch 47C disposed below the operation switch 47B, an operation switch 47D disposed on the right side of the operation switch 47C, an operation switch 47E disposed below the operation switch 47D, an operation switch 47F disposed on the right side of the operation switch 47E, and an operation switch 47G disposed above the operation switch 47F.

[0075] Hereinafter, the operation switch 47A may sometimes be referred to as the "driving assistance switch 49". This driving assistance switch 49 is an in-vehicle switch that can switch the ON / OFF of the ACC in the driving assistance function of the vehicle 10. In addition, the description of the operation switches 47B to 47G other than the operation switch 47A (driving assistance switch 49) in the operation switch group 45 is omitted, but the operation switches 47B to 47G are also switches that cause the functions of the vehicle 10 to operate or stop by the operation of the driver.

[0076] Figure 4 is a block diagram showing a schematic configuration of the control ECU 50. As Figure 4As shown in the figure, the control ECU 50 is configured to include a CPU (Central Processing Unit) 51, a ROM (Read Only Memory) 52, a RAM (Random Access Memory) 53, a storage 54, a communication I / F (InterFace) 55, and an input / output I / F 56. The CPU 51, ROM 52, RAM 53, storage 54, communication I / F 55, and input / output I / F 56 are communicably connected to each other via an internal bus 57.

[0077] The CPU 51 is a central arithmetic processing unit that executes various programs to control each part (unit). That is, the CPU 51, which is a processor, reads a program from the ROM 52, which is a memory, and executes the program using the RAM 53 as a working area. In the present embodiment, an information processing program 52A is stored in the ROM 52.

[0078] The ROM 52 stores various programs and various data. The RAM 53 temporarily stores programs or data as a working area.

[0079] The storage 54 is a NAND memory composed of an eMMC (embedded Multi Media Card) or a UFS (Universal Flash Storage), etc. The storage 54 is connected to the CPU 51 via an eMMC or UFS interface.

[0080] In addition, components such as the ROM 52 and the storage 54 included in the control ECU 50 are preferably media with tamper-proof properties, such as an HSM (Hardware Security Module).

[0081] The communication I / F 55 is an interface for connecting to other ECUs. This interface adopts a communication standard under Ethernet (registered trademark).

[0082] The input / output I / F 56 is an interface for communicating with in-vehicle devices such as the sensor group 20, output device 30, and various switches 40 mounted on the vehicle 10.

[0083] Next, the functional structure of the control ECU 50 will be described. Figure 5 It is a block diagram showing an example of the functional structure of the control ECU 50.

[0084] As Figure 5As shown, the CPU 51 of the control ECU 50 has a driving control unit 51A, a practice control unit 51B, and an output control unit 51C as functional structures. Each functional structure is realized by the CPU 51 reading out and executing the information processing program 52A stored in the ROM 52. The practice control unit 51B and the output control unit 51C are examples of the "control unit".

[0085] The driving control unit 51A executes the autonomous driving function or the driving assistance function instructed by the driver, and controls the autonomous driving of the vehicle 10. For example, during the driving of the vehicle 10, when the driving assistance switch 49 is operated, the driving control unit 51A executes ACC.

[0086] The practice control unit 51B executes a practice mode for practicing the autonomous driving function and the driving assistance function of the vehicle 10, and controls the progress of the practice mode. Here, when an instruction to start the practice mode is received during the stop of the vehicle 10, the practice control unit 51B starts the practice mode. In addition, during the execution of the practice mode, when various switches 40 related to the execution of the autonomous driving function or the driving assistance function are operated, the practice control unit 51B prohibits the execution of the autonomous driving function or the driving assistance function corresponding to the various switches 40. Thus, for example, even if the operation of the driving assistance switch 49 is instructed in the practice mode and the driver operates the driving assistance switch 49 according to the instruction, ACC will not be executed.

[0087] The output control unit 51C controls the output device 30 and outputs various output contents from the output device 30. For example, the output control unit 51C causes the output device 30 to output output contents corresponding to the correctness of the driver's input operation for a predetermined operation related to the execution of the autonomous driving function or the driving assistance function indicated in the practice mode. Hereinafter, Figures 6 to 12 the output contents related to the practice mode of the first embodiment will be described. In addition, it is assumed that the vehicle 10 is stopped when the output contents related to the practice mode are output.

[0088] Figure 6 is the first display example displayed on the multimedia display 32B as the output device 30. As an example, Figure 6 shows the main screen displayed on the multimedia display 32B after the predetermined system startup of the vehicle 10 for executing the practice mode.

[0089] Figure 6 A selection unit 60 for selecting the main contents displayed on the multimedia display 32B is displayed on the main screen shown. In the selection unit 60, text information 61 representing various main contents in text is displayed. In Figure 6In this case, a cursor 62 is displayed on the text "Practice Mode" represented by the text information 61. Moreover, when various switches 40 are operated in this state, the CPU 51 of the control ECU 50 receives an instruction to start the practice mode and starts the practice mode.

[0090] Figure 7 This is the second display example shown on the multimedia display 32B. Specifically, Figure 7 It shows the state after the CPU 51 receives an instruction to start the practice mode in the main screen shown in Figure 6 Moreover, Figure 7 This is a selection screen for selecting an autonomous driving function or a driving assistance function to execute the practice mode.

[0091] Figure 7 Multiple selection icons 63 are displayed on the selection screen shown in Figure 7 Specifically, the selection icons 63 shown in

[0092] are the selection icon 63A for practicing function A, the selection icon 63B for practicing function B, and the selection icon 63C for practicing function C in the practice mode. Figure 7 Specifically, the progress information 64 shown in

[0093] is the progress information 64A indicating the progress of the practice of function A, the progress information 64B indicating the progress of the practice of function B, and the progress information 64C indicating the progress of the practice of function C. The progress information 64 is an example of "progress information".

[0094] Figure 8 This is the third display example shown on the multimedia display 32B. Specifically, Figure 8 It shows the state after the selection icon 63A is selected in the selection screen shown in Figure 7 Moreover, hereinafter, the case where the selection icon 63A is selected and ACC is practiced in the practice mode as function A will be taken as an example for explanation.

[0095] Figure 8 Explanation information 80 is displayed on the multimedia display 32B shown inFigure 8 The illustrated explanatory information 80 is configured to include: text information 81, progress information 82, and table of contents information 83 displayed in the left approximately 1 / 4 area within the display area of the multimedia display 32B; and text information 84 and image information 85 displayed in the remaining approximately 3 / 4 area within the display area.

[0096] The text information 81 represents a promotional slogan for the ACC in which the practice mode is being executed. In Figure 8 , as the text information 81, the promotional slogan "Make driving on the highway comfortable and worry-free" is shown.

[0097] The progress information 82 represents the progress of the driver's practice in the currently-executed practice mode. Here, the progress information 82 is configured to include numerical information 82A representing the progress of the practice in terms of a progress rate, and graphical information 82B graphically representing the progress rate shown by the numerical information 82A. Here, the graphical information 82B represents the progress rate with a black area. Figure 8 In the illustrated progress information 82, the progress rate represented by the numerical information 82A is "0%", and the graph represented by the graphical information 82B is "no black area". Thus, Figure 8 it represents a state where the driver's practice in the practice mode has not progressed at all. The progress information 82 is an example of "progress information".

[0098] The table of contents information 83 represents the table of contents of the practice of the ACC in which the practice mode is being executed. As an example, Figure 8 the illustrated table of contents information 83 represents the first half of the practice items such as "1. Function overview", "2. System startup", and "3. Change settings". In addition, the underlined part in the table of contents information 83, Figure 8 in which is "1. Function overview - Follow the vehicle ahead" is the practice item being executed. In addition, the driver can change the practice items represented by the table of contents information 83 by moving the scroll bar 83A arranged on the right side of the table of contents information 83 up and down.

[0099] The text information 84 represents an explanation of the currently-executed practice item. In Figure 8 , as the text information 84, the explanation "1. Function overview - Follow the vehicle ahead to support maintaining the optimal inter-vehicle distance" is displayed.

[0100] The image information 85 represents an image of the currently-executed practice item. Here, Figure 8 the illustrated image information 85 is "image information 85A". This image information 85A shows a situation where the own vehicle image 10A of the vehicle 10 follows the ahead vehicle image 10B representing the ahead vehicle.

[0101] Figure 9 This is the fourth display example shown on the multimedia display 32B. Specifically, Figure 9 It shows Figure 8 the state where the driver's practice in the practice mode has progressed starting from the screen shown.

[0102] Figure 9 In the progress information 82 shown in , the progress rate represented by the numerical information 82A is "20%", and the graph represented by the graphical information 82B is "the black area occupies approximately 1 / 5 from the left". Thus, Figure 9 It indicates that the driver's practice in the practice mode has advanced by about 1 / 5.

[0103] In Figure 9 a check mark indicating that the practice has been completed, i.e., a completion mark 83B, is displayed on the right side of a part of the practice items represented by the table of contents information 83. Specifically, in Figure 9 the table of contents information 83 shown in , three completion marks 83B are displayed, indicating that the practice of the practice item "1. Function Overview" has been completed.

[0104] In Figure 9 as the text information 84, there is displayed "2. System startup - After confirming safe merging onto the highway main line, let's confirm the safety around us before starting", which is an explanation corresponding to the "2. System startup confirm safety" that is the practice item being executed.

[0105] Figure 9 The image information 85 shown in is "Image information 85B". This image information 85B represents the scene in front that the driver should see through the windshield when actually executing ACC during the driving of the vehicle 10. By displaying this image information 85B, even during the practice mode when the vehicle 10 is stopped, the driver can imagine a state close to the real environment.

[0106] Figure 10 This is the fifth display example shown on the multimedia display 32B. Specifically, Figure 10 It shows Figure 9 the state where the driver's practice in the practice mode has advanced starting from the screen shown.

[0107] In Figure 10 the table of contents information 83 shown in , four completion marks 83B are displayed, indicating that in addition to the practice items whose practice has been completed in Figure 9 the practice of the practice item "2. System startup confirm safety" has also been completed.

[0108] In Figure 10Among them, as the text information 84, there is a description "2. System startup - To operate the startup button, press the driving assistance switch on the right side of the steering wheel", which corresponds to "2. System startup operation startup button" as the exercise item being executed.

[0109] Figure 10 The displayed image information 85 is "Image Information 85C". This Image Information 85C represents an image corresponding to the operation switch group 45 of the vehicle 10 (refer to Figure 3 ). In addition, this Image Information 85C is emphasized by being surrounded by a dotted line around the switch image 10C representing the driving assistance switch 49, instructing the driver to operate this driving assistance switch 49. By displaying this Image Information 85C, the driver can operate the driving assistance switch 49 without looking at their hands in the practice mode just like in the real environment.

[0110] Figure 11A It is the sixth display example shown on the multimedia display 32B. Figure 11A It represents the following state: For the predetermined operation indicated in the Figure 10 shown screen, specifically the operation of the driving assistance switch 49, it is the state after the driver has performed the correct operation.

[0111] In Figure 11A , on the right side of the Image Information 85C, there is a response information 10D indicating the response to the correct operation performed by the driver. As an example, the response information 10D consists of the text "Good!" and an image representing a "gesture of appreciation".

[0112] Figure 11B It is the seventh display example shown on the multimedia display 32B. Figure 11B It represents the following state: For the operation of the driving assistance switch 49 indicated in the Figure 10 shown screen, it is the state after the driver has performed the wrong operation.

[0113] In Figure 11B , on the right side of the Image Information 85C, there is a response information 10E indicating the response to the wrong operation performed by the driver. As an example, the response information 10E consists of the text "Bad!" and an image representing a "cross mark". In addition, in the Figure 11B shown Image Information 85C, there is an arrow image 10F pointing to the switch image 10C, indicating that the operation of the driving assistance switch 49 is a correct operation.

[0114] Figure 12 It is the eighth display example shown on the multimedia display 32B. Specifically, Figure 12 It represents starting from Figure 11AThe displayed screen shows the state after the driver's practice has progressed in the practice mode.

[0115] Figure 12 In the displayed progress information 82, the progress rate indicated by the numerical information 82A is "80%", and the graph indicated by the graphical information 82B is "the black area occupies approximately 4 / 5 from the left". Thus, Figure 12 It indicates that the driver's practice in the practice mode has progressed about 4 / 5.

[0116] Figure 12 The displayed table of contents information 83 indicates the latter half of the practice items, namely "3. Change settings", "4. End system", "5. Precautions for use", and "6. Comprehension test". Additionally, in Figure 12 the displayed table of contents information 83, five completion marks 83B are shown, indicating that the practice of the practice items up to "5. Precautions for use" has been completed.

[0117] In Figure 12 as the text information 84, there is a display of "6. Comprehension test Q1. Which operation switch should be pressed when starting the system?", which is an explanation corresponding to the "6. Comprehension test" that is the practice item being executed.

[0118] Figure 12 The displayed image information 85 is "Image information 85D". This image information 85D is an image showing a plurality of various switches 40 including the operation switch group 45. As an example, in Figure 12 it is composed of the text information 84 and the image information 85D to form problem information indicating problems related to predetermined operations in the practice mode. Additionally, in Figure 12 the multimedia display 32B is an example of a "display device".

[0119] Here, the CPU 51 of the control ECU 50 determines whether the currently presented question is answered correctly based on the operation content of the various switches 40 during the execution of the comprehension test. In Figure 12 the shown example, the CPU 51 determines that the answer to "Comprehension test Q1" is correct when the driving assistance switch 49 is operated, and determines that the answer to "Comprehension test Q1" is incorrect when a switch other than the driving assistance switch 49 among the various switches 40 is operated. Moreover, the CPU 51 ends the practice mode when it determines that all comprehension tests are correct. On the other hand, the CPU 51 continues the practice mode when it determines that some of the comprehension tests are incorrect. Here, in the comprehension test, multiple questions are presented that are predetermined for each practice mode. Additionally, the questions presented in the comprehension test are composed of a part of the content practiced or explained in the practice items up to the comprehension test.

[0120] Figure 13 This is a flowchart showing the process of specific processing executed by the control ECU 50 in the practice mode. The CPU 51 reads the information processing program 52A from the ROM 52, expands and executes it in the RAM 53, thereby performing specific processing. As an example, the specific processing is executed based on the start of the practice mode. In addition, the following will be described by taking the case of practicing ACC in the practice mode as an example.

[0121] In Figure 13 step S10 shown, the CPU 51 displays the explanation information 80 indicating the explanation related to ACC on the multimedia display 32B. For example, the CPU 51 displays the explanation information 80 as shown in Figure 8 and Figure 9 on the multimedia display 32B. Then, the CPU 51 proceeds to step S11.

[0122] In step S11, the CPU 51 accepts the driver's input operation for the predetermined operation related to the execution of ACC indicated in the practice mode. For example, the CPU 51 accepts the driver's input operation for the operation of the driving assistance switch 49 indicated in the screen shown in Figure 10 as the predetermined operation. Then, the CPU 51 proceeds to step S12.

[0123] In step S12, the CPU 51 displays the output content corresponding to whether the driver's input operation accepted in step S11 is correct or not on the multimedia display 32B. For example, as the output content, the CPU 51 displays the response information 10D shown in Figure 11A when the driver performs a correct operation, and displays the response information 10E shown in Figure 11B when the driver performs an incorrect operation. Then, the CPU 51 proceeds to step S13.

[0124] In step S13, the CPU 51 displays the problem information indicating the problem related to the above-mentioned predetermined operation on the multimedia display 32B. For example, as the problem information, the CPU 51 uses the text information 84 and the image information 85D shown in Figure 12 to display the question asking about the various switches 40 that should be operated when executing ACC on the multimedia display 32B. Then, the CPU 51 proceeds to step S14.

[0125] In step S14, the CPU 51 determines whether the understanding test has been passed (whether it is qualified). Here, when the CPU 51 determines that the understanding test has been passed (step S14: YES), it proceeds to step S15. On the other hand, when the CPU 51 determines that the understanding test has not been passed (step S14: NO), it proceeds to step S16. As an example, when the CPU 51 determines that all the answers to the understanding tests are correct, it determines that the understanding test has been passed.

[0126] In step S15, the CPU 51 ends the practice mode. Then, the CPU 51 ends the specific process.

[0127] In step S16, the CPU 51 displays feedback information indicating feedback on the questions that the driver got wrong in the understanding test on the multimedia display 32B. This feedback information is configured to include, for example, images (e.g., switch image 10C) indicating various switches 40 that should be operated as shown Figure 11B and images (e.g., arrow image 10F) indicating the images. Then, the CPU 51 returns to step S11.

[0128] As described above, the CPU 51 of the control ECU 50 executes a practice mode for practicing the automatic driving function and the driving assistance function of the vehicle 10. Moreover, the CPU 51 displays output content corresponding to whether the driver's input operation regarding a predetermined operation related to the execution of the automatic driving function or the driving assistance function indicated in the practice mode is correct or not on the multimedia display 32B. Thus, according to this control ECU 50, when the driver practices at least one of the automatic driving function and the driving assistance function, the degree of the driver's interest in the practice can be increased compared to the case where the response to the driver's operation is the same and uniform. Specifically, in this control ECU 50, when the driver makes a correct input operation with respect to a predetermined operation, the output content in the case of a correct input operation is displayed on the multimedia display 32B. In addition, in this control ECU 50, when the driver makes an incorrect input operation with respect to a predetermined operation, the output content in the case of an incorrect input operation is displayed on the multimedia display 32B. In this way, the output content corresponding to whether the input operation is correct or not is displayed on the multimedia display 32B, so that the driver can identify whether his / her input operation is correct and can enhance the interest in the practice.

[0129] In addition, the CPU 51 of the control ECU 50 causes the multimedia display 32B to display progress information 82 indicating the progress of the driver's practice in the currently-executing practice mode. Thus, based on this control ECU 50, the driver can use the progress information 82 as an index when estimating the practice completion time. Therefore, based on this control ECU 50, the driver can estimate the practice completion time, thereby reducing the psychological barrier when executing the practice mode.

[0130] In addition, the CPU 51 of the control ECU 50 causes the multimedia display 32B to display problem information indicating problems related to a predetermined operation in the practice mode, and ends or continues the practice mode according to whether the answer to the problem indicated by the problem information by the driver is correct. Thus, based on this control ECU 50, by causing the multimedia display 32B to display the problem information in the practice mode, a sense of tension of the driver towards the practice mode can be created, and the driver's understanding of the predetermined operation can be improved. In addition, based on this control ECU 50, by dividing into ending the practice mode and continuing the practice mode according to whether the answer to the problem indicated by the problem information by the driver is correct, the practice mode can be advanced according to the driver's understanding of the predetermined operation.

[0131] In addition, the CPU 51 of the control ECU 50 causes each of the plurality of selection icons 63 displayed on the multimedia display 32B to display progress information 64 indicating the progress of the driver's practice in the autonomous driving function or driving assistance function corresponding to the selection icon 63. Thus, based on this control ECU 50, the driver can grasp the progress of their practice in each practice mode before the start of the practice mode, and the driver's selection of the practice mode can be assisted.

[0132] (Second Embodiment)

[0133] Next, while omitting or simplifying the overlapping parts with the above-described embodiment, the vehicle 10 according to the second embodiment will be described.

[0134] Figure 14 is the ninth display example shown on the multimedia display 32B. Specifically, Figure 14 is a list screen showing the progress of the driver's practice in the autonomous driving functions and driving assistance functions in which the practice mode can be executed in the form of a list.

[0135] In Figure 14 the shown list screen, a list 90 showing the progress of the above-described driver's practice in tabular form is displayed. As an example, the list 90 is configured to include a first column 92 indicating the autonomous driving function or driving assistance function in which the practice mode can be executed, and a second column 94 indicating the progress of the driver's practice for each function.

[0136] For example, in the first column 92 shown in Figure 14 function A, function B, function C, etc. are displayed as the autonomous driving function or driving assistance function capable of executing the practice mode.

[0137] In addition, in the second column 94 shown in Figure 14 progress information 96 including numerical information 96A indicating the progress of the driver's practice described above in terms of a progress rate and graphical information 96B graphically representing the progress rate shown by the numerical information 96A is displayed. Here, the graphical information 96B represents the progress rate by a black area.

[0138] For example, in the progress information 96 corresponding to the row of function A in the list 90, the progress rate shown by the numerical information 96A is "80%", and the graph shown by the graphical information 96B is "the black area occupies about 4 / 5 from the left". Thus, Figure 14 it indicates that the driver has practiced about 4 / 5 of function A. The progress information 96 is an example of "progress information".

[0139] As described above, as a function of the output control unit 51C, the CPU 51 of the control ECU 50 causes the progress information 96 indicating the progress of the driver's practice in the autonomous driving function and driving assistance function capable of executing the practice mode to be displayed in the form of a list on the multimedia display 32B. Thus, according to the control ECU 50, the driver can grasp the progress of the practice in each practice mode.

[0140] (Third Embodiment)

[0141] Next, while omitting or simplifying the overlapping parts with the above-described embodiment, the vehicle 10 according to the third embodiment will be described.

[0142] The difference between the third embodiment and the above-described embodiment is that the output content of the practice mode is displayed on the two display devices 32, i.e., the instrument display 32A and the multimedia display 32B. Specifically, as a function of the output control unit 51C, the CPU 51 of the control ECU 50 causes the instrument display 32A to display explanatory information 100 (refer to Figure 15 etc.) indicating the explanation related to the ACC in which the practice mode is being executed. In addition, as a function of the output control unit 51C, the CPU 51 causes the multimedia display 32B to display a specific image 110 (refer to Figure 16 etc.) representing the vehicle 10 and the surrounding conditions of the vehicle 10 corresponding to the explanatory information 100 from the viewpoint of observing the traveling vehicle 10 from a virtual viewpoint. The instrument display 32A is an example of "the first display device", and the multimedia display 32B is an example of "the second display device".

[0143] Hereinafter, using Figures 15 to 25 , the output content related to the practice mode of the third embodiment will be described. In addition, it is assumed that the vehicle 10 is stopped when the output content related to this practice mode is output.

[0144] Figure 15 is the first display example shown on the instrument display 32A. Specifically, as the explanatory information 100, Figure 15 a display example of the explanatory information 100A representing the first explanation related to ACC is shown.

[0145] Figure 15 The explanatory information 100A shown is configured to include notification information 101A and image information 102A displayed on the right side of the notification information 101A.

[0146] The notification information 101A represents a notification to the driver. For example, the notification information 101A uses text and images to notify the driver of the driving operations that the driver should perform in the practice mode and the various switches 40 that should be operated to enter the next explanatory information 100B (refer to Figure 17 ).

[0147] Figure 15 The image information 102A shown represents an image corresponding to the notification information 101A. The image information 102A is configured to include a vehicle speed image 102B representing the vehicle speed, a brake pedal image 102C representing the brake pedal, and an accelerator pedal image 102D representing the accelerator pedal. Here, in the vehicle speed image 102B, the current vehicle speed is shown as 47 km / h.

[0148] Figure 16 is the tenth display example shown on the multimedia display 32B. Specifically, Figure 16 represents Figure 15 a display example of a specific image 110, that is, a specific image 110A, corresponding to the explanatory information 100A shown.

[0149] Figure 16 The specific image 110A shown is configured to include a self-vehicle image 111 representing the vehicle 10 and a road image 112 representing the road on which the vehicle 10 travels.

[0150] Here, the specific image 110 is an image generated from the viewpoint of observing the traveling vehicle 10 from a virtual viewpoint. This virtual viewpoint is set in a three-dimensional virtual space with the position of the own vehicle image 111 as the origin, and is defined by the viewpoint coordinates and the viewpoint angle (orientation) in the virtual space. As an example, this virtual viewpoint is a viewpoint observed from specific viewpoint coordinates on the rear side of the traveling direction of the own vehicle image 111 representing the traveling vehicle 10 at a specific viewpoint angle. As a function of the output control unit 51C, the CPU 51 of the control ECU 50 assumes observing the surroundings of the traveling vehicle 10 from this virtual viewpoint in the virtual space, generates the specific image 110, and causes the multimedia display 32B to display it. In addition, while the vehicle 10 is traveling, the CPU 51 also causes the multimedia display 32B to display an image representing the vehicle 10 and the surrounding conditions of the vehicle 10 from the same virtual viewpoint as the specific image 110.

[0151] In addition, text information 120 indicating an explanation regarding the specific image 110 is displayed above the specific image 110 on the multimedia display 32B. In Figure 16 , as the text information 120, an explanation regarding the specific image 110A, "Traveling on a highway." is displayed.

[0152] Figure 17 is the second display example shown on the meter display 32A. Specifically, as the explanatory information 100, Figure 17 a display example of the explanatory information 100B indicating the second explanation related to ACC is shown.

[0153] Figure 17 The explanatory information 100B shown is configured to include notification information 101B and image information 103A displayed on the right side of the notification information 101B.

[0154] The notification information 101B indicates a notification to the driver. For example, the notification information 101B uses text and images to notify the driver of various switches 40 that should be operated in order to proceed to the next explanatory information 100C (refer to Figure 18 ).

[0155] Figure 17 The image information 103A shown represents an image corresponding to the notification information 101B. This image information 103A is configured to include a steering wheel image 103B representing the steering wheel 70, a steering wheel cover image 103C representing the steering wheel cover 72, a switch image 103D representing the driving assistance switch 49, and a road image 103G representing the road on which the vehicle 10 is traveling, etc. In addition, this image information 103A is emphasized by being surrounded by a dotted line around the switch image 103D, indicating to the driver to operate this driving assistance switch 49.

[0156] Figure 18 This is the third display example shown on the instrument display 32A. Specifically, as the explanatory information 100, Figure 18 a display example of the explanatory information 100C indicating the third explanation related to ACC is shown.

[0157] Figure 18 The shown explanatory information 100C is configured to include the notification information 101C and the image information 103A displayed on the right side of the notification information 101C.

[0158] The notification information 101C represents a notification to the driver. For example, the notification information 101C uses text and images to notify the driver that the operations of various switches 40 have been correctly performed.

[0159] Figure 18 The shown image information 103A Figure 17 The shown image information 103A changes the display content of the switch image 103D. Specifically, Figure 18 The shown switch image 103D Figure 17 The shown switch image 103D changes from white to black, indicating that the driving assistance switch 49 has been operated.

[0160] In addition, Figure 18 The shown image information 103A Figure 17 The shown image information 103A adds a response image 103E indicating the response to the correct operation performed by the driver. As an example, the response image 103E is composed of an image representing the "pattern of the driving assistance switch 49" and the text "Very good".

[0161] Figure 19 This is the fourth display example shown on the instrument display 32A. Specifically, as the explanatory information 100, Figure 19 a display example of the explanatory information 100D indicating the fourth explanation related to ACC is shown.

[0162] Figure 19 The shown explanatory information 100D is configured to include the notification information 101D and the image information 103A displayed on the right side of the notification information 101D.

[0163] The notification information 101D represents a notification to the driver. For example, the notification information 101D uses text and images to notify the driver that ACC has worked correctly in the practice mode.

[0164] Figure 19 The shown image information 103A Figure 18The image information 103A shown displays a surrounding image 103F that hypothetically observes the surroundings of the traveling vehicle 10 from a virtual viewpoint, instead of the response image 103E. The surrounding image 103F represents an image showing the vehicle 10 and the surrounding conditions of the vehicle 10 from a viewpoint that observes from the same virtual viewpoint as the specific image 110 shown, etc. Figure 16 This is the 11th display example shown on the multimedia display 32B. Specifically,

[0165] Figure 20 This is the 11th display example shown on the multimedia display 32B. Specifically, Figure 20 represents the display example of the specific image 110B corresponding to the explanatory information 100B, 100C, 100D shown, etc. Figures 17 to 19 This is the display example of the specific image 110B corresponding to the explanatory information 100B, 100C, 100D shown, etc.

[0166] Figure 20 The specific image 110B shown is configured to include a self-vehicle image 111, a road image 112, other vehicle images 113, other vehicle images 114, and a stripe image 115.

[0167] The other vehicle image 113 represents other vehicles located on the front side in the traveling direction in the same lane as the self-vehicle image 111. The other vehicle image 114 represents other vehicles located on the front side in the traveling direction in the right lane of the self-vehicle image 111.

[0168] The stripe image 115 represents the inter-vehicle distance between the self-vehicle image 111 and the other vehicle image 113. In Figure 20 , by displaying two stripe images 115 in a rectangular shape between the self-vehicle image 111 and the other vehicle image 113, it is shown that the vehicle 10 travels while maintaining the inter-vehicle distance shown by the two stripe images 115 during the execution of ACC.

[0169] In addition, in Figure 20 , as the text information 120, the explanation about the specific image 110B, "Supports maintaining a constant inter-vehicle distance." is displayed.

[0170] Figure 21 This is the 5th display example shown on the instrument display 32A. Specifically, as the explanatory information 100, Figure 21 the display example of the explanatory information 100E representing the 5th explanation related to ACC is shown.

[0171] Figure 21 The explanatory information 100E shown is configured to include a notification information 101E and an image information 102A displayed on the right side of the notification information 101E.

[0172] The notification information 101E indicates a notification to the driver. For example, the notification information 101E uses text and images to notify the driver of the driving operations that the driver should perform in the practice mode and the various switches 40 that should be operated in order to enter the next explanatory information 100F (refer to Figure 23 ).

[0173] Figure 21 The image information 102A shown starts from Figure 15 The image information 102A shown displays a vehicle speed image 102E representing the vehicle speed that is different from the vehicle speed image 102B. Here, in the vehicle speed image 102E, the current vehicle speed is indicated as 58 km / h.

[0174] Figure 22 This is the 12th display example shown on the multimedia display 32B. Specifically, Figure 22 represents a display example of a specific image 110, namely the specific image 110C, corresponding to the explanatory information 100E shown in Figure 21 .

[0175] Figure 22 The specific image 110C shown is configured to include an own vehicle image 111, a road image 112, other vehicle images 113, other vehicle images 114, and a stripe image 115.

[0176] Figure 22 Compared with the specific image 110B shown in Figure 20 , the distance between the own vehicle image 111 and the other vehicle image 113 in the specific image 110C is shortened. This is because, as a function of the output control unit 51C, the CPU 51 of the control ECU 50 changes the specific image 110 shown on the multimedia display 32B according to the change of the explanatory information 100 shown on the meter display 32A. In the examples shown in Figure 20 and Figure 22 , it shows the situation where the distance between the own vehicle image 111 and the other vehicle image 113 is shortened based on the increase in vehicle speed before and after the execution of ACC in the practice mode.

[0177] In addition, in Figure 22 , as the text information 120, there is a display of an explanation about the specific image 110C, which is "Supports keeping the inter-vehicle distance constant."

[0178] Figure 23 This is the 6th display example shown on the meter display 32A. Specifically, as the explanatory information 100, Figure 23 it shows a display example of the explanatory information 100F representing the 6th explanation related to ACC.

[0179] Figure 23The illustrated explanatory information 100F is configured to include notification information 101F and image information 103A displayed to the right of the notification information 101F.

[0180] The notification information 101F represents a notification to the driver. For example, the notification information 101F uses text and images to notify the driver of various switches 40 that should be operated in order to enter the next explanatory information 100G (see Figure 24 ).

[0181] Figure 23 The illustrated image information 103A Figure 17 The illustrated image information 103A changes the display content of the road image 103G. Specifically, based on the execution of ACC in the practice mode, with respect to the Figure 17 illustrated road image 103G, Figure 23 the illustrated road image 103G has two stripe images 103H representing the inter-vehicle distance between the vehicle 10 and the vehicle ahead of the vehicle 10 added thereto.

[0182] In addition, Figure 23 the illustrated image information 103A is emphasized by being surrounded by a dotted line around the switch image 103D, instructing the driver to operate the driving assistance switch 49.

[0183] Figure 24 is the seventh display example shown on the instrument display 32A. Specifically, as the explanatory information 100, Figure 24 a display example of the explanatory information 100G representing the seventh explanation related to ACC is shown.

[0184] Figure 24 The illustrated explanatory information 100G is configured to include notification information 101G and image information 103A displayed to the right of the notification information 101G.

[0185] The notification information 101G represents a notification to the driver. For example, the notification information 101G uses text and images to notify the driver that the operation of various switches 40 has been correctly performed.

[0186] Figure 24 The illustrated image information 103A shows the same response image 103E as the Figure 18 illustrated image information 103A.

[0187] Figure 25 is the thirteenth display example shown on the multimedia display 32B. Specifically, Figure 25 it represents a display example of a specific image 110, namely the specific image 110D, corresponding to the explanatory information 100F and 100G shown in Figure 23 and Figure 24 illustrated.

[0188] Figure 25 The specific image 110D shown is configured to include an image 111 of its own vehicle, a road image 112, an image 113 of another vehicle, and an image 114 of another vehicle.

[0189] In Figure 25 the specific image 110D shown, from Figure 22 the stripe image 115 has been eliminated from the specific image 110C shown. In Figure 22 and Figure 25 the example shown, it shows the case where the stripe image 115 has been eliminated based on the end of ACC in the practice mode.

[0190] In addition, in Figure 25 , as the text information 120, there is displayed an explanation regarding the specific image 110D, "The driving assistance has ended for you."

[0191] Above, using Figures 15 to 25 , the output content related to the practice mode of the third embodiment has been described, but other output content than those shown above can also be output in this practice mode. For example, before starting the practice mode, the multimedia display 32B can also display the main screen shown in Figure 6 and Figure 7 the selection screen shown, etc. In addition, above, the road image 112 displayed on the multimedia display 32B is an image representing a straight road on which the vehicle 10 travels, but it can also be an image representing a curved road when the vehicle 10 travels on a curve. Furthermore, in the multimedia display 32B, after displaying the specific image 110D shown in Figure 25 for a certain period of time, it can also display output content indicating the end of the practice mode represented by text and images, etc.

[0192] Above, using Figure 16 , Figure 20 , Figure 22 and Figure 25 , the specific image 110 in the case where ACC is not being executed and in the case where ACC is being executed in the practice mode has been described. Specifically, as shown in the specific image 110A in Figure 16 and the specific image 110D in Figure 25 , when ACC is not being executed in the practice mode, by not displaying the stripe image 115 between the image 111 of its own vehicle and the image 113 of another vehicle, it shows that the vehicle 10 is in the state of manual driving. In addition, as shown in the specific image 110B in Figure 20 and Figure 22As shown in the specific image 110C, when the ACC is being executed in the practice mode, the stripe image 115 is displayed between the own vehicle image 111 and the other vehicle image 113, indicating that the vehicle 10 is in the autonomous driving state. Thus, the CPU 51 of the control ECU 50 makes the display content of the specific image 110 different according to whether the autonomous driving function or the driving assistance function is being executed in the practice mode. As another example, when a specific autonomous driving function that allows hands-off operation during traffic jams is being executed in the practice mode, the CPU 51 causes Figure 26 the specific image 110E shown to be displayed on the multimedia display 32B.

[0193] Figure 26 The specific image 110E shown is configured to include the own vehicle image 111, the road image 112, the other vehicle image 113, and the inter-vehicle distance image 116.

[0194] The inter-vehicle distance image 116 represents the inter-vehicle distance between the own vehicle image 111 and the other vehicle image 113 using five circles. In Figure 26 this case, by displaying the inter-vehicle distance image 116 between the own vehicle image 111 and the other vehicle image 113, it is indicated that during the execution of the above specific autonomous driving function, the vehicle 10 automatically travels while maintaining the inter-vehicle distance represented by the inter-vehicle distance image 116, enabling hands-off operation.

[0195] As described above, the CPU 51 of the control ECU 50 causes the meter display 32A to display the explanatory information 100 indicating explanations related to the autonomous driving function or the driving assistance function being executed in the practice mode. Moreover, the CPU 51 causes the multimedia display 32B to display the specific image 110 representing the vehicle 10 and the surrounding conditions of the vehicle 10 corresponding to the explanatory information 100 from the viewpoint of observing the traveling vehicle 10 from a virtual viewpoint. Thus, according to this control ECU 50, it is possible to provide information related to the practice mode to the driver using the two display devices 32.

[0196] In addition, the CPU 51 of the control ECU 50 changes the specific image 110 displayed on the multimedia display 32B according to the change in the explanatory information 100 displayed on the meter display 32A. Thus, according to this control ECU 50, it is possible to give a sense of unity to the display content of the two display devices 32 and improve the driver's interest in the practice.

[0197] (Other)

[0198] Regarding the practice mode described in the above embodiment, as long as a predetermined system of the vehicle 10 for executing the practice mode is started, it can be executed even in a state where the vehicle 10 cannot travel, that is, in a state where the power circuit for driving the vehicle 10 is not powered. As an example, the predetermined system is automatically started when the smart key of the vehicle 10 is inside the vehicle. Moreover, in the vehicle 10, based on the start of the predetermined system, the lock of the steering wheel 70 is released, or the various switches 40 can be operated. Thus, in the practice mode, the driver can operate the steering wheel 70, the various switches 40, etc.

[0199] In the above embodiment, the driver can interrupt and end the executing practice mode at an arbitrary timing by operating the predetermined various switches 40 during the execution of the practice mode.

[0200] In the above embodiment, the CPU 51 of the control ECU 50 may also use the output device 30 to recommend to the driver to execute the practice mode.

[0201] For example, the CPU 51 may also recommend executing the practice mode when the driving history record of the vehicle 10 has a specific tendency. Specifically, the CPU 51 may recommend executing the practice mode related to the autonomous driving function or the driving assistance function that can be executed when driving on the highway when the number of highway driving times per unit period reaches a predetermined number or more as a specific tendency.

[0202] In addition, the CPU 51 may also recommend executing the practice mode when the set navigation route of the vehicle 10 includes a specific route. Specifically, the CPU 51 may recommend executing the practice mode related to the autonomous driving function or the driving assistance function that can be executed when driving on the highway when the specific route includes the highway.

[0203] In addition, the CPU 51 may also recommend executing the practice mode when a specific operation of the various switches 40 is performed by the driver during the driving of the vehicle 10. Specifically, the CPU 51 may recommend executing the practice mode related to the driving assistance function A when the various switches 40 related to the execution of the driving assistance function A are operated in a state where the driving assistance function B that is a prerequisite for executing the driving assistance function A is not executed as a specific operation.

[0204] In the above-described embodiment, the CPU 51 that controls the ECU 50 may also impose a predetermined restriction on the autonomous driving functions and driving assistance functions that can be executed during the driving of the vehicle 10 according to the progress of the driver's practice in the practice mode. For example, the CPU 51 may also allow only the autonomous driving functions or driving assistance functions for which the practice in the practice mode has been completed to be executed during the driving of the vehicle 10, that is, in the real environment. Further, in a case where a new autonomous driving function or driving assistance function (hereinafter referred to as "new function") can be added to the vehicle 10, the CPU 51 may also allow the download of a program for executing the new function only after the practice in the practice mode related to the new function has been completed.

[0205] In the above-described embodiment, the CPU 51 that controls the ECU 50 may also give a special privilege to the driver according to the progress of the driver's practice in a plurality of practice modes. For example, the CPU 51 may also allow the vehicle 10 of a driver whose progress of the practice satisfies a predetermined criterion to add a new function at an earlier time than the vehicle 10 of a driver whose progress of the practice does not satisfy the predetermined criterion. Further, the CPU 51 may also prohibit the vehicle 10 of a driver whose progress of the practice does not satisfy the predetermined criterion from downloading a program for executing the new function until the predetermined criterion is satisfied.

[0206] In the above-described embodiment, the display device 32 is provided on the instrument panel 12, the center console 14, the instrument cluster 16, or the like. However, it is not limited thereto, and the display device 32 may also be a head-up display (HUD). In this case, the CPU 51 that controls the ECU 50 may display information related to the practice mode on the head-up display, or may also cause a plurality of display devices 32 such as the head-up display, the instrument display 32A, and the multimedia display 32B to display information related to the practice mode.

[0207] In the above-described embodiment, information related to the practice mode is output by the display device 32 in the output device 30. However, it is not limited thereto, and information related to the practice mode may also be output by a plurality of output devices 30 including the display device 32 and the speaker 34. Further, information related to the practice mode may also be output by output devices 30 not shown such as a lamp and a buzzer in addition to the display device 32 and the speaker 34. That is, the output device 30 that outputs information related to the practice mode is not particularly limited. Further, the output content of the information related to the practice mode is not particularly limited, and for example, as long as the driver can grasp that he / she has performed a correct operation or an incorrect operation, it may also be Figure 11A response information 10D and Figure 11B response information 10E different output content.

[0208] Here, use Figures 27A to 27D, an example of outputting information related to the practice mode from the speaker 34 as the output device 30 will be described. Figures 27A to 27D is a diagram obtained by adding the output content of the speaker 34 provided on the instrument panel 16 to the diagram showing the interior of the vehicle 10 as viewed from the driver's seat 18A. In Figure 2 the output content of the speaker 34 is represented by text inside the speech bubble 200. Figures 27A to 27D

[0209] First, Figure 27A the output content of the speaker 34 when the driver performs a correct operation for a predetermined operation is shown. In Figure 27A the text "Operation correct" is displayed inside the speech bubble 200 shown, indicating that the output content of the speaker 34 is the voice "Operation correct". Next, Figure 27B the output content of the speaker 34 when the driver performs an incorrect operation for a predetermined operation is shown. In Figure 27B the text "Operation incorrect" is displayed inside the speech bubble 200 shown, indicating that the output content of the speaker 34 is the voice "Operation incorrect".

[0210] In addition, the output content of the speaker 34 corresponding to whether the driver's input operation for a predetermined operation is correct or not is not limited to Figure 27A and Figure 27B the speech sounds shown, and can also be non-speech sounds. Figure 27C the output content of the speaker 34 when the driver performs a correct operation for a predetermined operation is shown. In Figure 27C the text "ding-dong (ping-pong)" is displayed inside the speech bubble 200 shown, indicating that the output content of the speaker 34 is the non-speech sound "ding-dong". Next, Figure 27D the output content of the speaker 34 when the driver performs an incorrect operation for a predetermined operation is shown. In Figure 27D the text "boo" is displayed inside the speech bubble 200 shown, indicating that the output content of the speaker 34 is the non-speech sound "boo".

[0211] In the above-described embodiment, as a combination of images representing a response to a correct operation by the driver and a response to an incorrect operation, an example is Figure 11A the image representing the "appreciative gesture" of the response information 10D shown in Figure 11B and the image representing the "cross mark" of the response information 10E shown in. However, the combination of these images is not limited to this, and various images can be combined. For example, as shown in Figure 28As shown in Style P1, the image indicating the response to the correct operation by the driver can be an image representing a "tick (check mark)", and the image indicating the response to the incorrect operation can be an image representing a "cross". Additionally, as Figure 28 shown in Style P2 of

[0212] , the image indicating the response to the correct operation by the driver can be an image representing a "circle", and the image indicating the response to the incorrect operation can be an image representing a "cross". At this time, the image indicating the response to the correct operation by the driver can also be represented in a color reminiscent of a correct answer, such as green, and the image indicating the response to the incorrect operation can be represented in a color reminiscent of an incorrect answer, such as red. Figure 29A and Figure 29B will be used for the following explanation.

[0213] Figure 29A is the 14th display example shown on the multimedia display 32B. Figure 29A represents the state after the driver has performed a correct operation on the predetermined operation indicated in the Figure 10 shown screen, specifically, the operation of the driving assistance switch 49. In Figure 29A , response information 10G is displayed above the switch image 10C. As an example, the response indicated by the response information 10G is a response that executes a glittering animation using an image representing a "star". In Figure 29A , by emphasizing the switch image 10C through the animation based on the response information 10G, it is shown that the driver has performed a correct operation.

[0214] Figure 29B is the 15th display example shown on the multimedia display 32B. Figure 29B represents the state after the driver has performed an incorrect operation on the operation of the driving assistance switch 49 indicated in the Figure 10 shown screen. In Figure 29B , response information 10H is displayed around the switch image 10C. As an example, the response indicated by the response information 10H is a response in which an image representing a "dotted box" flashes in a predetermined color (e.g., red). In Figure 29B , by flashing the response information 10H in a predetermined color to emphasize the switch image 10C, it is shown that the driver has performed an incorrect operation.

[0215] In the above-described embodiment, the CPU 51 of the control ECU 50 causes the meter display 32A to display the explanatory information 100 and causes the multimedia display 32B to display the specific image 110. However, it is not limited thereto, and the CPU 51 may also cause the multimedia display 32B to display the explanatory information 100 and cause the meter display 32A to display the specific image 110. That is to say, the display device 32 for displaying the explanatory information 100 and the specific image 110 is not particularly limited.

[0216] In the above-described embodiment, the practice mode can practice both the autonomous driving function and the driving assistance function of the vehicle 10. However, it is not limited thereto, and the practice mode may be able to practice only the autonomous driving function or may be able to practice only the driving assistance function.

[0217] In the above-described embodiment, the control ECU 50 executes Figure 13 the specific process shown. However, it is not limited thereto, and the specific process may also be executed in cooperation with the control ECU 50 and other ECUs.

[0218] In addition, in the above-described embodiment, the specific process executed by the CPU 51 by reading software (program) may also be executed by various processors other than the CPU. Examples of the processor in this case include PLDs (Programmable Logic Devices) such as FPGAs (Field-Programmable Gate Arrays) that can change the circuit structure after manufacturing, and dedicated electrical circuits such as ASICs (Application Specific Integrated Circuits) that are processors having a circuit structure specifically designed to execute specific processes. In addition, the specific process may be executed by one of these various processors, or may be executed by a combination of two or more processors of the same type or different types (for example, a combination of multiple FPGAs, and a combination of a CPU and an FPGA, etc.). More specifically, the hardware configuration of these various processors is an electrical circuit formed by combining circuit elements such as semiconductor elements.

[0219] In addition, in the above-described embodiment, the technical solution in which the information processing program 52A is pre-stored (installed) in the ROM 52 has been described, but it is not limited thereto. The information processing program 52A may also be provided in a form recorded on a non-transitory storage medium such as a CD-ROM (Compact Disk ReadOnly Memory), a DVD-ROM (Digital Versatile Disk Read Only Memory), and a USB (Universal Serial Bus) memory. In addition, the information processing program 52A may be configured to be downloaded from an external device via the network N.

Claims

1. An information processing device, comprising a control unit that executes a practice mode for practicing at least one of an automatic driving function and a driving assistance function of a vehicle, and causes an output device to output output content corresponding to whether a user input operation for a predetermined operation indicated in the practice mode is correct or not, the predetermined operation being an operation related to the execution of the automatic driving function or the driving assistance function.

2. The information processing device according to claim 1, wherein the control unit causes the output device to output progress information indicating the progress of the user's practice in the practice mode being executed.

3. The information processing device according to claim 1, wherein the control unit causes problem information indicating a problem related to the predetermined operation to be displayed on a display device as the output device in the practice mode, and ends or continues the practice mode according to whether the answer of the user to the problem indicated by the problem information is correct or not.

4. The information processing device according to claim 1, wherein the control unit causes progress information indicating the progress of the user's practice in the automatic driving function and the driving assistance function in which the practice mode can be executed to be displayed in a list form on a display device as the output device.

5. The information processing device according to claim 1, wherein the control unit causes each selection icon among a plurality of selection icons displayed on a display device as the output device for selecting the automatic driving function or the driving assistance function for executing the practice mode to display progress information indicating the progress of the user's practice in the automatic driving function or the driving assistance function corresponding to the selection icon.

6. The information processing device according to claim 1, wherein the control unit causes a first display device as the output device to display explanation information indicating an explanation related to the automatic driving function or the driving assistance function for which the practice mode is being executed, and causes a second display device different from the first display device and serving as the output device to display a specific image representing the vehicle and the surrounding conditions of the vehicle corresponding to the explanation information from a viewpoint of observing the vehicle in motion from a virtual viewpoint.

7. The information processing device according to claim 6, wherein the control unit changes the specific image displayed on the second display device according to a change in the explanation information displayed on the first display device.

8. An information processing method, in which a processor executes the following processing: Executing a practice mode for practicing at least one of an automatic driving function and a driving assistance function of a vehicle, and causing an output device to output output content corresponding to whether a user input operation for a predetermined operation indicated in the practice mode is correct or not, the predetermined operation being an operation related to the execution of the automatic driving function or the driving assistance function.

9. A computer program product, including an information processing program, which, when executed by a processor, implements the following processing: Execute a practice mode for practicing at least either the autonomous driving function or the driving assistance function of a vehicle, and output from an output device output content corresponding to whether a user input operation for a predetermined operation indicated in the practice mode is correct or not, where the predetermined operation is an operation related to the execution of the autonomous driving function or the driving assistance function.

Images