Information processing device and program
The information processing device clarifies driving assistance system operations by displaying vehicle behavior videos and additional information, addressing driver discomfort and misunderstandings.
Patent Information
- Application Number
- JP2021039455
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-03-11
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2041-03-11
AI Technical Summary
Drivers may feel uncomfortable or suspect malfunctions when driving assistance systems activate without clear understanding, leading to misunderstandings during vehicle inspections.
An information processing device that acquires operation and motion history information from the vehicle, displaying behavior information including videos that reproduce the vehicle's behavior during driving assistance activation, along with supporting display controls to clarify the system's status.
Provides a clear and visually understandable explanation of the driving support system's operation, resolving driver misunderstandings and clarifying system status through detailed video reproductions and additional information displays.
Smart Images

Figure 0007579724000001 
Figure 0007579724000002 
Figure 0007579724000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device and a program. [Background technology]
[0002] There is known a technology for storing information about a vehicle while it is being driven in the vehicle, and utilizing the stored information during inspection and maintenance (Patent Document 1, etc.). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Publication No. 3-28045 Summary of the Invention [Problem to be solved by the invention]
[0004] With the development of vehicle driving assistance systems, various assistance functions such as automatic braking, automatic steering, and warning alerts are provided to drivers, contributing to improved vehicle safety. However, when a driving assistance function is activated, the driver may not immediately recognize the cause of the activation, and may feel uneasy about the activation of the driving assistance function. A driver who feels uneasy may think that the vehicle is broken and may ask for an explanation from the vehicle dealer.
[0005] The dealer's staff will determine the status of the driving assistance system based on the information stored in the vehicle, and if it is normal, they will explain to the driver that there is nothing wrong with it. However, because the explanation includes technical content, it may be difficult for the driver to understand just from a verbal explanation or a written document that lists the technical matters.
[0006] An object of the present invention is to provide a tool that can explain the operating status of a driving assistance system in a more understandable manner. [Means for solving the problem]
[0007] According to the present invention, An acquisition means for acquiring operation history information of a driving assistance system of a vehicle and motion history information of the vehicle from the vehicle; and a display control means for displaying, on a display device, behavior information indicating the behavior of the vehicle over time in a situation in which the driving assistance is activated, based on the operation history information and the motion history information acquired by the acquisition means. picture, The behavior information includes a video reproducing the behavior of the vehicle. The present invention provides an information processing apparatus comprising: Effect of the Invention
[0008] According to the present invention, a tool can be provided that can explain the operating status of a driving assistance system in a more easily understandable manner. [Brief description of the drawings]
[0009] [Figure 1] 1 is a block diagram showing an example of an information processing device according to an embodiment of the present invention and a vehicle from which information is acquired; [Diagram 2] 1A to 1C are explanatory diagrams showing an example of driving assistance. [Diagram 3] 4 is a flowchart showing an example of processing performed by the information processing device in FIG. 1; [Figure 4] FIG. 11 is a diagram showing a display example of behavior information. [Diagram 5] FIG. 11 is a diagram showing a display example of behavior information. [Figure 6] FIG. 11 is a diagram showing a display example of behavior information. [Figure 7] FIG. 11 is a diagram showing a display example of behavior information. [Figure 8] FIG. 11 is a diagram showing a display example of behavior information. [Figure 9] FIG. 11 is a diagram showing a display example of behavior information. [Figure 10] FIG. 11 is a diagram showing a display example of behavior information. [Figure 11] FIG. 11 is a diagram showing a display example of behavior information. [Figure 12] FIG. 11 is a diagram showing a display example of behavior information. [Figure 13]FIG. 4 is a diagram showing an example of display of map information. [Figure 14] FIG. 13 is a diagram showing a display example of behavior information. [Figure 15] FIG. 13 is a diagram showing a display example of behavior information. [Figure 16] FIG. 13 is a diagram showing a display example of behavior information. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims, and not all combinations of features described in the embodiments are essential to the invention. Two or more features among the multiple features described in the embodiments may be arbitrarily combined. In addition, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.
[0011] First Embodiment FIG. 1 is a block diagram showing an example of an information processing device 1 according to an embodiment of the present invention and a vehicle V from which information is to be acquired. As an example, the vehicle V is a four-wheeled sedan-type passenger car. The vehicle V includes a control unit 7. The control unit 7 includes a processor such as a CPU, a storage device such as a semiconductor memory, an interface with an external device, etc. The storage device stores programs executed by the processor, data used by the processor for processing, etc. The control unit 7 may include a plurality of processors, storage devices, interfaces, etc.
[0012] The control unit 7 can recognize the driving environment of the vehicle V based on the detection results of the detection units 10A to 10D that detect the surrounding conditions of the vehicle V. In the present embodiment, the detection unit 10A is a camera that captures the front of the vehicle V, and the detection unit 10B is a camera that captures the rear of the vehicle V. By analyzing the images captured by the detection units 10A and 10B, it is possible to extract the contours of targets and lane markings (white lines, etc.) on the road. The detection unit 10C is a millimeter wave radar that detects targets in front of the vehicle V and measures the distance to the target. The detection unit 10D is an ultrasonic sensor that detects targets behind the vehicle V and measures the distance to the target. As the detection units 10A to 10D, sensors other than cameras, millimeter wave radars, and ultrasonic sensors can also be used, and their arrangements and detection ranges can also be designed appropriately.
[0013] The control unit 7 can also acquire the detection results of an inertial sensor 11, a wheel speed sensor 12, an accelerator pedal sensor 13, and a brake pedal sensor 14. The inertial sensor 11 includes, for example, an acceleration sensor, a yaw rate sensor, etc., and can calculate, for example, the attitude of the vehicle V based on the detection results, and can calculate, for example, the speed of the vehicle V based on the wheel speed sensor 12. The detection results of the accelerator pedal sensor 13 and the brake pedal sensor 14 can calculate the amount of accelerator operation and the amount of brake operation by the driver, respectively.
[0014] The control unit 7 is capable of controlling a drive source 17, a braking device 18, and an electric power steering 19. The drive source 17 includes, for example, an internal combustion engine and an automatic transmission, and the control unit 7 is capable of controlling the acceleration and deceleration of the vehicle V by controlling the drive source 17. The braking device 18 is, for example, a disc brake device, and the control unit 7 is capable of controlling the brakes of the vehicle V by the braking device 18.
[0015] The electric power steering 19 is a mechanism for steering the front wheels in response to the driver's driving operation (steering operation) to the steering wheel. Gu 1Reference numeral 9 includes a motor that generates a driving force for assisting the steering operation (sometimes called steering assist torque), a steering angle sensor, a torque sensor that detects the steering torque borne by the driver, etc. The control unit 7 can control the steering of the vehicle V by the electric power steering 19, and can also calculate the amount of steering by the driver.
[0016] The control unit 7 can also control a sound output device 15 and a meter panel 16. The sound output device 15 can notify the driver with a warning sound, etc. The meter panel 16 can display various information.
[0017] The control unit 7 constitutes a driving assistance system. As driving assistance, the control unit 7 can perform, for example, collision mitigation braking, lane departure prevention, parking assistance, etc. FIG. 2(A) is an explanatory diagram of the collision mitigation braking. The collision mitigation braking is an automatic brake, and when an obstacle 100 is detected in front of the vehicle V by the detection units 10A and 10C and the control unit 7 predicts a collision between the obstacle 100 and the vehicle V, the control unit 7 issues an alert by the sound output device 15 or operates the brake device 18 to decelerate the vehicle V.
[0018] 2B is an explanatory diagram of lane departure prevention. The lane departure prevention is an automatic steering, and the control unit 7 issues a warning by the sound output device 15 or operates the electric power steering when the possibility of the vehicle V departing from the driving lane increases. Gu 1 9 to steer the vehicle V so that the vehicle V stays within the driving lane. Fig. 2(C) is an explanatory diagram of parking assistance. The control unit 7 recognizes the parking space 102 from the detection results of the detection units 10A and 10B, and controls the drive source 17 and the electric power steering 19 to move the vehicle V to the parking space 102.
[0019] The control unit 7 stores such driving assistance operation history information, as well as vehicle V motion history information and operation history information for a certain period before and after the operation in an internal storage device (drive recorder). The operation history information includes all past driving assistance that was operated without the driver's instruction, such as collision mitigation braking and lane departure prevention, and past driving assistance that was started by the driver's instruction but not completed, such as when parking assistance was stopped midway. The operation history information is stored in association with, for example, the total mileage of the vehicle V, and includes information related to the driving assistance (operation trigger, operation timing, control amount, etc.). The motion history information is information related to the motion of the vehicle V, and includes vehicle speed, acceleration, deceleration, angular velocity, steering angle, control amount of the drive source 17, etc. The operation history information is information related to the driver's driving operation (accelerator operation amount, brake operation amount, steering angle, etc.).
[0020] Returning to FIG. 1, the information processing device 1 is communicatively connected to the control unit 7 via a communication adapter 8, and is capable of reading and acquiring the operation history information, exercise history information, and operation history information stored in the control unit 7. The information processing device 1 includes a processing unit 2, a storage unit 3, and an interface 4 between an external device and the processing unit 2. The processing unit 2 is a processor represented by a CPU, and executes a program stored in the storage unit 3. The storage unit 3 is a storage device such as a RAM, a ROM, or a hard disk. The storage unit 3 stores various data in addition to the program executed by the processing unit 2. The various data include data used to display behavior information, which will be described later. The program executed by the processing unit 2 can also be installed in the information processing device 1 using a storage medium such as a CD-ROM.
[0021] A display device 5 and an input device 6 are connected to the information processing device 1. The display device 5 is, for example, a liquid crystal display device, and the information processing device 1 displays behavior information, which will be described later, on the display device 5. The input device 6 is a mouse, a keyboard, or the like, and the information processing device 1 is capable of receiving instructions from an operator inputted to the input device 6. The information processing device 1, the display device 5, and the input device 6 may be a desktop personal computer, a notebook personal computer, or a tablet equipped with a touch panel.
[0022] <Processing example> An example of processing by the information processing device 1 will be described. During inspection and maintenance of the vehicle V, the information processing device 1 is connected to a control unit 7 of the vehicle V via a communication adapter 8. FIG. 2 1 is a flowchart showing an example of processing executed by the information processing device 1. In S1, the information processing device 1 acquires history information (the above-mentioned operation history information, exercise history information, and operation history information) stored in the control unit 7 from the control unit 7 through communication between the information processing device 1 and the control unit 7.
[0023] In S2, the acquired history information is analyzed, and information to be displayed on the display device 5 is generated. In S3, display control is executed to display the information generated in S2 on the display device 5. The display in S3 is not only for the service staff of the vehicle dealer to check the condition of the vehicle V, but also for the owner of the vehicle V to request the owner of the vehicle V to display the vehicle V's status. driving The display includes a display for explaining the operation of the driving assistance. If the owner of the vehicle V feels something is wrong with the operation of the driving assistance in the past, the owner may request an explanation. The service staff uses the display on the display device 5 to provide an explanation to the owner.
[0024] FIG. 4 shows an example of a display on the display device 5, illustrating an example of behavior information 21 that indicates the behavior of the vehicle V over time in a situation where driving assistance is activated.
[0025] The behavior information 21 includes a total mileage display area 22. As described above, in this embodiment, the operation history information is associated with the total mileage of the vehicle V. distance The display area 22 displays a list of the distance traveled when driving assistance was activated, and the user can select from this list the information on past driving assistance that the user wishes to reproduce.
[0026] For example, the service staff, through a dialogue with the owner, finds out the approximate mileage when the driving assistance was activated, which the owner is requested to explain, and selects one mileage that is close to the mileage found out from the total mileage display area 22. In the illustrated example, the history of a mileage of 1,352 km is selected by the cursor 22a. When the mileage is selected, the corresponding history information is confirmed.
[0027] The behavior information 21 includes a setting display area 23. The setting display area 23 shows various settings of the vehicle V when driving assistance is activated. In the illustrated example, the "alarm distance setting" is normal, "lane keeping control" is OFF (not activated), and "auto cruise" is OFF. The "alarm distance setting" is a setting of a predetermined distance length when an obstacle approaches the vehicle V within a predetermined distance and the driver is notified of this. The "lane keeping control" is the same as the lane departure prevention described above, and when this is OFF, driving assistance related to lane departure prevention is not executed. The "auto cruise" is an automatic following control for a preceding vehicle, and when this is OFF, it does not operate.
[0028] The behavior information 21 includes a reproduction video display area 24 that displays a video that reproduces the behavior of the vehicle V. In this embodiment, the behavior of the vehicle V over time is displayed as a video as the behavior information. In the illustrated example, a vehicle image VI corresponding to the vehicle V is displayed in a planar view, and a video that shows an overhead view of the behavior of the vehicle V is displayed. The vehicle image VI may be a photographic image of the actual vehicle. The display at the stage of FIG. 4 is an initial display before reproduction begins, and when the play button 21a is selected, reproduction using a video begins, and when the stop button 21b is selected, the video stops.
[0029] The behavior information 21 includes an assistance content display area 25. Information indicating the type of driving assistance that has been activated is displayed in the assistance content display area 25. This information is displayed at a timing that corresponds to the actual activation timing in accordance with the reproduced video displayed in the reproduced video display area 24, and is not displayed in the illustrated example.
[0030] The behavior information 21 includes a meter reproduction area 26. An image reproducing the display content of the meter panel 16 when the driving assistance is activated is displayed in the meter reproduction area 26. In the illustrated example, it is shown that the shift range of the automatic transmission of the drive source 17 is the D range, and the vehicle speed is 53 km / h.
[0031] The behavior information 21 includes an operation display area 27. The operation display area 27 displays information indicating the driving operation of the driver when the driving assistance is activated. In the illustrated example, the accelerator operation amount is displayed by a level meter 30. 30 The throttle opening of the internal combustion engine (control information for the internal combustion engine) is displayed in the steering information 29, which uses an icon showing a steering wheel to display the amount of steering by the driver or the amount of automatic steering by driving assistance. The brake information 28 uses an icon showing a brake pedal to display whether or not the driver is operating the brakes or whether or not automatic braking is activated by driving assistance.
[0032] Changes in the display of the behavior information 21 after the playback button 21a is operated will be described with reference to Figs. 5 to 8. The behavior display of the vehicle image VI is controlled based on the motion history information. Fig. 5 shows the stage before the driving assistance is activated. The vehicle image VI is moving forward. The driving trajectory 24a shows the trajectory of the movement of the vehicle image VI (i.e., the vehicle V). At this stage, an icon 26b that calls attention to the preceding vehicle is displayed in the meter reproduction area 26. In other words, it can be understood that the proximity of the preceding vehicle was detected by the detection units 10A and 10C at this timing during the actual driving of the vehicle V.
[0033] FIG. 6 shows a stage after some time has passed since the state of FIG. 5. The vehicle image VI is moving forward, but there is no braking operation, and the display on the level meter 30 (amount of accelerator operation) remains unchanged. At this stage, the assistance content display area 25 shows carInformation 25a is displayed indicating that a warning has been issued to alert the driver of the preceding vehicle. In addition to an icon 26b for alerting the driver of the preceding vehicle, an icon 26c for indicating that a notification is being issued is displayed in the meter reproduction area 26. In other words, it can be understood that, during the actual traveling of the vehicle V, driving assistance has been performed at this timing to alert the driver of the approach to the preceding vehicle.
[0034] FIG. 7 shows a stage after some time has passed since the state of FIG. 6. The vehicle image VI is moving forward while the brakes are being applied. At this stage, the assistance content display area 25 shows car In addition to information 25a indicating that an alarm calling for attention to the collision has been activated, information 25b indicating that automatic braking (collision mitigation braking) has been activated is displayed. Also, the vehicle speed display in the meter reproduction area 26 indicates that the vehicle speed is decreasing, and the display (amount of accelerator operation) of the level meter 30 indicating the throttle opening is decreasing (the output of the internal combustion engine is reduced by control), although there is no change in the display (amount of accelerator operation) of the level meter 30 indicating the throttle opening. In the operation display area 27, information 28a indicating that automatic braking has been activated is displayed adjacent to the brake information 28. In other words, it can be understood that driving assistance by the operation of the automatic brake has been performed during the actual traveling of the vehicle V.
[0035] FIG. 8 shows a stage after the driving assistance has ended after time has passed since the state of FIG. 7. The vehicle image VI moves forward and turns slightly to the right. Displays related to driving assistance have disappeared from the assistance content display area 25, the meter reproduction area 26, and the operation display area 27. In the operation display area 27, steering information 29 indicates that the driver is steering to the right. An automatic brake operation section 24b is displayed on the driving trajectory 24a. From the display of FIG. 8, it can be inferred that in the actual driving of the vehicle V, after the automatic brake is activated, the vehicle V continues to drive without colliding with the preceding vehicle.
[0036] By presenting the above-mentioned behavior information 21 to the owner of the vehicle V who has requested an explanation, the operating status of the driving assistance system can be explained more clearly, and misunderstandings such as malfunctions and breakdowns can be cleared up. In particular, by displaying a video that reproduces the behavior of the vehicle V in the reproduction video display area 24, a visually easy-to-understand explanation can be provided. In addition to the reproduction video, information regarding the operating status of the vehicle V when the driving assistance is activated and the driver's operating status is also displayed, so that the owner of the vehicle V can more clearly understand the relationship between the operating status of the driving assistance system and his or her own driving operation, etc.
[0037] Second Embodiment In the first embodiment, the behavior of the vehicle V is displayed as a video, but in the present embodiment, a tool capable of displaying reference information about the driving environment of the road on which the vehicle V was traveling when the driving assistance was activated will be described. This makes it easier for the owner of the vehicle V who receives the explanation to intuitively recognize the situation that triggered the activation of the driving assistance.
[0038] 9 is a display example of the display device 5. In this embodiment, as an optional function of the behavior information 21 described in FIGS. 4 to 8, an editing function capable of displaying various items in the reproduced moving image display area 24 is provided.
[0039] The item area 32 lists items that can be displayed in the reproduced moving image display area 24. Item 32a is an icon indicating an automobile, item 32b is an icon indicating a pedestrian, and item 32c is an icon indicating a bicycle and rider. Item 32d is an icon indicating a roadside tree, item 32e is an icon indicating an intersection, and item 32f is an icon indicating a road. The operator selects an item from the item area 32 using the input device 6, and then performs a drag operation or the like on the reproduced moving image display area 24, whereupon the selection is accepted and displayed in the reproduced moving image display area 24.
[0040] A free drawing tool 33a, an eraser tool 33b, and a trash can tool 33c are displayed in the editing area 33. By selecting the free drawing tool 33a with the input device 6, the operator can freely draw a line drawing in the reproduced moving image display area 24. The eraser tool 33b is a tool for deleting the free drawing drawn in the reproduced moving image display area 24, and the trash can tool 33c is a tool for deleting an icon selected from the item area 32 and displayed in the reproduced moving image display area 24.
[0041] The service staff asks the owner about the driving environment of the road on which the vehicle V was traveling when the driving assistance was activated, and performs editing operations on the reproduced video display area 24 using the items in the item area 32 and the tools in the editing area 33. FIG. 10 shows an example of the display after editing, in which a still image of the driving environment is displayed superimposed on the reproduced video display area 24. By operating the play button 21a, it is also possible to play the reproduced video of the vehicle image VI exemplified in FIGS. 5 to 8 (the still image of the driving environment remains the same). By proceeding with the dialogue between the service staff and the owner while referring to such displays, it is possible to deepen understanding of the activation trigger of the driving assistance, etc., and to clear up misunderstandings such as malfunctions and breakdowns.
[0042] <Third embodiment> In the second embodiment, a still image drawn by the operator is displayed in a superimposed manner as reference information about the road driving environment, but map information may also be displayed in a superimposed manner. Fig. 11 is a display example of the display device 5 showing an example of such a case. In this embodiment as well, an editing function capable of displaying map information in the reproduced moving image display area 24 is provided as an optional function of the behavior information 21 described in Figs. 4 to 8.
[0043] An image of an aerial photograph is displayed as map information in the map display area 34. The image of the aerial photograph may be stored in advance in the storage unit 3, or may be acquired by the information processing device 1 from a server providing map information via a network such as the Internet. The operator selects the display range from the map display area 34 with a frame 34a using the input device 6, and then performs a drag operation or the like in the reproduced animation display area 24, whereby the selection is accepted and the image of the frame 34a is displayed in the reproduced animation display area 24. The area of the map displayed in the map display area 34 can be changed by inputting area information in the input box 35.
[0044] The service staff asks the owner about the location on the road where the vehicle V was traveling when the driving assistance was activated, inputs the location information in the input box 35, selects map information from the map display area 34, and displays it in the reproduced video display area 24. 12 shows an example of the display after map information is selected, in which an aerial photograph image 24c is displayed superimposed on the reproduced video display area 24. By operating the play button 21a, it is also possible to play the reproduced video of the vehicle image VI exemplified in Figs. 5 to 8 (the aerial photograph image 24c remains unchanged). By proceeding with the dialogue between the service staff and the owner while referring to such a display, it is possible to deepen understanding of the operating triggers of the driving assistance, etc., and to clear up any misunderstandings such as malfunctions or breakdowns.
[0045] As another method for displaying map information superimposed on the reproduced moving image display area 24, a method can be adopted in which the background of the reproduced moving image display area 24 can be selectively made transparent and the map information can be displayed as the background. Figures 13 to 15 show one example.
[0046] Fig. 13 shows an example of the display of map information as a background. In the illustrated example, a window 40 of an Internet browser or the like is shown. The window 40 displays map information (aerial photographs, etc.) provided on the Internet. The operator can change the location displayed in the window 40 and perform zooming in and out as desired.
[0047] A window of behavior information 21 is overlapped on this window 40. Figure 14 shows an example. At the stage of Figure 14, reproduced animation display area 24 is in a non-transparent state. Therefore, the map information of window 40 behind is not displayed. In the illustrated example, a pattern is added to behavior information 21 in order to visually make the overlapping relationship between the two easier to understand.
[0048] The behavior information 21 is provided with a transparent selection button 21c. When the operator operates the transparent selection button 21c, the reproduced moving image display area 24 becomes transparent as shown in Fig. 15, and the map information in the window 40 behind it is displayed. In this state, within the frame of the reproduced moving image display area 24, the operator can arbitrarily change the point displayed in the window 40 and perform zooming in and out operations. In addition, by operating the play button 21a, it is also possible to play the reproduced moving image of the vehicle image VI exemplified in Figs. 5 to 8 (the map information remains displayed).
[0049] A video recreating this display By making it possible to select between a transparent state and a non-transparent state of the area 24, it becomes possible to display map information from a variety of sources in the background.
[0050] <Fourth embodiment> In the above-described embodiments, the case where the collision mitigation brake is activated as the driving assistance is illustrated, but the above-described embodiments can be applied to other types of driving assistance. In this embodiment, a display example in the case where the parking assistance is activated as the driving assistance but is not completed will be described.
[0051] 16 shows a display example of the display device 5, and shows an example of the behavior information 21 in this embodiment. In the support content display area 25, "Parking mode" indicating parking support is displayed as information indicating the type of driving support that has been activated, and in particular, "Right parallel space parking" is displayed, indicating that parallel parking will be performed automatically.
[0052] The behavior information 21 includes an operation result display area 36, and displays the reason why the parking assistance was not completed (reason for cancellation). In the illustrated example, the reason displayed is that parking was not completed within a specified time.
[0053] In the reproduced video display area 24, an image FI of a parking space assumed during parking assistance is displayed. Playback of the video is started by operating the play button 21a. In the illustrated example, it is assumed that a video is played in which a vehicle image VI moves from the position indicated by the dashed line to the position indicated by the solid line. The position indicated by the solid line is the position where parking assistance for the vehicle V is stopped.
[0054] In this embodiment, too, by presenting the behavior information 21 to the owner of the vehicle V who has requested an explanation, the operating status of the driving assistance system can be explained in a more understandable manner, and misunderstandings such as malfunctions and breakdowns can be cleared up. In particular, by displaying a video that reproduces the behavior of the vehicle V in the reproduced video display area 24, a visually easy-to-understand explanation can be provided, and by also displaying the parking space image FI, the situation at the time can be confirmed between the serviceman and the owner, and the owner can deepen his / her understanding of the system.
[0055] <Fifth embodiment> In the first to fourth embodiments, the behavior information 21 includes a replay video display area 24 and displays a replay video of the behavior of the vehicle V, but instead, other display forms may be used, such as displaying the changes over time of each parameter included in the motion history information as a bar graph, line graph, etc.
[0056] <Summary of the embodiment> The above embodiment discloses at least the following information processing device, program, and storage medium.
[0057] 1. The information processing device (1) of the above embodiment is An acquisition means (2, S1) for acquiring operation history information of a driving assistance by a driving assistance system (7) of a vehicle (V) and motion history information of the vehicle from the vehicle; and a display control means (2, S3) for causing a display device (5) to display behavior information (21) indicating the behavior of the vehicle over time in a situation where the driving assistance is activated, based on the operation history information and the motion history information acquired by the acquisition means. According to this embodiment, a tool can be provided that can explain the operating status of the driving assistance system in a more easily understandable manner.
[0058] 2. In the above embodiment, The behavior information includes a video (24) that reproduces the behavior of the vehicle. According to this embodiment, a visually easy-to-understand explanation can be given.
[0059] 3. In the above embodiment, The video is a video (24) that shows an overhead view of the vehicle's behavior. According to this embodiment, a visually easy-to-understand explanation can be given.
[0060] 4. In the above embodiment, The display control means causes the display device to display the video superimposed on map information (FIGS. 12 and 15). According to this embodiment, the operating status of the driving assistance system can be explained more clearly while taking into account the driving environment of the road.
[0061] 5. In the above embodiment, The acquisition means acquires operation history information of a driver of the vehicle, The display control means Together with the video, information (27) showing the driving operation of the driver in a situation where the driving assistance was activated is displayed based on the operation history information. According to this embodiment, the relationship between the operating status of the driving assistance system and the driving operation of the driver can be explained more clearly.
[0062] 6. In the above embodiment, The motion history information includes a vehicle speed and a steering angle of the vehicle. The operation history information includes information regarding the driver's accelerator operation, brake operation, and steering operation. According to this embodiment, the vehicle behavior can be reproduced more accurately, and the relationship with the driver's driving operation can be explained more clearly.
[0063] 7. In the above embodiment, The display control means Together with the video, information (25) indicating the type of driving assistance is displayed at the timing when the driving assistance is activated (FIGS. 6 and 7). According to this embodiment, it is possible to deepen understanding of the trigger for activation of the driving assistance system.
[0064] 8. The information processing device of the above embodiment is a reception means (32) for receiving a selection of an item indicating a driving environment of a road on which the vehicle was traveling when the driving assistance was activated, The display control means The items selected and accepted by the accepting means are displayed together with the video (FIG. 10). According to this embodiment, the operating status of the driving assistance system can be explained more clearly while taking into account the driving environment of the road.
[0065] 9. In the above embodiment, The driving assistance includes at least one of automatic braking (FIG. 2(A)), automatic steering (FIG. 2(B)), and notification to the driver (15). According to this embodiment, the operating status of the driving assistance system that may cause the driver to feel uncomfortable can be explained in a more understandable manner.
[0066] 10. In the above embodiment, The driving assistance includes parking assistance for the vehicle (FIG. 2(C)); The video during the parking assistance includes an image (FI) showing a parking space (FIG. 16). According to this embodiment, the operating status of the parking assistance can be explained more clearly.
[0067] 11. The program of the above embodiment (FIG. 3) A computer (2), An acquisition means (2, S1) for acquiring operation history information of a driving assistance by a driving assistance system (7) of a vehicle (V) and motion history information of the vehicle from the vehicle; A display control means (2, S3) for displaying, on a display device (5), behavior information (21) indicating the behavior of the vehicle over time in a situation in which the driving assistance is activated, based on the operation history information and the motion history information acquired by the acquisition means; Function as. According to this embodiment, a tool can be provided that can explain the operating status of the driving assistance system in a more easily understandable manner.
[0068] 12. The storage medium of the above embodiment is A computer (2), An acquisition means (2, S1) for acquiring operation history information of a driving assistance by a driving assistance system (7) of a vehicle (V) and motion history information of the vehicle from the vehicle; A display control means (2, S3) for displaying, on a display device (5), behavior information (21) indicating the behavior of the vehicle over time in a situation in which the driving assistance is activated, based on the operation history information and the motion history information acquired by the acquisition means; The program (Figure 3) that functions as the According to this embodiment, a tool can be provided that can explain the operating status of the driving assistance system in a more easily understandable manner.
[0069] Although the embodiment of the invention has been described above, the invention is not limited to the above embodiment, and various modifications and variations are possible within the scope of the gist of the invention. [Explanation of symbols]
[0070] V vehicle, 1 information processing device
Claims
1. An acquisition means for acquiring operation history information of a driving assistance system of a vehicle and motion history information of the vehicle from the vehicle; and a display control means for causing a display device to display behavior information indicating a behavior of the vehicle over time in a situation in which the driving assistance is activated, based on the operation history information and the motion history information acquired by the acquisition means, The behavior information includes a video reproducing the behavior of the vehicle.
23. An information processing apparatus comprising:
2. 2. The information processing device according to claim 1, The video is a video showing an overview of the vehicle's behavior.
23. An information processing apparatus comprising:
3. 3. The information processing device according to claim 2, the display control means causes the display device to display the video superimposed on map information; 23. An information processing apparatus comprising:
4. 4. The information processing device according to claim 1, The acquisition means acquires operation history information of a driver of the vehicle, The display control means displaying information indicating the driving operation of the driver in a situation where the driving assistance is activated based on the operation history information together with the video; 23. An information processing apparatus comprising:
5. 5. The information processing device according to claim 4, The motion history information includes a vehicle speed and a steering angle of the vehicle. The operation history information includes information regarding the driver's accelerator operation, brake operation, and steering operation.
23. An information processing apparatus comprising:
6. 6. The information processing device according to claim 1, The display control means displaying information indicating a type of the driving assistance together with the video at a timing when the driving assistance is activated; 23. An information processing apparatus comprising:
7. 7. The information processing device according to claim 1, a reception means for receiving a selection of an item indicating a driving environment of a road on which the vehicle was traveling when the driving assistance was activated, The display control means displaying the item selected by the receiving means together with the video; 23. An information processing apparatus comprising:
8. 8. The information processing device according to claim 1, The driving assistance includes at least one of automatic braking, automatic steering, and notification to the driver.
23. An information processing apparatus comprising:
9. 3. The information processing device according to claim 1, The driving assistance includes parking assistance for the vehicle, The video during the parking assistance includes an image showing a parking space.
23. An information processing apparatus comprising:
10. Computer, An acquisition means for acquiring operation history information of a driving assistance system of a vehicle and motion history information of the vehicle from the vehicle; a display control means for displaying, on a display device, behavior information indicating the behavior of the vehicle over time in a situation in which the driving assistance is activated, based on the operation history information and the motion history information acquired by the acquisition means; A program that functions as The behavior information includes a video reproducing the behavior of the vehicle. A program characterized by:
Citation Information
Patent Citations
Monitoring device
JP1991028045A
Vehicle travel state display device
JP2014151879A
Driving support system of vehicle
JP2020052801A
