Information processing device and storage medium
The information processing device obtains and displays the movement and motion history information of the vehicle's driving assistance system, which solves the problem that the driver finds difficult to understand the movement of the driving assistance system, and realizes a more intuitive description of the movement status, reducing misunderstandings and fault concerns.
Patent Information
- Application Number
- CN202210106418.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2021-03-11
- Filing Date
- 2022-01-28
- Publication Date
- 2025-04-15
- Estimated Expiration
- 2042-01-28
AI Technical Summary
The driver has difficulty understanding the cause of the action when the driving assistance system is in action, resulting in misunderstandings and concerns about vehicle failure.
An information processing device is designed to obtain the action history information and movement history information of the vehicle's driving assistance system, and display the movement status information on the display device through the display control unit to indicate the movement status of the vehicle when the driving assistance is operated.
Visually displaying the vehicle's movement status and driving assistance movement history, helping drivers to understand the driving assistance system's movement status and resolve misunderstandings of misconceptions of mismoving and failures.
Smart Images

Figure CN115123276B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an information processing device and a storage medium. Background Art
[0002] There is known a technique for storing information during vehicle travel in a vehicle and effectively utilizing the stored information during inspection and maintenance (Patent Document 1, etc.).
[0003] Prior art literature
[0004] Patent Literature
[0005] Patent Document 1: Japanese Patent Application Laid-Open No. 3-28045 Summary of the invention
[0006] Problems to be solved by the invention
[0007] With the development of vehicle driving assistance systems, various assistance such as automatic braking, automatic wheel turning, and notifications for warning attention are provided to drivers, which helps improve vehicle safety. On the other hand, when driving assistance is in action, the driver may not be able to immediately recognize the cause of the action, and sometimes the driver may feel uncomfortable with the action of driving assistance. Drivers who feel uncomfortable may wonder if there is a malfunction in the vehicle and ask for an explanation at the vehicle sales store.
[0008] The person in charge of the sales store determines the status of the driving assistance system based on the information accumulated in the vehicle, and if it is normal, he / she will explain to the driver that there is no abnormality. However, the explanation also includes professional technical content, so sometimes it is difficult for the driver to understand only verbal explanations or written documents showing technical matters.
[0009] An object of the present invention is to provide a tool that can explain the operating status of a driving assistance system in a more understandable manner.
[0010] Solutions for solving problems
[0011] According to the present invention, there is provided an information processing device, characterized in that it comprises:
[0012] an acquisition unit that acquires, from a vehicle, driving assistance action history information of a driving assistance system of the vehicle and movement history information of the vehicle; and
[0013] A display control unit displays motion state information on a display device based on the action history information and the motion history information acquired by the acquisition unit, wherein the motion state information indicates the motion state of the vehicle over time when the driving assistance is in action.
[0014] According to the present invention, there is provided a storage medium storing a program for causing a computer to function as an acquisition unit and a display control unit, wherein:
[0015] The acquisition unit acquires the driving assistance action history information of the driving assistance system of the vehicle and the movement history information of the vehicle from the vehicle.
[0016] The display control unit causes a display device to display motion state information indicating a motion state of the vehicle over time when the driving assistance is in operation, based on the action history information and the motion history information acquired by the acquisition unit.
[0017] Effects of the Invention
[0018] According to the present invention, it is possible to provide a tool that can explain the operating status of a driving assistance system in a more understandable manner. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] Figure 1 This is a block diagram showing an information processing device according to one embodiment of the present invention and an example of a vehicle from which information is acquired.
[0020] Figure 2 (A) to (C) are explanatory diagrams showing examples of driving assistance.
[0021] Figure 3 It is shown Figure 1 A flowchart of an example of processing by an information processing device.
[0022] Figure 4 It is a diagram showing a display example of exercise status information.
[0023] Figure 5 It is a diagram showing a display example of exercise status information.
[0024] Figure 6 It is a diagram showing a display example of exercise status information.
[0025] Figure 7 It is a diagram showing a display example of exercise status information.
[0026] Figure 8 It is a diagram showing a display example of exercise status information.
[0027] Fig. 9 It is a diagram showing a display example of exercise status information.
[0028] Fig.10 It is a diagram showing a display example of exercise status information.
[0029] Fig.11It is a diagram showing a display example of exercise status information.
[0030] Fig.12 It is a diagram showing a display example of exercise status information.
[0031] Fig.13 It is a diagram showing a display example of map information.
[0032] Fig.14 It is a diagram showing a display example of exercise status information.
[0033] Fig.15 It is a diagram showing a display example of exercise status information.
[0034] Fig.16 It is a diagram showing a display example of exercise status information.
[0035] Description of Reference Numerals
[0036] V: vehicle; 1: information processing device. DETAILED DESCRIPTION
[0037] Hereinafter, the embodiments are described in detail with reference to the accompanying drawings. In addition, the following embodiments are not intended to limit the scope of protection of the claims, and the present invention does not require the combination of all the features described in the embodiments. It is also possible to arbitrarily combine two or more of the multiple features described in the embodiments. In addition, the same figure mark is marked on the same or similar structure, and repeated descriptions are omitted.
[0038] <First Embodiment>
[0039] Figure 1 1 is a block diagram showing an example of an information processing device 1 and a vehicle V, which is an object of information acquisition, according to an embodiment of the present invention. As an example, the vehicle V is a sedan-type four-wheeled passenger vehicle. The vehicle V is provided with a control unit 7. The control unit 7 includes a processor represented by a CPU, a storage device such as a semiconductor memory, an interface with an external device, and the like. The storage device stores programs executed by the processor, data used by the processor in processing, and the like. The control unit 7 may also include a plurality of processors, storage devices, interfaces, and the like.
[0040] The control unit 7 can identify the driving environment of the vehicle V based on the detection results of the detection units 10A to 10D that detect the surrounding conditions of the vehicle V. In the case of the present embodiment, the detection unit 10A is a camera that shoots the front of the vehicle V, and the detection unit 10B is a camera that shoots the rear of the vehicle V. By analyzing the images captured by the detection units 10A and 10B, the outline of the object target and the dividing line of the lane on the road (white line, etc.) can be extracted. The detection unit 10C is a millimeter wave radar that detects the object target in front of the vehicle V or measures the distance to the object target. The detection unit 10D is an ultrasonic sensor that detects the object target behind the vehicle V or measures the distance to the object target. As the detection units 10A to 10D, sensors other than cameras, millimeter wave radars, and ultrasonic sensors can also be used, and their configuration and detection range can also be appropriately designed.
[0041] In addition, the control unit 7 can obtain the detection results of the inertial sensor 11, the wheel speed sensor 12, the accelerator pedal sensor 13, and the brake pedal sensor 14. The inertial sensor 11 includes, for example, an acceleration sensor, a yaw rate sensor, etc., and can calculate the posture of the vehicle V based on its detection results, and can calculate the speed of the vehicle V based on the wheel speed sensor 12. The driver's acceleration operation amount and brake operation amount can be calculated based on the detection results of the accelerator pedal sensor 13 and the brake pedal sensor 14, respectively.
[0042] The control unit 7 can control the driving source 17, the braking device 18, and the electric power steering 19. The driving source 17 includes, for example, an internal combustion engine and an automatic transmission, and the control unit 7 can control the acceleration and deceleration of the vehicle V by controlling the driving source 17. The braking device 18 is, for example, a disc brake device, and the control unit 7 can control the braking of the vehicle V using the braking device 18.
[0043] The electric power steering 19 is a mechanism for turning the front wheels according to the driver's driving operation (wheel turning operation) of the steering wheel. The electric power steering 19 includes a motor, a wheel turning angle sensor, a torque sensor, etc., wherein the motor generates a driving force for supplementing the wheel turning operation (sometimes referred to as wheel turning supplementary torque), and the torque sensor detects the wheel turning torque borne by the driver. The control unit 7 can control the wheel turning of the vehicle V using the electric power steering 19, and can also calculate the wheel turning amount of the driver.
[0044] The control unit 7 can also control the sound output device 15 and the instrument panel 16. The sound output device 15 can notify the driver of a warning sound or the like. The instrument panel 16 can display various information.
[0045] The control unit 7 constitutes a driving assistance system. As driving assistance, the control unit 7 can perform, for example, collision mitigation braking, lane departure prevention, parking assistance, and the like. Figure 2 (A) is an illustration of collision mitigation braking. Collision mitigation braking is automatic braking. When the detection unit 10A or the detection unit 10C detects an obstacle 100 in front of the vehicle V and the control unit 7 predicts that the obstacle 100 and the vehicle V will collide, the control unit 7 uses the sound output device 15 to notify or activates the brake device 18 to decelerate the vehicle V.
[0046] Figure 2 (B) is an explanatory diagram of lane departure prevention. Lane departure prevention is an automatic wheel turning, and when the possibility of the vehicle V deviating from the driving lane increases, the control unit 7 notifies using the sound output device 15, or controls the electric power steering 19 to turn the vehicle V in a manner to maintain the vehicle V in the driving lane. Figure 2 (C) is an explanatory diagram of parking assistance. The control unit 7 recognizes the parking frame 102 based on the detection results of the detection unit 10A and the detection unit 10B, and controls the driving source 17 and the electric power steering 19 to move the vehicle V to the parking frame 102.
[0047] The control unit 7 stores such driving assistance action history information, vehicle V motion history information within a specified period before and after the action, and operation history information in an internal storage device (driving recorder). The action history information includes: all past driving assistance actions that were performed without the driver's instructions, such as collision mitigation braking and lane departure suppression; and past driving assistance that was started based on the driver's instructions but not completed, such as the case of terminating parking assistance. The action history information is stored in association with the total driving distance of the vehicle V, for example, and includes information related to driving assistance (action trigger, action timing, control amount, etc.). The motion history information is information related to the movement of the vehicle V, including vehicle speed, acceleration, deceleration, angular velocity, steering angle, control amount of the drive source 17, etc. The operation history information is information related to the driver's driving operation (acceleration operation amount, braking operation amount, steering angle, etc.).
[0048] Back to Figure 1The information processing device 1 is communicatively connected to the control unit 7 via the communication adapter 8, and can read out and obtain the action history information, motion history information and operation history information stored in the control unit 7. The information processing device 1 includes a processing unit 2, a storage unit 3, and an interface 4 between the external device and the processing unit 2. The processing unit 2 is a processor represented by a CPU, which executes the program stored in the storage unit 3. The storage unit 3 is a storage device such as a RAM, a ROM, and a hard disk. In addition to storing the program executed by the processing unit 2, the storage unit 3 also stores various data. The various data include data for displaying the motion status information described later. The program executed by the processing unit 2 can also be installed in the information processing device 1 using a storage medium such as a CD-ROM.
[0049] The display device 5 and the input device 6 are connected to the information processing device 1. The display device 5 is, for example, a liquid crystal display device, and the information processing device 1 displays the motion state information described later on the display device 5. The input device 6 is a mouse, a keyboard, etc., and the information processing device 1 can accept instructions input by the operator to the input device 6. The information processing device 1, the display device 5, and the input device 6 may also be a desktop computer, a notebook computer, or a tablet computer with a touch panel.
[0050] <Processing example>
[0051] An example of processing by the information processing device 1 will be described. When the vehicle V is inspected or maintained, the information processing device 1 is connected to the control unit 7 of the vehicle V via the communication adapter 8 . Figure 3 1 is a flowchart showing an example of processing executed by the processing unit 2 under such circumstances. In S1, the information processing device 1 communicates with the control unit 7, thereby acquiring the history information (the above-mentioned action history information, motion history information, and operation history information) stored in the control unit 7 from the information processing device 1.
[0052] In S2, the acquired historical information is analyzed to generate information to be displayed on the display device 5. In S3, display control is performed to display the information generated in S2 on the display device 5. The display in S3 includes a display for the service personnel of the vehicle sales store to confirm the status of the vehicle V, and a display for explaining the driving assistance of the vehicle V according to the request of the owner of the vehicle V. When the owner of the vehicle V feels uncomfortable with the past driving assistance action, he may request an explanation. The service personnel use the display of the display device 5 to explain to the owner.
[0053] Figure 4 FIG. 1 shows a display example of the display device 5 , showing an example of the motion state information 21 indicating the motion state of the vehicle V over time in a situation where the driving assistance is being operated.
[0054] The motion state information 21 includes a total driving distance display area 22. As described above, in the present embodiment, the action history information is associated with the total driving distance of the vehicle V. The total driving distance display area 22 displays a list of driving distances when the driving assistance is in action, and past driving assistance information to be reproduced can be selected from the list.
[0055] For example, the service personnel asks the vehicle owner about the approximate driving distance when the driver requests the driver to explain the driving assistance operation, and selects a driving distance close to the asked driving distance from the total driving distance display area 22. In the example shown in the figure, the history of driving 1352 km is selected using the cursor 22a. When the driving distance is selected, the corresponding history information is determined.
[0056] The motion state information 21 includes a setting display area 23. The setting display area 23 shows various settings of the vehicle V when the driving assistance is in action. In the illustrated example, an example is shown in which the "alarm distance setting" is normal, the "lane keeping control" is "off" (no action is performed), and the "auto cruise" is "off". The "alarm distance setting" is a setting for the length of a predetermined distance when an obstacle approaches the vehicle V to a predetermined distance and notifies the driver of the situation. The "lane keeping control" is the same as the lane departure suppression mentioned above. When it is "off", the driving assistance related to the lane departure suppression is not performed. The "auto cruise" is an automatic tracking control for the vehicle in front. When it is "off", it does not take effect.
[0057] The motion state information 21 includes a reproduced motion image display area 24, which displays a motion image that reproduces the motion state of the vehicle V. In this embodiment, the motion state of the vehicle V over time is displayed as a motion image as the motion state information. In the example shown in the figure, the vehicle image VI corresponding to the vehicle V is displayed in a bird's-eye view, and a motion image of the motion state of the vehicle V is displayed. The vehicle image VI may also be a photo image of a real vehicle. Figure 4 The display in the stage is the initial display before the reproduction starts. When the play button 21a is selected, the moving image starts to be reproduced, and when the stop button 21b is selected, the moving image stops.
[0058] The motion state information 21 includes an assist content display area 25. Information indicating the type of driving assist that has been performed is displayed in the assist content display area 25. The information is displayed at a timing corresponding to the actual timing of the action in conjunction with the reproduced motion image displayed in the reproduced motion image display area 24, but is not displayed in the illustrated example.
[0059] The motion state information 21 includes an instrument reproduction area 26. An image that reproduces the display content of the instrument panel 16 when the driving assistance is in operation is displayed in the instrument reproduction area 26. In the illustrated example, the gear position of the automatic transmission of the driving source 17 is the forward gear (D gear) and the vehicle speed is 53 km / h.
[0060] The motion state information 21 includes an operation display area 27. The operation display area 27 displays information indicating the driver's driving operation when the driving assistance is in action. In the illustrated example, a level meter 30 is used to indicate the amount of acceleration operation. In addition, the level meter 30 indicates the throttle opening of the internal combustion engine (control information of the internal combustion engine). The wheel turning information 29 uses an icon representing a steering wheel to display the driver's wheel turning amount or the wheel turning amount of the automatic wheel turning of the driving assistance. The braking information 28 uses an icon representing a brake pedal to display whether there is a braking operation by the driver or an action of the automatic braking of the driving assistance.
[0061] Reference Figures 5 to 8 The following describes the change in the display of the motion state information 21 after the play button 21a is operated. The display of the motion state of the vehicle image VI is controlled based on the motion history information. Figure 5 The stage before the driving assistance is performed is shown. The vehicle image VI is moving forward. The driving trajectory 24a shows the trajectory of the vehicle image VI (that is, the vehicle V). At this stage, an icon 26b for reminding the driver to pay attention to the vehicle in front is displayed in the instrument reproduction area 26. In other words, it can be understood that when the vehicle V is actually driving, the detection unit 10A and the detection unit 10C detect that the vehicle in front is approaching at this timing.
[0062] Figure 6 Shows from Figure 5 The vehicle image VI is moving forward, but there is no braking operation, and the display of the meter 30 (acceleration operation amount) has not changed. At this stage, the auxiliary content display area 25 displays information 25a, which indicates that an alarm has been issued to remind the driver to pay attention to the vehicle in front. In addition, in addition to the icon 26b for reminding the driver to pay attention to the vehicle in front, the meter reproduction area 26 also displays an icon 26c indicating that a notification is being made. In other words, it can be understood that during the actual driving of the vehicle V, driving assistance for reminding the driver to pay attention to the approaching vehicle in front is performed at this timing.
[0063] Figure 7 Shows from Figure 6The stage in which a certain time has passed since the state of the vehicle image VI moves forward and the brakes are acting. At this stage, in addition to the information 25a indicating that an alarm has been initiated to remind the driver ahead, the auxiliary content display area 25 also displays information 25b indicating that automatic braking (collision mitigation braking) has been acting. In addition, the vehicle speed display in the instrument reproduction area 26 shows that the vehicle speed is decreasing, and the display of the meter 30 (acceleration operation amount) has not changed (the driver continues to perform the acceleration operation), but the throttle opening is decreasing in the display of the meter 30 indicating the throttle opening (the output of the internal combustion engine is reduced through control). In the operation display area 27, information 28a indicating that the automatic braking has been acting is displayed adjacent to the braking information 28. That is to say, it can be understood that driving assistance such as automatic braking action is performed during the actual driving of the vehicle V.
[0064] Figure 8 Shows from Figure 7 The stage after the driving assistance is ended after a certain time has passed since the state of the vehicle. The vehicle image VI is moving forward and slightly turning right. The display related to driving assistance disappears from the assistance content display area 25, the instrument reproduction area 26, and the operation display area 27. In the operation display area 27, the wheel information 29 indicates that the driver has turned the wheel to the right. The automatic braking action interval 24b is displayed in the driving trajectory 24a. According to Figure 8 The display infers that after the automatic braking was performed while the vehicle V was actually traveling, the vehicle V did not collide with the vehicle in front and continued to travel.
[0065] By providing the above-described motion state information 21 to the owner of the vehicle V who requests explanation, the operation status of the driving assistance system can be explained in a more understandable manner, and misunderstandings such as erroneous operation and failure can be eliminated. In particular, a motion image that reproduces the motion state of the vehicle V is displayed in the reproduced motion image display area 24, so that a visually understandable explanation can be made. In addition to displaying the reproduced motion image, information related to the operation status of the vehicle V and the driver's operation status when the driving assistance is in operation is also displayed, so that the owner of the vehicle V can more easily understand the relationship between the operation status of the driving assistance system and his own driving operation.
[0066] <Second Embodiment>
[0067] In the first embodiment, the motion state of the vehicle V is displayed using a moving image, but in the present embodiment, a tool capable of displaying reference information about the driving environment of the road on which the vehicle V is traveling when the driving assistance is performed is further described. The owner of the vehicle V who receives the description can easily and intuitively recognize the situation that becomes the driving assistance action opportunity.
[0068] Fig. 9 5 is a display example of the display device 5 of this example. Figures 4 to 8 The function of selecting items in the motion state information 21 described in the above has an editing function that can display various items in the reproduced motion image display area 24.
[0069] The item area 32 lists items that can be displayed in the playback moving image display area 24. Item 32a is an icon representing a car, item 32b is an icon representing a pedestrian, and item 32c is an icon representing a bicycle and a rider. Item 32d is an icon representing a street tree, item 32e is an icon representing an intersection, and item 32f is an icon representing a road. The operator selects an item from the item area 32 using the input device 6 and drags the item to the playback moving image display area 24, whereby the selection is accepted and displayed in the playback moving image display area 24.
[0070] A free drawing tool 33a, an eraser tool 33b, and a trash can tool 33c are displayed in the editing area 33. The operator can freely draw a line drawing in the playback moving image display area 24 by selecting the free drawing tool 33a using the input device 6. The eraser tool 33b is a tool for deleting a free line drawing drawn in the playback moving image display area 24, and the trash can tool 33c is a tool for deleting an icon selected from the item area 32 and displayed in the playback moving image display area 24.
[0071] The service person listens to the vehicle owner's questions about the driving environment of the road on which the vehicle V is traveling when the driving assistance is being performed, and performs editing operations on the playback moving image display area 24 using the items in the item area 32 and the tools in the editing area 33 . Fig.10 The display example after editing is shown, in which a still image of the driving environment is displayed superimposed on the reproduced moving image display area 24. By operating the play button 21a, it is also possible to play Figures 5 to 8 The reproduced moving image of the illustrated vehicle image VI (the still image of the driving environment remains the same) is shown. By referring to such a display, the service personnel and the vehicle owner can have a conversation, thereby deepening their understanding of the driving assistance action opportunities, etc., and can resolve misunderstandings such as erroneous actions and failures.
[0072] <Third Embodiment>
[0073] In the second embodiment, a still image drawn by an operator is displayed in a superimposed manner as reference information on the traveling environment of a road, but map information may also be displayed in a superimposed manner. Fig.11 5 is a display example of the display device 5 of this example. Figures 4 to 8The function of selecting the items in the motion state information 21 described in the above has an editing function capable of displaying map information in the reproduced motion image display area 24.
[0074] The image of the aerial photograph is displayed as map information in the map display area 34. The image of the aerial photograph may be stored in advance in the storage unit 3, or may be obtained by the information processing device 1 from a server providing map information via a network such as the Internet. The operator selects the display range using the frame 34a from the map display area 34 through the input device 6, and drags the frame 34a to the playback motion image display area 24, whereby the selection is accepted and the image of the frame 34a is displayed in the playback motion image display area 24. The region of the map displayed in the map display area 34 can be switched by inputting the information of the region in the input frame 35.
[0075] The service person receives information from the vehicle owner about the location of the road on which the vehicle V is traveling when the driving assistance is being performed, inputs the location information in the input box 35 , and selects map information from the map display area 34 to display it in the reproduced moving image display area 24 . Fig.12 The display example after selecting the map information is shown, and the image 24c of the aerial photograph is displayed superimposed on the playback moving image display area 24. By operating the play button 21a, it is also possible to play Figures 5 to 8 The reproduced moving image of the illustrated vehicle image VI (the image 24c of the aerial photograph remains unchanged) is shown. By referring to such a display, the service personnel and the vehicle owner can have a conversation, thereby deepening their understanding of the driving assistance action opportunities, etc., and can resolve misunderstandings such as malfunctions and failures.
[0076] As another method of displaying the map information in a superimposed manner on the reproduced moving image display area 24 , it is also possible to selectively make the background of the reproduced moving image display area 24 transparent and display the map information as the background. Figure 13 to Figure 15 This example is shown.
[0077] Fig.13 An example of display with map information as the background is shown. In the example shown in the figure, a window 40 of an Internet browser or the like is shown. The window 40 displays map information (aerial photos, etc.) provided on the Internet. The operator can arbitrarily change, enlarge, or reduce the location displayed in the window 40.
[0078] The window of the motion state information 21 is overlapped on the window 40 . Fig.14 This example is shown in Fig.14At the stage of the reproduction motion image display area 24, a non-transparent state is set. Therefore, the map information of the window 40 behind is not displayed. Moreover, in the example shown in the figure, a shadow is added to the motion state information 21 in order to visually facilitate the overlapping relationship between the two.
[0079] A transparent selection button 21c is provided in the motion state information 21. When the operator operates the transparent selection button 21c, Fig.15 The playback moving image display area 24 shown in the figure becomes transparent, and the map information of the window 40 behind is displayed. In this state, within the frame of the playback moving image display area 24, the operator can arbitrarily change, enlarge, or reduce the location displayed in the window 40. In addition, by operating the play button 21a, it is also possible to play Figures 5 to 8 The reproduced moving image of the vehicle image VI is illustrated (the display of the map information remains unchanged).
[0080] In this way, the transparent state and the opaque state of the playback moving image display area 24 can be selected, thereby making it possible to display map information from various sources behind.
[0081] <Fourth Embodiment>
[0082] In the above embodiments, the case where the collision reduction brake is operated as driving assistance is exemplified, but the above embodiments can also be applied to other types of driving assistance. In this embodiment, a display example is described in which the parking assistance is operated as driving assistance but is not completed.
[0083] Fig.16 The display example of the display device 5 is shown, and an example of the motion state information 21 in this embodiment is shown. The "parking mode" indicating parking assistance is displayed in the assistance content display area 25 as information indicating the type of driving assistance performed, and in particular, "right side space parking" indicating automatic parallel parking is displayed.
[0084] The motion state information 21 includes an action result display area 36, which displays the reason why the parking assistance was not completed (the reason for suspension). In the example shown in the figure, the fact that the parking was not completed within a predetermined time is displayed as the reason.
[0085] The image FI of the parking frame assumed when parking assistance is performed is displayed in the playback motion image display area 24. By operating the play button 21a, the playback of the motion image starts. In the example shown in the figure, it is assumed that the motion image VI moves from the position shown by the dotted line to the position shown by the solid line. The position of the solid line is the position where the parking assistance of the vehicle V is terminated.
[0086] In this embodiment, the motion state information 21 is presented to the owner of the vehicle V who requests explanation, so that the operation status of the driving assistance system can be explained in a more understandable manner, and misunderstandings such as malfunction and failure can be eliminated. In particular, a motion image that reproduces the motion state of the vehicle V is displayed in the reproduced motion image display area 24, so that a visually understandable explanation can be made, and the image FI of the parking frame is also displayed, so that the service personnel and the owner can confirm the current situation and the owner can deepen his understanding of the system.
[0087] <Fifth Embodiment>
[0088] In the first to fourth embodiments, the motion status information 21 includes a reproduced motion image display area 24, which displays a reproduced motion image of the motion status of the vehicle V, but it may also be replaced by other display methods such as a bar graph, a line graph, etc. to display the changes of various parameters included in the motion history information over time.
[0089] <Summary of Implementation Methods>
[0090] The above-mentioned embodiments disclose at least the following information processing device, program, and storage medium.
[0091] 1. The information processing device 1 of the above embodiment comprises:
[0092] An acquisition unit (2, S1) that acquires the driving assistance action history information of the driving assistance system 7 of the vehicle V and the movement history information of the vehicle from the vehicle; and
[0093] A display control unit (2, S3), which displays motion state information 21 on a display device 5 based on the action history information and the motion history information acquired by the acquisition unit, wherein the motion state information 21 represents the motion state of the vehicle over time when the driving assistance is in action.
[0094] According to this embodiment, it is possible to provide a tool that can explain the operating status of the driving assistance system in a more understandable manner.
[0095] 2. In the above embodiment,
[0096] The motion state information includes a motion image (24) which reproduces the motion state of the vehicle.
[0097] According to this embodiment, a description that is visually easy to understand can be performed.
[0098] 3. In the above embodiment,
[0099] The moving image is a moving image 24 obtained by looking down on the moving state of the vehicle.
[0100] According to this embodiment, a description that is visually easy to understand can be performed.
[0101] 4. In the above embodiment,
[0102] The display control unit causes the moving image to be superimposed on the map information and displayed on the display device ( Fig.12 , Fig.15 ).
[0103] According to this embodiment, the operation status of the driving support system can be explained in a more understandable manner while referring to the traveling environment of the road.
[0104] 5. In the above embodiment,
[0105] The acquiring unit acquires operation history information of the driver of the vehicle,
[0106] The display control unit displays information 27 indicating the driving operation of the driver in a situation where the driving assistance is being operated together with the moving image based on the operation history information.
[0107] According to this embodiment, the relationship between the operating status of the driving assistance system and the driving operation of the driver can be explained in a more understandable manner.
[0108] 6. In the above embodiment,
[0109] The movement history information includes the vehicle speed and the wheel angle of the vehicle,
[0110] The operation history information includes information related to the driver's acceleration operation, braking operation, and wheel turning operation.
[0111] According to this embodiment, the movement state of the vehicle can be reproduced more accurately, and the relationship with the driver's driving operation can be explained in a more understandable manner.
[0112] 7. In the above embodiment,
[0113] At the timing of the driving assistance operation, the display control unit displays information (25) indicating the type of the driving assistance together with the moving image. Figure 6 , Figure 7 ).
[0114] According to this embodiment, it is possible to deepen the understanding of the operation timing of the driving assistance system.
[0115] 8. The information processing device of the above embodiment includes a receiving unit (32) that receives a selection of an item, the item indicating a driving environment of a road on which the vehicle is traveling when the driving assistance is performed.
[0116] The display control unit displays the item selected by the receiving unit together with the moving image. Fig.10 ).
[0117] According to this embodiment, the operation status of the driving support system can be explained in a more understandable manner while referring to the traveling environment of the road.
[0118] 9. In the above embodiment,
[0119] The driving assistance includes automatic braking ( Figure 2 (A)), automatic wheel ( Figure 2 (B)) and at least one of notification to the driver (15).
[0120] According to this embodiment, the operation status of the driving assistance system that may make the driver feel uncomfortable can be explained in a more understandable manner.
[0121] 10. In the above embodiment,
[0122] The driving assistance includes parking assistance for the vehicle ( Figure 2 (C)),
[0123] The moving image during the parking assistance includes an image FI ( Fig.16 ).
[0124] According to this embodiment, the operation status of parking assistance can be explained in a more understandable manner.
[0125] 11. The procedure of the above embodiment ( Figure 3 ) enables the computer 2 to function as an acquisition unit (2, S1) and a display control unit (2, S3), wherein,
[0126] The acquisition unit acquires the driving assistance action history information of the driving assistance system 7 of the vehicle V and the movement history information of the vehicle from the vehicle,
[0127] The display control unit displays the motion state information 21 indicating the motion state of the vehicle over time when the driving assistance is in action, on the display device 5 based on the action history information and the motion history information acquired by the acquisition unit.
[0128] According to this embodiment, it is possible to provide a tool that can explain the operating status of the driving assistance system in a more understandable manner.
[0129] 12. The storage medium of the above embodiment stores a program ( Figure 3 ),in,
[0130] The acquisition unit acquires the driving assistance action history information of the driving assistance system 7 of the vehicle V and the movement history information of the vehicle from the vehicle,
[0131] The display control unit displays the motion state information 21 indicating the motion state of the vehicle over time when the driving assistance is in action, on the display device 5 based on the action history information and the motion history information acquired by the acquisition unit.
[0132] According to this embodiment, it is possible to provide a tool that can explain the operating status of the driving assistance system in a more understandable manner.
[0133] As mentioned above, although embodiment of the invention was described, the invention is not limited to the above-mentioned embodiment, and various modifications can be made within the scope that does not depart from the gist of the invention.
Claims
1. An information processing device, characterized in that: have: an acquisition unit, which acquires, from a vehicle, action history information of driving assistance of a driving assistance system of the vehicle and movement history information of the vehicle, wherein the action history information is associated with a total travel distance of the vehicle; as well as a display control unit that causes a display device to display a list of total travel distances when the driving assistance is in action; as well as Based on the action history information and the motion history information acquired by the acquisition unit, the total driving distance selected according to the user's selection of the total driving distance in the list causes the corresponding motion state information to be displayed on the display device, and the motion state information represents the motion state of the vehicle over time when the driving assistance is in action, wherein the motion state information includes a motion image, and the motion image reproduces the motion state of the vehicle.
2. The information processing device according to claim 1, characterized in that The moving image is a moving image obtained by looking down on the moving state of the vehicle.
3. The information processing device according to claim 2, characterized in that: The display control unit causes the moving image to be superimposed on map information and displayed on the display device.
4. The information processing device according to claim 1, characterized in that The acquiring unit acquires operation history information of the driver of the vehicle, The display control unit displays information indicating the driving operation of the driver in a situation where the driving assistance is being operated together with the moving image based on the operation history information.
5. The information processing device according to claim 4, characterized in that The movement history information includes the vehicle speed and the wheel angle of the vehicle, The operation history information includes information related to the driver's acceleration operation, braking operation, and wheel turning operation.
6. The information processing device according to claim 1, characterized in that The display control unit displays information indicating a type of the driving assistance together with the moving image at an operation timing of the driving assistance.
7. The information processing device according to claim 1, characterized in that: A receiving unit is provided, the receiving unit receiving a selection of an item, the item indicating a driving environment of a road on which the vehicle is traveling when the driving assistance is performed, The display control unit displays the item whose selection is accepted by the acceptance unit together with the moving image.
8. The information processing device according to any one of claims 1 to 7, characterized in that: The driving assistance includes at least one of automatic braking, automatic wheel turning, and notification to the driver.
9. The information processing device according to claim 1, characterized in that: The driving assistance includes parking assistance for the vehicle, The moving image during the parking assistance includes an image representing a parking frame.
10. A storage medium storing a program for causing a computer to function as an acquisition unit and a display control unit, wherein: The acquisition unit acquires, from the vehicle, driving assistance action history information of the driving assistance system of the vehicle and movement history information of the vehicle, wherein the action history information is associated with a total travel distance of the vehicle. The display control unit causes the display device to display a list of total travel distances when the driving assistance is in action; And based on the action history information and the motion history information acquired by the acquisition unit, the total driving distance selected according to the user's selection of the total driving distance in the list causes the motion state information to be displayed on the display device, the motion state information representing the motion state of the vehicle over time when the driving assistance is in action, wherein the motion state information includes a motion image, and the motion image reproduces the motion state of the vehicle.
Citation Information
Patent Citations
Monitoring device
JP1991028045A
Vehicle travel state display device
JP2014151879A
Vehicle Event Playback Apparatus and Methods
US20140046550A1