Driving assistance device and driving assistance method

Abstract

This drive assistance device (1) comprises a sensor (10) for acquiring vehicle internal and external data, and a controller (20). The controller (20): determines whether the vehicle is in an abnormal state, based on the data acquired by the sensor (10); upon determining that the vehicle is in an abnormal state, outputs, to a user driving the vehicle, a message indicating that the vehicle is in an abnormal state; and acquires a user's response to the message via a microphone (11).

Description

[Technical field]

[0001] The present invention relates to a driving assistance device and a driving assistance method. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there has been known an invention that detects dangerous driving by a user and presents the driving characteristics to the user (Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6480143 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the invention described in Patent Document 1, the system judges whether the driving is dangerous or not. It is up to the user to decide whether to accept the judgment result. Therefore, driving assistance based on the judgment result may not be effective.

[0005] The present invention has been made in consideration of the above problems, and has an object to provide a driving assistance device and a driving assistance method that are capable of performing driving assistance that matches the user's senses. [Means for solving the problem]

[0006] A driving assistance device according to one aspect of the present invention Place The system determines whether the vehicle is in an abnormal state based on data acquired by the sensor, and if it determines that the vehicle is in an abnormal state, outputs a message to the user in the vehicle indicating that the vehicle is in an abnormal state, and acquires the user's response to the message via the input device. Effect of the Invention

[0007] According to the present invention, it is possible to provide driving assistance that matches the user's sense. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a configuration diagram of a driving support device 1 according to an embodiment of the present invention. [Diagram 2] FIG. 2 shows a conversation between a user 51 and a robot head 40 . [Diagram 3] FIG. 3 shows an example of a method for determining dangerous driving. [Figure 4] FIG. 4 is an example of data that is stored when the assistance function is executed. [Diagram 5] FIG. 5 is an example of a message output from the robot head 40. [Figure 6] FIG. 6 shows a conversation between a user 51 and a robot head 40 . [Figure 7] FIG. 7 shows a conversation between a user 51 and a robot head 40 . [Figure 8] FIG. 8 is a flowchart illustrating an example of the operation of the driving support device 1. [Figure 9] FIG. 9 is a flowchart illustrating an example of the operation of the driving assistance device 1. [Figure 10] FIG. 10 is a flowchart illustrating an example of the operation of the driving support device 1. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the description of the drawings, the same parts are given the same reference numerals and the description will be omitted.

[0010] An example of the configuration of a driving support device 1 will be described with reference to Fig. 1. As shown in Fig. 1, the driving support device 1 includes a sensor 10, a microphone 11, a camera 12, a GPS receiver 13, a switch 14, a controller 20, a robot head 40, a speaker 41, a display 42, a steering actuator 43, an accelerator pedal actuator 44, and a brake actuator 45.

[0011] The driving assistance device 1 is mounted on a vehicle having an automatic driving function. The driving assistance device 1 may be mounted on a vehicle capable of switching between automatic driving and manual driving. An example of the automatic driving function is to automatically control steering control, braking force control, driving force control, etc. to assist the user in driving. In this embodiment, the "user" refers to a user sitting in the driver's seat of the vehicle.

[0012] The sensor 10 is used to acquire various data and information. The sensor 10 includes sensors that acquire vehicle data and sensors that acquire information outside the vehicle. Examples of vehicle data include speed, acceleration, steering angle, brake oil pressure, and accelerator opening. Sensors that acquire these data include a speed sensor, an acceleration sensor, a steering angle sensor, a gyro sensor, a brake oil pressure sensor, and an accelerator opening sensor.

[0013] Examples of information outside the vehicle include objects (pedestrians, bicycles, motorbikes, other vehicles, etc.) present around the vehicle (host vehicle), traffic lights, dividing lines, signs, crosswalks, intersections, etc. Examples of sensors that acquire this information include laser range finders, radars, lidars, cameras 12, sonars, etc. In this embodiment, for convenience of explanation, the sensor 10 and the camera 12 are separated, but the camera 12 is a type of sensor 10. The data and information acquired by the sensor 10 are output to the controller 20.

[0014] The microphone 11 captures voice data of the user. The voice data captured by the microphone 11 is output to the controller 20.

[0015] The camera 12 has an imaging element such as a charge-coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). The location where the camera 12 is installed is not particularly limited, but as an example, the camera 12 is installed in the front, side, or rear of the vehicle. The camera 12 captures images of the surroundings of the vehicle. Image data captured by the camera 12 is output to the controller 20. In this embodiment, the camera 12 is also installed inside the vehicle. For example, the camera 12 is installed near the driver's seat and captures an image of the user's face. Face image data captured by the camera 12 is output to the controller 20.

[0016] The GPS receiver 13 detects the vehicle's position information on the ground by receiving radio waves from artificial satellites. The vehicle's position information detected by the GPS receiver 13 includes latitude information and longitude information. The GPS receiver 13 outputs the detected vehicle's position information to the controller 20. Note that the method of detecting the vehicle's position information is not limited to the GPS receiver 13. For example, the vehicle's position may be estimated using a method called odometry. Odometry is a method of estimating the vehicle's position by determining the amount and direction of movement of the vehicle according to the rotation angle and rotation angular velocity of the vehicle. Note that a GNSS receiver may be used instead of the GPS receiver 13.

[0017] The switch 14 is used when the user uses an assistance function. When the user presses the switch 14, the assistance function is activated. The "assistance function" in this embodiment includes an around view monitor (hereinafter referred to as AVM), automatic parking, a side down view monitor, steering assistance, emergency stop braking, emergency avoidance steering, lane departure prevention, blind spot warning, a combination of AVM and ultrasonic sensor, and the like. These assistance functions are well known, so detailed explanations are omitted. The switch 14 may be a physical switch or a virtual switch. A virtual switch is, for example, a switch displayed on the display 42. Some of the above-mentioned assistance functions are also automatic driving functions. That is, the assistance functions in this embodiment also include automatic driving functions. The automatic driving functions include ACC (Adaptive Cruise Control), constant speed control, and the like.

[0018] The controller 20 is a general-purpose microcomputer equipped with a CPU (Central Processing Unit), a memory, and an input / output unit. A computer program for functioning as the driving support device 1 is installed in the microcomputer. By executing the computer program, the microcomputer functions as a plurality of information processing circuits equipped in the driving support device 1. Note that here, an example is shown in which the plurality of information processing circuits equipped in the driving support device 1 are realized by software, but it is of course possible to configure the information processing circuits by preparing dedicated hardware for executing each information process shown below. In addition, the plurality of information processing circuits may be configured by individual hardware. The controller 20 includes, as an example of the plurality of information processing circuits, a dangerous situation determination unit 21, a responsibility determination unit 22, a message creation unit 23, an utterance acquisition unit 24, an utterance analysis unit 25, a parameter change unit 26, a user determination unit 27, a position detection unit 28, an assistance function selection unit 32, a suggestion unit 33, and an assistance function implementation unit 34.

[0019] The robot head 40 is a figurine that resembles the head of a robot. The robot head 40 is installed to enhance the affinity between the user and the vehicle. The robot head 40 has a speaker function and an information processing function.

[0020] Next, with reference to Figures 2 to 7, the dangerous situation determination unit 21, the responsibility determination unit 22, the message creation unit 23, the utterance acquisition unit 24, the utterance analysis unit 25, the parameter change unit 26, the user determination unit 27, the position detection unit 28, the assistance function selection unit 32, the proposal unit 33, and the assistance function implementation unit 34 will be described in detail.

[0021] The scene shown in FIG. 2 is a scene in which the user 51 is having a conversation with the robot head 40. The conversation is indicated by reference numerals 60 to 63. Reference numerals 60 and 62 indicate the speech of the robot head 40. Reference numerals 61 and 63 indicate the speech of the user 51. The flow of the conversation is in the order of reference numerals 60, 61, 62, and 63. Reference numeral 52 indicates a preceding vehicle. Reference numerals 60 to 63 are all described as voices, but are not limited to this. For example, reference numerals 60 and 62 may be displayed as characters on the display 42. Reference numerals 61 and 63 may also indicate information selected by the user 51 from a plurality of options. In this case, the plurality of options are displayed on the display 42. First, the condition for outputting "Did something happen?" indicated by reference numeral 60 will be described. Note that the installation of the robot head 40 is not essential. A virtual robot head may be displayed on the display 42.

[0022] The dangerous situation determination unit 21 uses data acquired from the sensor 10 to determine whether the driving of the user 51 was dangerous. An example of the determination method will be described with reference to FIG. 3. The scenes shown in FIG. 3 are classified into parking, narrow road, approaching a preceding vehicle, lane departure, merging or changing lanes, right turn, and left turn. In "parking", if the distance to an obstacle is 15 cm or less, or the number of turns in the forward and backward directions is 5 or more, the dangerous situation determination unit 21 determines that the driving of the user 51 was dangerous. The distance to an obstacle is detected by a lidar. The number of turns is detected by a steering angle sensor. In "narrow road", if the distance to an obstacle on the left side is 15 cm or less, the dangerous situation determination unit 21 determines that the driving of the user 51 was dangerous. Here, the Japanese traffic rules (keep on the left side) are used as a reference. "Left" and "right" can be interpreted appropriately according to the traffic rules of each country.

[0023] Regarding "approaching a preceding vehicle", if the speed of the vehicle is 15 km / h or more and the distance between the vehicle and the preceding vehicle is 5 m or less, the dangerous situation determination unit 21 determines that the driving of the user 51 was dangerous. The speed of the vehicle is detected by a speed sensor. The distance between the vehicle and the preceding vehicle is detected by a lidar. Regarding "lane departure", if the distance between the vehicle and either the left or right dividing line is 5 cm or less, the dangerous situation determination unit 21 determines that the driving of the user 51 was dangerous. The distance between the dividing line is detected by the camera 12. Regarding "merging or changing lanes", if the distance between the vehicle and the rear side vehicle is 5 m or less and the vehicle is steered in that direction, the dangerous situation determination unit 21 determines that the driving of the user 51 was dangerous. The distance between the vehicle and the rear side vehicle is detected by a lidar. The steering direction is detected by a steering angle sensor. Regarding "right turn", if the TTC (Time To Collision) with an oncoming vehicle moving straight is equal to or less than a predetermined value, the dangerous situation determination unit 21 determines that the driving of the user 51 was dangerous. The TTC with an oncoming vehicle moving straight is calculated using the speed of the oncoming vehicle moving straight and the distance to the oncoming vehicle moving straight. Regarding "left turn", if the distance to an obstacle on the left side is equal to or less than 15 cm, the dangerous situation determination unit 21 determines that the driving of the user 51 was dangerous.

[0024] When the dangerous situation determination unit 21 determines that the user 51's driving was dangerous, a signal indicating the determination result is transmitted to the responsibility determination unit 22. The responsibility determination unit 22, which has received this signal, determines who is responsible for the dangerous driving. In the scene of FIG. 3, it is determined that the user 51 is responsible for the dangerous driving. In this case, a signal indicating the determination result is transmitted to the message creation unit 23. The message creation unit 23, which has received this signal, creates a message indicated by reference numeral 60. The message creation unit 23 outputs the created message to the robot head 40. As a result, the message 60 is output by voice as shown in FIG. 2. In response to the question "Did something happen?" as shown in FIG. 2, the user 51 responds "That was a bit dangerous!" (reference numeral 61). This response is an affirmative response. The "affirmative response" here means a response in which the user 51 acknowledges that his or her driving was dangerous.

[0025] The user 51's answer by voice is output to the speech acquisition unit 24 via the microphone 11. The speech acquisition unit 24 outputs the voice data of the user 51 to the speech analysis unit 25. The speech analysis unit 25 analyzes the voice data of the user 51. A well-known technology is used for the voice analysis method. The speech analysis unit 25 judges whether the answer of the user 51 is positive or not based on the analysis result. A signal indicating the judgment result is output to the message creation unit 23. The message creation unit 23 receiving this signal creates a message indicated by reference numeral 62 (So, will you support me next time?). The message 62 is created because the answer of the user 51 is a positive answer. As shown in FIG. 2, in response to the question "So, will you support me next time?", the user 51 answers "Please!" (reference numeral 63). This answer is a positive answer. The "positive answer" here is an answer that accepts the support function. This answer 63 is also analyzed by the speech analysis unit 25 in the same way as the answer 61. Then, it is determined whether the answer of the user 51 is affirmative or not. A signal indicating the determination result is output to the user database 31. The user database 31 is stored in the storage device 30. The storage device 30 is composed of a hard disk drive (HDD), a solid state drive (SSD), etc.

[0026] When it is determined that the driving of the user 51 was dangerous, the position detection unit 28 detects the position (location) of the vehicle at that time, using the data acquired from the GPS receiver 13. The detected position information is stored in the user database 31.

[0027] The "assistance function" in this embodiment is implemented the next time the user 51 drives after the exchange of symbols 60 to 63. When the user 51 gets in the vehicle, the camera 12 captures the face of the user 51. The facial image data captured by the camera 12 is output to the user determination unit 27. The user determination unit 27 compares the facial image data acquired from the camera 12 with facial image data pre-stored in the user database 31 to identify the user who has gotten in. In this embodiment, the user who has gotten in is identified as the user 51. The reason for identifying the user is to provide support suitable for the user. There are cases in which one vehicle is shared by multiple users. In this case, it is necessary to identify the user who has gotten in in order to provide support suitable for the user. If support is provided without identifying the user, the user may feel uncomfortable.

[0028] The assistance function selection unit 32 selects assistance appropriate for the scene from among the multiple assistance functions. As shown in FIG. 3, when the scene is "parking", AVM or automatic parking is selected from among the multiple assistance functions. Note that AVM and automatic parking may be selected. When the scene is "narrow road", side down view monitor or steering assistance is selected from among the multiple assistance functions. When the scene is "approaching a preceding vehicle", emergency stop braking or emergency avoidance steering is selected from among the multiple assistance functions. When the scene is "lane departure", lane departure prevention is selected from among the multiple assistance functions. When the scene is "merging or lane change", blind spot warning or steering assistance is selected from among the multiple assistance functions. When the scene is "right turn", emergency stop braking is selected from among the multiple assistance functions. When the scene is "left turn", a combination of AVM and ultrasonic sensor is selected from among the multiple assistance functions.

[0029] Here, assistance when the scene is "parking" will be described. The location where the user 51's driving was determined to be dangerous last time is called parking lot A. It is assumed that the user 51 heads to this parking lot A again. The suggestion unit 33 determines that the vehicle is in parking lot A based on the position information acquired from the position detection unit 28. In the previous exchange (exchanges indicated by symbols 60 to 63), the user 51 accepted the assistance function. The acceptance result is stored in the user database 31. The assistance function selection unit 32 refers to the user database 31 and selects an assistance function to be proposed to the user 51. It is assumed here that automatic parking is selected. The assistance function selection unit 32 outputs the selection result to the suggestion unit 33. The suggestion unit 33 confirms with the user 51 whether or not to implement the assistance function. The reason for the reconfirmation is to increase the trust between the user 51 and the vehicle. This confirmation may be performed by voice via the speaker 41, or by displaying characters on the display 42. The user 51 responds to this confirmation using the switch 14. When the user 51 presses the switch 14, the assistance function is accepted. The suggestion unit 33 receives a signal indicating that the switch 14 is on and outputs a command to execute the assistance function to the assistance function execution unit 34. The assistance function execution unit 34 that receives the command controls the steering actuator 43, the accelerator pedal actuator 44, and the brake actuator 45. This performs automatic parking.

[0030] When an assistance function is implemented, data at that time is recorded in the user database 31. The recorded data includes the user name, date and time, location, scene, and the implemented assistance function, as shown in FIG.

[0031] Although the message creation unit 23 has been described as creating the messages 60 and 62 and outputting them to the robot head 40, the present invention is not limited to this. Such messages may be created in advance. The messages created in advance may be stored in the storage device 30. The message creation unit 23 can output an appropriate message to the robot head 40 by referring to the storage device 30. An example of a message created in advance is shown in FIG. 5. When the user 51 is responsible for dangerous driving, examples of messages selected by the message creation unit 23 include "What happened?", "What happened?", "What did you do?", and "What did you do?". These message example 1 are intended to make the user 51 admit responsibility in a roundabout way. In contrast, the message example 2 in FIG. 5 is intended to prompt the user 51 to give a specific answer. Examples of message example 2 include "Who is at fault?" and "Whose responsibility?" as shown in FIG. 5.

[0032] The above is an example of a case where it is determined that the driving of the user 51 was dangerous. Here, the user 51 is not the only one who drives the vehicle. Since the vehicle has an automatic driving function, driving without the user 51's intervention (automatic driving) is also performed. Normally, automatic driving is designed not to be dangerous. However, some abnormality may occur in automatic driving due to an unexpected cause. "Abnormality" here means that it is not normal. "Abnormality" is a concept that includes not only a failure that prevents automatic driving from performing its original function, but also a malfunction that does not lead to a failure and a sign of a failure. When an abnormality occurs in automatic driving, it may lead to a dangerous situation as shown in the judgment example of FIG. 3. An example of a conversation when an abnormality occurs in automatic driving will be described with reference to FIG. 6. The scene shown in FIG. 6 is a scene where the user 51 is talking with the robot head 40. The conversation is indicated by reference numerals 70 to 73. Reference numerals 70 and 72 indicate the speech of the robot head 40. Reference numerals 71 and 73 indicate the speech of the user 51. The flow of the conversation is in the order of reference numerals 70, 71, 72, and 73. The conditions for outputting "Was it scary?" shown at 70 will be described.

[0033] When the risk situation determination unit 21 determines that an abnormality has occurred in the automatic driving, a signal indicating the determination result is transmitted to the responsibility determination unit 22. The responsibility determination unit 22, which has received this signal, determines who is responsible for the dangerous driving. Here, it is determined that the responsibility for the dangerous driving lies with the automatic driving (vehicle side). A signal indicating the determination result is transmitted to the message creation unit 23. The message creation unit 23, which has received this signal, creates a message shown by reference numeral 70. The message creation unit 23 outputs the created message to the robot head 40. As a result, the message 70 is output by voice as shown in FIG. 6. As shown in FIG. 6, in response to the question "Was it scary?", the user 51 answers "The distance between the cars is short!" (reference numeral 71). This answer is an affirmative answer. The "affirmative answer" here means an answer in which the user 51 acknowledges that the automatic driving was dangerous. The answer of the user 51 is analyzed in the same manner as described above. Based on the analysis result, the message creation unit 23 creates a message shown by reference numeral 72 (so would you like to make it longer from next time?). The message 72 is created because the answer of the user 51 was an affirmative answer. As shown in FIG. 6, in response to the question, "Then, would you like to make it longer from next time?", the user 51 answers, "Yes!" (reference symbol 73). This answer is an affirmative answer. The "affirmative answer" here is an answer for changing the parameters of the assistance function (automatic driving function). The answer 73 is analyzed by the speech analysis unit 25. Then, it is determined whether the answer of the user 51 is affirmative or not. A signal indicating the determination result is output to the parameter change unit 26. Next time automatic driving is performed, the parameter change unit 26 changes the following distance so that it is longer than that during the previous automatic driving. The changed parameters are output to the assistance function implementation unit 34. The assistance function implementation unit 34 controls the following distance based on the changed parameters. This makes it possible to perform driving assistance that matches the user's sense.

[0034] The messages 70 and 72 may be prepared in advance, similarly to the messages 60 and 62. When the responsibility for dangerous driving lies with the autonomous driving (vehicle side), messages selected by the message preparation unit 23 include "Did you feel it was dangerous?", "Did you drive dangerously?", and "Were you scared?", as shown in Fig. 5. Other messages include "Did you brake late?", "Was the distance between the vehicles too short?", "Was the vehicle ahead too close?", "Did you press the accelerator too hard?", "Too early?", "Too late?", "Did you steer too late / too early?", "Did you veer too far to the right / left?", "Wandered?", and "Did you feel choppy?".

[0035] The cause of a dangerous situation is not limited to driving by the user 51 or automatic driving. For example, it may be caused by driving by a user of another vehicle, automatic driving of another vehicle, pedestrians, etc. The scene shown in FIG. 7 is a scene where a dangerous situation occurs because a pedestrian 53 suddenly appears. Reference numeral 80 indicates an utterance of the robot head 40. Reference numeral 81 indicates an utterance of the user 51. The conversation flows in the order of reference numerals 80, 81. When a dangerous situation occurs because a pedestrian 53 suddenly appears, the message creation unit 23 creates a message shown by reference numeral 80 (Are you OK?) and outputs it to the robot head 40.

[0036] Next, an example of the operation of the driving support device 1 will be described with reference to the flowcharts of FIGS.

[0037] If the ignition is on (YES in step S101), the process proceeds to step S103. "Ignition is on" means that the power supply of the vehicle is on. In steps S103 and S105, the dangerous situation determination unit 21 determines whether or not a dangerous situation has occurred using data acquired from the sensor 10. If a dangerous situation has occurred (YES in step S105), the process proceeds to step S107. In step S107, the responsibility determination unit 22 estimates the cause of the dangerous situation based on the data acquired from the sensor 10. For example, if the dangerous situation shown in FIG. 3 has occurred due to driving by the user 51, it is estimated that the user 51 is responsible for the dangerous driving (YES in step S113). If the dangerous situation shown in FIG. 3 has occurred due to the autonomous driving function of the vehicle, it is estimated that the autonomous driving (vehicle side) is responsible for the dangerous driving (NO in step S113). When a dangerous situation occurs due to the driving of a user of another vehicle, the automatic driving function of another vehicle, or a pedestrian, etc., it is presumed that the responsibility for the dangerous driving lies with the user of the other vehicle, the other vehicle, or the pedestrian, etc. (NO in step S109). "Pedestrians, etc." includes pedestrians, bicycles, and motorcycles.

[0038] In step S111, a message 80 is output (see FIG. 7). In step S115, a message 60 is output (see FIG. 2). The process proceeds to step S117, where the speech acquisition unit 24 acquires an answer from the user 51 via the microphone 11. If the answer from the user 51 is determined to be affirmative (YES in step S119), a message 62 for suggesting an assistance function is output (see FIG. 2). If the answer from the user 51 is determined to be negative (NO in step S119), a message is output to the effect that the user 51 is responsible for the dangerous driving.

[0039] In step S127, the message 70 is output (see FIG. 6). The process proceeds to step S129, where the speech acquisition unit 24 acquires the answer of the user 51 via the microphone 11. If it is determined that the answer of the user 51 is affirmative (YES in step S131), the parameter change unit 26 reflects the desire of the user 51 in the control content the next time autonomous driving is performed (step S133). Specifically, the parameter change unit 26 changes a parameter related to the autonomous driving function. As an example of the parameter change, the parameter is changed so that the inter-vehicle distance is increased. If it is determined that the answer of the user 51 is negative (NO in step S131), the parameter is not changed. The processes of steps S103 to S135 are repeated until the ignition is turned off.

[0040] Next, an example of the operation of the driving support device 1 will be described with reference to the flowchart of FIG.

[0041] If the ignition is on (YES in step S201), the process proceeds to step S203. In step S203, the suggestion unit 33 acquires location information from the location detection unit 28. In step S205, the suggestion unit 33 determines whether the current location of the vehicle is a location where an assistance function was previously proposed based on the location information. The "location where an assistance function was previously proposed" is referred to as "location A." If the current location of the vehicle is location A (YES in step S205), the assistance function selection unit 32 refers to the user database 31 and suggests an assistance function to the user 51 (step S207). If the user 51 accepts the assistance function (YES in step S209), the assistance function implementation unit 34 implements the assistance function (step S211). If the user 51 does not accept the assistance function (NO in step S209), the assistance function implementation unit 34 does not implement the assistance function (step S213). When the vehicle passes through location A (YES in step S215), data at that time is recorded in the user database 31 (step S217). The processes in steps S203 to S217 are repeated until the ignition is turned off.

[0042] (Action and effect) As described above, the driving assistance device 1 according to this embodiment provides the following advantageous effects.

[0043] The driving assistance device 1 includes a sensor 10 that acquires data inside and outside the vehicle, and a controller 20. The controller 20 determines whether or not the vehicle is in an abnormal state based on the data acquired by the sensor 10. When the controller 20 determines that the vehicle is in an abnormal state, it outputs a message indicating that the vehicle is in an abnormal state to a user 51 riding in the vehicle. The controller 20 acquires the user 51's response to the message via an input device. An example of the input device is a microphone 11. By providing assistance according to the response of the user 51, it is possible to provide driving assistance that matches the sense of the user 51.

[0044] "The vehicle is in an abnormal state" means a situation in which there is a possibility of a vehicle collision or accident. It is sufficient that the "possibility of a vehicle collision or accident" is determined based only on the data acquired by the sensor 10. It does not matter whether the subject of driving is the user 51 or an automatic driving function. However, the subject of driving may be taken into consideration as described below.

[0045] The answers of user 51 relate to feelings that indicate anxiety or danger regarding the state of the vehicle.

[0046] When the controller 20 determines that the answer of the user 51 to the message indicates anxiety or danger, the controller 20 suggests the use of an assistance function to assist the user 51. An example of an answer indicating anxiety or danger is a message 61 shown in Fig. 2. This makes it possible to provide driving assistance that matches the perception of the user 51.

[0047] The controller 20 estimates the cause of the abnormal state based on the data acquired by the sensor 10. When the controller 20 estimates that the cause is due to the driving of the user 51, it outputs a message to the user 51 to confirm responsibility. An example of a message to confirm responsibility is "Whose responsibility?" shown in FIG. 5. When the controller 20 determines that the user 51's response to the message is an acknowledgement of responsibility, it suggests the use of an assistance function to assist the user 51. This makes it possible to provide driving assistance that matches the user 51's perception. Also, by having the user 51 acknowledge responsibility, it becomes possible to make the relationship between the user 51 and the vehicle a favorable one.

[0048] The messages include those that confirm responsibility to the user 51, those related to the condition of the vehicle, those that confirm the feelings of the user 51, and those that confirm the safety of the user 51. An example of a "message that confirms responsibility to the user 51" is "Whose fault is it?" shown in FIG. 5. An example of a "message related to the condition of the vehicle" is "Did you brake late?" shown in FIG. 5. An example of a "message that confirms the feelings of the user 51" is "Were you scared?" shown in FIG. 5. An example of a "message that confirms the safety of the user 51" is "Did you feel it was dangerous?" shown in FIG. 5.

[0049] An example of a message confirming responsibility to the user 51 is a message confirming to the user 51 what happened in or around the vehicle (see FIG. 5).

[0050] When the controller 20 determines that the response of the user 51 to the message confirming responsibility is not an admission of responsibility, it outputs a message to the effect that the responsibility lies with the user 51. This can provide the user 51 with an opportunity to change his / her way of thinking.

[0051] The controller 20 estimates the cause of the abnormal state based on the data acquired by the sensor 10. If the controller 20 estimates that the cause is due to the autonomous driving function, it outputs a message to the user 51 to check whether he / she felt anxious. An example of the "message to check whether the user 51 felt anxious" is "Were you scared?" shown in Fig. 5. This makes it possible to check whether the user 51 feels anxious about the autonomous driving function.

[0052] When the controller 20 determines that the response of the user 51 to the message confirming the anxiety indicates that the user 51 felt anxious, the controller 20 changes the parameter settings of the automatic driving function. Specifically, the controller 20 changes the parameter of the automatic driving function to the safe side. One example of the parameter change is to increase the following distance. This makes it possible to provide driving assistance that matches the sense of the user 51. Furthermore, the reliability of the automatic driving is improved.

[0053] Each of the functions described in the above embodiments may be implemented by one or more processing circuits. A processing circuit includes a programmed processing device, such as a processor including electrical circuitry. A processing circuit also includes devices such as application specific integrated circuits (ASICs) or circuit components arranged to perform the described functions.

[0054] As described above, the embodiment of the present invention has been described, but the description and drawings forming a part of this disclosure should not be understood as limiting this invention. From this disclosure, various alternative embodiments, examples and operating techniques will become apparent to those skilled in the art. [Explanation of symbols]

[0055] 1 Driving assistance device, 10 Sensor, 11 Microphone, 12 Camera, 13 GPS receiver, 14 Switch, 20 Controller, 40 Robot head

Claims

1. A sensor for acquiring data inside and outside the vehicle; A controller, The controller: determining whether the vehicle is in an abnormal state based on the data acquired by the sensor; When it is determined that the vehicle is in an abnormal state, a message is output to a user riding in the vehicle, indicating that the vehicle is in an abnormal state; acquiring a response from the user to the message via an input device; Suggesting the use of a support function to support the user based on the user's response to the message. A driving assistance device comprising:

2. The vehicle being in an abnormal state means a situation where there is a possibility of a collision or accident of the vehicle.

2. The driving support device according to claim 1 .

3. The user's response is related to feelings of anxiety or danger regarding the state of the vehicle.

3. A driving assistance device according to claim 1 or 2.

4. When the controller determines that the user's response to the message indicates anxiety or danger, the controller suggests the use of a support function to support the user.

4. A driving support device according to claim 1, wherein the driving support device is a vehicle driving device.

5. The controller: Inferring a cause of the abnormal state based on the data acquired by the sensor; If it is estimated that the cause is due to the driving of the user, a message is output to the user to confirm the responsibility; If it is determined that the user's response to the message is an admission of responsibility, suggesting the use of an assistance function to assist the user.

5. The driving support device according to claim 4.

6. The messages may include those that confirm responsibility to the user, those that relate to the condition of the vehicle, those that confirm the user's feelings, or those that confirm the user's safety.

6. A driving support device according to claim 1,

7. A message confirming responsibility to the user is a message confirming to the user what happened in or around the vehicle.

7. The driving support device according to claim 6.

8. If the controller determines that the user's response to the message confirming the responsibility does not acknowledge the responsibility, the controller outputs a message indicating that the responsibility lies with the user.

8. A driving support device according to claim 6 or 7.

9. Acquire data inside and outside the vehicle, determining whether the vehicle is in an abnormal state based on the acquired data; When it is determined that the vehicle is in an abnormal state, a message is output to a user riding in the vehicle, indicating that the vehicle is in an abnormal state; acquiring a response from the user to the message via an input device; Suggesting the use of a support function to support the user based on the user's response to the message. A driving assistance method comprising:

Images