In-vehicle system and driving diagnostic program

The in-vehicle system uses a probe data map and autonomous sensors to enhance safety and security by identifying hazards and providing alerts, addressing the limitations of conventional systems that focus only on vehicle behavior.

JP7593261B2Active Publication Date: 2024-12-03DENSO CORP
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2021128410
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-08-04
Publication Date
2024-12-03
Estimated Expiration
2041-08-04

AI Technical Summary

Technical Problem

Conventional driving diagnosis systems that rely solely on the behavior of the own vehicle fail to account for varying driving environments, leading to inadequate safety and security feedback for drivers.

Method used

An in-vehicle system that utilizes a probe data map and autonomous system sensors to identify caution spots, assess driver attention, and provide real-time safety notifications based on the comparison between the map's quality and the driver's actions.

Benefits of technology

Enhances driver safety and security by accurately identifying potential hazards and providing alerts when necessary, while rewarding safe driving behaviors with points, thereby improving overall driving performance.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007593261000001
    Figure 0007593261000001
  • Figure 0007593261000002
    Figure 0007593261000002
  • Figure 0007593261000003
    Figure 0007593261000003
Patent Text Reader

Abstract

To appropriately provide a driver with a sense of safety and security from a vehicle.SOLUTION: An on-vehicle system 1 comprises: an own vehicle position estimation unit 4a for estimating an own vehicle position; a probe data map acquisition unit 2a for acquiring a probe data map based on probe data from the outside of an own vehicle; a caution point identification unit 4c for identifying a caution point using the probe data map; a driver state recognition unit 4d for recognizing a driver state; a safety confirmation determination unit 4f for determining whether or not a driver performs safety confirmation for the caution point based on the driver state; and a notification control unit 5a for notifying the driver of a determination result of the safety confirmation determination unit.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an in-vehicle system and a driving diagnosis program. [Background technology]

[0002] Conventionally, a configuration has been disclosed in which driving state information while a driver is driving is transmitted from an in-vehicle system to a driving diagnosis server, and the driving diagnosis server performs driving diagnosis based on the driving state information received from the in-vehicle system (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-095403 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the method disclosed in Patent Document 1, driving diagnosis is performed based on the behavior of the vehicle, such as accelerator operation, brake operation, and speed. However, the driving environment around the vehicle is diverse, for example, the presence or absence of pedestrians, bicycles, and oncoming vehicles, and a configuration that performs driving diagnosis based only on the behavior of the vehicle may not provide an appropriate driving diagnosis result. If an appropriate driving diagnosis result is not obtained, there is a problem that the driver cannot be appropriately given a sense of safety and security from the vehicle.

[0005] The present invention has been made in consideration of the above-mentioned circumstances, and has an object to provide an in-vehicle system and a driving diagnosis program that can appropriately give a driver a sense of safety and security from the vehicle. [Means for solving the problem]

[0006] According to the invention recited in claim 1, the vehicle position estimating unit (4a) estimates the vehicle position. The probe data map acquiring unit (2a) acquires a probe data map based on probe data from outside the vehicle. The autonomous sensors (12 to 14) detect surrounding information of the host vehicle. The host vehicle surroundings recognition unit (4b) recognizes the surrounding information of the host vehicle using the detection results of the autonomous sensors. The warning spot identifying unit (4c) identifies warning spots using a probe data map. The driver's state recognizing unit (4d) recognizes the driver's state. The map quality determination unit (4e) compares feature information shown on the probe data map with surrounding information of the vehicle's surroundings shown by the detection results of the autonomous sensors, and determines whether the quality of the probe data map is good or bad. The safety confirmation judgment unit (4f) When the quality of the probe data map is judged to be good, the good quality is indicated by the probe data map. The notification control unit (5a) determines whether the driver has performed a safety check for the caution area based on the driver's state. The notification control unit (5a) notifies the driver of the result of the determination by the safety check determination unit.

[0007] Unlike conventional methods that only perform driving diagnosis based on the vehicle's own behavior, this system uses probe data maps to identify areas of concern. When the quality of the probe data map is judged to be good, the good quality is indicated by the probe data map. Whether the driver is performing a safety check for the caution points is judged based on the driver's state, and the judgment result is notified to the driver. If the driver has not performed a safety check for the caution points, the driver is notified to that effect and made aware of it, so that the driver can be made aware of the need to perform a safety check. If the driver has performed a safety check for the caution points, the driver is notified to that effect and made aware of it, so that the driver can be appropriately given a sense of safety and security from the vehicle. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a functional block diagram showing a configuration of an in-vehicle system according to an embodiment. [Diagram 2] Functional block diagram showing the overall configuration including non-vehicle systems [Diagram 3] Flowchart showing probe data transmission processing [Figure 4] Flowchart showing driving diagnosis processing [Diagram 5] Flowchart showing driving diagnosis processing [Figure 6] FIG. 13 is a diagram showing a manner in which driving caution information is displayed in an in-vehicle system. [Figure 7] FIG. 13 is a diagram showing a manner in which a driving diagnosis result is displayed in an in-vehicle system. [Figure 8] FIG. 13 is a diagram showing a manner in which a driving diagnosis result is displayed on a portable information terminal. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] An embodiment will be described below with reference to the drawings. As shown in Fig. 1, an in-vehicle system 1 mounted on a vehicle includes a data communication module (hereinafter referred to as a DCM (Data Communication Module)) 2, a central ECU (Electronic Control Unit) 3, an ADAS (Advanced Driver Assistance System) domain ECU 4, a cockpit domain ECU 5, a body ECU 6, and a powertrain domain ECU 7.

[0010] The DCM 2 and each of the ECUs 3 to 7 are each equipped with a microcomputer having a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and an I / O (Input / Output). The microcomputer executes a computer program stored in a non-transient tangible storage medium, thereby executing processing corresponding to the computer program and controlling the overall operation of the DCM 2 and each of the ECUs 3 to 7. The microcomputer has the same meaning as a processor. The non-transient tangible storage medium may share its hardware with other computer resources. The DCM 2 and each of the ECUs 3 to 7 cooperate to control the overall operation of the in-vehicle system 1.

[0011] As shown in FIG. 2, the in-vehicle system 1 is connected to a map generation server 8 and a driving data management server 9 so as to be able to communicate data with each other via a communication network including, for example, a digital communication line. The map generation server 8 is a server managed by an OEM, a data supplier, etc., and has a function of integrating a plurality of probe data to generate a probe data map. The driving data management server 9 is a server managed by an OEM, a data supplier, etc., and has a function of managing driver driving data. The driving data management server 9 is also connected to an affiliated service server 10 so as to be able to communicate data with each other via a communication network. The affiliated service server 10 has a function of managing points to be given to drivers. The points given to drivers can be used as compensation for various purposes, such as automobile insurance premiums, parking fees, vehicle maintenance costs, OTA charges, purchase fees for goods, and fees for using facilities such as movie theaters and restaurants.

[0012] There is a multiple-to-one relationship between the in-vehicle systems 1, the map generation server 8, and the driving data management server 9. That is, a plurality of in-vehicle systems 1 mounted on a plurality of vehicles are connected to one map generation server 8 so as to be able to communicate data therewith, and a plurality of in-vehicle systems 1 mounted on a plurality of vehicles are connected to one driving data management server 9 so as to be able to communicate data therewith.

[0013] The DCM 2 has a V2X (Vehicle to X) communication function as an in-vehicle communication device, and performs communication control on the vehicle side in data communication with infrastructure facilities including the map generation server 8 and the driving data management server 9. The DCM 2 includes a probe data map acquisition unit 2a, a first driver driving data transmission unit 2b, and a second driver driving data transmission unit 2c.

[0014] The central ECU 3 performs integrated management of the ADAS domain ECU 4, the cockpit domain ECU 5, and the powertrain domain ECU 7. The ADAS domain ECU 4 includes a host vehicle position estimation unit 4a, a host vehicle surroundings recognition unit 4b, a caution area identification unit 4c, a driver state recognition unit 4d, a map quality determination unit 4e, a safety confirmation determination unit 4f, and a driving intervention implementation unit 4g. The cockpit domain ECU 5 includes a notification control unit 5a.

[0015] The locator 11 calculates position coordinates using various parameters included in a GNSS satellite signal received from a GNSS (Global Navigation Satellite System) satellite, corrects the calculated position coordinates using detection results from a gyro sensor, a vehicle speed sensor, and the like, and outputs the corrected position coordinates to the vehicle position estimation unit 4a. Note that GNSS is a general term for global positioning and navigation satellite systems, and various systems such as GPS (Global Positioning System), GLONASS (Global Navigation Satellite System), Galileo, BeiDou, and IRNSS (Indian Regional Navigational Satellite System) have been realized. When the vehicle position estimation unit 4a receives the position coordinates from the locator 11, it estimates the vehicle position using the input position coordinates and outputs the estimated vehicle position to the DCM2.

[0016] The millimeter wave radar 12 irradiates millimeter waves to the surroundings of the vehicle to sense the surroundings of the vehicle, and outputs the detection result to the vehicle surroundings recognition unit 4b. The millimeter wave radar 12 has the advantages of being highly linear, allowing for miniaturization of the circuit and antenna design, high distance resolution and high angle resolution due to a wide bandwidth, and being resistant to environmental changes such as weather. The sonar 13 irradiates ultrasonic waves to the surroundings of the vehicle to sense the surroundings of the vehicle, and outputs the detection result to the vehicle surroundings recognition unit 4b. The sonar 13 has the advantage of being able to reflect on glass surfaces and water surfaces. The LiDAR (Light Detection and Ranging) 14 irradiates laser light to the surroundings of the vehicle to sense the surroundings of the vehicle, and outputs the detection result to the vehicle surroundings recognition unit 4b. The LiDAR 14 has the advantages of being able to reflect on non-metallic surfaces, and being able to detect at night or during rain. The camera 15 includes an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), captures an image of the surroundings of the vehicle, and outputs the captured camera image to the vehicle surroundings recognition unit 4b. The millimeter wave radar 12, sonar 13, LiDAR 14, and camera 15 correspond to autonomous system sensors. It is not necessary to include all of the millimeter wave radar 12, sonar 13, LiDAR 14, and camera 15, and a configuration including at least one of the autonomous system sensors may be used. Also, a configuration including an autonomous system sensor other than the millimeter wave radar 12, sonar 13, LiDAR 14, and camera 15 may be used.

[0017] The vehicle surroundings recognition unit 4b receives the detection results from the millimeter wave radar 12, the sonar 13, the LiDAR 14, and the camera image from the camera 15, and recognizes the surroundings of the vehicle using the received detection results and camera image, and outputs the recognized surroundings information of the vehicle to the DCM2, the map quality determination unit 4e, the safety confirmation determination unit 4f, and the driving intervention implementation unit 4g. The surroundings information includes static information such as the positions and types of marking lines, stop lines, and crosswalks painted on the road surface, the positions and types of traffic lights and road signs erected on the road surface, road width, road type, number of lanes, and other feature information. The surroundings information also includes dynamic and static information such as the positions of pedestrians, bicycles, and oncoming vehicles.

[0018] When the DCM2 receives the vehicle position from the vehicle position estimation unit 4a and the surrounding information of the vehicle from the vehicle surroundings recognition unit 4b, the DCM2 transmits probe data in which the input vehicle position, surrounding information of the vehicle, and time are associated with each other to the map generation server 8 via the communication network. In this case, the DCM2 transmits the probe data to the map generation server 8 via the communication network, for example, when the traveled distance reaches a certain distance, when the elapsed time reaches a certain time, etc.

[0019] When the map generation server 8 receives the probe data transmitted from the in-vehicle system 1, the map generation server 8 integrates the multiple pieces of probe data to generate a probe data map. For example, every time the map generation server 8 receives probe data transmitted from the in-vehicle system 1, the map generation server 8 sequentially updates the probe data map by sequentially reflecting feature information included in the received probe data in the latest probe data map stored at that time.

[0020] When the transmission condition for the probe data map is satisfied, the map generation server 8 transmits the latest probe data map stored at that time to the in-vehicle system 1. The map generation server 8, which manages the probe data map by segment for each block, for example, and upon receiving the vehicle position transmitted from the in-vehicle system 1, identifies the probe data map of the segment corresponding to the received vehicle position, and transmits the identified probe data map via the communication network to the in-vehicle system 1 which is the transmission source of the vehicle position.

[0021] In the DCM 2, when the probe data map acquisition unit 2a receives the probe data map transmitted from the map creation server 8, it outputs the received probe data map to the warning point specification unit 4c and the map quality determination unit 4e.

[0022] When the map quality determination unit 4e receives the surrounding information of the vehicle from the vehicle surroundings recognition unit 4b and the probe data map from the DCM2, it compares the probe data map with the surrounding information of the vehicle and determines whether the quality of the probe data map is good or bad. The map quality determination unit 4e determines whether the feature information shown by the probe data map matches the surrounding information of the vehicle shown by the detection result of the autonomous sensor, for example, and determines whether the quality of the probe data map is good or bad. Specifically, the map quality determination unit 4e determines whether the positions and types of features shown by the probe data map match the positions and types of features included in the surrounding information of the vehicle shown by the detection result of the autonomous sensor, and determines whether the quality of the probe data map is good or bad.

[0023] The map quality determination unit 4e quantifies the degree of coincidence between the feature information shown by the probe data map and the surrounding information around the vehicle shown by the detection result of the autonomous sensor, for example, and compares the quantified value with a threshold value. When the map quality determination unit 4e determines that the deviation between the feature information shown by the probe data map and the surrounding information around the vehicle shown by the detection result of the autonomous sensor is small and the value indicating the degree of coincidence is equal to or greater than the threshold value, it determines that the quality of the probe data map is good. When the map quality determination unit 4e determines that the quality of the probe data map is good, it outputs the probe data map determined to be of good quality to the caution point identification unit 4c. On the other hand, when the map quality determination unit 4e determines that the deviation between the feature information shown by the probe data map and the surrounding information around the vehicle shown by the detection result of the autonomous sensor is large and the value indicating the degree of coincidence is less than the threshold value, it determines that the quality of the probe data map is bad.

[0024] The external array microphone 16 outputs audio information collected around the vehicle to the caution area identification unit 4c. The external array microphone 16 also corresponds to an autonomous sensor, like the millimeter wave radar 12, the sonar 13, the LiDAR 14, and the camera 15. When the caution area identification unit 4c receives the probe data map from the map quality determination unit 4e, it identifies caution areas and outputs the identification result to the safety confirmation determination unit 4f. The caution area is, for example, a blind spot at an intersection, and is a location where the driver needs to confirm safety while driving. In this case, when the caution area identification unit 4c receives audio information from the external array microphone 16, it also refers to the input audio information to identify the caution area. When the caution area identification unit 4c does not receive the probe data map from the map quality determination unit 4e, it identifies the caution area using the detection result of the autonomous sensor and outputs the identification result to the safety confirmation determination unit 4f.

[0025] A Driver Status Monitor (registered trademark) (hereinafter referred to as DSM (Driver Status Monitor)) 17, which monitors the driver's state, captures an image of the driver's face using a driver monitor camera, determines the driver's facial direction, line of sight, head movement, etc. from the facial image, and outputs the determination result to the driver state recognition unit 4d.

[0026] When the driver state recognition unit 4d receives the judgment result from the DSM 17, it recognizes the driver state using the judgment result and outputs driver state information indicating the recognized driver state to the DCM 2, the safety confirmation judgment unit 4f, and the driving intervention implementation unit 4g.

[0027] The safety confirmation determination unit 4f inputs surrounding information of the vehicle from the vehicle surroundings recognition unit 4b and driver state information from the driver state recognition unit 4d, and determines whether or not an alert needs to be issued using the input surrounding information of the vehicle and the driver state information. The safety confirmation determination unit 4f determines whether or not the driver's line of sight is directed toward a caution point in a situation where a caution point has occurred, determines whether or not the driver is performing a safety check based on the driver state, and determines whether or not an alert needs to be issued.

[0028] When the safety confirmation determination unit 4f determines that the driver's line of sight is directed toward the attention location, it determines that it is not necessary to issue an alert. On the other hand, when the safety confirmation determination unit 4f determines that the driver's line of sight is not directed toward the attention location, it determines that it is necessary to issue an alert, and outputs a notification instruction to the notification control unit 5a. When the notification instruction is input from the safety confirmation determination unit 4f, the notification control unit 5a outputs a drive instruction to a head-up display (hereinafter referred to as HUD (Head-Up Display)) 18, a speaker 19, and an ambient light 20, and also outputs a notification instruction to the body ECU 6. The notification control unit 5a issues an alert to a location in the HUD 18, the speaker 19, the ambient light 20, and the side electronic mirror 21 close to the driver's line of sight, and notifies the driver of incomplete safety confirmation information indicating that the driver has not performed a safety confirmation.

[0029] The alert is, for example, a message or an icon that prompts the driver to check the safety of the caution area. If the driver's line of sight is directly ahead in the vehicle travel direction, the notification control unit 5a displays, for example, a message or an icon in front of the driver on the HUD 18. If the driver's line of sight is ahead to the right in the vehicle travel direction, the notification control unit 5a displays, for example, a message or an icon on the HUD 18 to the right in front of the driver. If the driver's line of sight is ahead to the left in the vehicle travel direction, the notification control unit 5a displays, for example, a message or an icon on the HUD 18 to the left in front of the driver. In addition, the notification control unit 5a may output, for example, a message that prompts the driver to check the safety of the caution area from the speaker 19. By issuing an alert in this manner, the driver can be made aware that he is not paying attention to the caution area.

[0030] In the DCM2, when the safety confirmation determination unit 4f determines that the driver's line of sight is directed toward the caution point and that there is no need to issue an alert, the first driver driving data transmission unit 2b transmits the driver driving data to the driving data management server 9 via the communication network to give points for the driver's line of sight being directed toward the caution point, i.e., the driver making a safety confirmation. The driver driving data includes driver information that can identify the driver, and information indicating the behavior of the vehicle, such as the vehicle's driving position, accelerator operation, brake operation, steering operation, and speed.

[0031] When the driving data management server 9 receives the driver driving data transmitted from the in-vehicle system 1, it transmits the received driver driving data to the affiliated service server 10. When the affiliated service server 10 receives the driver driving data transmitted from the driving data management server 9, it performs driving diagnosis using the received driver driving data and assigns points to the driver according to the driving diagnosis result in association with the driver. The affiliated service server 10 may assign a fixed number of points regardless of the driving diagnosis result, or may assign different numbers of points depending on the level of the driving diagnosis result. When the affiliated service server 10 assigns points to the driver in this manner, it transmits point data to the driving data management server 9 to notify the driver that the points have been assigned.

[0032] When the driving data management server 9 receives the point data transmitted from the affiliated service server 10, it transmits the received point data to the DCM2. When the DCM2 receives the point data transmitted from the driving data management server 9, it outputs the received point data to the safety confirmation determination unit 4f. When the safety confirmation determination unit 4f inputs the point data from the DCM2, it outputs a notification instruction to the notification control unit 5a.

[0033] When the notification control unit 5a receives a notification instruction from the safety confirmation determination unit 4f, the notification control unit 5a outputs a drive instruction to the HUD 18, the speaker 19, and the ambient light 20, notifies the driver of point-granting information indicating that points have been granted, and notifies the driver of safety confirmation implementation information indicating that the driver is performing a safety confirmation. The point-granting information is, for example, a message or an icon for notifying the driver that points have been granted, and the notification control unit 5a causes, for example, the HUD 18 to display the message or the icon. The notification control unit 5a may also cause the speaker 19 to output a sound, such as a "clink" sound, that expresses that a coin has fallen or a message indicating that points have been granted. By notifying the point-granting information in this manner, the driver can recognize that points have been granted by performing a safety confirmation for a caution point, and the driver can be made aware of continuing to perform safety confirmation for caution points.

[0034] The sensor group 23 attached to the airbag 22 includes, for example, a vehicle speed sensor, an acceleration sensor, and a yaw rate sensor, which detect the vehicle speed, acceleration, and yaw rate, respectively, and output the detection results to the driving intervention execution unit 4g. The sensor group 23 may be attached to the ADAS domain ECU 4 or the central ECU 3.

[0035] The driving intervention unit 4g inputs surrounding information about the vehicle from the vehicle surroundings recognition unit 4b, driver state information from the driver state recognition unit 4d, and detection results from the sensor group 23 attached to the airbag 22, and then determines whether or not it is necessary to intervene in the driver's driving operation using the input surrounding information about the vehicle, the driver state information, and the detection results. The driving intervention unit 4g determines, for example, whether the driver's line of sight is facing the vehicle's traveling direction, whether the vehicle's traveling direction is dangerous, and whether the vehicle speed, acceleration, and yaw rate are normal, and determines whether or not it is necessary to intervene in the driver's driving operation.

[0036] The driving intervention unit 4g, for example, determines that the driver's line of sight is directed in the vehicle travel direction, that the vehicle travel direction is not dangerous, and that the vehicle speed, acceleration, and yaw rate are normal, and if it determines that the driver's driving is appropriate, it determines that there is no need to intervene in the driver's driving operation. On the other hand, if the driving intervention unit 4g determines that the driver's line of sight is not directed in the vehicle travel direction, that the vehicle travel direction is dangerous, or that the vehicle speed, acceleration, and yaw rate are not normal, and if it determines that the driver's driving is not appropriate, it determines that there is a need to intervene in the driver's driving operation, and outputs a driving intervention instruction to the powertrain domain ECU 7.

[0037] When the powertrain domain ECU 7 receives a driving intervention command from the driving intervention execution unit 4g, the powertrain domain ECU 7 outputs the driving intervention command to the brake device 24. The sensor group 25 attached to the brake device 24 includes, for example, a vehicle speed sensor, an acceleration sensor, and a yaw rate sensor, which detect the vehicle speed, acceleration, and yaw rate, respectively, and output the detection results to the brake device 24. The sensor group 25 may be attached to the powertrain domain ECU 7 or the central ECU 3. When the brake device 24 receives a driving intervention command from the powertrain domain ECU 7, the brake device 24 performs collision damage mitigation braking (hereinafter referred to as AEB (Autonomous Emergency Braking)) control using, for example, the detection result of the sensor group 25. Note that, in addition to AEB control, steering control, attitude control, etc. may be performed as an intervention in the driving operation, and for example, skid prevention control (hereinafter referred to as ESC (Electronic Stability Control)) may be performed.

[0038] In the DCM2, when it is determined that the driver's line of sight is directed in the direction of travel of the vehicle, the direction of travel of the vehicle is not dangerous, the vehicle speed, acceleration, and yaw rate are normal, and it is determined that there is no need to intervene in the driver's driving operation, the second driver driving data transmission unit 2c transmits the driver driving data to the driving data management server 9 via the communication network to award points for the fact that there is no need to intervene in the driver's driving operation, that is, for the fact that the driver has continued to drive safely even after confirming safety. Thereafter, the driving data management server 9 and the affiliated service server 10 perform the same process as when the first driver driving data transmission unit 2b transmits the driver driving data, and award points in association with the driver.

[0039] As described above, the point allocation information is notified by the in-vehicle system 1 while the driver is driving, but the driving diagnosis result may be notified by the in-vehicle system 1 when the driver finishes driving. Also, by registering the address of the driver's mobile information terminal such as a smartphone in advance, the driving diagnosis result may be transmitted from the driving data management server 9 to the driver's mobile information terminal via a communication network when the driver finishes driving, and the driving diagnosis result may be notified by the mobile information terminal.

[0040] Next, the operation of the above-mentioned configuration will be described with reference to Fig. 3 to Fig. 8. A probe data transmission process and a driving diagnosis process will be described as processes performed by the in-vehicle system 1. The in-vehicle system 1 performs the probe data transmission process by a probe data transmission program, and performs the driving diagnosis process by a driving diagnosis program.

[0041] (1) Probe data transmission process (see Figure 3) When the start condition of the probe data transmission process is satisfied, for example, by turning on the ignition, the in-vehicle system 1 starts the probe data transmission process. When the in-vehicle system 1 starts the probe data transmission process, the vehicle position estimation unit 4a estimates the vehicle position using the position coordinates input from the locator 11 (S1). The in-vehicle system 1 recognizes the surroundings of the vehicle using the detection result input from the millimeter wave radar 12, the detection result input from the sonar 13, the detection result input from the LiDAR 14, and the camera image input from the camera 15 (S2). The in-vehicle system 1 generates probe data by associating the vehicle position estimated by the vehicle position estimation unit 4a with the surrounding information of the surroundings of the vehicle recognized by the vehicle surroundings recognition unit 4b and time (S3), and stores the generated probe data in a data storage area (S4).

[0042] The in-vehicle system 1 determines whether the conditions for transmitting probe data are met (S5), and if it determines that the conditions for transmitting probe data are met (S5: YES), for example when the traveled distance reaches a certain distance or the elapsed time reaches a certain time, the in-vehicle system 1 transmits the probe data stored in the data storage area from the DCM2 to the map generation server 8 via the communication network (S6).

[0043] The in-vehicle system 1 determines whether the end condition of the probe data transmission process is satisfied, for example, by turning off the ignition (S7), and if it determines that the end condition of the probe data transmission process is not satisfied with the ignition on (S7: NO), it returns to the above-mentioned step S1 and repeats step S1 and subsequent steps. If the in-vehicle system 1 determines that the end condition of the probe data transmission process is satisfied by turning off the ignition (S7: YES), it ends the probe data transmission process.

[0044] (2) Driving diagnosis process (see Figures 4 and 5) The in-vehicle system 1 starts the driving diagnosis process when the start condition of the driving diagnosis process is satisfied, for example, by turning on the ignition. When the in-vehicle system 1 starts the driving diagnosis process, the vehicle position estimation unit 4a estimates the vehicle position using the position coordinates input from the locator 11 (S11, which corresponds to the vehicle position estimation procedure). The in-vehicle system 1 recognizes the surroundings of the vehicle using the detection result input from the millimeter wave radar 12, the detection result input from the sonar 13, the detection result input from the LiDAR 14, and the camera image input from the camera 15 (S12).

[0045] The in-vehicle system 1 transmits the vehicle position estimated by the vehicle position estimation unit 4a from the DCM 2 to the map generation server 8 via the communication network (S13), and waits for reception of a probe data map from the map generation server 8 (S14). When the map generation server 8 receives the vehicle position transmitted from the in-vehicle system 1, it identifies a probe data map of a segment corresponding to the received vehicle position, and transmits the identified probe data map to the in-vehicle system 1, which is the transmission source of the vehicle position, via the communication network. Note that S11 to S13 may be performed in S1 to S6 of the probe data transmission process. That is, the in-vehicle system 1 may transmit the vehicle position by transmitting probe data, and the map generation server 8 may, when receiving the probe data transmitted from the in-vehicle system 1, identify the vehicle position from the received probe data, identify a probe data map of a segment corresponding to the identified vehicle position, and transmit the identified probe data map to the in-vehicle system 1, which is the transmission source of the vehicle position, via the communication network.

[0046] When the in-vehicle system 1 determines that the probe data map transmitted from the map generation server 8 has been received by the DCM 2 (S14: YES, which corresponds to the probe data map acquisition procedure), it compares the received probe data map with surrounding information around the vehicle (S15), and determines the quality of the probe data map by the map quality determination unit 4e (S16). When the in-vehicle system 1 determines that the quality of the probe data map is good because there is a small discrepancy between the feature information shown by the probe data map and the surrounding information around the vehicle shown by the detection results of the autonomous sensor (S16: YES), it identifies points of caution using the probe data map determined to be of good quality (S17).

[0047] On the other hand, when the vehicle system 1 determines that there is a large discrepancy between the feature information shown by the probe data map and the surrounding information around the vehicle shown by the detection results of the autonomous sensor and determines that the probe data map is of poor quality (S16: NO), it identifies caution areas using the detection results of the autonomous sensor (S18, which corresponds to the caution area identification procedure).

[0048] The in-vehicle system 1 inputs the judgment result of the driver's face image captured by the driver monitor camera, and recognizes the driver's state by the driver state recognition unit 4d (S19, which corresponds to the driver state recognition procedure). The in-vehicle system 1 judges whether the driver's line of sight is directed toward the caution point in a situation where the caution point occurs, judges whether the driver is checking for safety based on the driver's state, and judges whether it is necessary to issue an alert by the safety confirmation judgment unit 4f (S20, which corresponds to the safety confirmation judgment procedure).

[0049] When the in-vehicle system 1 determines that the driver's line of sight is directed in the direction of the caution area and that there is no need to issue an alert (S20: NO), it transmits the driver's driving data from DCM2 via the communication network to the driving data management server 9 to award points for the driver's safety check (S21), and waits to receive point data from the driving data management server 9 (S22).

[0050] When the driving data management server 9 receives the driver driving data transmitted from the in-vehicle system 1, it transmits the received driver driving data to the affiliated service server 10. When the affiliated service server 10 receives the driver driving data transmitted from the driving data management server 9, it performs a driving diagnosis using the received driver driving data, assigns points to the driver according to the driving diagnosis result in association with the driver, and transmits point data to the driving data management server 9 to notify the driver that the points have been assigned. When the driving data management server 9 receives the point data transmitted from the affiliated service server 10, it transmits the received point data to the in-vehicle system 1.

[0051] When the in-vehicle system 1 determines that the point data transmitted from the driving data management server 9 has been received by the DCM2 (S22: YES), it drives the HUD 18, the speaker 19, the ambient light 20, etc., and notifies the notification control unit 5a of point allocation information indicating that points have been allocated (S23, which corresponds to the notification control procedure).

[0052] On the other hand, when the in-vehicle system 1 determines that the driver's line of sight is not directed toward the attention location and determines that an alert needs to be issued (S20: YES), it drives the HUD 18, the speaker 19, the ambient light 20, etc., and issues an alert to a location close to the driver's line of sight by the notification control unit 5a. (S24, corresponding to the notification control procedure). That is, as shown in FIG. 6, for example, when the in-vehicle system 1 determines that a pedestrian B may jump out from behind a building A in the left front of the vehicle and the left front of the vehicle is identified as the attention location, but the driver's line of sight is not directed toward the left front of the vehicle, it determines that an alert needs to be issued. When the in-vehicle system 1 determines that the driver's line of sight is directed directly ahead of the vehicle's traveling direction, for example, it displays a message M such as "Watch out for the left front" in front of the driver by the HUD 18. Note that any mode of issuing an alert may be used as long as the driver can recognize the activation of the alert.

[0053] After the in-vehicle system 1 notifies the point grant information by the notification control unit 5a, it inputs surrounding information around the vehicle, inputs driver state information, and inputs detection results from the sensor group 23 attached to the airbag 22, and determines whether or not it is necessary to intervene in the driver's driving operation by the driving intervention execution unit 4g (S25). For example, when the in-vehicle system 1 determines that the driver's line of sight is facing the vehicle's traveling direction, that the vehicle's traveling direction is not dangerous, and that the vehicle speed, acceleration, and yaw rate are normal, and it is determined that it is not necessary to intervene in the driver's driving operation (S25: NO), it transmits the driver's driving data from the DCM2 to the driving data management server 9 via the communication network to grant points for the driver's continued safe driving even after the driver has confirmed safety (S26), and waits to receive point data from the driving data management server 9 (S27).

[0054] When the driving data management server 9 receives the driver driving data transmitted from the in-vehicle system 1, it transmits the received driver driving data to the affiliated service server 10. When the affiliated service server 10 receives the driver driving data transmitted from the driving data management server 9, it uses the received driver driving data to evaluate the degree of safe driving as a driving diagnosis, assigns points to the driver according to the driving diagnosis result in association with the driver, and transmits point data to the driving data management server 9 to notify the driver that the points have been assigned. When the driving data management server 9 receives the point data transmitted from the affiliated service server 10, it transmits the received point data to the in-vehicle system 1.

[0055] When the in-vehicle system 1 determines that the point data transmitted from the driving data management server 9 has been received by the DCM2 (S27: YES), it drives the HUD 18, the speaker 19, the ambient light 20, etc., and notifies the notification control unit 5a of point allocation information indicating that points have been awarded (S28).

[0056] On the other hand, if the in-vehicle system 1 determines that it is necessary to intervene in the driver's driving operation (S25: YES), for example, the driver's line of sight is not facing the direction in which the vehicle is traveling, the direction in which the vehicle is traveling is dangerous, or the vehicle speed, acceleration, and yaw rate are not normal, the in-vehicle system 1 performs, for example, ABS control by the powertrain domain ECU 7 and intervenes in the driver's driving operation (S29).

[0057] The in-vehicle system 1 judges whether or not the end condition of the driving diagnosis process is satisfied by, for example, turning off the ignition (S30), and if it judges that the end condition of the driving diagnosis process is not satisfied while the ignition is on (S30: NO), it returns to the above-mentioned step S11 and repeats step S11 and subsequent steps. If the in-vehicle system 1 judges that the end condition of the driving diagnosis process is satisfied by turning off the ignition (S30: YES), it displays, for example, the driving diagnosis result on a center display, a meter display, or the like (S31), and ends the driving diagnosis process. As shown in FIG. 7, the in-vehicle system 1 displays, for example, the driving diagnosis result performed by the data management center 9 for six items A to F on a center display, a meter display, or the like. Each of the six items A to F is one of the indexes indicating whether the driver's driving is safe or not, and is used to evaluate, for example, the frequency of sudden acceleration, the frequency of sudden deceleration, the frequency of sudden steering, and the like, on a five-point scale.

[0058] 8, when the driver's mobile information terminal 51 receives the driving diagnosis result transmitted from the driving data management server 9, it displays the received driving diagnosis result on the display 52. ​​Note that, as long as the driver can recognize the driving diagnosis result, the driving diagnosis result displayed on the center display or meter display of the in-vehicle system 1 and the driving diagnosis result displayed on the display 52 of the mobile information terminal 51 may be displayed in any manner.

[0059] As described above, according to this embodiment, the following advantageous effects can be obtained. Unlike conventional driving diagnosis based only on the behavior of the vehicle, the in-vehicle system 1 identifies caution points using a probe data map, judges whether the driver has performed a safety check for the caution points based on the driver's state, and notifies the driver of the judgment result. If the driver has not performed a safety check for the caution points, the driver is notified and made aware of the fact, so that the driver can be made aware of the need to check for safety. If the driver has performed a safety check for the caution points, the driver is notified and made aware of the fact, so that the driver can be appropriately given a sense of safety and security from the vehicle.

[0060] The system compares the feature information shown by the probe data map with the surrounding information around the vehicle shown by the detection results of the autonomous sensor, and when it judges that the quality of the probe data map is good, it judges whether the driver has performed safety checks for the caution points shown by the probe data map judged to be of good quality, based on the driver's state. It is possible to improve the accuracy of identifying caution points by using a highly reliable probe data map, and then judge whether the driver has performed safety checks for the caution points.

[0061] When the quality of the probe data map is judged to be poor, it is not judged whether the driver has performed safety checks for the caution points indicated by the probe data map whose quality has been judged to be poor, but whether the driver has performed safety checks for the caution points indicated by the detection results of the autonomous system sensor is judged based on the driver's state. When the reliability of the probe data map is low, it is possible to determine whether the driver has performed safety checks for the caution points by identifying the caution points using the detection results of the autonomous system sensor.

[0062] When it is determined that the driver is performing a safety check, the driver driving data converted into points that will be a benefit to the driver is transmitted to the data management server 9. A service can be developed in which points are awarded to drivers for performing safety checks. Drivers can earn points by performing safety checks.

[0063] If it is determined that the driver has driven properly after performing a safety check, the driver driving data converted into points that will be a benefit to the driver is transmitted to the data management server 9. A service can be developed in which points are awarded to drivers who drive properly after performing a safety check. Drivers can further earn points by driving properly after performing a safety check.

[0064] If it is determined that the driver has not been driving appropriately after checking for safety, the system will intervene in the driver's driving operation. For example, ABS control can be implemented to deal with the driver's failure to drive appropriately after checking for safety.

[0065] Although the present disclosure has been described based on the embodiment, it is understood that the present disclosure is not limited to the embodiment or structure. The present disclosure also includes various modifications and modifications within the equivalent range. In addition, various combinations and forms, as well as other combinations and forms including only one element, more than one element, or less than one element, are also within the scope and concept of the present disclosure.

[0066] The control unit and the method described in the present disclosure may be realized by a special-purpose computer provided by configuring a processor and a memory programmed to execute one or more functions embodied in a computer program. Alternatively, the control unit and the method described in the present disclosure may be realized by a special-purpose computer provided by configuring a processor with one or more dedicated hardware logic circuits. Alternatively, the control unit and the method described in the present disclosure may be realized by one or more special-purpose computers configured by a combination of a processor and a memory programmed to execute one or more functions and a processor configured with one or more hardware logic circuits. Also, the computer program may be stored in a computer-readable non-transitory tangible recording medium as instructions executed by a computer. [Explanation of symbols]

[0067] In the drawing, 1 is an in-vehicle system, 2a is a probe data map acquisition unit, 2b is a first driver driving data transmission unit, 2c is a second driver driving data transmission unit, 4a is a vehicle position estimation unit, 4b is a vehicle surroundings recognition unit, 4c is a caution area identification unit, 4d is a driver state recognition unit, 4e is a map quality determination unit, 4f is a safety confirmation determination unit, 4g is a driving intervention implementation unit, 5a is an alarm control unit, 12 is a millimeter wave radar (autonomous system sensor), 13 is a sonar (autonomous system sensor), 14 is a LiDAR (autonomous system sensor), 15 is a camera (autonomous system sensor), and 16 is an external array microphone (autonomous system sensor).

Claims

1. a vehicle position estimating unit (4a) for estimating a vehicle position; a probe data map acquisition unit (2a) for acquiring a probe data map based on probe data from outside the vehicle; An autonomous sensor (12 to 14) that detects surrounding information around the vehicle; a vehicle surroundings recognition unit (4b) that recognizes surrounding information of the vehicle surroundings using the detection results of the autonomous sensor; A warning spot specifying unit (4c) for specifying warning spots using the probe data map; A driver state recognition unit (4d) for recognizing a driver state; a map quality determination unit (4e) for comparing feature information shown by the probe data map with surrounding information around the vehicle shown by the detection result of the autonomous sensor, and determining whether the quality of the probe data map is good or bad; a safety confirmation determination unit (4f) that, when it is determined that the quality of the probe data map is good, determines, based on a driver state, whether or not a driver has performed a safety confirmation for a caution point indicated by the probe data map whose quality has been determined to be good; and a notification control unit (5a) that notifies a driver of the determination result of the safety confirmation determination unit.

2. An in-vehicle system as described in claim 1, wherein, when the quality of the probe data map is determined to be poor, the safety confirmation judgment unit does not judge whether the driver has performed a safety check for the caution points indicated by the probe data map whose quality has been determined to be poor.

3. An in-vehicle system as described in claim 2, wherein the safety confirmation judgment unit, when determining the quality of the probe data map, judges based on the driver's state whether the driver has performed a safety check for caution areas indicated by the detection results of the autonomous sensor.

4. An in-vehicle system as described in any one of claims 1 to 3, wherein the attention area identification unit identifies areas that are blind spots from the driver as the attention areas.

5. An in-vehicle system as described in any one of claims 1 to 4, wherein the notification control unit, when it is determined that the driver is performing a safety check, notifies the driver of safety check implementation information indicating that a safety check is being performed.

6. An in-vehicle system as described in any one of claims 1 to 5, comprising a first driver driving data transmission unit (2b) which transmits driver driving data outside the vehicle when it is determined that the driver is performing safety checks, and the driver driving data is converted into points that are a reward for the driver.

7. The in-vehicle system according to any one of claims 1 to 6, wherein the notification control unit, when it is determined that the driver has not performed a safety check, notifies the driver of incomplete safety check information indicating that the driver has not performed a safety check.

8. An in-vehicle system as described in claim 7, wherein the notification control unit notifies the driver of the information that the safety check has not been performed by at least one of displaying the information that the safety check has not been performed in a location close to the driver's line of sight and outputting a warning sound.

9. An in-vehicle system as described in any one of claims 1 to 8, comprising: a second driver driving data transmission unit (2c) that transmits driver driving data outside the vehicle that is converted into points that are a reward for the driver when it is determined that the driver is driving appropriately after performing a safety check.

10. A driving intervention implementation unit (4g) that intervenes in the driving operation of a driver, The in-vehicle system according to claim 9 , wherein the driving intervention execution unit intervenes in the driving operation of the driver when it is determined that the driver has not driven appropriately after performing a safety check.

11. An in-vehicle system (1), a vehicle position estimation step for estimating a vehicle position; a probe data map acquisition step of acquiring a probe data map based on the probe data from outside the vehicle; a vehicle surroundings recognition procedure for recognizing surrounding information around the vehicle using a detection result of an autonomous sensor that detects surrounding information around the vehicle; A warning spot identification step of identifying warning spots using the probe data map; a driver state recognition procedure for recognizing a driver state; a map quality determination step of comparing feature information shown by the probe data map with surrounding information around the vehicle shown by the detection result of the autonomous sensor, and determining whether the quality of the probe data map is good or bad; a safety confirmation determination step of determining, when the quality of the probe data map is determined to be good, whether or not the driver has performed a safety confirmation for the caution points indicated by the probe data map determined to be good based on a driver state; a notification control procedure for notifying a driver of a result of the safety confirmation determination procedure; and a driving diagnosis program for executing the notification control procedure.

Citation Information

Patent Citations

  • Operation support system

    JP2008070987A

  • Systems and methods for processing information concerning geographical regions

    JP2012514198A

  • Vehicle driving support device

    JP2015108926A

  • Drive assist system

    JP2017102519A

  • Point management device

    JP2020095403A