Driving skills evaluation method, driving skills evaluation system, and non-transient recording medium

The driving skill evaluation method and system use kernel density estimation to compare driving data with skilled driver references, improving convenience and accuracy in assessing driving skills.

JP7854570B2Active Publication Date: 2026-05-01SUBARU CORP
View PDF 6 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
SUBARU CORP
Filing Date
2023-03-31
Publication Date
2026-05-01

AI Technical Summary

Technical Problem

Existing driving skill evaluation technologies lack convenience and effectiveness in providing objective and comprehensive assessments.

Method used

A driving skill evaluation method and system that utilizes kernel density estimation images to compare driving data from a vehicle's curves with reference images from skilled drivers, calculating similarities to evaluate driving skills based on average similarities.

Benefits of technology

Enhances convenience and accuracy in evaluating driving skills by objectively comparing driving data with skilled driver references, providing a comprehensive assessment of a driver's performance.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007854570000001
    Figure 0007854570000001
  • Figure 0007854570000002
    Figure 0007854570000002
  • Figure 0007854570000003
    Figure 0007854570000003
Patent Text Reader

Abstract

A driving skill evaluation method according to the embodiment of the present disclosure includes performing detection processing for detecting a curve on the basis of travel data relating to a vehicle and performing evaluation processing for evaluating a driving skill of a drive of the vehicle on the basis of the travel data acquired in the curve. The evaluation processing includes: generating a first kernel density estimation image on the basis of the travel data acquired in a first curve detected by the detection processing; calculating a plurality of first similarities between the first kernel density estimation image and a plurality of reference images associated with each of a plurality of curves that do not include the first curve and calculating a first average similarity that is the average of the plurality of first similarities for each of the plurality of curves; and evaluating the driving skill of the driver of the vehicle on the basis of the first average similarity indicating the highest similarity from among the plurality of first average similarities.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a driving skill evaluation method and a driving skill evaluation system for evaluating a driver's driving skill, and a non-transitory recording medium on which software for evaluating a driver's driving skill is recorded.

Background Art

[0002] In recent years, technologies for evaluating a driver's driving skill have been developed in vehicles such as automobiles. For example, Patent Document 1 discloses a technology for evaluating a driver's driving skill based on longitudinal acceleration and lateral acceleration when a vehicle turns.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

[0004] A driving skill evaluation method according to an embodiment of the present disclosure includes performing a detection process of detecting a curve based on driving data of a vehicle, and performing an evaluation process of evaluating a driving skill of a driver of the vehicle based on driving data in the curve. The evaluation process includes generating a first kernel density estimation image based on driving data in a first curve detected by the detection process, calculating a plurality of first similarities between the first kernel density estimation image and a plurality of reference images respectively associated with a plurality of curves not including the first curve, calculating a first average similarity that is an average value of the plurality of first similarities for each of the plurality of curves, and evaluating a driving skill of a driver of the vehicle based on the first average similarity indicating the highest degree of similarity among the plurality of first average similarities.

[0005] A driving skill evaluation system according to one embodiment of the present disclosure comprises a curve detection circuit and an evaluation circuit. The curve detection circuit is capable of performing detection processing to detect curves based on vehicle driving data. The evaluation circuit is capable of performing evaluation processing to evaluate the driving skills of the vehicle driver based on the driving data at the curve. The evaluation processing includes generating a first kernel density estimation image based on the driving data at the first curve detected by the detection processing, calculating a plurality of first similarities between the first kernel density estimation image and a plurality of reference images associated with each of a plurality of curves that do not include the first curve, calculating a first average similarity which is the average value of the plurality of first similarities for each of the plurality of curves, and evaluating the driving skills of the vehicle driver based on the first average similarity which indicates the highest degree of similarity among the plurality of first average similarities.

[0006] A non-transient recording medium according to one embodiment of the present disclosure records software that causes a processor to perform a detection process to detect curves based on vehicle driving data, and an evaluation process to evaluate the driving skills of the vehicle driver based on the driving data at the curves. The evaluation process includes generating a first kernel density estimation image based on the driving data at a first curve detected by the detection process, calculating a plurality of first similarities between the first kernel density estimation image and a plurality of reference images associated with each of a plurality of curves that do not include the first curve, calculating a first average similarity which is the average of the plurality of first similarities for each of the plurality of curves, and evaluating the driving skills of the vehicle driver based on the first average similarity which indicates the highest degree of similarity among the plurality of first average similarities. [Brief explanation of the drawing]

[0007] The accompanying drawings are provided for further understanding of this disclosure and are incorporated herein and constitute part of this specification. The drawings illustrate one embodiment and, together with the specification, serve to illustrate the principles of this disclosure.

[0008] [Figure 1] Figure 1 is an explanatory diagram showing an example configuration of a driving skills evaluation system in which a driving skills evaluation method according to one embodiment of the present disclosure is used. [Figure 2] Figure 2 is a block diagram showing one example configuration of the smartphone shown in Figure 1. [Figure 3] Figure 3 is a block diagram showing one example configuration of the server device 30 shown in Figure 1. [Figure 4] Figure 4 is an explanatory diagram showing the data stored in the memory unit 32 shown in Figure 3. [Figure 5] Figure 5 is an image diagram showing an example of a kernel density estimation image derived from the image data shown in Figure 4. [Figure 6] Figure 6 is an explanatory diagram illustrating an example of the parameters in the kernel density estimation image shown in Figure 5. [Figure 7] Figure 7 is an explanatory diagram illustrating an example of the operation of the curve detection unit shown in Figure 3. [Figure 8] Figure 8 is an explanatory diagram illustrating one example configuration of the data processing system shown in Figure 1. [Figure 9] Figure 9 is a block diagram showing one example configuration of the in-vehicle device shown in Figure 8. [Figure 10] Figure 10 is a block diagram showing one example configuration of the information processing device shown in Figure 8. [Figure 11] Figure 11 is a flowchart illustrating an example of the operation of the information processing device shown in Figure 8. [Figure 12] Figure 12 is another flowchart illustrating an example of the operation of the information processing device shown in Figure 8. [Figure 13] Figure 13 is another flowchart illustrating an example of the operation of the information processing device shown in Figure 8. [Figure 14]Figure 14 is another flowchart showing an example of the operation of the information processing apparatus shown in FIG. 8. [Figure 15] Figure 15 is an explanatory diagram showing an example of the process of generating the preprocessed image shown in FIG. 14. [Figure 16] Figure 16 is another flowchart showing an example of the operation of the information processing apparatus shown in FIG. 8. [Figure 17] Figure 17 is an explanatory diagram showing an example of the operation of the information processing apparatus shown in FIG. 8. [Figure 18] Figure 18 is another flowchart showing an example of the operation of the information processing apparatus shown in FIG. 8. [Figure 19A] Figure 19A is a flowchart showing an example of the operation of the server apparatus shown in FIG. 1. [Figure 19B] Figure 19B is another flowchart showing an example of the operation of the server apparatus shown in FIG. 1. [Figure 19C] Figure 19C is another flowchart showing an example of the operation of the server apparatus shown in FIG. 1. [Figure 20] Figure 20 is an explanatory diagram showing an example of the operation of the server apparatus shown in FIG. 1. [Figure 21] Figure 21 is an explanatory diagram showing an example of parameters in the kernel density estimation image according to a modification. [Figure 22] Figure 22 is an explanatory diagram showing an example of parameters in the kernel density estimation image according to another modification. [Figure 23] Figure 23 is an explanatory diagram showing an example of parameters in the kernel density estimation image according to another modification. [Figure 24] Figure 24 is an explanatory diagram showing an example of parameters in the kernel density estimation image according to another modification. [Figure 25] Figure 25 is an image diagram showing an example of the kernel density estimation image according to another modification. [Figure 26] Figure 26 is an explanatory diagram showing an example of parameters in the kernel density estimation image shown in FIG. 25. [Figure 27]FIG. 27 is a block diagram showing a configuration example of a smartphone according to another modification. MODE FOR CARRYING OUT THE INVENTION

[0009] In the evaluation of a driver's driving skills, it is desired that the convenience is high, and further improvement in convenience is expected.

[0010] It is desirable to provide a driving skill evaluation method, a driving skill evaluation system, and a non-transitory recording medium that can enhance convenience.

[0011] Hereinafter, some exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. Note that the following description shows a specific example of the present disclosure and should not be construed as limiting the present disclosure. For example, each element including numerical values, shapes, materials, components, the positions of each component, and the connection method of each component is merely an example and should not be construed as limiting the present disclosure. In the following exemplary embodiments, components not described in the independent claims based on the most general concept of the present disclosure are optional and may be provided as necessary. The drawings are schematic and are not intended to illustrate actual sizes. Throughout this specification and the drawings, components having substantially the same function and substantially the same configuration are denoted by the same reference numerals, and redundant descriptions are omitted. In addition, components not directly related to one embodiment of the present disclosure are not shown in the drawings.

[0012] <Embodiment> [Configuration Example] FIG. 1 shows a configuration example of a driving skill evaluation system 1 in which a driving skill evaluation method according to an embodiment is used. The driving skill evaluation system 1 includes a smartphone 10, a server device 30, and a data processing system 2.

[0013] Smartphone 10 is a high-function mobile phone and is fixedly installed inside vehicle 9 in a predetermined orientation relative to vehicle 9. Smartphone 10 collects driving data of vehicle 9. Smartphone 10 connects to the internet (not shown) by communicating with a mobile phone base station (not shown) via, for example, mobile phone communication.

[0014] The server device 30 is an information processing device. The server device 30 evaluates the driving skills of the vehicle 9's driver based on the vehicle's driving data. The server device 30 is connected to the internet (not shown). The server device 30 is capable of communicating with the smartphone 10 via the internet.

[0015] The data processing system 2 includes an information processing device and generates data used in the evaluation of driving skills. The data processing system 2 is connected to the Internet (not shown). The data processing system 2 is capable of communicating with the server device 30 via the Internet.

[0016] In the driving skills evaluation system 1, a driver being evaluated drives a vehicle 9 in an evaluation area with many curves, such as a mountain road. The smartphone 10 collects driving data from the vehicle 9 and transmits this data to the server device 30. This driving data includes information about the acceleration of the vehicle 9 in the direction of travel (longitudinal acceleration), information about the yaw angular velocity of the vehicle 9, and information about the position of the vehicle 9. Based on the time-series data of the yaw angular velocity of the vehicle 9, the server device 30 detects multiple curves in the road traveled by the vehicle 9. Based on the time-series data of longitudinal acceleration and yaw angular velocity, the server device 30 generates kernel density estimation images for each of the multiple curves. The server device 30 then evaluates the driver's driving skills by comparing the kernel density estimation images for multiple curves in an area different from the evaluation area (data acquisition area), which are generated by the data processing system 2 based on the driving data of a skilled driver and registered in advance in the server device 30. The smartphone 10 then presents the driver with the evaluation results of their driving skills. This allows the driver to obtain an objective evaluation of their driving skills using the driving skills evaluation system 1.

[0017] Figure 2 shows an example configuration of a smartphone 10. The smartphone 10 includes a touch panel 11, a memory unit 12, a communication unit 13, an acceleration sensor 14, an angular velocity sensor 15, a GNSS (Global Navigation Satellite System) receiver 16, and a processing unit 20.

[0018] The touch panel 11 is a user interface and comprises, for example, a touch sensor and a display device such as a liquid crystal display or an organic EL (Electro-Luminescence) display. The touch panel 11 accepts user input from the smartphone 10 and displays the processing results of the smartphone 10.

[0019] The memory unit 12 is a non-volatile memory and is configured to store program data for various application software. In this example, the smartphone 10 has application software related to the driving skills evaluation system 1 installed. The program data for this application software is stored in the memory unit 12.

[0020] The communication unit 13 is configured to communicate with a mobile phone base station by performing mobile phone communication. As a result, the communication unit 13 communicates with a server device 30 connected to the internet via the mobile phone base station.

[0021] The acceleration sensor 14 is configured to detect acceleration in three directions within the coordinate system of the smartphone 10.

[0022] The angular velocity sensor 15 is configured to detect three angular velocities (yaw angular velocity, roll angular velocity, and pitch angular velocity) in the coordinate system of the smartphone 10.

[0023] The GNSS receiver 16 is configured to acquire the position of the vehicle 9 on the ground using a GNSS such as GPS (Global Positioning System).

[0024] The processing unit 20 is configured to control the operation of the smartphone 10 and is composed of, for example, one or more processors, one or more memories, etc. The processing unit 20 collects time-series data of acceleration detected by the acceleration sensor 14, time-series data of angular velocity detected by the angular velocity sensor 15, and time-series data of the position of the vehicle 9 obtained by the GNSS receiver 16. The processing unit 20 can operate as a data processing unit 21 and a display processing unit 22 by executing application software related to the driving skill evaluation system 1 installed on the smartphone 10.

[0025] The data processing unit 21 is configured to perform predetermined data processing based on the detection results of the acceleration sensor 14 and the angular velocity sensor 15. The predetermined data processing includes, for example, filtering the time-series data of acceleration detected by the acceleration sensor 14 and filtering the time-series data of angular velocity detected by the angular velocity sensor 15. Here, the filtering is performed using a low-pass filter. After the vehicle has finished driving in the evaluation area, the communication unit 13 transmits the time-series data of acceleration and angular velocity processed by the data processing unit 21, along with the time-series data of the vehicle 9's position obtained by the GNSS receiver 16, to the server device 30.

[0026] The display processing unit 22 is configured to perform display processing based on data indicating the driving skill evaluation results transmitted from the server device 30. As a result, the touch panel 11 displays the driving skill evaluation results.

[0027] Figure 3 shows an example configuration of the server device 30. The server device 30 includes a communication unit 31, a storage unit 32, and a processing unit 40.

[0028] The communication unit 31 is configured to communicate with the smartphone 10 via the internet by performing network communication.

[0029] The storage unit 32 includes, for example, an HDD (Hard Disk Drive) or an SSD (Solid State Drive), and is configured to store program data for various software. In this example, the server device 30 has server software related to the driving skills evaluation system 1 installed. The program data for this software is stored in the storage unit 32. The storage unit 32 also stores various data used by this software.

[0030] Figure 4 shows an example of data used by the server software, stored in the storage unit 32. The storage unit 32 stores area data DAR and multiple image data DP. This data is generated by the data processing system 2 and stored in this storage unit 32.

[0031] Area data DAR is data used to evaluate driving skills, for example, by indicating multiple evaluation areas. These evaluation areas can include areas with many curves, such as mountain roads. This area data DAR includes, for example, data on the latitude and longitude of each of the multiple evaluation areas.

[0032] Multiple image data points (DPs) are kernel density estimation images obtained by skilled drivers operating vehicles in data acquisition areas different from the evaluation area. The data acquisition areas, like the evaluation area, are areas with many curves, such as mountain roads. Each kernel density estimation image represented by a single image data point (DP) corresponds to one curve. Each of the multiple image data points (DPs) is managed in association with the curve numbers of multiple curves within the data acquisition area.

[0033] Figure 5 shows an example of a kernel density estimation image for a certain curve. Figure 6 shows the coordinate axes of the kernel density estimation image shown in Figure 5. In this kernel density estimation image, the horizontal axis (X axis) represents time, and the vertical axis (Y axis) represents the square of the yaw angular acceleration. The yaw angular acceleration is the time derivative of the yaw angular velocity. The pixel value (Z axis) of the kernel density estimation image represents the square of the longitudinal jerk. The longitudinal jerk is the time derivative of the longitudinal acceleration. In the kernel density estimation image, darker colored areas indicate a large value of the square of the longitudinal jerk, and lighter colored areas indicate a small value of the square of the longitudinal jerk. In this example, a larger value of the square of the longitudinal jerk corresponds to a smaller pixel value, and a smaller value of the square of the longitudinal jerk corresponds to a larger pixel value. This kernel density estimation image may change depending on the driver's driving skill. Multiple kernel density estimation images corresponding to multiple curves in the data acquisition area are stored in the storage unit 32 as multiple image data DPs.

[0034] Multiple image data DPs may include, for example, two or more image data DPs relating to a single curve. Multiple image data DPs may include image data DPs relating to different skilled drivers, or they may include multiple image data DPs relating to a single skilled driver.

[0035] The memory unit 32 stores this type of data. This data is generated by the data processing system 2 and stored in the memory unit 32.

[0036] The processing unit 40 (Figure 3) is configured to control the operation of the server device 30 and is composed of, for example, one or more processors, one or more memories, etc. By executing the server software related to the driving skill evaluation system 1 installed on the server device 30, the processing unit 40 can operate as a data processing unit 41, a curve detection unit 42, a data extraction unit 43, an image generation unit 44, an image similarity calculation unit 45, and a skill determination unit 46.

[0037] The data processing unit 41 is configured to generate acceleration data DA1 and yaw angular velocity data DY1 by performing predetermined data processing based on the time-series data of acceleration, time-series data of angular velocity, and time-series data of the position of the vehicle 9 received by the communication unit 31. The predetermined data processing includes, for example, a process to confirm whether the vehicle 9 is traveling in the evaluation area based on the time-series data of the position of the vehicle 9; a process to generate time-series data of acceleration in the direction of travel (longitudinal acceleration) of the vehicle 9 by performing coordinate transformation based on the time-series data of acceleration obtained by the smartphone 10; a process to generate time-series data of the yaw angular velocity of the vehicle 9 by performing coordinate transformation based on the time-series data of angular velocity obtained by the smartphone 10; filtering of the time-series data of longitudinal acceleration; and filtering of the time-series data of yaw angular velocity. Here, the filtering is performed using a low-pass filter.

[0038] The curve detection unit 42 is configured to detect multiple curves based on the yaw angular velocity data DY1 generated by the data processing unit 41.

[0039] Figure 7 shows an example of the operation of the curve detection unit 42. The curve detection unit 42 detects curves based on the time-series data of yaw angular velocity included in the yaw angular velocity data DY1. That is, since the yaw angular velocity changes according to the curve of the road, the curve detection unit 42 can detect curves based on this time-series data of yaw angular velocity. In this example, the curve detection unit 42 detects nine curves based on the time-series data of yaw angular velocity.

[0040] The data extraction unit 43 is configured to extract time-series data of longitudinal acceleration related to multiple detected curves from the time-series data of longitudinal acceleration included in the acceleration data DA1, based on the detection results of the curve detection unit 42, and to extract time-series data of yaw angular velocity related to multiple detected curves from the time-series data of yaw angular velocity included in the yaw angular velocity data DY1.

[0041] The image generation unit 44 is configured to generate multiple image data DP1 by generating multiple kernel density estimation images for multiple curves in the evaluation area, based on time-series data of longitudinal acceleration and yaw angular velocity for multiple curves in the evaluation area, which are extracted by the data extraction unit 43. Specifically, the image generation unit 44 generates a kernel density estimation image for one curve in the evaluation area by performing kernel density estimation processing based on time-series data of longitudinal acceleration and yaw angular velocity for that curve. In the kernel density estimation processing, the original data, including data that has not yet been observed, is estimated as density data based on the measured data. The image generation unit 44 generates multiple kernel density estimation images by performing this processing for each of the multiple curves in the evaluation area. In this way, the image generation unit 44 generates multiple image data DP1 for multiple curves.

[0042] The image similarity calculation unit 45 is configured to calculate the average minimum image similarity based on multiple kernel density estimation images shown by multiple image data DP1 generated by the image generation unit 44 and multiple kernel density estimation images shown by multiple image data DP stored in the storage unit 32. Specifically, the image similarity calculation unit 45 calculates multiple image similarities by comparing one kernel density estimation image related to one curve of the area to be evaluated, generated by the image generation unit 44, with multiple kernel density estimation images stored in the storage unit 32 that are associated with each of the multiple curves of the data acquisition area. The image similarity calculation unit 45 then calculates an average image similarity, which is the average value of the multiple image similarities, for each of the multiple curves of the data acquisition area. The image similarity calculation unit 45 then selects the lowest of the multiple average image similarities corresponding to the multiple curves of the data acquisition area as the minimum image similarity. The image similarity calculation unit 45 calculates multiple minimum image similarities by performing this process for each of the multiple curves of the area to be evaluated. The image similarity calculation unit 45 then calculates the average minimum image similarity, which is the average of these multiple minimum image similarity values.

[0043] The skill determination unit 46 is configured to determine the driving skills of the vehicle 9 driver based on the average minimum image similarity calculated by the image similarity calculation unit 45. The communication unit 31 then transmits data indicating the driving skill evaluation result generated by the skill determination unit 46 to the smartphone 10.

[0044] Multiple image data DPs and area data DARs stored in the memory unit 32 are generated by the data processing system 2. The data processing system 2 is described below.

[0045] Figure 8 shows an example configuration of the data processing system 2. The data processing system 2 comprises an in-vehicle device 110 and an information processing device 130. The in-vehicle device 110 is a device installed in a vehicle 109 driven by a skilled driver. In this example, the information processing device 130 is a so-called personal computer.

[0046] Figure 9 shows an example configuration of the in-vehicle device 110. The in-vehicle device 110 includes an acceleration sensor 114, a yaw angular velocity sensor 115, a GNSS receiver 116, and a processing unit 120.

[0047] The acceleration sensor 114 is configured to detect the acceleration (longitudinal acceleration) of the vehicle 109 in the direction of travel.

[0048] The yaw angular velocity sensor 115 is configured to detect the yaw angular velocity of the vehicle 109.

[0049] The GNSS receiver 116 is configured to acquire the position of the vehicle 109 on the ground using a GNSS such as GPS.

[0050] The processing unit 120 is a so-called ECU (Electronic Control Unit) and is composed of, for example, one or more processors, one or more memories, etc. The processing unit 120 collects time-series data of longitudinal acceleration detected by the acceleration sensor 114, time-series data of yaw angular velocity detected by the yaw angular velocity sensor 115, and time-series data of the position of the vehicle 109 obtained by the GNSS receiver 116.

[0051] For example, after the vehicle has finished traveling through the data acquisition area, the engineer stores the time-series data collected by the processing unit 120 into an external recording medium, such as a semiconductor memory.

[0052] Figure 10 shows an example configuration of the information processing device 130. Based on the engineer's operation, the information processing device 130 reads data recorded on an external recording medium and generates multiple image data DPs and area data DARs to be stored in the storage unit 32 of the server device 30 based on the read data. The information processing device 130 comprises a user interface unit 131, a storage unit 132, a communication unit 133, and a processing unit 140.

[0053] The user interface unit 131 includes, for example, a keyboard, a mouse, and a display unit such as a liquid crystal display or an organic EL display. The user interface unit 131 accepts operations from the user of the information processing device 130 (an engineer in this example) and displays the processing results of the information processing device 130.

[0054] The storage unit 132 includes, for example, an HDD or SSD, and is configured to store program data for various software. In this example, the information processing device 130 has software related to the data processing system 2 installed. The program data for this software is stored in the storage unit 132.

[0055] The communication unit 133 is configured to communicate with the server device 30 via the internet by performing network communication.

[0056] The processing unit 140 is configured to control the operation of the information processing device 130 and is composed of, for example, one or more processors, one or more memories, etc. By executing software related to the data processing system 2 installed on the information processing device 130, the processing unit 140 can operate as a data processing unit 141, a curve detection unit 142, an image generation unit 144, an image similarity calculation unit 145, a dataset generation unit 146, a calculation target selection unit 147, and an area data generation unit 148.

[0057] The data processing unit 141 is configured to generate acceleration data DA and yaw angular velocity data DY by performing predetermined data processing based on time-series data of longitudinal acceleration and time-series data of yaw angular velocity read from an external recording medium. The predetermined data processing includes, for example, filtering the time-series data of longitudinal acceleration, filtering the time-series data of yaw angular velocity, and processing to generate area data DAR based on the engineer's operations. Here, the filtering is performed using a low-pass filter.

[0058] The curve detection unit 142 is configured to generate curve data DC by detecting multiple curves based on the yaw angular velocity data DY generated by the data processing unit 141. The curve data DC is data that includes curve numbers for multiple curves on the road. In the curve data DC, the curve numbers of the multiple curves are set in correspondence with the time-series data of yaw angular velocity in the yaw angular velocity data DY.

[0059] The image generation unit 144 is configured to generate multiple image data DPs by generating multiple kernel density estimation images for multiple curves based on time-series data of longitudinal acceleration and time-series data of yaw angular velocity for multiple curves. The processing of the image generation unit 144 is the same as the processing of the image generation unit 44 in the server device 30.

[0060] The image similarity calculation unit 145 is configured to calculate image similarity based on multiple kernel density estimated images.

[0061] The dataset generation unit 146 is configured to generate a dataset DS that includes acceleration data DA, yaw angular velocity data DY, curve data DC, and multiple image data DP, and to store the generated dataset DS in the storage unit 132.

[0062] The processing unit 140 generates multiple datasets DS based on multiple driving data related to multiple skilled drivers, for example. These multiple datasets DS include dataset DSA and multiple datasets DSB. As described later, the data processing system 2 adjusts the curve numbers of the curve data DC in each of the multiple datasets DSB based on the curve data DC in dataset DSA. That is, since the curve numbers are generated based on the yaw angular velocity data DY, different curve numbers may be assigned to different curves depending on the yaw angular velocity data DY. Therefore, the data processing system 2 uses dataset DSA as sample data and adjusts the curve numbers of the curve data DC in each of the multiple datasets DSB based on the curve data DC in dataset DSA. This ensures that the curve numbers of the same curves in the curve data DC of the multiple datasets DSB are adjusted to be the same.

[0063] The calculation target selection unit 147 is configured to select multiple image data DPs from among multiple image data DPs included in multiple datasets DS to be used for the calculation of driving skills evaluation, based on the processing results of the image similarity calculation unit 145.

[0064] The area data generation unit 148 is configured to generate area data DAR, which is data indicating multiple evaluation target areas, based on the engineer's operations.

[0065] In this configuration, the data processing system 2 generates multiple datasets DS and area data DAR based on the driving data of skilled drivers. The data processing system 2 then selects multiple image data DP from among the multiple image data DP contained in the multiple datasets DS to be used for calculating driving skill evaluation. The data processing system 2 transmits the selected image data DP and area data DAR to the server device 30. The server device 30 stores the received multiple image data DP and area data DAR in the storage unit 32.

[0066] Here, the curve detection unit 42 corresponds to a specific example of the "curve detection circuit" in one embodiment of the present disclosure. The image generation unit 44, the image similarity calculation unit 45, and the skill determination unit 46 correspond to a specific example of the "evaluation circuit" in one embodiment of the present disclosure. The kernel density estimation image shown by the image data DP stored in the storage unit 32 corresponds to a specific example of the "reference image" in one embodiment of the present disclosure.

[0067] [Action and function] Next, the operation and function of the driving skills evaluation system 1 of this embodiment will be described.

[0068] (Overview of overall operation) Refer to Figures 1-4 and 8-10 to explain the operation of the driving skills evaluation system 1.

[0069] First, the driving skills evaluation system 1 generates multiple image data DPs and area data DARs based on driving data obtained when a skilled driver drives vehicle 109 in the data acquisition area.

[0070] Specifically, in the data acquisition area, a skilled driver operates the vehicle 109 of the data processing system 2, and the processing unit 120 of the in-vehicle device 110 collects driving data of the vehicle 109. For example, after the driving is completed, the engineer stores the driving data collected by the processing unit 120 in an external recording medium such as a semiconductor memory. Based on this driving data, the information processing device 130 generates acceleration data DA, yaw angular velocity data DY, curve data DC, and multiple image data DP, and stores a dataset DS containing this data in the storage unit 132. The information processing device 130 stores multiple datasets DS in the storage unit 132 by repeating this process. Then, the information processing device 130 selects multiple image data DP from among the multiple image data DP included in the multiple datasets DS to be used in the calculation of driving skill evaluation, and transmits the selected multiple image data DP and area data DAR to the server device 30. The server device 30 stores the multiple image data DP and area data DAR transmitted from the information processing device 130 in the storage unit 32.

[0071] The driving skills evaluation system 1 evaluates the driver's driving skills using multiple image data DP generated by the skilled driver operating the vehicle 109 in this manner.

[0072] Specifically, in an evaluation area different from the data acquisition area, the driver being evaluated drives the vehicle 9, and the smartphone 10 collects driving data from the vehicle 9. The smartphone 10 then transmits the collected driving data to the server device 30. Based on this driving data, the server device 30 generates acceleration data DA1, yaw angular velocity data DY1, and multiple image data DP1. Based on the multiple kernel density estimation images shown by the multiple image data DP1 and the multiple kernel density estimation images shown by the multiple image data DP stored in the storage unit 32, the server device 30 calculates the average minimum image similarity and determines the driving skill of the vehicle 9 driver based on this average minimum image similarity. The server device 30 then transmits data showing the driving skill evaluation result to the smartphone 10. The smartphone 10 then displays the driving skill evaluation result transmitted from the server device 30.

[0073] (Detailed operation) The operation of the driving skills evaluation system 1 is described in detail below.

[0074] (Regarding the generation of multiple datasets / datasets) First, the data processing system 2 generates multiple datasets DS based on driving data obtained by a skilled driver operating vehicle 109 in the data acquisition area. The operation of generating multiple datasets DS is described in detail below.

[0075] When a skilled driver operates vehicle 109, the vehicle 109's onboard device 110 detects the vehicle's acceleration in the direction of travel (longitudinal acceleration) using its acceleration sensor 114, detects the vehicle's yaw angular velocity using its yaw angular velocity sensor 115, and acquires the vehicle's position on the ground using its GNSS receiver 116. The processing unit 120 collects time-series data of longitudinal acceleration detected by the acceleration sensor 114, time-series data of yaw angular velocity detected by the yaw angular velocity sensor 115, and time-series data of the vehicle's position obtained by the GNSS receiver 116.

[0076] For example, after the vehicle has finished traveling through the data acquisition area, the engineer stores the time-series data collected by the processing unit 120 into an external recording medium, such as a semiconductor memory.

[0077] The information processing device 130 generates a dataset DS based on the time-series data of longitudinal acceleration, time-series data of yaw angular velocity, and time-series data of the position of the vehicle 109, which are read from the external recording medium, and stores this dataset DS in the storage unit 132. The operation of this information processing device 130 will be described in detail below.

[0078] Figure 11 shows an example of the operation of the information processing device 130 in the data processing system 2.

[0079] First, the data processing unit 141 of the information processing device 130 checks whether the vehicle 109 has traveled through the data acquisition area based on the time-series data of the vehicle's position (step S101). If the vehicle 109 has not traveled through the data acquisition area ("N" in step S101), this process ends.

[0080] When vehicle 109 travels through the data acquisition area ("Y" in step S101), the data processing unit 141 generates acceleration data DA and yaw angular velocity data DY by filtering the time-series data of longitudinal acceleration and yaw angular velocity in the data acquisition area (step S102).

[0081] Next, the curve detection unit 142 generates curve data DC by performing a curve division process based on the yaw angular velocity data DY generated in step S102 (step S103). The curve division process includes the following two-stage process.

[0082] Figure 12 shows a specific example of the first stage of the curve splitting process. The curve detection unit 142 reads the yaw angular velocity included in the yaw angular velocity data DY sequentially in chronological order and performs the processing shown in Figure 12.

[0083] First, the curve detection unit 142 checks whether a yaw angular velocity of a predetermined value A or greater (for example, 0.02 rad / sec. or greater) continues for a predetermined time B or longer (for example, 2 seconds or longer) (step S201). This condition is the basic condition for curve detection by the curve detection unit 142. In this example, a predetermined time B was used for evaluation, but a predetermined distance may be used instead of a predetermined time B. If this condition is not met ("N" in step S201), the process in step S201 is repeated until this condition is met.

[0084] If the conditions shown in step S201 are met (in step S201, "Y"), the curve detection unit 142 checks whether the polarity of the yaw angular velocity is the same as the polarity of the yaw angular velocity at the previous curve, and whether the vehicle 109 has been traveling on a straight road for less than a predetermined time C (for example, less than 9 seconds) after the previous curve (step S202). In this example, a predetermined time C was used for evaluation, but a predetermined distance may be used instead of a predetermined time C.

[0085] In step S202, if this condition is not met ("N" in step S202), the curve detection unit 142 detects a curve (step S203). That is, in step S201, the basic conditions for curve detection are met, and the distance from the previous curve is large, so the curve detection unit 142 detects a new curve separately from the previous curve. The curve detection unit 142 assigns a curve number to the detected curve. Then the process proceeds to step S205.

[0086] In step S202, if this condition is met ("Y" in step S202), the curve detection unit 142 considers the previous curve to be a continuation (step S203). That is, in step S201, the basic conditions for curve detection are met, but because the distance from the previous curve is short, it is considered that the previous curve is a continuation. Then the process proceeds to step S205.

[0087] Next, the curve detection unit 142 checks whether the yaw angular velocity is less than or equal to a predetermined value A (for example, less than or equal to 0.02 rad / sec.) (step S205). That is, the curve detection unit 142 checks whether the basic conditions for curve detection are no longer met. If the yaw angular velocity is not less than or equal to the predetermined value A ("N" in step S205), the process in step S205 is repeated until the yaw angular velocity becomes less than or equal to the predetermined value A.

[0088] If the yaw angular velocity is less than or equal to a predetermined value A (indicated as "Y" in step S205), the curve detection unit 142 checks whether the yaw angular velocity has remained below the predetermined value A (for example, less than 0.02 rad / sec.) for a period of less than a predetermined time B (for example, less than 2 seconds) and then become greater than or equal to the predetermined value A (for example, 0.02 rad / sec. or greater) (step S206). If this condition is met (indicated as "Y" in step S206), the curve detection unit 142 considers that the previous curve is continuing (step S207). In other words, if this condition is met, the curve detection unit 142 determines that the vehicle 109 has swayed due to the driver adjusting the steering operation immediately after the end of the curve, and considers that the previous curve is continuing. Then, the process returns to step S205.

[0089] If the conditions in step S206 are not met ("N" in step S206), the curve detection unit 142 detects the end of the curve (step S208).

[0090] The curve detection unit 142 then checks whether it has read all the yaw angular velocity data included in the yaw angular velocity data DY (step S209). If not all the data has been read yet ("N" in step S209), the process returns to step S201.

[0091] In step S209, if all data has been read (indicated as "Y" in step S209), this process terminates.

[0092] Thus, in the first stage of the curve division process, the curve detection unit 142 basically detects a curve when a yaw angular velocity of a predetermined value A or greater (e.g., 0.02 rad / sec. or greater) continues for a predetermined time B or greater (e.g., 2 seconds or greater) (step S201). Furthermore, the curve detection unit 142 considers the previous curve to be continuing if, after the curve ends, a yaw angular velocity of less than the predetermined value A (e.g., less than 0.02 rad / sec.) continues for a predetermined time B or less (e.g., less than 2 seconds), and then the yaw angular velocity becomes the predetermined value A or greater (e.g., 0.02 rad / sec. or greater) (steps S205-S207). In addition, if the straight road between two curves curving in the same direction is short, the curve detection unit 142 considers these two curves to be one curve (steps S201, S202, S204).

[0093] Figure 13 shows a specific example of the second stage of processing in the curve division process. The curve detection unit 142 performs this second stage of processing using the results of the first stage of processing. As a result, the curve detection unit 142 decides whether to use each of the multiple curves detected in the first stage of processing for the calculation of driving skill evaluation.

[0094] First, the curve detection unit 142 selects the first curve from among the multiple curves obtained in the first stage of processing (step S221).

[0095] Next, the curve detection unit 142 checks whether the average value of the yaw angular velocity in the selected curve is less than a predetermined value D (for example, less than 0.05 rad / sec.) (step S222).

[0096] In step S222, if the average value of the yaw angular velocity is less than a predetermined value D (Y in step S222), the curve detection unit 142 checks whether the maximum value of the yaw angular velocity is greater than or equal to a predetermined value E (for example, 0.07 rad / sec. or greater) (step S223).

[0097] In step S222, if the average value of the yaw angular velocity is not less than a predetermined value D ("N" in step S222), or in step S223, if the maximum value of the yaw angular velocity is greater than or equal to a predetermined value E ("Y" in step S223), the curve detection unit 142 uses this curve in the calculation of the driving skill evaluation (step S224). Also, in step S223, if the maximum value of the yaw angular velocity is not greater than or equal to a predetermined value E ("N" in step S223), the curve detection unit 142 does not use this curve in the calculation of the driving skill evaluation (step S225).

[0098] Next, the curve detection unit 142 checks whether all curves have been selected (step S226). If not all curves have been selected yet ("N" in step S226), the curve detection unit 142 selects one of the unselected curves (step S227). Then, the process returns to step S221. The curve detection unit 142 repeats steps S221 to S227 until all curves have been selected.

[0099] Then, if the curve detection unit 142 has already selected all curves ("Y" in step S226), this process ends.

[0100] In this way, as shown in step S103 of Figure 11, the curve detection unit 142 generates curve data DC by performing a curve division process.

[0101] Next, the curve detection unit 142 checks whether sample data exists (step S104). Specifically, the curve detection unit 142 checks whether the sample data set DSA is stored in the storage unit 132.

[0102] In step S104, if there is no sample data ("N" in step S104), the image generation unit 144 generates multiple image data DPs by generating kernel density estimation images for each of the multiple curves (step S105).

[0103] Figure 14 shows an example of the process for generating a kernel density estimation image.

[0104] First, the image generation unit 144 performs preprocessing (step S241). Specifically, the image generation unit 44 first calculates time-series data of longitudinal jerk by differentiating the time-series data of longitudinal acceleration included in the acceleration data DA, and then calculates time-series data of the square of longitudinal jerk based on this time-series data of longitudinal jerk. The image generation unit 144 also calculates time-series data of yaw angular acceleration by differentiating the time-series data of yaw angular velocity included in the yaw angular velocity data DY, and then calculates time-series data of the square of yaw angular acceleration based on this time-series data of yaw angular acceleration. Finally, the image generation unit 144 generates a preprocessed image based on the time-series data of the square of longitudinal jerk and the time-series data of the square of yaw angular acceleration.

[0105] Figure 15 shows an example of the process for generating a preprocessed image. In this preprocessed image, the horizontal axis (X-axis) represents time, and the vertical axis (Y-axis) represents the square of the yaw angular acceleration. In this example, the preprocessed image is divided into 100 regions in the X-axis direction and 100 regions in the Y-axis direction. Therefore, the preprocessed image has 10,000 regions.

[0106] The full scale in the X-axis direction of the preprocessed image is set to, for example, 5 seconds, assuming a travel time of 10⁹ vehicles on a single curve.

[0107] The full scale in the Y-axis direction in the preprocessed image is set based on time-series data of the square of the yaw angular acceleration. The value of the square of the yaw angular acceleration generally varies greatly, and may be significantly out of bounds due to factors such as detection accuracy. Therefore, in this example, the image generation unit 144 performs a process to remove the significantly out-of-bounds values ​​from the square of the yaw angular acceleration. The image generation unit 44 can remove the significantly out-of-bounds values, for example, by using a box plot. Then, the image generation unit 144 finds the minimum and maximum values ​​from the data from which the significantly out-of-bounds values ​​have been removed, and determines the full scale in the Y-axis direction such that the range R of values ​​from the minimum to the maximum value fits within the Y-axis direction in Figure 15 with an appropriate margin M. The margin M can be, for example, about 3% of the range of values ​​from the minimum to the maximum value.

[0108] For example, if the full scale in the X-axis direction is 5 seconds and the sampling period for the time series data is 10 msec., then the number of data points in the time series data of the square of the forward and backward jerk is 500 (= 5 sec. / 10 msec.), and the number of data points in the time series data of the square of the yaw angular acceleration is also 500. In practice, however, as described above, outlier data among these data is removed. The image generation unit 144 maps the square of the forward and backward jerk values ​​to 10,000 regions in the preprocessed image based on the time and the square of the yaw angular acceleration.

[0109] The image generation unit 144, for each of the 10,000 regions, sets the square of the forward and backward jerk value for the region where one data point is mapped. Furthermore, for each of the 10,000 regions where multiple data points are mapped, the image generation unit 144 adds the squares of the forward and backward jerk values ​​for each of the multiple data points together and sets the summed value as the value for that region. In this way, the image generation unit 144 generates the pixel values ​​(Z-axis) of the preprocessed image. The image generation unit 144 then scales these pixel values, for example, to integers between 0 and 255, such that a larger square of the forward and backward jerk corresponds to a smaller pixel value, and a smaller square of the forward and backward jerk corresponds to a larger pixel value. In this way, the image generation unit 144 generates the preprocessed image.

[0110] Next, the image generation unit 144 performs kernel density estimation processing based on this preprocessed image, as shown in Figure 14 (step S242). In the kernel density estimation processing, the original data, including data that has not yet been observed, is estimated as density data based on the measured data. The image generation unit 144 performs kernel density estimation processing using known techniques. As a result, the image generation unit 144 generates a kernel density estimation image.

[0111] This completes the process.

[0112] In this way, as shown in step S105 of Figure 11, the image generation unit 144 generates multiple image data DPs by generating a kernel density estimation image for each of the multiple curves.

[0113] Then, the dataset generation unit 146 stores the acceleration data DA and yaw angular velocity data DY generated in step S102, the curve data DC generated in step S103, and the multiple image data DP generated in step S105 as a dataset DSA in the storage unit 132 (step S106). This completes the process.

[0114] In step S104, if sample data is available (indicated as "Y" in step S104), the curve detection unit 142 corrects the curve data DC by identifying the correspondence between the curves based on the similarity between the yaw angular velocity data DY generated in step S102 and the yaw angular velocity data DY of the dataset DSA stored in the storage unit 132 (step S107).

[0115] Figure 16 shows an example of the process in step S107.

[0116] First, the curve detection unit 142 identifies the overall travel section to be processed (step S261) based on the yaw angular velocity data DY generated in step S102 and the yaw angular velocity data DY of the dataset DSA. Specifically, the curve detection unit 142 identifies similar overall travel sections using Dynamic Time Wrapping (DTW) based on the yaw angular velocity data DY generated in step S102 and the yaw angular velocity data DY of the dataset DSA. That is, since these yaw angular velocity data DY are both time-series data of yaw angular velocity in the data acquisition area, it is desirable that they be almost the same. However, if the accuracy of the vehicle 109's position obtained by GNSS is not very good, the yaw angular velocity data DY may contain unnecessary data or have missing data at the beginning or end of the time-series data. Therefore, the curve detection unit 142 identifies overall travel sections with approximately the same number of curves using Dynamic Time Wrapping based on the yaw angular velocity data DY generated in step S102 and the yaw angular velocity data DY of the dataset DSA. This allows the yaw angular velocity data DY generated in step S102 and the yaw angular velocity data DY in the dataset DSA to be compared with each other over the entire travel section. In this way, the curve detection unit 142 identifies the entire travel section to be processed.

[0117] Next, the curve detection unit 142 identifies the correspondence between the multiple curves in the entire travel section to be processed, obtained from the yaw angular velocity data DY generated in step S102, and the multiple curves in the entire travel section to be processed, obtained from the yaw angular velocity data DY of the dataset DSA (step S262). Specifically, the curve detection unit 142 identifies the correspondence between the curves by identifying multiple sections that are similar to each other, using a dynamic time stretching method based on the yaw angular velocity data DY generated in step S102 and the yaw angular velocity data DY of the dataset DSA.

[0118] Figure 17 shows an example of the processing in step S262, where (A) shows the yaw angular velocity data DY generated in step S102, and (B) shows the yaw angular velocity data DY of the dataset DSA. This Figure 17 shows the yaw angular velocity data DY for a portion of the travel section to be processed. In Figure 17, the numbers indicate the curve numbers in the curve data DC.

[0119] There is a difference in section W1 between these two yaw angular velocity data DYs. Specifically, in the yaw angular velocity data DY shown in Figure 17(A), one curve with curve number "6" is detected in section W1. On the other hand, in the yaw angular velocity data DY shown in Figure 17(B), three curves with curve numbers "6" to "8" are detected in section W1.

[0120] Therefore, in this example, the curve detection unit 142 changes the curve number of the curve in section W1 from "6" to "6, 7, 8" in the yaw angular velocity data DY (Figure 17(A)) generated in step S102, and also changes the curve numbers of the curves after this curve. That is, the curve detection unit 142 identifies the correspondence between curves so that the curve numbers of the multiple curves in the yaw angular velocity data DY (Figure 17(A)) generated in step S102 match the curve numbers of the multiple curves in the yaw angular velocity data DY (Figure 17(B)) of the dataset DSA. Then, based on this processing result, the curve detection unit 142 corrects the curve data DC generated in step S103.

[0121] Next, the curve detection unit 142 excludes curves with low similarity between the multiple curves in the yaw angular velocity data DY generated in step S102 and the multiple curves in the yaw angular velocity data DY of the dataset DSA from the calculation of driving skill evaluation (step S263). Specifically, the curve detection unit 142 calculates the similarity of the curves that correspond to each other among the multiple curves in the yaw angular velocity data DY generated in step S102 and the multiple curves in the yaw angular velocity data DY of the dataset DSA, using the dynamic time stretching method. Then, the curve detection unit 142 excludes curves with a similarity lower than a predetermined amount from the calculation of driving skill evaluation.

[0122] This completes the process.

[0123] In this way, as shown in step S107 of Figure 11, the curve detection unit 142 corrects the curve data DC by identifying the correspondence between the curves based on the similarity between the yaw angular velocity data DY generated in step S102 and the yaw angular velocity data DY of the dataset DSA.

[0124] Next, the image generation unit 144 generates multiple image data DPs by generating kernel density estimation images for each of the multiple curves (step S108). This process is the same as the process in step S105.

[0125] Then, the dataset generation unit 146 stores the acceleration data DA and yaw angular velocity data DY generated in step S102, the curve data DC generated in step S103 and corrected in step S107, and the multiple image data DP generated in step S108 as a dataset DSB in the storage unit 132 (step S109). This completes the process.

[0126] In this way, the data processing system 2 generates a dataset DS, which includes acceleration data DA, yaw angular velocity data DY, curve data DC, and multiple image data DP, based on driving data obtained by a skilled driver operating the vehicle 109. By repeating this process, the data processing system 2 can generate multiple datasets DS based on multiple driving data sets.

[0127] (Regarding the selection of image data (DP) to be used in the calculation of driving skills evaluation) In the above, the data processing system 2 performs processing based on driving data obtained when a skilled driver operates the vehicle 109. However, it is also possible to perform processing based on driving data obtained when an unskilled driver operates the vehicle 109. In this case, the data processing system 2 can obtain kernel density estimation images related to the skilled driver and kernel density estimation images related to the unskilled driver.

[0128] This kernel density estimation image may change depending on the driver's driving skill. As will be described later, the driving skill evaluation system 1 evaluates the driver's driving skill based on the kernel density estimation image. In some curves, for example, there may be a large difference between the kernel density estimation image for a skilled driver and the kernel density estimation image for an unskilled driver. In other curves, for example, there may be almost no difference between the kernel density estimation image for a skilled driver and the kernel density estimation image for an unskilled driver. Therefore, the driving skill evaluation system 1 uses curves where there is a large difference between the kernel density estimation image for a skilled driver and the kernel density estimation image for an unskilled driver as the target of calculation for driving skill evaluation.

[0129] The following describes in detail the process of selecting multiple image data DPs to be used for calculating driving skills from among multiple image data DPs included in multiple datasets DS, by determining the curve to be used for calculating driving skills.

[0130] Figure 18 shows an example of the operation of the calculation target selection unit 147. In this example, the data processing system 2 has already acquired multiple datasets DS related to skilled drivers and multiple datasets DS related to unskilled drivers.

[0131] The calculation target selection unit 147 selects one of several curves in the data acquisition area (step S301).

[0132] Next, the image similarity calculation unit 145 calculates the average value F1 of the image similarity between multiple kernel density estimation images related to skilled drivers and multiple kernel density estimation images related to unskilled drivers for one selected curve (step S302). Specifically, the image similarity calculation unit 145 calculates the image similarity of kernel density estimation images for all combinations between multiple kernel density estimation images related to one or more skilled drivers and multiple kernel density estimation images related to one or more unskilled drivers for one selected curve. Then, the image similarity calculation unit 145 calculates the average value F1 of these image similarities.

[0133] Next, the image similarity calculation unit 145 calculates the average value F2 of the image similarity between each of the multiple kernel density estimation images related to the skilled driver for the selected curve (step S303). Specifically, the image similarity calculation unit 145 calculates the image similarity of the kernel density estimation images for all combinations between each of the multiple kernel density estimation images related to one or more skilled drivers for the selected curve. Then, the image similarity calculation unit 145 calculates the average value F2 of these image similarities.

[0134] Next, the calculation target selection unit 147 checks whether there is a significant difference between the average value F1 and the average value F2 (step S304). Specifically, the calculation target selection unit 147 determines that there is a significant difference between the average value F1 and the average value F2 if the difference between them is greater than or equal to a predetermined amount. If there is a significant difference between the average value F1 and the average value F2 (indicated as "Y" in step S304), the calculation target selection unit 147 uses the curve selected in step S301 as the calculation target for the driving skill evaluation (step S305). If there is no significant difference between the average value F1 and the average value F2 (indicated as "N" in step S304), the calculation target selection unit 147 does not use the curve selected in step S301 as the calculation target for the driving skill evaluation (step S306).

[0135] Next, the calculation target selection unit 147 checks whether all curves have been selected (step S307). If not all curves have been selected yet ("N" in step S307), the calculation target selection unit 147 selects one of the unselected curves (step S308). Then, the process returns to step S302. The calculation target selection unit 147 repeats the process from steps S302 to S308 until all curves have been selected.

[0136] In step S307, if all curves are selected ("Y" in step S307), the calculation target selection unit 147 selects multiple image data DPs from among multiple image data DPs included in multiple datasets DS that relate to the curves to be used for the driving skill evaluation calculation (step S309).

[0137] This completes the process.

[0138] In this way, the calculation target selection unit 147 selects multiple image data DPs from among multiple image data DPs included in multiple datasets DS to be used for calculating driving skills. The area data generation unit 148 generates area data DARs indicating multiple evaluation target areas based on the engineer's operations. The data processing system 2 then transmits the selected image data DPs and area data DARs to the server device 30. The server device 30 stores this data in the storage unit 32.

[0139] In this way, by selecting multiple image data points (DP) related to the curve that is the target of the driving skill evaluation calculation, the driving skill evaluation system 1 can reduce the amount of computation required when performing the driving skill evaluation described later. In this example, the driving skill evaluation system 1 performs the driving skill evaluation calculation using multiple selected image data points (DP) from among multiple image data points (DP) included in multiple datasets (DS), but it is not limited to this. Alternatively, for example, the driving skill evaluation system 1 may perform the driving skill evaluation calculation using all of the multiple image data points (DP) included in the multiple datasets (DS).

[0140] In this example, the processing unit 140 calculates mean values ​​F1 and F2 in steps S302 to S304 and determines whether to evaluate the selected curve by checking whether there is a significant difference between these mean values ​​F1 and F2, but it is not limited to this. Alternatively, the processing unit 140 may, for example, determine whether to calculate the selected curve by performing a non-parametric U test based on multiple image similarity values ​​used to calculate mean value F1 and multiple image similarity values ​​used to calculate mean value F2, without using mean values ​​F1 and F2. Specifically, first, similar to step S302, the image similarity calculation unit 145 calculates the image similarity of kernel density estimation images for all combinations between multiple kernel density estimation images related to one or more skilled drivers and multiple kernel density estimation images related to one or more unskilled drivers for the selected curve. Next, similar to step S303, the image similarity calculation unit 145 calculates the image similarity of kernel density estimation images for all combinations between each of the multiple kernel density estimation images relating to one or more skilled drivers for the selected curve. Then, the calculation target selection unit 147 determines whether there is a significant difference between the multiple image similarities obtained in the first step and the multiple image similarities obtained in the later steps by performing, for example, a nonparametric U test based on the multiple image similarities obtained in the first step and the multiple image similarities obtained in the later steps. If there is a significant difference, the calculation target selection unit 147 uses the curve selected in step S301 as the calculation target for the driving skill evaluation (step S305). If there is no significant difference ("N" in step S304), the calculation target selection unit 147 does not use the curve selected in step S301 as the calculation target for the driving skill evaluation (step S306).

[0141] (Regarding the evaluation of driving skills) The driving skills evaluation system 1 evaluates the driver's driving skills in the evaluation area based on driving data generated by the driver operating the vehicle 9, using multiple image data DP and area data DAR stored in the storage unit 32 of the server device 30. This operation will be described in detail below.

[0142] When the driver operates vehicle 9, the acceleration sensor 14 of the smartphone 10 detects acceleration in three directions in the coordinate system of the smartphone 10, the angular velocity sensor 15 detects three angular velocities (yaw angular velocity, roll angular velocity, and pitch angular velocity) in the coordinate system of the smartphone 10, and the GNSS receiver 16 obtains the position of vehicle 9 on the ground.

[0143] The data processing unit 21 performs predetermined data processing, such as filtering, based on the detection results from the acceleration sensor 14 and the angular velocity sensor 15. Specifically, the data processing unit 21 filters the time-series data of acceleration detected by the acceleration sensor 14 and filters the time-series data of angular velocity detected by the angular velocity sensor 15. However, it is not limited to this, and the data processing unit 21 may also perform downsampling on these filtered time-series data.

[0144] Then, after the vehicle has finished driving through the evaluation area, the communication unit 13 transmits the time-series data of acceleration and time-series data of angular velocity processed by the data processing unit 21 to the server device 30, along with the time-series data of the vehicle 9's position obtained by the GNSS receiver 16.

[0145] In the server device 30, the communication unit 31 receives data transmitted from the smartphone 10. Based on the data received by the communication unit 31, the server device 30 evaluates the driver's driving skills. The operation of this server device 30 will be described in detail below.

[0146] Figures 19A to 19C illustrate an example of the operation of the server device 30.

[0147] First, the data processing unit 41 of the server device 30 uses the area data DAR stored in the storage unit 32 to check whether the vehicle 9 has traveled through the evaluation area based on the time-series data of the vehicle 9's position (step S401). If the vehicle 9 has not traveled through the evaluation area ("N" in step S401), this process ends.

[0148] When vehicle 9 travels through the evaluation area ("Y" in step S401), the data processing unit 41 generates time-series data of longitudinal acceleration and yaw angular velocity by performing a coordinate transformation (step S402). Specifically, the data processing unit 41 generates time-series data of acceleration (longitudinal acceleration) in the direction of travel of vehicle 9 by performing a coordinate transformation based on the time-series data of acceleration in the evaluation area. The data processing unit 41 also generates time-series data of the yaw angular velocity of vehicle 9 by performing a coordinate transformation based on the time-series data of angular velocity in the evaluation area. However, it is not limited to this, and for example, if downsampling is performed in the smartphone 10, the data processing unit 41 may perform upsampling on the time-series data of acceleration and angular velocity received by the communication unit 31, and perform a coordinate transformation based on the upsampled time-series data of longitudinal acceleration and yaw angular velocity.

[0149] Next, the data processing unit 41 performs a filter process on the time-series data of longitudinal acceleration and yaw angular velocity generated in step S402 to generate acceleration data DA1 and yaw angular velocity data DY1, respectively (step S403).

[0150] Next, the curve detection unit 42 performs curve division processing based on the yaw angular velocity data DY1 generated in step S403 (step S404). This curve division processing is the same as the processing in step S103 shown in Figure 11. As a result, multiple curves are detected in the area to be evaluated.

[0151] Next, the data extraction unit 43 extracts time-series data of longitudinal acceleration and time-series data of yaw angular velocity related to the multiple curves detected from the acceleration data DA1 and yaw angular velocity data DY1 based on the detection results of the curve detection unit 42 (step S405). Specifically, the data extraction unit 43 extracts time-series data of longitudinal acceleration related to the multiple curves detected in step S404 from the time-series data of longitudinal acceleration included in the acceleration data DA1. The data extraction unit 43 also extracts time-series data of yaw angular velocity related to the multiple curves detected in step S404 from the time-series data of yaw angular velocity included in the yaw angular velocity data DY1.

[0152] Next, the image generation unit 44 generates multiple image data DP1 by generating kernel density estimation images for each of the multiple curves based on the time-series data of longitudinal acceleration and yaw angular velocity extracted in step S405 (step S406). This process is the same as the process in steps S105 and S108. In step S406, the image generation unit 44 generates multiple kernel density estimation images related to the area to be evaluated.

[0153] Next, the image similarity calculation unit 45 selects one of the multiple curves detected in step S404 within the evaluation target area (step S407).

[0154] The image similarity calculation unit 45 then calculates multiple image similarities between the kernel density estimation image of the selected curve and the multiple kernel density estimation images stored in the storage unit 32 for each of the multiple curves in the data acquisition area (step S408). In this example, the image similarity value is a positive value, and the more similar the kernel density estimation images are, the smaller the image similarity value is, and the less similar the kernel density estimation images are, the larger the image similarity value is.

[0155] Then, the image similarity calculation unit 45 calculates an average image similarity, which is the average value of multiple image similarities, for each of the multiple curves in the data acquisition area (step S409).

[0156] Then, the image similarity calculation unit 45 selects the lowest value among the multiple average image similarity values ​​corresponding to multiple curves of the data acquisition area as the minimum image similarity (step S410). Here, the image similarity value is smaller the more similar the kernel density estimated images are. Therefore, the image similarity calculation unit 45 selects the one with the highest degree of similarity among the multiple average image similarity values ​​as the minimum image similarity.

[0157] Figure 20 shows an example of the operation of the image similarity calculation unit 45. The kernel density estimation image P1 is a kernel density estimation image related to a certain curve in the evaluation target area, selected by the image similarity calculation unit 45 in step S407. Multiple kernel density estimation images P21 are kernel density estimation images related to curve C1 in the data acquisition area, stored in the storage unit 32. Multiple kernel density estimation images P22 are kernel density estimation images related to curve C2 in the data acquisition area, stored in the storage unit 32. Multiple kernel density estimation images P23 are kernel density estimation images related to curve C3 in the data acquisition area, stored in the storage unit 32.

[0158] First, in step S408, the image similarity calculation unit 45 calculates multiple image similarities between the kernel density estimation image of the selected curve and the multiple kernel density estimation images related to each of the multiple curves in the data acquisition area, which are stored in the storage unit 32. In the example in Figure 20, the image similarity calculation unit 45 calculates multiple image similarities VAL1 by comparing the kernel density estimation image P1 of the selected curve in the evaluation area with the multiple kernel density estimation images P21 related to curve C1 in the data acquisition area. Similarly, the image similarity calculation unit 45 calculates multiple image similarities VAL2 by comparing the kernel density estimation image P1 of the selected curve in the evaluation area with the multiple kernel density estimation images P22 related to curve C2 in the data acquisition area. The image similarity calculation unit 45 calculates multiple image similarities VAL3 by comparing the kernel density estimation image P1 of the selected curve in the evaluation area with the multiple kernel density estimation images P23 related to curve C3 in the data acquisition area. The same applies to the other curves in the data acquisition area.

[0159] Next, in step S409, the image similarity calculation unit 45 calculates the average image similarity, which is the average value of multiple image similarities, for each of the multiple curves in the data acquisition area. In the example in Figure 20, the image similarity calculation unit 45 calculates the average image similarity VALave1 by calculating the average value of multiple image similarities VAL1 related to curve C1 in the data acquisition area. Similarly, the image similarity calculation unit 45 calculates the average image similarity VALave2 by calculating the average value of multiple image similarity VAL2 related to curve C2 in the data acquisition area. The image similarity calculation unit 45 calculates the average image similarity VALave3 by calculating the average value of multiple image similarity VAL3 related to curve C3 in the data acquisition area. The same applies to the other curves in the data acquisition area.

[0160] Next, in step S410, the image similarity calculation unit 45 selects the one with the smallest image similarity value from among multiple average image similarities corresponding to multiple curves in the data acquisition area as the minimum image similarity. In the example in Figure 20, the image similarity calculation unit 45 selects the one with the smallest value from among multiple average image similarities VALave1, VALave2, VALave3, ... as the minimum image similarity. Here, the more similar the kernel density estimated images are, the smaller the image similarity value. Therefore, for example, if the average image similarity VALave1 is the smallest, it indicates that the selected curve in the evaluation area is most similar to curve C1 among the multiple curves in the data acquisition area.

[0161] In this way, in steps S408 to S410, the image similarity calculation unit 45 evaluates which of the multiple curves in the data acquisition area the selected curve in the evaluation target area is most similar to, and calculates the image similarity of the kernel density estimation images relating to the two curves that are most similar to each other. Here, for example, kernel density estimation image P1 corresponds to a specific example of the "first kernel density estimation image" in one embodiment of the present disclosure. For example, multiple kernel density estimation images P21 correspond to a specific example of the "multiple reference images" in one embodiment of the present disclosure. For example, multiple image similarity VAL1 corresponds to a specific example of the "multiple first similarity" in one embodiment of the present disclosure. For example, average image similarity VALave1 corresponds to a specific example of the "first average similarity" in one embodiment of the present disclosure.

[0162] Next, the image similarity calculation unit 45 checks whether all the curves detected in step S404 have been selected (step S411). If not all curves have been selected yet ("N" in step S411), it selects one of the multiple curves detected in step S404 that has not yet been selected (step S412) and returns to step S408. In this way, the image similarity calculation unit 45 repeats the process in steps S408 to S410 until all of the multiple curves detected in step S404 have been selected.

[0163] If all curves are selected in step S411 ("Y" in step S411), the image similarity calculation unit 45 calculates an average minimum image similarity, which is the average of the multiple minimum image similarities calculated in step S410 (step S413).

[0164] Next, the skill determination unit 46 checks whether the average minimum image similarity value calculated in step S413 is less than the threshold G2 (step S414).

[0165] In step S414, if the average similarity value is less than the threshold G2 ("Y" in step S414), the skill determination unit 46 determines that the driver of vehicle 9 has high driving skills (step S415). That is, in step S414, since the average minimum image similarity value is less than the threshold G2, the kernel density estimation image of the driver being evaluated is similar to the kernel density estimation image of a skilled driver. This indicates that the driving skills of the driver being evaluated are similar to those of a skilled driver. Therefore, the skill determination unit 46 determines that the driver of vehicle 9 has high driving skills.

[0166] Furthermore, in step S414, if the average minimum image similarity value is not less than the threshold G2 ("N" in step S414), the skill determination unit 46 determines that the skill level of the vehicle 9 driver is low (step S416). In other words, in step S414, since the average minimum image similarity value is not less than the threshold G2, the kernel density estimation image of the driver is not similar to the kernel density estimation image of a skilled driver. This indicates that the driving skills of the driver being evaluated are not similar to those of a skilled driver. Therefore, the skill determination unit 46 determines that the driver's driving skills are low.

[0167] This completes the process.

[0168] The communication unit 31 of the server device 30 transmits data including the driving skill evaluation results to the smartphone 10. The communication unit 13 of the smartphone 10 receives the data transmitted from the smartphone 10. The display processing unit 22 performs display processing based on the data indicating the driving skill evaluation results transmitted from the server device 30. The touch panel 11 displays the driving skill evaluation results. This allows the driver to obtain an objective evaluation of their driving skills.

[0169] Thus, the driving skills evaluation method in the driving skills evaluation system 1 includes a detection process that detects curves based on the driving data of the vehicle 9, and an evaluation process that evaluates the driving skills of the driver of the vehicle 9 based on the driving data on the curves. This evaluation process includes, for example, as shown in Figure 20, generating a first kernel density estimation image (kernel density estimation image P1) based on driving data in a first curve detected by the detection process; calculating multiple first similarities (e.g., multiple image similarity VAL1) between the first kernel density estimation image (kernel density estimation image P1) and multiple reference images (e.g., multiple kernel density estimation images P21) associated with each of multiple curves (curves C1, C2, C3, ...) that do not include the first curve; calculating a first average similarity (e.g., average image similarity VALave1), which is the average of the multiple first similarities, for each of the multiple curves (curves C1, C2, C3, ...); and evaluating the driving skills of the vehicle driver based on the first average similarity that indicates the highest degree of similarity among the multiple first average similarities. This allows this driving skills evaluation method to assess a driver's skills using multiple kernel density estimation images related to multiple curves in a data acquisition area different from the evaluation area, based on kernel density estimation images related to curves in the evaluation area. As a result, this driving skills evaluation method can be made more convenient.

[0170] In other words, for example, when evaluating a driver's driving skills using multiple kernel density estimation images related to multiple curves in an evaluation area, based on kernel density estimation images related to curves in that evaluation area, the driver being evaluated must drive vehicle 9 on the same roads that a skilled driver has driven. In this case, the evaluation area in which driving evaluation is performed is limited, resulting in low convenience. On the other hand, this driving skills evaluation method allows for the evaluation of a driver's driving skills using multiple kernel density estimation images related to multiple curves in data acquisition areas different from the evaluation area, based on kernel density estimation images related to curves in the evaluation area. Therefore, the driver being evaluated can drive vehicle 9 on roads different from those driven by a skilled driver. In this case, for example, more evaluation areas can be prepared than the number of data acquisition areas, and the driver can obtain driving skills evaluation results by driving vehicle 9 in one of the many evaluation areas. As a result, this driving skills evaluation method makes it easier to evaluate a driver's driving skills, thus increasing convenience.

[0171] Furthermore, in this driving skill evaluation method, as shown in Figures 5 and 6, for example, the first image direction in the kernel density estimation image represents time, the second image direction in the kernel density estimation image represents a first parameter (in this example, the square of the yaw angular velocity) corresponding to the change in the direction of travel of the vehicle 9, and the pixel value of the kernel density estimation image is set to a value corresponding to the data of the second parameter (in this example, the square of the longitudinal jerk) which represents the square of the jerk in the direction of travel of the vehicle 9. This makes it possible to improve the accuracy of evaluating the driver's driving skills, for example, on roads where the speed of the vehicle 9 changes significantly. That is, for example, on a road with many undulations, the speed of the vehicle 9 changes significantly, and the value of the square of the longitudinal jerk can change significantly, so the pixel value of the kernel density estimation image can change significantly. Therefore, this driving skill evaluation method can improve the accuracy of evaluating the driver's driving skills, especially on roads where the speed of the vehicle 9 changes significantly.

[0172] Furthermore, this driving skills evaluation method now includes presenting the driver with the evaluation results of their driving skills. This allows drivers to obtain an objective evaluation of their own driving skills. As a result, drivers can pay more attention to their driving and strive to improve their driving skills.

[0173] [effect] As described above, in this embodiment, the driving skill evaluation method includes a detection process to detect curves based on vehicle driving data, and an evaluation process to evaluate the driving skills of the vehicle driver based on the driving data at the curves. This evaluation process includes generating a first kernel density estimation image based on the driving data at the first curve detected by the detection process, calculating multiple first similarities between the first kernel density estimation image and multiple reference images associated with each of multiple curves that do not include the first curve, calculating a first average similarity which is the average of the multiple first similarities for each of the multiple curves, and evaluating the driving skills of the vehicle driver based on the first average similarity which indicates the highest degree of similarity among the multiple first average similarities. This improves convenience.

[0174] [Example 1] In the above embodiment, as shown in Figures 5 and 6, the vertical axis (Y-axis) of the kernel density estimation image represents the square of the yaw angular acceleration, but it is not limited to this. Alternatively, for example, the vertical axis (Y-axis) of the kernel density estimation image may represent the yaw angular acceleration as shown in Figure 21, or the absolute value of the yaw angular acceleration. Also, for example, the vertical axis (Y-axis) of the kernel density estimation image may represent the yaw angular velocity as shown in Figure 22, or the absolute value of the yaw angular velocity. Furthermore, the vertical axis (Y-axis) of the kernel density estimation image may represent the square of the acceleration in the direction intersecting the direction of vehicle travel (lateral acceleration) as shown in Figure 23, or it may represent the lateral acceleration as shown in Figure 24, or it may represent the absolute value of the lateral acceleration.

[0175] [Differentiation 2] In the above embodiment, as shown in Figures 5 and 6, the vertical axis (Y-axis) of the kernel density estimation image represents the square of the yaw angular acceleration, and the pixel values ​​(Z-axis) of the kernel density estimation image represent the square of the longitudinal jerk. However, the embodiment is not limited to this. Alternatively, for example, as shown in Figures 25 and 26, the vertical axis (Y-axis) of the kernel density estimation image may represent the square of the longitudinal jerk, and the pixel values ​​(Z-axis) of the kernel density estimation image may represent the square of the yaw angular acceleration. Figure 25 shows an example of a kernel density estimation image on a curve. Figure 26 shows the coordinate axes of the kernel density estimation image shown in Figure 25. This makes it possible to improve the accuracy of evaluating the driver's driving skills, for example, especially on roads where the change in vehicle speed 9 is small. That is, for example, on a gently undulating road, the change in vehicle speed 9 is small, and the value of the square of the longitudinal jerk does not change significantly, so the pixel values ​​of the kernel density estimation image shown in Figures 6 and 7 do not change significantly. In such cases, the accuracy of evaluating the driver's driving skills can be improved by using the kernel density estimation images shown in Figures 25 and 26.

[0176] Furthermore, in the examples in Figures 25 and 26, the pixel values ​​(Z-axis) of the kernel density estimation image represent the square of the yaw angular acceleration, but this is not the only way to do so. Alternatively, for example, as in Modification 1, the pixel values ​​(Z-axis) of the kernel density estimation image may represent the absolute value of the yaw angular acceleration, the square of the transverse acceleration, or the absolute value of the transverse acceleration.

[0177] [Difference 3] In the above embodiment, as shown in Figure 2, the smartphone 10 transmitted time-series data of acceleration, time-series data of angular velocity, and time-series data of the vehicle 9's position to the server device 30, but it is not limited to this. Alternatively, for example, the smartphone 10 may also transmit time-series data of the geomagnetic field to the server device 30. This example will be described in detail below.

[0178] Figure 27 shows an example configuration of a smartphone 10A according to this modified example. The smartphone 10A has a geomagnetic sensor 17A and a processing unit 20A. The geomagnetic sensor 17A is configured to detect the Earth's magnetic field. The processing unit 20A collects time-series data of acceleration detected by the acceleration sensor 14, time-series data of angular velocity detected by the angular velocity sensor 15, time-series data of the vehicle 9's position obtained by the GNSS receiver 16, and time-series data of the Earth's magnetic field detected by the geomagnetic sensor 17A. After the vehicle has finished driving, the communication unit 13 transmits the time-series data of acceleration and angular velocity processed by the data processing unit 21, along with the time-series data of the vehicle 9's position obtained by the GNSS receiver 16 and the time-series data of the Earth's magnetic field detected by the geomagnetic sensor 17A, to the server device 30.

[0179] The data processing unit 41 of the server device 30 generates time-series data of acceleration (longitudinal acceleration) in the direction of travel of the vehicle 9 by performing coordinate transformations based on the time-series acceleration data received by the communication unit 31. It also generates time-series data of the yaw angular velocity of the vehicle 9 by performing coordinate transformations based on the time-series angular velocity data received by the communication unit 31. Then, the data processing unit 41 corrects the time-series data of longitudinal acceleration and yaw angular velocity based on the time-series geomagnetic data received by the communication unit 31. This improves the accuracy of the time-series data of longitudinal acceleration and yaw angular velocity.

[0180] [Differentiation Example 4] In the above embodiment, the evaluation area is different from the data acquisition area, but this is not the only option. Alternatively, for example, the evaluation area may be the same as the data acquisition area. Even in this case, the driving skills evaluation system 1 can evaluate the driver's driving skills using the method shown in Figures 19A to 19C.

[0181] Furthermore, for example, if the vehicle 9 driven by the driver being evaluated is traveling within the data acquisition area, the driving skill evaluation system 1 may be configured to evaluate the driver's driving skills using a method different from that shown in Figures 19A to 19C. In this case, the route traveled by the vehicle 109 driven by the skilled driver and the route traveled by the vehicle 9 driven by the driver being evaluated are the same. Therefore, multiple curves detected based on the driving data of the driver being evaluated can be made to correspond one-to-one with multiple curves detected based on the driving data of the skilled driver. Thus, the image similarity of the two kernel density estimation images related to the curves that correspond one-to-one in this way can be calculated, and the driver's driving skills can be evaluated based on this image similarity.

[0182] [Other variations] Furthermore, two or more of these variations may be combined.

[0183] While an example of an embodiment of the present disclosure has been described above with reference to the accompanying drawings, the present disclosure is by no means limited to the above embodiment. Those skilled in the art will understand that various modifications and changes can be made without departing from the scope defined by the attached claims. The present disclosure is intended to encompass such modifications and changes insofar as they fall within the scope of the attached claims and their equivalents.

[0184] For example, in the above embodiment, the server device 30 evaluates driving skills based on driving data transmitted from the smartphone 10, but it is not limited to this. Alternatively, for example, the smartphone 10 may evaluate driving skills based on driving data. In this case, the processing unit 20 of the smartphone 10 may operate as a data processing unit 41, a curve detection unit 42, a data extraction unit 43, an image generation unit 44, an image similarity calculation unit 45, and a skill determination unit 46. In addition, the storage unit 12 of the smartphone 10 stores multiple image data DPs and area data DARs.

[0185] Furthermore, the onboard device of vehicle 9 may collect driving data of vehicle 9 and evaluate driving skills based on this driving data. Similar to the onboard device 110 (Figure 9), this onboard device of vehicle 9 collects time-series data of longitudinal acceleration detected by an acceleration sensor, time-series data of yaw angular velocity detected by a yaw angular velocity sensor, and time-series data of the position of vehicle 9 obtained by a GNSS receiver. The processing unit of the onboard device of vehicle 9 may operate as a data processing unit 41, a curve detection unit 42, a data extraction unit 43, an image generation unit 44, an image similarity calculation unit 45, and a skill determination unit 46. In addition, the storage unit of this onboard device stores multiple image data DPs and area data DARs.

[0186] The effects described herein are illustrative only, and the effects of this disclosure are not limited to those described herein. Therefore, other effects may be obtained with respect to this disclosure.

[0187] Furthermore, this disclosure may take the following forms:

[0188] (1) The system performs a detection process to detect curves based on vehicle driving data, Based on the driving data in the curve, an evaluation process is performed to evaluate the driving skills of the vehicle's driver. Includes, The aforementioned evaluation process is, Based on the driving data in the first curve detected by the detection process, a first kernel density estimation image is generated. The process involves calculating multiple first similarities between the first kernel density estimation image and multiple reference images associated with each of the multiple curves that do not include the first curve, and for each of the multiple curves, calculating a first average similarity which is the average of the multiple first similarities. The driving skills of the vehicle's driver are evaluated based on the first average similarity, which indicates the highest degree of similarity among a plurality of the aforementioned first average similarities. A method for evaluating driving skills, including the following. (2) The aforementioned plurality of curves do not include the first curve and the second curve. The aforementioned evaluation process is, A second kernel density estimation image is generated based on the driving data in the second curve detected by the above detection process, The process involves calculating multiple second similarities between the second kernel density estimation image and the multiple reference images associated with each of the multiple curves, and for each of the multiple curves, calculating a second average similarity which is the average of the multiple second similarities. It further includes, When evaluating the driving skills of the vehicle's driver, the driving skills of the vehicle's driver are evaluated based not only on the first average similarity, but also on the second average similarity, which indicates the highest degree of similarity among a plurality of second average similarities. The driving skills evaluation method described in (1) above. (3) The aforementioned multiple curves are provided in a predetermined area. The detection process detects the curve when it is located in an evaluation area different from the predetermined area. The driving skills evaluation method described in (1) or (2) above. (4) In the kernel density estimation image, the first image direction represents time. The second image orientation in the kernel density estimation image indicates a first parameter corresponding to the change in the direction of travel of the vehicle. The pixel values ​​of the kernel density estimation image correspond to the data of a second parameter that represents the square of the jerk in the direction of travel of the vehicle. A driving skills evaluation method as described in any of (1) to (3) above. (5) In the kernel density estimation image, the first image direction represents time. The second image direction in the kernel density estimation image represents the first parameter which indicates the square of the jerk in the direction of travel of the vehicle. The pixel values ​​of the kernel density estimation image are values ​​corresponding to the data of a second parameter that corresponds to the change in the direction of travel of the vehicle. A driving skills evaluation method as described in any of (1) to (3) above. (6) The further includes presenting the driver with the results of an evaluation of the driver's driving skills. A driving skills evaluation method as described in any of (1) to (5) above. (7) A curve detection circuit capable of performing detection processing to detect curves based on vehicle driving data, An evaluation circuit capable of performing an evaluation process to evaluate the driving skills of the vehicle's driver based on the driving data in the curve. Equipped with, The aforementioned evaluation process is, Based on the driving data in the first curve detected by the detection process, a first kernel density estimation image is generated. The process involves calculating multiple first similarities between the first kernel density estimation image and multiple reference images associated with each of the multiple curves that do not include the first curve, and for each of the multiple curves, calculating a first average similarity which is the average of the multiple first similarities. The driving skills of the vehicle's driver are evaluated based on the first average similarity, which indicates the highest degree of similarity among a plurality of the aforementioned first average similarities. including Driving skills evaluation system. (8) The system performs a detection process to detect curves based on vehicle driving data, Based on the driving data in the curve, an evaluation process is performed to evaluate the driving skills of the vehicle's driver. Software that instructs the processor to perform this task is recorded. The aforementioned evaluation process is, Based on the driving data in the first curve detected by the detection process, a first kernel density estimation image is generated. The process involves calculating multiple first similarities between the first kernel density estimation image and multiple reference images associated with each of the multiple curves that do not include the first curve, and for each of the multiple curves, calculating a first average similarity which is the average of the multiple first similarities. The driving skills of the vehicle's driver are evaluated based on the first average similarity, which indicates the highest degree of similarity among a plurality of the aforementioned first average similarities. including Non-transient recording medium.

[0189] The processing unit 40 shown in Figure 3 can be implemented by a circuit including at least one semiconductor integrated circuit, such as at least one processor (e.g., a central processing unit (CPU)), at least one application-specific integrated circuit (ASIC) and / or at least one field-programmable gate array (FPGA). At least one processor can be configured to perform all or some of the functions of the processing unit 40 shown in Figure 3 by reading instructions from at least one non-temporary, tangible computer-readable medium. Such a medium can take various forms, including, but is not limited to, various magnetic media such as hard disks, various optical media such as CDs or DVDs, and various semiconductor memories (i.e., semiconductor circuits) such as volatile or non-volatile memory. Volatile memory may include DRAM and SRAM. Non-volatile memory may include ROM and NVRAM. An ASIC is an integrated circuit (IC) specialized to perform all or some of the functions of the processing unit 40 shown in Figure 3. An FPGA is an integrated circuit designed to be configurable after manufacturing to perform all or some of the functions of the processing unit 40 shown in Figure 3.

Claims

1. The system performs a detection process to detect curves based on vehicle driving data, Based on the driving data in the curve, an evaluation process is performed to evaluate the driving skills of the vehicle's driver. Includes, The aforementioned evaluation process is, Based on the driving data in the first curve detected by the detection process, a first kernel density estimation image is generated. The process involves calculating multiple first similarities between the first kernel density estimation image and multiple reference images associated with each of the multiple curves that do not include the first curve, and for each of the multiple curves, calculating a first average similarity which is the average of the multiple first similarities. The driving skills of the vehicle's driver are evaluated based on the first average similarity, which indicates the highest degree of similarity among a plurality of the aforementioned first average similarities. A method for evaluating driving skills, including the following.

2. The plurality of curves exclude the first curve and the second curve. The aforementioned evaluation process is, A second kernel density estimation image is generated based on the driving data in the second curve detected by the above detection process, The process involves calculating multiple second similarities between the second kernel density estimation image and the multiple reference images associated with each of the multiple curves, and for each of the multiple curves, calculating a second average similarity which is the average of the multiple second similarities. It further includes, When evaluating the driving skills of the vehicle's driver, the driving skills of the vehicle's driver are evaluated based not only on the first average similarity but also on the second average similarity, which is the one that shows the highest degree of similarity among a plurality of second average similarities. The method for evaluating driving skills according to claim 1.

3. The aforementioned multiple curves are provided in a predetermined area. The detection process detects the curve when it is located in an evaluation area different from the predetermined area. The method for evaluating driving skills according to claim 1.

4. In the kernel density estimation image, the first image direction indicates time. The second image orientation in the kernel density estimation image indicates the first parameter corresponding to the change in the direction of travel of the vehicle. The pixel values ​​of the kernel density estimation image correspond to the data of a second parameter that represents the square of the jerk in the direction of travel of the vehicle. The method for evaluating driving skills according to claim 1.

5. In the kernel density estimation image, the first image direction indicates time. The second image direction in the kernel density estimation image represents the first parameter which indicates the square of the jerk in the direction of travel of the vehicle. The pixel values ​​of the kernel density estimation image are values ​​corresponding to the data of a second parameter that corresponds to the change in the direction of travel of the vehicle. The method for evaluating driving skills according to claim 1.

6. The further includes presenting the driver with the results of an evaluation of the driver's driving skills. The method for evaluating driving skills according to claim 1.

7. A curve detection circuit capable of performing detection processing to detect curves based on vehicle driving data, An evaluation circuit capable of performing an evaluation process to evaluate the driving skills of the vehicle's driver based on the driving data in the curve. Equipped with, The aforementioned evaluation process is, Based on the driving data in the first curve detected by the detection process, a first kernel density estimation image is generated. The process involves calculating multiple first similarities between the first kernel density estimation image and multiple reference images associated with each of the multiple curves that do not include the first curve, and for each of the multiple curves, calculating a first average similarity which is the average of the multiple first similarities. The driving skills of the vehicle's driver are evaluated based on the first average similarity, which indicates the highest degree of similarity among a plurality of the aforementioned first average similarities. including Driving skills evaluation system.

8. The system performs a detection process to detect curves based on vehicle driving data, Based on the driving data in the curve, an evaluation process is performed to evaluate the driving skills of the vehicle's driver. Software that instructs the processor to perform this task is recorded. The aforementioned evaluation process is, Based on the driving data in the first curve detected by the detection process, a first kernel density estimation image is generated. The process involves calculating multiple first similarities between the first kernel density estimation image and multiple reference images associated with each of the multiple curves that do not include the first curve, and for each of the multiple curves, calculating a first average similarity which is the average of the multiple first similarities. The driving skills of the vehicle's driver are evaluated based on the first average similarity, which indicates the highest degree of similarity among a plurality of the aforementioned first average similarities. including Non-transient recording medium.

Citation Information

Patent Citations

  • Monitor for driving practice

    JP2001354047A

  • Target vehicle speed determination device

    JP2003276472A

  • Imaging device and method

    JP2008109176A

  • Image identification method, image identification device and program

    JP2017033469A

  • Operation evaluation system, operation evaluation method, program, and medium

    JP2020019289A