Cognitive function estimation device

The cognitive function estimation device addresses the inadequacies of conventional methods by calculating steering shake to estimate a driver's cognitive function, enabling precise adjustments and alerts based on age-related correlations.

JP7593854B2Active Publication Date: 2024-12-03NAT UNIV CORP TOKAI NAT HIGHER EDUCATION & RES SYST +1
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2021048738
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-03-23
Publication Date
2024-12-03
Estimated Expiration
2041-03-23

AI Technical Summary

Technical Problem

Conventional methods for estimating a driver's condition during driving fail to accurately determine whether the driver's cognitive function is normal, decreased, or fatigued, and do not provide insights into essential cognitive functions.

Method used

A cognitive function estimation device that calculates the amount of steering shake based on time-series changes in the steering angle, correlates it with the driver's age, and uses this information to estimate cognitive function through a calculation and estimation unit.

Benefits of technology

Enables accurate estimation of a driver's cognitive function, allowing for adjustments in vehicle operations and alerts based on the driver's cognitive state, and providing insights into cognitive decline trends.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007593854000001
    Figure 0007593854000001
  • Figure 0007593854000002
    Figure 0007593854000002
  • Figure 0007593854000003
    Figure 0007593854000003
Patent Text Reader

Abstract

To estimate a cognitive function of a driver using an amount of steering shake.SOLUTION: A cognitive function estimating device comprises: a calculation unit 14 for calculating a steering shake amount based on time-series change information on a steering angle in operation of a target driver; and an estimating unit 15 for estimating a cognitive function of the target driver based on information which expresses relationships between steering shake amounts and ages of a plurality of drivers obtained by experiments conducted in advance with the drivers, an actual age of the target driver, and the steering shake amount of the driving of the target driver calculated by the calculation unit.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an apparatus for estimating cognitive function using automobile driving. [Background technology]

[0002] A conventional technique in this field is disclosed in Japanese Patent Application Laid-Open No. 2008-56059. In the method for estimating the state of a driver described in this publication, information on the driver's heart rate, sweat, steering wheel operation, and braking operation is acquired, a model of the driver is created, and the state of the driver is estimated.

[0003] More specifically, the method of estimating the driver's state described in this publication can estimate that the driver's level of alertness is declining by utilizing information such as unstable steering operation, unstable accelerator operation, sudden braking operation, and unstable relative speed of the vehicle ahead. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2008-56059 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, the conventional driver state estimation method described above estimates whether the driver's state while driving is normal, has a reduced level of alertness, is tense, is fatigued, etc., and does not estimate the driver's essential cognitive function. The present invention provides a cognitive function estimation device that estimates a driver's cognitive function by utilizing automobile driving. [Means for solving the problem]

[0006] The cognitive function estimation device of the present invention includes a calculation unit that calculates the amount of steering shake based on time-series change information of the steering angle while the target driver is driving, and an estimation unit that estimates the cognitive function of the target driver based on information correlating the relationship between the amount of steering shake and the driver's age through experiments conducted in advance with a plurality of drivers, the actual age of the target driver, and the amount of steering shake during the driving of the target driver calculated by the calculation unit. This makes it possible to estimate the driver's cognitive function based on the amount of change in the steering wheel angle. Effect of the Invention

[0007] This makes it possible to estimate the driver's cognitive function. [Brief description of the drawings]

[0008] [Figure 1] FIG. 2 is a diagram illustrating a configuration of a cognitive function estimation device provided in a vehicle. [Diagram 2] FIG. 4 is a diagram showing an example of a change over time in steering shake amount. [Diagram 3] FIG. 11 is a diagram showing a positive correlation between the amount of steering shake and age. [Figure 4] FIG. 13 is a diagram showing a negative correlation between the amount of steering shake and the MMSE score. [Diagram 5] FIG. 11 is a diagram showing that there is a positive correlation between the amount of steering shake and TMT. [Figure 6] FIG. 11 is a diagram showing that there is a positive correlation between the amount of steering shake and the reaction time in an emergency reaction test. [Figure 7] FIG. 11 is a diagram showing that there is a positive correlation between the amount of steering shake and the signal confirmation test reaction time. [Figure 8] FIG. 13 is a diagram showing that there is a positive correlation between the amount of steering shake and reaction time in a lateral vigilance test. [Figure 9] FIG. 13 is a diagram showing a negative correlation between the amount of steering shake and the accuracy rate in a lateral vigilance test. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. As shown in Fig. 1, a vehicle 1 includes a steering wheel 11 operated by a driver, a steering angle acquisition unit 12 that acquires the steering angle of the steering wheel 11, a memory unit 13 that stores information acquired by the steering angle acquisition unit 12, a calculation unit 14 that calculates the amount of steering shake (amount of steering shake) from the information stored in the memory unit 13, an estimation unit 15 that estimates the cognitive function of the driver using the amount of steering shake calculated by the calculation unit 14, and a position measurement device 16.

[0010] In the following description, the cognitive function estimation device 2 provided in the vehicle 1 is described as including a steering angle acquisition unit 12, a storage unit 13, a calculation unit 14, and an estimation unit 15. Furthermore, the driver of the vehicle 1, who is the subject of cognitive function estimation using the cognitive function estimation device 2, may be referred to as a target driver.

[0011] The steering wheel 11 is an annular part that the driver rotates to operate the steering mechanism of the vehicle 1 and adjust the traveling direction.

[0012] The steering angle acquisition unit 12 is a sensor connected to the steering wheel 11. For example, an angle sensor can be used as the sensor used in the steering angle acquisition unit 12. The steering angle acquisition unit 12 acquires a steering angle (hereinafter, steering angle) resulting from the operation of the steering wheel 11 by the driver.

[0013] The steering angle acquisition unit 12 may be provided by being directly connected to the steering wheel 11, or may be connected to other steering components that operate in response to the operation of the steering wheel 11 and measure the operation of the connected components.

[0014] More specifically, the steering angle acquisition unit 12 acquires the absolute value of the steering angle of the steering wheel 11 every 10 ms while the vehicle 1 is traveling on a straight road. Here, the absolute value of the steering angle is the deviation of the steering wheel 11 from the center to the left or right when the steering wheel 11 is operated.

[0015] The memory unit 13 stores information on the steering angle of the steering wheel 11 by the driver, which information is acquired by the steering angle acquisition unit 12.

[0016] Furthermore, the memory unit 13 stores information on the amount of steering shake calculated by a calculation unit 14 described later from steering angle information acquired by the steering angle acquisition unit 12 while driving by multiple drivers, and information on the age of the driver associated with this amount of steering shake.

[0017] The calculation unit 14 calculates the steering shake amount, which is the amount of shaking of the steering angle, from the time-series change information of the steering angle during driving of the target driver stored in the storage unit 13. The calculation unit 14 uses the absolute value of the average steering angle every 10 ms acquired by the steering angle acquisition unit 12, and can calculate the average value of the absolute value of the steering angle for 3 to 10 seconds as the amount of steering shake.

[0018] Also, for example, the steering angle acquisition unit 12 can acquire information on the steering angle for a predetermined long period of time by one driving by the target driver. Fig. 2 is a diagram showing an example of a change in the steering shake amount over time. Also, the calculation unit 14 stores the calculated steering shake amount in the storage unit 13.

[0019] The estimation unit 15 uses the steering shake amount calculated by the calculation unit 14 to estimate the cognitive function of the target driver.

[0020] Specifically, the estimation unit 15 estimates the cognitive function of the target driver based on the information on the steering shake amount calculated by the driving of the multiple drivers stored in the storage unit 13, the ages of the multiple drivers associated with the relationship with the steering shake amount, and the steering shake amount of the target driver. The estimation of this cognitive function will be described later.

[0021] A GPS (Global Positioning System) can be used for the position measurement device 16. With this, the position measurement device 16 acquires information on the position where the vehicle 1 is traveling.

[0022] The memory unit 13 stores map information in advance, and the location where the vehicle 1 is traveling can be identified by the position measurement device 16. This makes it possible to detect that the vehicle 1 is traveling on a straight road. Therefore, the steering angle acquisition unit 12 can acquire the steering angle when it is determined that the vehicle 1 is traveling on a straight road.

[0023] Next, it will be described how the estimation unit 15 can estimate the driver's cognitive function using the steering shake amount.

[0024] It is generally known that the older a person is, the more likely they are to have poorer scores on screening tests for dementia (such as the Mini-Mental State Examination (MMSE)), poorer attention function, attention allocation function, and attention maintenance function (TMT A, TMT B: Trail Making Test_A, B), poorer lateral attention function, and poorer reaction speed to stimuli.

[0025] For example, Figure 3 shows the results of an experiment conducted on multiple subjects, which showed that there is a positive correlation between the amount of steering shake and age. In other words, it shows that the amount of shake increases as people get older.

[0026] Figure 4 shows the results of an experiment conducted on multiple subjects, which showed that there is a negative correlation between the amount of steering shake and the MMSE score. In other words, the more the amount of shake increases, the lower the MMSE score becomes, which indicates a state closer to dementia.

[0027] Figure 5 shows the results of an experiment conducted with multiple subjects, which showed that there is a positive correlation between the amount of steering shake and TMT. In other words, it shows that the more the amount of steering shake increases, the more the driver's attention function declines.

[0028] Figure 6 shows the results of an experiment conducted with multiple subjects, which showed that there is a positive correlation between the amount of steering shake and the reaction time of the emergency reaction test. In other words, the more the amount of steering shake increases, the slower the reaction to the stimulus becomes.

[0029] Figure 7 shows the results of an experiment conducted with multiple subjects, which showed that there is a positive correlation between the amount of steering shake and the reaction time to the signal confirmation test. In other words, the reaction to the signal color becomes slower as the amount of steering shake increases.

[0030] Figures 8 and 9 show the results of an experiment conducted with multiple subjects, which showed that the amount of steering shake was positively correlated with reaction time in the lateral vigilance test and negatively correlated with the accuracy rate. In other words, it was shown that the more the amount of steering shake increases, the longer the reaction time to the lateral stimulus becomes and the lower the accuracy becomes.

[0031] 3 to 9, the ability of the cognitive function related to attention function and stimulus response required for driving can be estimated from the steering shake amount. Therefore, the estimation unit 15 can estimate the cognitive function of the driver by using the steering shake amount.

[0032] Here, an example of a procedure for estimating the cognitive function of a target driver will be described.

[0033] The steering angle acquisition unit 12 acquires the steering angle when the target driver drives on a road that is determined to be a straight road by the position measurement device 16. The steering angle information acquired by the steering angle acquisition unit 12 is stored in the memory unit 13.

[0034] The calculation unit 14 calculates the amount of steering shake applied to the target driver from the stored information on the steering angle applied to the target driver.

[0035] On the other hand, the memory unit 13 stores information on the steering shake amount of a plurality of drivers and the age of the driver associated with each steering shake amount. As shown in Fig. 3, the steering shake amount has a positive correlation with the age. Therefore, for example, the memory unit 13 stores information on the steering amount associated with the driver's age.

[0036] The estimation unit 15 compares the amount of steering shake calculated from the steering angle information acquired when the target driver was driving with the amount of steering shake and age information of multiple drivers pre-stored in the memory unit 13.

[0037] This makes it possible to estimate the age of the target driver from the amount of steering shake.

[0038] In the vehicle 1, the operation settings of various functions can be adjusted according to the estimated age of the target driver. For example, in the vehicle 1, when an alert is necessary, the timing of issuing the alert can be adjusted according to the estimated age of the target driver.

[0039] Here, the case where an alert needs to be issued is when attention is called to a signal ahead or an approaching object on the side, etc. For example, in the vehicle 1, when an alert is issued to a driver who is found to have impaired cognitive function based on the estimation of cognitive function by the estimation unit 15, adjustments can be made such as issuing the alert earlier.

[0040] Furthermore, if personal attribute information such as the actual age of the target driver is input to the cognitive function estimation device 2, and the amount of steering shake is estimated to be equivalent to an age greater than the actual age, the estimation unit 15 can determine that the target driver's cognitive function has declined.

[0041] In such a case, it is possible to set the range of steering shake based on personal attribute information as an acceptable range, and to generate an alert when the range is deviated from the acceptable range.

[0042] Furthermore, the estimation result of the deterioration of the cognitive function of the target driver by the estimation unit 15 may be transmitted to and used outside the vehicle 1. For example, the information on the cognitive function of the target driver may be communicated to a family member of the target driver who is set as a contact in advance.

[0043] Also, it is possible to change the settings of devices installed in locations other than the vehicle 1, depending on the estimation result of the cognitive function of the target driver by the estimation unit 15. As an example, depending on the estimation result of the estimation unit 15, it is possible to adjust the reaction speed to an input operation performed by the target driver, change the detection level for an erroneous operation, etc., for other devices installed in the home or the like of the target driver.

[0044] In addition, the estimation unit 15 can estimate the cognitive function of the target driver multiple times over a long period of time. This makes it possible to obtain the transition of changes in cognitive function, for example, on a monthly basis.

[0045] The cognitive function estimation device 2 can estimate the cognitive function of the driver using data from the entire journey when the driver drives the vehicle 1, but the estimation accuracy can be improved by focusing on straight roads in particular to perform calculations for estimation. In this case, continuous data measured continuously for about 10 seconds on a straight road is required.

[0046] For example, the cognitive function estimation device 2 can distinguish between straight roads and curves / turns when the vehicle 1 is traveling. The cognitive function estimation device 2 extracts only straight roads and performs calculations to estimate the cognitive function of the target driver.

[0047] Furthermore, by adding conditions such as speed and time, the cognitive function estimation device 2 can improve the estimation accuracy of the cognitive function of the target driver. For example, the cognitive function estimation device 2 can improve the estimation accuracy by using continuous data of driving at a predetermined speed or more for a predetermined period of time or more.

[0048] Furthermore, in the cognitive function estimation device 2, the accuracy of estimating the cognitive function of the target driver can be further improved by performing calculations under conditions that combine the extraction of this straight road with the addition of speed and time conditions.

[0049] Specifically, in the cognitive function estimation device 2, the target data is extracted by setting the target road type (residential road) and the course (straight ahead) in combination with the GPS information and map information, and the condition that the data is extracted with three or more continuous data sections of about 10 seconds at a driving speed of 40 km / h or less can be combined. In this way, by setting a combination of conditions and performing estimation in the cognitive function estimation device 2, it is expected that the calculation results will be more noticeable for each driver, and the estimation accuracy of the cognitive function of the target driver can be further improved.

[0050] The method of determining whether or not a road is a straight road is not limited to the method using GPS, but may be a method using an image sensor or a G / yaw rate sensor+speed, and is not limited to these methods.

[0051] The present invention is not limited to the above-described embodiment, and can be modified as appropriate without departing from the spirit of the present invention. In other words, the above description has been omitted or simplified as appropriate for the purpose of clarity, and a person skilled in the art can easily modify, add, or convert each element of the embodiment within the scope of the present invention.

[0052] For example, the calculation unit 14 may calculate the steering shake amount from the steering angle acquired by the steering angle acquisition unit 12, and the estimation unit 15 may estimate the cognitive function of the target driver in real time while the target driver is driving, but this is not limited to this. That is, by utilizing information stored in the memory unit 13, the estimation unit 15 may perform calculation processing for the estimation of the cognitive function of the target driver after the end of driving. Alternatively, the calculation unit 14 may calculate the steering shake amount and the estimation unit 15 may calculate the cognitive function of the target driver after the end of driving.

[0053] Also, for example, the steering angle acquisition unit 12 can acquire the steering angle multiple times during a predetermined time, and the calculation unit 14 can acquire information on multiple steering shake amounts from the information on the multiple steering angles. At this time, the estimation unit 15 may estimate the cognitive function multiple times from the information on multiple steering shake amounts within a predetermined period of time.

[0054] In this case, the cognitive function estimation device 2 can select which of the estimation results output multiple times to use as the cognitive function estimation result, or whether to use the average value or the median value, etc.

[0055] In the above, as a specific example, the continuous data used for estimation is described with the reference driving speed being 40 km / h and the reference Time Window of the continuous data section being 10 seconds, but this is not limited thereto, and the reference speed and reference time can be changed arbitrarily.

[0056] The cognitive function estimation device 2 can be realized by a computer having a main storage device, an auxiliary storage device, and a CPU (Central Processing Unit). In addition, in this computer, any processing can be realized by making the CPU (Central Processing Unit) execute a computer program. The above-mentioned program can be stored using various types of non-transitory computer readable medium and supplied to the computer. The non-transitory computer readable medium includes various types of tangible storage medium. Examples of the non-transitory computer readable medium include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROM (Read Only Memory) CD-R, CD-R / W, and semiconductor memory (e.g., mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)). The program may be supplied to the computer by various types of transitory computer readable medium. Examples of the temporary computer-readable medium include an electric signal, an optical signal, and an electromagnetic wave. The temporary computer-readable medium can provide the program to the computer via a wired communication path such as an electric wire or an optical fiber, or a wireless communication path.

[0057] In the above embodiment, the cognitive function estimation device 2 is described as being provided in the vehicle 1, but some functions may not be provided in the vehicle 1. For example, the memory unit 13 for storing the steering shake information and age information of a plurality of drivers, and the computer operating as the calculation unit 14 and estimation unit 15 may be provided outside the vehicle 1. In this case, the steering angle information acquired by the steering angle acquisition unit 12 can be transmitted to an external server in real time via a communication line and processed by the server. Alternatively, the steering angle information acquired by the steering angle acquisition unit 12 can be stored in the memory unit 13 during driving, and the stored steering angle information can be input to the server after driving for arithmetic processing. [Explanation of symbols]

[0058] 1 vehicle 2. Cognitive function estimation device 11 Handle 12 Steering angle acquisition unit 13 Storage section 14 Calculation section 15 Estimation part 16 Position measuring device

Claims

[Claim 1] A calculation unit that calculates a steering shake amount based on time-series change information of a steering angle when a target driver is driving; and an estimation unit that estimates the cognitive function of the target driver based on information in which the relationship between the steering shake amount and the driver's age is associated with each other through an experiment previously performed by a plurality of drivers, the actual age of the target driver, and the steering shake amount of the target driver calculated by the calculation unit. A device for estimating cognitive function.

Citation Information

Patent Citations

  • Driver state estimation device and driving support device

    JP2008056059A

  • Device for determining ability to drive and method for determining ability to drive

    JP2011227883A

  • Vehicle driving support device

    JP2012254694A

  • Vehicle safe driving ability measurement system

    JP2014174848A

  • Determination system of dementia risk

    JP2019124975A